2023-12-16T07:16:59.923 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T07:16:59.923 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744 -- /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744/orig.config.yaml 2023-12-16T07:16:59.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:17:00.061 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744 branch: main description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7493744' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5996 sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ4dugy2QJFLobqMO6TzJx/H/ZiQVMh1oiBX+vegqWrwLoDZWu49eUhu0vaduKw3SBjYz5Qxw13A6HFd9kHqMB8= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4G/G71C6yWsuoEs80x9yOXJCCPS8AgI9qRHKEY88t1Tls6IuPdbk0qC8eDYvKESAyWzhRREDLBZqT/Wld/Q1Y= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_00:09:48 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-16T07:17:00.062 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa; will attempt to use it 2023-12-16T07:17:00.062 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks 2023-12-16T07:17:00.063 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T07:17:00.064 INFO:teuthology.task.internal:Checking packages... 2023-12-16T07:17:00.088 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6d933094a156ec7587742e5aa25fba5ba27ec678' 2023-12-16T07:17:00.088 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T07:17:00.088 INFO:teuthology.packaging:ref: None 2023-12-16T07:17:00.088 INFO:teuthology.packaging:tag: None 2023-12-16T07:17:00.088 INFO:teuthology.packaging:branch: main 2023-12-16T07:17:00.088 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:17:00.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-12-16T07:17:00.324 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-196.g85fe3c65 2023-12-16T07:17:00.326 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T07:17:00.332 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T07:17:00.333 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T07:17:00.362 INFO:teuthology.task.internal:Saving configuration 2023-12-16T07:17:00.383 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T07:17:00.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T07:17:00.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 07:11:04.409909', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ4dugy2QJFLobqMO6TzJx/H/ZiQVMh1oiBX+vegqWrwLoDZWu49eUhu0vaduKw3SBjYz5Qxw13A6HFd9kHqMB8='} 2023-12-16T07:17:00.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 07:11:04.408307', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4G/G71C6yWsuoEs80x9yOXJCCPS8AgI9qRHKEY88t1Tls6IuPdbk0qC8eDYvKESAyWzhRREDLBZqT/Wld/Q1Y='} 2023-12-16T07:17:00.439 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T07:17:00.445 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-16T07:17:00.445 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-16T07:17:00.445 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T07:17:00.535 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d8b532e50>, signals=[15]) 2023-12-16T07:17:00.536 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T07:17:00.542 INFO:teuthology.task.internal:Opening connections... 2023-12-16T07:17:00.542 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:17:00.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:17:00.613 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-12-16T07:17:00.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:17:00.680 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T07:17:00.687 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-12-16T07:17:00.710 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-12-16T07:17:00.710 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T07:17:00.772 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-12-16T07:17:00.773 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T07:17:00.773 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-12-16T07:17:00.773 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T07:17:00.773 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T07:17:00.773 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T07:17:00.773 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-12-16T07:17:00.799 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-12-16T07:17:00.822 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-12-16T07:17:00.823 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-12-16T07:17:00.883 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-12-16T07:17:00.883 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2023-12-16T07:17:00.883 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T07:17:00.884 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T07:17:00.884 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-12-16T07:17:00.907 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T07:17:00.916 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T07:17:00.979 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T07:17:00.980 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2023-12-16T07:17:00.982 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-12-16T07:17:01.002 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T07:17:01.009 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T07:17:01.009 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2023-12-16T07:17:01.044 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-12-16T07:17:01.074 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T07:17:01.125 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T07:17:01.140 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-16T07:17:01.140 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-16T07:17:01.141 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T07:17:01.141 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T07:17:01.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:17:01.162 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-12-16T07:17:01.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:17:01.163 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-12-16T07:17:01.222 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-489.el8.x86_64 2023-12-16T07:17:01.222 INFO:teuthology.task.kernel:Running kernel on smithi133: 4.18.0-489.el8.x86_64 2023-12-16T07:17:01.222 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2023-12-16T07:17:01.225 INFO:teuthology.orchestra.run.smithi049.stdout:4.18.0-489.el8.x86_64 2023-12-16T07:17:01.225 INFO:teuthology.task.kernel:Running kernel on smithi049: 4.18.0-489.el8.x86_64 2023-12-16T07:17:01.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2023-12-16T07:17:05.505 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - AppStream 20 MB/s | 35 MB 00:01 2023-12-16T07:17:05.622 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - AppStream 18 MB/s | 35 MB 00:01 2023-12-16T07:17:17.929 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - BaseOS 9.2 MB/s | 56 MB 00:06 2023-12-16T07:17:19.082 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - BaseOS 8.4 MB/s | 56 MB 00:06 2023-12-16T07:17:26.462 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-12-16T07:17:26.837 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras common packages 37 kB/s | 6.9 kB 00:00 2023-12-16T07:17:27.147 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-12-16T07:17:27.973 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-12-16T07:17:28.173 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras 31 kB/s | 18 kB 00:00 2023-12-16T07:17:28.865 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.9 kB 00:00 2023-12-16T07:17:29.558 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 6.6 kB/s | 3.5 kB 00:00 2023-12-16T07:17:31.325 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-12-16T07:17:31.914 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 243 kB/s | 24 kB 00:00 2023-12-16T07:17:35.442 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 598 kB/s | 24 kB 00:00 2023-12-16T07:17:35.630 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-16T07:17:35.631 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-16T07:17:35.918 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:17:35.918 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:17:35.919 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2023-12-16T07:17:35.919 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:17:35.919 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:17:35.919 INFO:teuthology.orchestra.run.smithi133.stdout: kernel x86_64 4.18.0-527.el8 baseos 10 M 2023-12-16T07:17:35.919 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:17:35.919 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-core x86_64 4.18.0-527.el8 baseos 43 M 2023-12-16T07:17:35.920 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules x86_64 4.18.0-527.el8 baseos 36 M 2023-12-16T07:17:35.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:17:35.920 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:17:35.920 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:17:35.920 INFO:teuthology.orchestra.run.smithi133.stdout:Install 3 Packages 2023-12-16T07:17:35.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:17:35.921 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 90 M 2023-12-16T07:17:35.922 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 96 M 2023-12-16T07:17:35.922 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:17:37.040 INFO:teuthology.orchestra.run.smithi133.stdout:(1/3): kernel-4.18.0-527.el8.x86_64.rpm 9.3 MB/s | 10 MB 00:01 2023-12-16T07:17:39.217 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-16T07:17:39.217 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-16T07:17:39.509 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 4.18.0-527.el8 baseos 10 M 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core x86_64 4.18.0-527.el8 baseos 43 M 2023-12-16T07:17:39.510 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules x86_64 4.18.0-527.el8 baseos 36 M 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout:Install 3 Packages 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 90 M 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 96 M 2023-12-16T07:17:39.511 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:17:41.085 INFO:teuthology.orchestra.run.smithi049.stdout:(1/3): kernel-4.18.0-527.el8.x86_64.rpm 7.4 MB/s | 10 MB 00:01 2023-12-16T07:17:41.827 INFO:teuthology.orchestra.run.smithi049.stdout:(2/3): kernel-modules-4.18.0-527.el8.x86_64.rpm 17 MB/s | 36 MB 00:02 2023-12-16T07:17:41.898 INFO:teuthology.orchestra.run.smithi133.stdout:(2/3): kernel-core-4.18.0-527.el8.x86_64.rpm 7.3 MB/s | 43 MB 00:05 2023-12-16T07:17:42.218 INFO:teuthology.orchestra.run.smithi049.stdout:(3/3): kernel-core-4.18.0-527.el8.x86_64.rpm 17 MB/s | 43 MB 00:02 2023-12-16T07:17:42.219 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:17:42.219 INFO:teuthology.orchestra.run.smithi049.stdout:Total 33 MB/s | 90 MB 00:02 2023-12-16T07:17:42.931 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:17:42.948 INFO:teuthology.orchestra.run.smithi133.stdout:(3/3): kernel-modules-4.18.0-527.el8.x86_64.rpm 5.2 MB/s | 36 MB 00:06 2023-12-16T07:17:42.949 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:17:42.949 INFO:teuthology.orchestra.run.smithi133.stdout:Total 13 MB/s | 90 MB 00:07 2023-12-16T07:17:43.386 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:17:43.386 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:17:43.631 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:17:44.064 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:17:44.064 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:17:44.685 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:17:44.707 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:17:45.320 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:17:45.354 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:17:47.660 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:17:48.125 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:17:48.189 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T07:17:48.663 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T07:17:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T07:17:52.239 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 1/3 2023-12-16T07:17:52.305 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T07:17:52.629 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T07:17:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T07:17:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 2/3 2023-12-16T07:17:56.283 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:17:56.358 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:18.218 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:18.243 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:18.587 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:18.587 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-4.18.0-527.el8.x86_64 1/3 2023-12-16T07:18:18.587 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-core-4.18.0-527.el8.x86_64 2/3 2023-12-16T07:18:19.396 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:19.396 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:18:19.396 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:18:19.396 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-4.18.0-527.el8.x86_64 kernel-core-4.18.0-527.el8.x86_64 2023-12-16T07:18:19.396 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-4.18.0-527.el8.x86_64 2023-12-16T07:18:19.396 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:18:19.396 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:18:19.538 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T07:18:19.752 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T07:18:19.752 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T07:18:19.752 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-527.el8.x86_64 2023-12-16T07:18:19.752 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T07:18:19.752 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T07:18:19.753 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-16T07:18:19.753 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T07:18:19.753 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T07:18:19.769 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:19.794 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:19.963 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T07:18:19.963 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T07:18:19.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -qi grub2-tools 2023-12-16T07:18:19.996 INFO:teuthology.orchestra.run.smithi133.stdout:Name : grub2-tools 2023-12-16T07:18:19.996 INFO:teuthology.orchestra.run.smithi133.stdout:Epoch : 1 2023-12-16T07:18:19.996 INFO:teuthology.orchestra.run.smithi133.stdout:Version : 2.02 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Release : 129.el8 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: x86_64 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Group : System Environment/Base 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Size : 9265586 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:License : GPLv3+ 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Relocations : (not relocatable) 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Packager : CentOS BuildSystem 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:Vendor : CentOS 2023-12-16T07:18:19.997 INFO:teuthology.orchestra.run.smithi133.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout:Summary : Support tools for GRUB. 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout:Description : 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout:hardware devices. 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:18:19.998 INFO:teuthology.orchestra.run.smithi133.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T07:18:19.999 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T07:18:19.999 INFO:teuthology.task.kernel:Updating grub on smithi133 to boot 4.18.0-527.el8.x86_64 2023-12-16T07:18:19.999 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T07:18:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-4.18.0-527.el8.x86_64 1/3 2023-12-16T07:18:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-core-4.18.0-527.el8.x86_64 2/3 2023-12-16T07:18:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-4.18.0-527.el8.x86_64 3/3 2023-12-16T07:18:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:18:20.999 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:18:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-4.18.0-527.el8.x86_64 kernel-core-4.18.0-527.el8.x86_64 2023-12-16T07:18:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-4.18.0-527.el8.x86_64 2023-12-16T07:18:20.999 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:18:20.999 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:18:21.165 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T07:18:21.390 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T07:18:21.391 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T07:18:21.391 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-527.el8.x86_64 2023-12-16T07:18:21.391 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-16T07:18:21.391 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-16T07:18:21.391 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-16T07:18:21.391 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2023-12-16T07:18:21.392 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2023-12-16T07:18:21.609 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-4.18.0-527.el8.x86_64 2023-12-16T07:18:21.610 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-527.el8.x86_64 2023-12-16T07:18:21.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2023-12-16T07:18:21.644 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2023-12-16T07:18:21.644 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2023-12-16T07:18:21.644 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.02 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 129.el8 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Group : System Environment/Base 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 9265586 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Relocations : (not relocatable) 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : CentOS BuildSystem 2023-12-16T07:18:21.645 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:18:21.646 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2023-12-16T07:18:21.647 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-16T07:18:21.647 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 4.18.0-527.el8.x86_64 2023-12-16T07:18:21.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-16T07:18:21.848 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-12-16T07:18:23.089 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2023-12-16T07:18:24.130 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-12-16T07:18:24.131 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-16T07:18:24.165 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.fJPcV3b4Am 2023-12-16T07:18:24.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fJPcV3b4Am 2023-12-16T07:18:24.239 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.fJPcV3b4Am 2023-12-16T07:18:24.378 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.fJPcV3b4Am is 6KB 2023-12-16T07:18:24.427 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.fJPcV3b4Am 2023-12-16T07:18:24.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T07:18:24.518 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-16T07:18:24.518 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-16T07:18:24.518 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-16T07:18:24.518 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64.conf 2023-12-16T07:18:24.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64 2023-12-16T07:18:24.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2023-12-16T07:18:24.810 INFO:teuthology.orchestra.run.smithi049.stderr:done 2023-12-16T07:18:24.812 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2023-12-16T07:18:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.SigyAZq2G0 2023-12-16T07:18:24.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SigyAZq2G0 2023-12-16T07:18:24.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.SigyAZq2G0 2023-12-16T07:18:25.098 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.SigyAZq2G0 is 6KB 2023-12-16T07:18:25.145 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.SigyAZq2G0 2023-12-16T07:18:25.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2023-12-16T07:18:25.237 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-16T07:18:25.238 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-16T07:18:25.238 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-16T07:18:25.238 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64.conf 2023-12-16T07:18:25.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-527.el8.x86_64 2023-12-16T07:18:25.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2023-12-16T07:18:54.729 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-16T07:18:54.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-16T07:18:54.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:18:55.393 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-16T07:18:55.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-16T07:18:55.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:19:30.066 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-16T07:19:39.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-16T07:19:39.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:19:42.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-16T07:19:54.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-16T07:19:54.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:19:54.733 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T07:20:03.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-16T07:20:03.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:20:04.116 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-12-16T07:20:04.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-16T07:20:04.461 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-527.el8.x86_64"... 2023-12-16T07:20:04.461 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-12-16T07:20:04.478 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-527.el8.x86_64 2023-12-16T07:20:04.478 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-527.el8.x86_64 vs 4.18.0-527.el8.x86_64 2023-12-16T07:20:04.479 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T07:20:04.479 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T07:20:05.480 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-16T07:20:05.481 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T07:20:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2023-12-16T07:20:05.557 DEBUG:teuthology.parallel:result is None 2023-12-16T07:20:54.149 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T07:21:09.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-16T07:21:09.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:21:09.490 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-12-16T07:21:09.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-16T07:21:09.780 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-527.el8.x86_64"... 2023-12-16T07:21:09.780 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2023-12-16T07:21:09.800 INFO:teuthology.orchestra.run.smithi049.stdout:4.18.0-527.el8.x86_64 2023-12-16T07:21:09.800 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-527.el8.x86_64 vs 4.18.0-527.el8.x86_64 2023-12-16T07:21:09.800 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T07:21:09.800 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-16T07:21:10.801 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-16T07:21:10.802 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-16T07:21:10.866 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2023-12-16T07:21:10.881 DEBUG:teuthology.parallel:result is None 2023-12-16T07:21:10.882 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T07:21:10.890 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T07:21:10.890 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T07:21:10.892 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T07:21:10.917 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T07:21:10.925 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T07:21:10.963 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T07:21:10.963 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T07:21:10.966 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T07:21:11.005 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T07:21:11.011 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T07:21:11.012 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T07:21:11.045 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T07:21:11.078 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T07:21:11.080 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T07:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T07:21:11.091 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T07:21:11.092 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T07:21:11.099 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T07:21:11.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T07:21:11.133 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T07:21:11.163 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T07:21:11.172 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T07:21:11.172 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T07:21:11.203 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T07:21:11.222 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T07:21:11.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T07:21:11.358 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T07:21:11.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T07:21:11.486 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:21:11.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T07:21:11.553 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T07:21:11.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T07:21:11.654 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T07:21:11.740 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T07:21:11.784 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:21:11.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T07:21:11.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2023-12-16T07:21:11.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-12-16T07:21:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T07:21:11.965 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T07:21:12.379 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T07:21:12.387 INFO:teuthology.task.internal:Starting timer... 2023-12-16T07:21:12.387 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T07:21:12.430 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T07:21:12.462 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-16T07:21:12.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2023-12-16T07:21:12.539 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2023-12-16T07:21:12.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2023-12-16T07:21:12.626 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2023-12-16T07:21:12.628 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T07:21:12.628 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2023-12-16T07:21:12.650 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2023-12-16T07:21:12.651 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2023-12-16T07:21:12.676 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2023-12-16T07:21:12.677 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2023-12-16T07:21:12.677 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T07:21:12.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:21:12.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T07:21:12.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:21:12.748 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T07:21:12.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2023-12-16T07:21:12.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2023-12-16T07:21:12.818 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T07:21:12.828 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-16T07:21:12.828 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T07:21:12.847 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T07:21:12.848 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T07:28:45.030 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2023-12-16T07:28:45.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-16T07:28:45.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:28:45.128 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-12-16T07:28:45.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-12-16T07:28:45.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-16T07:28:45.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T07:28:45.272 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-12-16T07:28:45.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-16T07:28:45.342 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T07:28:45.354 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T07:28:45.355 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T07:28:45.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T07:28:45.358 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T07:28:45.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T07:28:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T07:28:45.407 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T07:28:45.416 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-16T07:28:45.430 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-16T07:28:45.481 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2023-12-16T07:28:45.494 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2023-12-16T07:28:45.494 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2023-12-16T07:28:45.506 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2023-12-16T07:28:45.509 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T07:28:45.519 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-16T07:28:45.523 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T07:28:45.533 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-16T07:28:45.598 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2023-12-16T07:28:45.598 INFO:teuthology.orchestra.run.smithi049.stderr:bash: ntpq: command not found 2023-12-16T07:28:45.601 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T07:28:45.601 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2023-12-16T07:28:45.601 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.601 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.602 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.602 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.602 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T07:28:45.603 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2023-12-16T07:28:45.603 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.603 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.603 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.603 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:28:45.603 INFO:teuthology.run_tasks:Running task pexec... 2023-12-16T07:28:45.614 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-16T07:28:45.615 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:28:45.615 DEBUG:teuthology.orchestra.run.smithi049:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-16T07:28:45.615 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi133.front.sepia.ceph.com 2023-12-16T07:28:45.615 DEBUG:teuthology.orchestra.run.smithi133:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-16T07:28:46.521 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:43 ago on Sat 16 Dec 2023 07:27:03 AM UTC. 2023-12-16T07:28:46.552 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:34 ago on Sat 16 Dec 2023 07:27:12 AM UTC. 2023-12-16T07:28:48.652 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout:Resetting modules: 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:28:48.653 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:28:48.859 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:28:48.860 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:28:48.860 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2023-12-16T07:28:48.860 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:28:48.860 INFO:teuthology.orchestra.run.smithi049.stdout:Resetting modules: 2023-12-16T07:28:48.861 INFO:teuthology.orchestra.run.smithi049.stdout: container-tools 2023-12-16T07:28:48.861 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:28:48.861 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:28:48.861 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:28:48.861 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:28:48.897 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:28:49.118 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:28:49.841 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:46 ago on Sat 16 Dec 2023 07:27:03 AM UTC. 2023-12-16T07:28:50.099 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:37 ago on Sat 16 Dec 2023 07:27:12 AM UTC. 2023-12-16T07:28:51.943 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:28:52.129 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:28:52.129 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:28:52.129 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:28:52.129 INFO:teuthology.orchestra.run.smithi133.stdout:Installing group/module packages: 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-16T07:28:52.130 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout:Installing module profiles: 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools/common 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout:Enabling module streams: 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools rhel8 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout:Install 13 Packages 2023-12-16T07:28:52.131 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:28:52.132 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 27 M 2023-12-16T07:28:52.132 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 89 M 2023-12-16T07:28:52.132 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:28:52.375 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout:Installing group/module packages: 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-16T07:28:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout:Installing module profiles: 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: container-tools/common 2023-12-16T07:28:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling module streams: 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout: container-tools rhel8 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout:Install 13 Packages 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:28:52.578 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 27 M 2023-12-16T07:28:52.579 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 89 M 2023-12-16T07:28:52.579 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:28:52.616 INFO:teuthology.orchestra.run.smithi133.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.5 MB/s | 750 kB 00:00 2023-12-16T07:28:52.649 INFO:teuthology.orchestra.run.smithi133.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 3.1 MB/s | 1.0 MB 00:00 2023-12-16T07:28:52.675 INFO:teuthology.orchestra.run.smithi133.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 647 kB/s | 38 kB 00:00 2023-12-16T07:28:52.708 INFO:teuthology.orchestra.run.smithi133.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 4.0 MB/s | 241 kB 00:00 2023-12-16T07:28:52.767 INFO:teuthology.orchestra.run.smithi133.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 3.0 MB/s | 178 kB 00:00 2023-12-16T07:28:52.817 INFO:teuthology.orchestra.run.smithi133.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 494 kB/s | 25 kB 00:00 2023-12-16T07:28:52.926 INFO:teuthology.orchestra.run.smithi133.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 16 MB/s | 3.9 MB 00:00 2023-12-16T07:28:52.951 INFO:teuthology.orchestra.run.smithi133.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 702 kB/s | 94 kB 00:00 2023-12-16T07:28:53.011 INFO:teuthology.orchestra.run.smithi049.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.9 MB/s | 750 kB 00:00 2023-12-16T07:28:53.060 INFO:teuthology.orchestra.run.smithi133.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 13 MB/s | 9.6 MB 00:00 2023-12-16T07:28:53.067 INFO:teuthology.orchestra.run.smithi049.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 3.3 MB/s | 1.0 MB 00:00 2023-12-16T07:28:53.095 INFO:teuthology.orchestra.run.smithi049.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 454 kB/s | 38 kB 00:00 2023-12-16T07:28:53.121 INFO:teuthology.orchestra.run.smithi049.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 4.4 MB/s | 241 kB 00:00 2023-12-16T07:28:53.127 INFO:teuthology.orchestra.run.smithi133.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 789 kB/s | 53 kB 00:00 2023-12-16T07:28:53.177 INFO:teuthology.orchestra.run.smithi133.stdout:(11/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 11 MB/s | 2.5 MB 00:00 2023-12-16T07:28:53.179 INFO:teuthology.orchestra.run.smithi049.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 3.0 MB/s | 178 kB 00:00 2023-12-16T07:28:53.194 INFO:teuthology.orchestra.run.smithi133.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 613 kB/s | 41 kB 00:00 2023-12-16T07:28:53.229 INFO:teuthology.orchestra.run.smithi049.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 496 kB/s | 25 kB 00:00 2023-12-16T07:28:53.289 INFO:teuthology.orchestra.run.smithi049.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.6 MB/s | 94 kB 00:00 2023-12-16T07:28:53.355 INFO:teuthology.orchestra.run.smithi049.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 15 MB/s | 3.9 MB 00:00 2023-12-16T07:28:53.445 INFO:teuthology.orchestra.run.smithi133.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 16 MB/s | 8.1 MB 00:00 2023-12-16T07:28:53.445 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:28:53.445 INFO:teuthology.orchestra.run.smithi133.stdout:Total 20 MB/s | 27 MB 00:01 2023-12-16T07:28:53.514 INFO:teuthology.orchestra.run.smithi049.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 13 MB/s | 9.6 MB 00:00 2023-12-16T07:28:53.581 INFO:teuthology.orchestra.run.smithi049.stdout:(10/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 11 MB/s | 2.5 MB 00:00 2023-12-16T07:28:53.606 INFO:teuthology.orchestra.run.smithi049.stdout:(11/13): udica-0.2.6-20.module_el8+712+4cd1bd69 572 kB/s | 53 kB 00:00 2023-12-16T07:28:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:28:53.733 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:28:53.734 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:28:53.748 INFO:teuthology.orchestra.run.smithi049.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 246 kB/s | 41 kB 00:00 2023-12-16T07:28:53.848 INFO:teuthology.orchestra.run.smithi049.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 15 MB/s | 8.1 MB 00:00 2023-12-16T07:28:53.848 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:28:53.849 INFO:teuthology.orchestra.run.smithi049.stdout:Total 21 MB/s | 27 MB 00:01 2023-12-16T07:28:53.984 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:28:53.987 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:28:54.126 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:28:54.148 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:28:54.149 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:28:54.400 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:28:54.403 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:28:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:28:54.972 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-16T07:28:55.125 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:28:55.160 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-16T07:28:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-16T07:28:55.337 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-16T07:28:55.596 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T07:28:55.813 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-16T07:28:56.047 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T07:28:56.174 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-16T07:28:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-16T07:28:57.146 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T07:28:57.395 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-16T07:28:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T07:28:57.633 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-16T07:28:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-16T07:28:57.897 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-16T07:28:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-16T07:28:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-16T07:28:58.296 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-16T07:28:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-16T07:28:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T07:28:59.389 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-16T07:28:59.583 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T07:28:59.644 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T07:28:59.886 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-16T07:29:00.006 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T07:29:00.007 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-16T07:29:00.088 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-16T07:29:00.533 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-16T07:29:00.534 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-16T07:29:00.534 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-16T07:29:00.534 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:00.868 INFO:teuthology.orchestra.run.smithi133.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:29:00.869 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:29:01.367 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-16T07:29:01.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:29:01.367 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:29:01.367 INFO:teuthology.orchestra.run.smithi049.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:01.367 INFO:teuthology.orchestra.run.smithi049.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:01.367 INFO:teuthology.orchestra.run.smithi049.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-16T07:29:01.367 INFO:teuthology.orchestra.run.smithi049.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-16T07:29:01.368 INFO:teuthology.orchestra.run.smithi049.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:01.368 INFO:teuthology.orchestra.run.smithi049.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:01.368 INFO:teuthology.orchestra.run.smithi049.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-16T07:29:01.368 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-16T07:29:01.368 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-16T07:29:01.368 INFO:teuthology.orchestra.run.smithi049.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:01.368 INFO:teuthology.orchestra.run.smithi049.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-16T07:29:01.369 INFO:teuthology.orchestra.run.smithi049.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-16T07:29:01.369 INFO:teuthology.orchestra.run.smithi049.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-16T07:29:01.369 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:29:01.369 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:29:01.521 DEBUG:teuthology.parallel:result is None 2023-12-16T07:29:01.652 DEBUG:teuthology.parallel:result is None 2023-12-16T07:29:01.652 INFO:teuthology.run_tasks:Running task install... 2023-12-16T07:29:01.661 DEBUG:teuthology.task.install:project ceph 2023-12-16T07:29:01.661 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}} 2023-12-16T07:29:01.661 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T07:29:01.661 INFO:teuthology.task.install:Using flavor: default 2023-12-16T07:29:01.667 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-16T07:29:01.667 INFO:teuthology.task.install:extra packages: [] 2023-12-16T07:29:01.667 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T07:29:01.667 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T07:29:01.667 INFO:teuthology.packaging:ref: None 2023-12-16T07:29:01.667 INFO:teuthology.packaging:tag: None 2023-12-16T07:29:01.668 INFO:teuthology.packaging:branch: quincy 2023-12-16T07:29:01.668 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:29:01.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T07:29:01.670 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'tag': None, 'wait_for_package': False} 2023-12-16T07:29:01.670 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T07:29:01.670 INFO:teuthology.packaging:ref: None 2023-12-16T07:29:01.670 INFO:teuthology.packaging:tag: None 2023-12-16T07:29:01.670 INFO:teuthology.packaging:branch: quincy 2023-12-16T07:29:01.670 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:29:01.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T07:29:01.916 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-16T07:29:01.917 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T07:29:01.992 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-16T07:29:01.992 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-16T07:29:02.090 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T07:29:02.091 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:29:02.091 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T07:29:02.123 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T07:29:02.123 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T07:29:02.123 INFO:teuthology.packaging:ref: None 2023-12-16T07:29:02.123 INFO:teuthology.packaging:tag: None 2023-12-16T07:29:02.124 INFO:teuthology.packaging:branch: quincy 2023-12-16T07:29:02.124 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:29:02.124 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T07:29:02.165 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-16T07:29:02.166 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:29:02.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-16T07:29:02.197 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-16T07:29:02.197 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T07:29:02.197 INFO:teuthology.packaging:ref: None 2023-12-16T07:29:02.197 INFO:teuthology.packaging:tag: None 2023-12-16T07:29:02.197 INFO:teuthology.packaging:branch: quincy 2023-12-16T07:29:02.197 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:29:02.197 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-16T07:29:02.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T07:29:02.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-16T07:29:02.278 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T07:29:02.346 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-16T07:29:02.347 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2023-12-16T07:29:02.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2023-12-16T07:29:02.413 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2023-12-16T07:29:02.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2023-12-16T07:29:02.618 INFO:teuthology.orchestra.run.smithi133.stdout:76 files removed 2023-12-16T07:29:02.649 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw 2023-12-16T07:29:02.699 INFO:teuthology.orchestra.run.smithi049.stdout:76 files removed 2023-12-16T07:29:02.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw 2023-12-16T07:29:03.414 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 218 kB/s | 78 kB 00:00 2023-12-16T07:29:03.416 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 305 kB/s | 78 kB 00:00 2023-12-16T07:29:03.739 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 32 kB/s | 9.1 kB 00:00 2023-12-16T07:29:04.076 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 15 kB/s | 9.1 kB 00:00 2023-12-16T07:29:04.146 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 3.8 kB/s | 1.5 kB 00:00 2023-12-16T07:29:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-12-16T07:29:05.794 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - AppStream 25 MB/s | 35 MB 00:01 2023-12-16T07:29:06.607 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - AppStream 14 MB/s | 35 MB 00:02 2023-12-16T07:29:19.715 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - BaseOS 8.3 MB/s | 56 MB 00:06 2023-12-16T07:29:19.786 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - BaseOS 7.7 MB/s | 56 MB 00:07 2023-12-16T07:29:28.106 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras 41 kB/s | 18 kB 00:00 2023-12-16T07:29:28.524 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 6.9 kB 00:00 2023-12-16T07:29:28.693 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras 39 kB/s | 18 kB 00:00 2023-12-16T07:29:29.294 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-12-16T07:29:29.884 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - PowerTools 5.5 MB/s | 6.6 MB 00:01 2023-12-16T07:29:31.301 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-12-16T07:29:31.787 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - PowerTools 2.9 MB/s | 6.6 MB 00:02 2023-12-16T07:29:33.297 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-12-16T07:29:35.164 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 16 MB 00:01 2023-12-16T07:29:39.256 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 429 kB/s | 24 kB 00:00 2023-12-16T07:29:44.106 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:29:44.109 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:29:44.109 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:29:44.109 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:29:44.109 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-16T07:29:44.110 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:29:44.111 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:29:44.112 INFO:teuthology.orchestra.run.smithi049.stdout:Install 21 Packages 2023-12-16T07:29:44.112 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 2 Packages 2023-12-16T07:29:44.112 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:29:44.112 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 64 M 2023-12-16T07:29:44.112 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:29:45.032 INFO:teuthology.orchestra.run.smithi049.stdout:(1/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 8.4 MB/s | 5.2 MB 00:00 2023-12-16T07:29:45.082 INFO:teuthology.orchestra.run.smithi049.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 486 kB/s | 24 kB 00:00 2023-12-16T07:29:45.174 INFO:teuthology.orchestra.run.smithi049.stdout:(3/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 8.5 MB/s | 796 kB 00:00 2023-12-16T07:29:45.258 INFO:teuthology.orchestra.run.smithi049.stdout:(4/23): libradosstriper1-17.2.7-125.g1f2f5510.e 6.0 MB/s | 509 kB 00:00 2023-12-16T07:29:45.808 INFO:teuthology.orchestra.run.smithi049.stdout:(5/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_64 10 MB/s | 5.6 MB 00:00 2023-12-16T07:29:46.000 INFO:teuthology.orchestra.run.smithi049.stdout:(6/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8.x 11 MB/s | 17 MB 00:01 2023-12-16T07:29:46.025 INFO:teuthology.orchestra.run.smithi049.stdout:(7/23): python3-ceph-argparse-17.2.7-125.g1f2f5 206 kB/s | 45 kB 00:00 2023-12-16T07:29:46.050 INFO:teuthology.orchestra.run.smithi049.stdout:(8/23): python3-ceph-common-17.2.7-125.g1f2f551 2.3 MB/s | 115 kB 00:00 2023-12-16T07:29:46.076 INFO:teuthology.orchestra.run.smithi049.stdout:(9/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 3.7 MB/s | 190 kB 00:00 2023-12-16T07:29:46.109 INFO:teuthology.orchestra.run.smithi049.stdout:(10/23): python3-rados-17.2.7-125.g1f2f5510.el8 6.2 MB/s | 371 kB 00:00 2023-12-16T07:29:46.135 INFO:teuthology.orchestra.run.smithi049.stdout:(11/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 6.0 MB/s | 359 kB 00:00 2023-12-16T07:29:46.160 INFO:teuthology.orchestra.run.smithi049.stdout:(12/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 2.1 MB/s | 106 kB 00:00 2023-12-16T07:29:46.360 INFO:teuthology.orchestra.run.smithi049.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-12-16T07:29:46.394 INFO:teuthology.orchestra.run.smithi049.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.5 MB/s | 677 kB 00:00 2023-12-16T07:29:46.419 INFO:teuthology.orchestra.run.smithi049.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 748 kB/s | 44 kB 00:00 2023-12-16T07:29:46.511 INFO:teuthology.orchestra.run.smithi049.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 401 kB/s | 47 kB 00:00 2023-12-16T07:29:46.584 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 16 MB 00:15 2023-12-16T07:29:47.112 INFO:teuthology.orchestra.run.smithi049.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 99 kB/s | 59 kB 00:00 2023-12-16T07:29:47.203 INFO:teuthology.orchestra.run.smithi049.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 391 kB/s | 306 kB 00:00 2023-12-16T07:29:47.312 INFO:teuthology.orchestra.run.smithi049.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 375 kB/s | 75 kB 00:00 2023-12-16T07:29:47.687 INFO:teuthology.orchestra.run.smithi049.stdout:(20/23): librados2-17.2.7-125.g1f2f5510.el8.x86 9.2 MB/s | 3.5 MB 00:00 2023-12-16T07:29:47.729 INFO:teuthology.orchestra.run.smithi049.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 3.3 MB/s | 1.7 MB 00:00 2023-12-16T07:29:47.980 INFO:teuthology.orchestra.run.smithi049.stdout:(22/23): ceph-common-17.2.7-125.g1f2f5510.el8.x 6.6 MB/s | 23 MB 00:03 2023-12-16T07:29:48.046 INFO:teuthology.orchestra.run.smithi049.stdout:(23/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 10 MB/s | 3.6 MB 00:00 2023-12-16T07:29:48.050 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:29:48.051 INFO:teuthology.orchestra.run.smithi049.stdout:Total 16 MB/s | 64 MB 00:03 2023-12-16T07:29:48.096 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:29:48.147 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:29:48.147 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:29:48.538 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:29:48.541 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:29:49.577 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:29:49.779 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-16T07:29:49.986 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T07:29:50.383 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T07:29:50.434 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 454 kB/s | 24 kB 00:00 2023-12-16T07:29:50.581 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T07:29:50.681 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T07:29:50.926 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T07:29:51.147 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T07:29:51.578 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T07:29:51.747 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T07:29:52.000 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T07:29:52.168 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-16T07:29:52.360 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-16T07:29:53.035 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-16T07:29:53.171 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T07:29:53.223 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T07:29:53.375 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-16T07:29:53.554 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T07:29:53.742 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T07:29:53.936 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-16T07:29:54.063 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T07:29:54.128 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T07:29:54.323 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-16T07:29:54.480 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-16T07:29:54.674 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-16T07:29:54.872 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-16T07:29:55.112 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:29:55.114 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:29:55.114 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:29:55.114 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:29:55.114 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-16T07:29:55.115 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-16T07:29:55.116 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout:Install 21 Packages 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 2 Packages 2023-12-16T07:29:55.117 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:29:55.118 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 64 M 2023-12-16T07:29:55.118 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:29:57.102 INFO:teuthology.orchestra.run.smithi133.stdout:(1/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8.x 10 MB/s | 17 MB 00:01 2023-12-16T07:29:57.143 INFO:teuthology.orchestra.run.smithi133.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 586 kB/s | 24 kB 00:00 2023-12-16T07:29:57.386 INFO:teuthology.orchestra.run.smithi133.stdout:(3/23): ceph-common-17.2.7-125.g1f2f5510.el8.x8 12 MB/s | 23 MB 00:01 2023-12-16T07:29:57.449 INFO:teuthology.orchestra.run.smithi133.stdout:(4/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 2.5 MB/s | 796 kB 00:00 2023-12-16T07:29:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:(5/23): libradosstriper1-17.2.7-125.g1f2f5510.e 4.2 MB/s | 509 kB 00:00 2023-12-16T07:29:57.570 INFO:teuthology.orchestra.run.smithi133.stdout:(6/23): python3-ceph-argparse-17.2.7-125.g1f2f5 670 kB/s | 45 kB 00:00 2023-12-16T07:29:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T07:29:57.653 INFO:teuthology.orchestra.run.smithi133.stdout:(7/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 2.3 MB/s | 5.2 MB 00:02 2023-12-16T07:29:57.704 INFO:teuthology.orchestra.run.smithi133.stdout:(8/23): python3-ceph-common-17.2.7-125.g1f2f551 866 kB/s | 115 kB 00:00 2023-12-16T07:29:57.729 INFO:teuthology.orchestra.run.smithi133.stdout:(9/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 2.5 MB/s | 190 kB 00:00 2023-12-16T07:29:57.771 INFO:teuthology.orchestra.run.smithi133.stdout:(10/23): python3-rados-17.2.7-125.g1f2f5510.el8 5.4 MB/s | 371 kB 00:00 2023-12-16T07:29:57.838 INFO:teuthology.orchestra.run.smithi133.stdout:(11/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_6 14 MB/s | 5.6 MB 00:00 2023-12-16T07:29:57.863 INFO:teuthology.orchestra.run.smithi133.stdout:(12/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 1.1 MB/s | 106 kB 00:00 2023-12-16T07:29:57.905 INFO:teuthology.orchestra.run.smithi133.stdout:(13/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 2.0 MB/s | 359 kB 00:00 2023-12-16T07:29:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T07:29:58.047 INFO:teuthology.orchestra.run.smithi133.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 310 kB/s | 44 kB 00:00 2023-12-16T07:29:58.089 INFO:teuthology.orchestra.run.smithi133.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.6 MB/s | 677 kB 00:00 2023-12-16T07:29:58.114 INFO:teuthology.orchestra.run.smithi133.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2023-12-16T07:29:58.165 INFO:teuthology.orchestra.run.smithi133.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 400 kB/s | 47 kB 00:00 2023-12-16T07:29:58.231 INFO:teuthology.orchestra.run.smithi133.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 503 kB/s | 59 kB 00:00 2023-12-16T07:29:58.248 INFO:teuthology.orchestra.run.smithi133.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 912 kB/s | 75 kB 00:00 2023-12-16T07:29:58.274 INFO:teuthology.orchestra.run.smithi133.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-12-16T07:29:58.358 INFO:teuthology.orchestra.run.smithi133.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-12-16T07:29:58.516 INFO:teuthology.orchestra.run.smithi133.stdout:(22/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 15 MB/s | 3.6 MB 00:00 2023-12-16T07:29:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T07:29:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T07:29:58.892 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T07:29:59.033 INFO:teuthology.orchestra.run.smithi133.stdout:(23/23): librados2-17.2.7-125.g1f2f5510.el8.x86 4.4 MB/s | 3.5 MB 00:00 2023-12-16T07:29:59.037 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:29:59.038 INFO:teuthology.orchestra.run.smithi133.stdout:Total 16 MB/s | 64 MB 00:03 2023-12-16T07:29:59.046 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T07:29:59.082 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:29:59.128 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:29:59.128 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:29:59.532 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:29:59.560 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:30:00.730 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:30:00.939 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-16T07:30:01.115 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T07:30:01.497 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-16T07:30:01.732 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T07:30:01.824 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T07:30:02.075 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T07:30:02.281 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T07:30:02.675 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T07:30:02.864 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T07:30:03.086 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T07:30:03.294 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-16T07:30:03.499 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-16T07:30:04.159 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-16T07:30:04.314 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T07:30:04.376 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T07:30:04.517 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-16T07:30:04.734 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T07:30:04.940 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T07:30:05.304 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-16T07:30:05.581 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T07:30:05.682 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-16T07:30:05.891 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-16T07:30:06.065 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-16T07:30:06.276 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-16T07:30:06.473 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-16T07:30:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T07:30:09.406 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T07:30:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-16T07:30:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T07:30:10.353 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-16T07:30:10.538 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T07:30:18.164 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /run 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2023-12-16T07:30:18.165 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:20.085 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T07:30:20.168 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T07:30:20.168 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T07:30:20.366 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T07:30:20.366 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T07:30:21.102 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T07:30:21.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-16T07:30:21.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-16T07:30:21.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T07:30:21.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T07:30:21.109 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T07:30:21.109 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T07:30:21.109 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-16T07:30:21.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-16T07:30:21.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T07:30:21.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-16T07:30:21.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-16T07:30:22.229 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T07:30:22.230 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:22.230 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2023-12-16T07:30:22.230 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.230 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.230 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:30:22.230 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.230 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.231 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-16T07:30:22.232 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:22.233 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:30:22.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-test 2023-12-16T07:30:23.343 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:44 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:30:25.141 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-16T07:30:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout:Install 6 Packages 2023-12-16T07:30:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:25.144 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 53 M 2023-12-16T07:30:25.144 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 234 M 2023-12-16T07:30:25.144 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:30:25.358 INFO:teuthology.orchestra.run.smithi049.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.1 MB/s | 203 kB 00:00 2023-12-16T07:30:25.416 INFO:teuthology.orchestra.run.smithi049.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-12-16T07:30:25.475 INFO:teuthology.orchestra.run.smithi049.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-12-16T07:30:25.500 INFO:teuthology.orchestra.run.smithi049.stdout:(4/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 551 kB/s | 174 kB 00:00 2023-12-16T07:30:25.559 INFO:teuthology.orchestra.run.smithi049.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 844 kB/s | 71 kB 00:00 2023-12-16T07:30:27.901 INFO:teuthology.orchestra.run.smithi049.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 19 MB/s | 52 MB 00:02 2023-12-16T07:30:27.902 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:30:27.903 INFO:teuthology.orchestra.run.smithi049.stdout:Total 19 MB/s | 53 MB 00:02 2023-12-16T07:30:27.947 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:30:27.970 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:30:27.970 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:30:28.272 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:30:28.275 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:30:28.789 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:30:29.001 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-16T07:30:29.024 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /run 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-12-16T07:30:29.025 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:29.177 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-16T07:30:29.307 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T07:30:29.415 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T07:30:29.582 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-16T07:30:29.740 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T07:30:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T07:30:30.803 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-16T07:30:30.812 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T07:30:31.054 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-16T07:30:31.054 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T07:30:31.763 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T07:30:31.763 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-16T07:30:31.763 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-16T07:30:31.763 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-16T07:30:31.763 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-16T07:30:31.763 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-16T07:30:31.763 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-16T07:30:31.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-16T07:30:31.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-16T07:30:31.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-16T07:30:31.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-16T07:30:31.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-16T07:30:31.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-16T07:30:31.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-16T07:30:31.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-16T07:30:31.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-16T07:30:32.841 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-16T07:30:32.842 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:32.843 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:30:33.101 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-test 2023-12-16T07:30:33.957 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:43 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:30:35.034 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T07:30:35.289 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T07:30:35.585 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T07:30:35.586 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-16T07:30:35.586 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-16T07:30:35.586 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-16T07:30:35.586 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-16T07:30:35.586 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-16T07:30:35.632 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-16T07:30:35.633 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout:Install 6 Packages 2023-12-16T07:30:35.634 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:35.635 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 53 M 2023-12-16T07:30:35.635 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 234 M 2023-12-16T07:30:35.635 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:30:36.043 INFO:teuthology.orchestra.run.smithi133.stdout:(1/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 854 kB/s | 174 kB 00:00 2023-12-16T07:30:36.093 INFO:teuthology.orchestra.run.smithi133.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 799 kB/s | 203 kB 00:00 2023-12-16T07:30:36.210 INFO:teuthology.orchestra.run.smithi133.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-12-16T07:30:36.244 INFO:teuthology.orchestra.run.smithi133.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 935 kB/s | 187 kB 00:00 2023-12-16T07:30:36.269 INFO:teuthology.orchestra.run.smithi133.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout: jq-1.6-8.el8.x86_64 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-16T07:30:36.361 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-16T07:30:36.362 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-16T07:30:36.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:36.362 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:30:36.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph 2023-12-16T07:30:37.462 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:58 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:30:38.538 INFO:teuthology.orchestra.run.smithi133.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 19 MB/s | 52 MB 00:02 2023-12-16T07:30:38.540 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:30:38.540 INFO:teuthology.orchestra.run.smithi133.stdout:Total 18 MB/s | 53 MB 00:02 2023-12-16T07:30:38.584 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:30:38.605 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:30:38.605 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:30:38.890 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:30:38.893 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:30:39.260 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-16T07:30:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-16T07:30:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-16T07:30:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:39.267 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:30:39.267 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:30:39.267 INFO:teuthology.orchestra.run.smithi049.stdout:Install 32 Packages 2023-12-16T07:30:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:39.267 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 28 M 2023-12-16T07:30:39.267 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 110 M 2023-12-16T07:30:39.268 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:30:39.358 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:30:39.596 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-16T07:30:39.810 INFO:teuthology.orchestra.run.smithi049.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 35 kB/s | 6.4 kB 00:00 2023-12-16T07:30:39.811 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-16T07:30:39.966 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T07:30:39.986 INFO:teuthology.orchestra.run.smithi049.stdout:(2/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 4.4 MB/s | 1.6 MB 00:00 2023-12-16T07:30:40.036 INFO:teuthology.orchestra.run.smithi049.stdout:(3/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 5.7 MB/s | 2.3 MB 00:00 2023-12-16T07:30:40.040 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-16T07:30:40.111 INFO:teuthology.orchestra.run.smithi049.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 3.1 MB/s | 238 kB 00:00 2023-12-16T07:30:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-16T07:30:40.286 INFO:teuthology.orchestra.run.smithi049.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 898 kB/s | 157 kB 00:00 2023-12-16T07:30:40.337 INFO:teuthology.orchestra.run.smithi049.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 778 kB/s | 39 kB 00:00 2023-12-16T07:30:40.387 INFO:teuthology.orchestra.run.smithi049.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.0 MB/s | 103 kB 00:00 2023-12-16T07:30:40.442 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T07:30:40.446 INFO:teuthology.orchestra.run.smithi049.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 974 kB/s | 57 kB 00:00 2023-12-16T07:30:40.538 INFO:teuthology.orchestra.run.smithi049.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 4.9 MB/s | 457 kB 00:00 2023-12-16T07:30:40.663 INFO:teuthology.orchestra.run.smithi049.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-12-16T07:30:40.847 INFO:teuthology.orchestra.run.smithi049.stdout:(11/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_ 19 MB/s | 17 MB 00:00 2023-12-16T07:30:40.914 INFO:teuthology.orchestra.run.smithi049.stdout:(12/32): python3-cryptography-3.2.1-6.el8.x86_6 2.5 MB/s | 641 kB 00:00 2023-12-16T07:30:40.998 INFO:teuthology.orchestra.run.smithi049.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 727 kB/s | 109 kB 00:00 2023-12-16T07:30:41.106 INFO:teuthology.orchestra.run.smithi049.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 227 kB/s | 44 kB 00:00 2023-12-16T07:30:41.148 INFO:teuthology.orchestra.run.smithi049.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.2 MB/s | 185 kB 00:00 2023-12-16T07:30:41.207 INFO:teuthology.orchestra.run.smithi049.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.7 MB/s | 173 kB 00:00 2023-12-16T07:30:41.232 INFO:teuthology.orchestra.run.smithi049.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 4.5 MB/s | 384 kB 00:00 2023-12-16T07:30:41.257 INFO:teuthology.orchestra.run.smithi049.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-12-16T07:30:41.283 INFO:teuthology.orchestra.run.smithi049.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 350 kB/s | 18 kB 00:00 2023-12-16T07:30:41.308 INFO:teuthology.orchestra.run.smithi049.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 970 kB/s | 49 kB 00:00 2023-12-16T07:30:41.333 INFO:teuthology.orchestra.run.smithi049.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2023-12-16T07:30:41.358 INFO:teuthology.orchestra.run.smithi049.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-12-16T07:30:41.384 INFO:teuthology.orchestra.run.smithi049.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-12-16T07:30:41.409 INFO:teuthology.orchestra.run.smithi049.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 373 kB/s | 19 kB 00:00 2023-12-16T07:30:41.434 INFO:teuthology.orchestra.run.smithi049.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 476 kB/s | 24 kB 00:00 2023-12-16T07:30:41.460 INFO:teuthology.orchestra.run.smithi049.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 582 kB/s | 29 kB 00:00 2023-12-16T07:30:41.485 INFO:teuthology.orchestra.run.smithi049.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 550 kB/s | 27 kB 00:00 2023-12-16T07:30:41.544 INFO:teuthology.orchestra.run.smithi049.stdout:(28/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_ 2.3 MB/s | 3.9 MB 00:01 2023-12-16T07:30:41.569 INFO:teuthology.orchestra.run.smithi049.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2023-12-16T07:30:41.603 INFO:teuthology.orchestra.run.smithi049.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2023-12-16T07:30:41.628 INFO:teuthology.orchestra.run.smithi049.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 429 kB/s | 23 kB 00:00 2023-12-16T07:30:41.678 INFO:teuthology.orchestra.run.smithi049.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 638 kB/s | 85 kB 00:00 2023-12-16T07:30:41.682 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:30:41.682 INFO:teuthology.orchestra.run.smithi049.stdout:Total 12 MB/s | 28 MB 00:02 2023-12-16T07:30:41.770 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:30:41.810 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:30:41.810 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:30:42.123 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:30:42.127 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:30:43.250 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:30:43.476 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-16T07:30:43.715 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-16T07:30:43.996 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-16T07:30:44.246 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-16T07:30:44.443 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-16T07:30:44.636 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-16T07:30:44.842 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-16T07:30:45.020 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-16T07:30:45.227 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-16T07:30:45.433 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-16T07:30:45.438 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-16T07:30:45.664 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T07:30:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-16T07:30:45.953 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-16T07:30:45.987 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-16T07:30:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-16T07:30:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-16T07:30:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-16T07:30:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-16T07:30:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-16T07:30:46.377 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-16T07:30:46.628 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.6-8.el8.x86_64 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:46.710 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:30:46.856 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-16T07:30:46.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph 2023-12-16T07:30:47.125 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-16T07:30:47.324 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T07:30:47.650 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-16T07:30:47.788 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:57 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:30:47.872 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-16T07:30:48.035 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-16T07:30:48.252 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-16T07:30:48.518 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-16T07:30:48.799 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-16T07:30:49.051 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-16T07:30:49.390 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-16T07:30:49.500 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:30:49.504 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:30:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:30:49.504 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:30:49.504 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:30:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-16T07:30:49.504 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:30:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-16T07:30:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-16T07:30:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-16T07:30:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-16T07:30:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-16T07:30:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-16T07:30:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-16T07:30:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-16T07:30:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-16T07:30:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-16T07:30:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-16T07:30:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-16T07:30:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-16T07:30:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-16T07:30:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-16T07:30:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-16T07:30:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-16T07:30:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-16T07:30:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-16T07:30:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-16T07:30:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-16T07:30:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-16T07:30:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-16T07:30:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-16T07:30:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-16T07:30:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-16T07:30:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-16T07:30:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-16T07:30:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-16T07:30:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-16T07:30:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-16T07:30:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:49.510 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:30:49.510 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:30:49.510 INFO:teuthology.orchestra.run.smithi133.stdout:Install 32 Packages 2023-12-16T07:30:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:30:49.511 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 28 M 2023-12-16T07:30:49.512 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 110 M 2023-12-16T07:30:49.512 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:30:49.732 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-16T07:30:50.028 INFO:teuthology.orchestra.run.smithi133.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 54 kB/s | 6.4 kB 00:00 2023-12-16T07:30:50.145 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-16T07:30:50.274 INFO:teuthology.orchestra.run.smithi133.stdout:(2/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 6.3 MB/s | 2.3 MB 00:00 2023-12-16T07:30:50.320 INFO:teuthology.orchestra.run.smithi133.stdout:(3/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 3.8 MB/s | 1.6 MB 00:00 2023-12-16T07:30:50.388 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T07:30:50.412 INFO:teuthology.orchestra.run.smithi133.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 2.5 MB/s | 238 kB 00:00 2023-12-16T07:30:50.588 INFO:teuthology.orchestra.run.smithi133.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 898 kB/s | 157 kB 00:00 2023-12-16T07:30:50.655 INFO:teuthology.orchestra.run.smithi133.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 580 kB/s | 39 kB 00:00 2023-12-16T07:30:50.713 INFO:teuthology.orchestra.run.smithi133.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.7 MB/s | 103 kB 00:00 2023-12-16T07:30:50.787 INFO:teuthology.orchestra.run.smithi133.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 774 kB/s | 57 kB 00:00 2023-12-16T07:30:50.847 INFO:teuthology.orchestra.run.smithi133.stdout:(9/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_6 4.8 MB/s | 3.9 MB 00:00 2023-12-16T07:30:50.873 INFO:teuthology.orchestra.run.smithi133.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.3 MB/s | 457 kB 00:00 2023-12-16T07:30:50.981 INFO:teuthology.orchestra.run.smithi133.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.8 MB/s | 249 kB 00:00 2023-12-16T07:30:51.148 INFO:teuthology.orchestra.run.smithi133.stdout:(12/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_ 19 MB/s | 17 MB 00:00 2023-12-16T07:30:51.173 INFO:teuthology.orchestra.run.smithi133.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 569 kB/s | 109 kB 00:00 2023-12-16T07:30:51.207 INFO:teuthology.orchestra.run.smithi133.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 1.9 MB/s | 641 kB 00:00 2023-12-16T07:30:51.703 INFO:teuthology.orchestra.run.smithi133.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 79 kB/s | 44 kB 00:00 2023-12-16T07:30:51.807 INFO:teuthology.orchestra.run.smithi133.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 292 kB/s | 185 kB 00:00 2023-12-16T07:30:51.842 INFO:teuthology.orchestra.run.smithi133.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 276 kB/s | 173 kB 00:00 2023-12-16T07:30:51.908 INFO:teuthology.orchestra.run.smithi133.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-12-16T07:30:51.934 INFO:teuthology.orchestra.run.smithi133.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2023-12-16T07:30:51.966 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T07:30:51.992 INFO:teuthology.orchestra.run.smithi133.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.3 MB/s | 384 kB 00:00 2023-12-16T07:30:52.012 INFO:teuthology.orchestra.run.smithi133.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 484 kB/s | 49 kB 00:00 2023-12-16T07:30:52.034 INFO:teuthology.orchestra.run.smithi133.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 584 kB/s | 59 kB 00:00 2023-12-16T07:30:52.112 INFO:teuthology.orchestra.run.smithi133.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-12-16T07:30:52.127 INFO:teuthology.orchestra.run.smithi133.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 203 kB/s | 19 kB 00:00 2023-12-16T07:30:52.146 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T07:30:52.154 INFO:teuthology.orchestra.run.smithi133.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-12-16T07:30:52.227 INFO:teuthology.orchestra.run.smithi133.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 204 kB/s | 24 kB 00:00 2023-12-16T07:30:52.252 INFO:teuthology.orchestra.run.smithi133.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 233 kB/s | 29 kB 00:00 2023-12-16T07:30:52.269 INFO:teuthology.orchestra.run.smithi133.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 235 kB/s | 27 kB 00:00 2023-12-16T07:30:52.380 INFO:teuthology.orchestra.run.smithi133.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 788 kB/s | 85 kB 00:00 2023-12-16T07:30:52.412 INFO:teuthology.orchestra.run.smithi133.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.4 MB/s | 255 kB 00:00 2023-12-16T07:30:52.458 INFO:teuthology.orchestra.run.smithi133.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2023-12-16T07:30:52.478 INFO:teuthology.orchestra.run.smithi133.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2023-12-16T07:30:52.482 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:30:52.483 INFO:teuthology.orchestra.run.smithi133.stdout:Total 9.6 MB/s | 28 MB 00:02 2023-12-16T07:30:52.565 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T07:30:52.566 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:30:52.604 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:30:52.604 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:30:52.753 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T07:30:52.908 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:30:52.911 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:30:52.984 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T07:30:53.194 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T07:30:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T07:30:53.880 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T07:30:54.010 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:30:54.241 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-16T07:30:54.317 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T07:30:54.317 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-16T07:30:54.317 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-16T07:30:54.317 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-16T07:30:54.317 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-16T07:30:54.317 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-16T07:30:54.317 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-16T07:30:54.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-16T07:30:54.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-16T07:30:54.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-16T07:30:54.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-16T07:30:54.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-16T07:30:54.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-16T07:30:54.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-16T07:30:54.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-16T07:30:54.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-16T07:30:54.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-16T07:30:54.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-16T07:30:54.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-16T07:30:54.523 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-16T07:30:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-16T07:30:55.054 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-16T07:30:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-16T07:30:55.409 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-16T07:30:55.527 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-16T07:30:55.527 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-16T07:30:55.528 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-2.6-1.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-16T07:30:55.529 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:30:55.530 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:30:55.600 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-16T07:30:55.717 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-base 2023-12-16T07:30:55.787 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-16T07:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-16T07:30:56.235 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-16T07:30:56.473 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-16T07:30:56.605 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:17 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:30:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-16T07:30:57.179 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-16T07:30:57.426 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-16T07:30:57.630 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-16T07:30:57.899 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-16T07:30:58.132 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T07:30:58.162 INFO:teuthology.orchestra.run.smithi049.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:30:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:30:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:30:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:30:58.420 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-16T07:30:58.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install cephadm 2023-12-16T07:30:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-16T07:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-16T07:30:59.069 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-16T07:30:59.336 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-16T07:30:59.417 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:20 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:30:59.818 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-16T07:31:00.092 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-16T07:31:00.438 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-16T07:31:00.768 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-16T07:31:01.184 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-16T07:31:01.212 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:01.212 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:01.212 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:31:01.212 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:01.212 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:01.212 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-16T07:31:01.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:01.213 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:01.213 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:01.213 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2023-12-16T07:31:01.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:01.213 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 80 k 2023-12-16T07:31:01.213 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 364 k 2023-12-16T07:31:01.214 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 326 kB/s | 80 kB 00:00 2023-12-16T07:31:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:01.461 INFO:teuthology.orchestra.run.smithi049.stdout:Total 325 kB/s | 80 kB 00:00 2023-12-16T07:31:01.461 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:01.462 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T07:31:01.469 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:01.469 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:01.471 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:01.474 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:01.516 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:01.995 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:02.190 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:02.428 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:02.934 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-16T07:31:03.154 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T07:31:03.171 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:03.171 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:03.171 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:03.171 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:03.171 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:03.171 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:03.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T07:31:03.545 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-16T07:31:03.778 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T07:31:03.995 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-16T07:31:04.187 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T07:31:04.206 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-16T07:31:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:25 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:04.371 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-16T07:31:04.764 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-16T07:31:04.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-16T07:31:04.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-16T07:31:04.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-16T07:31:04.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-16T07:31:04.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-16T07:31:04.765 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-16T07:31:04.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-16T07:31:04.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-16T07:31:04.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-16T07:31:04.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-16T07:31:04.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-16T07:31:04.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-16T07:31:04.766 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-16T07:31:04.767 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-16T07:31:04.767 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-16T07:31:04.767 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-16T07:31:04.767 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-16T07:31:04.767 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-16T07:31:04.767 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-16T07:31:04.768 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-16T07:31:04.768 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-16T07:31:04.768 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-16T07:31:06.048 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-16T07:31:06.048 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:06.048 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:31:06.048 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:06.048 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:06.048 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:06.048 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-16T07:31:06.049 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-2.6-1.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-16T07:31:06.050 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-16T07:31:06.051 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-16T07:31:06.051 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-16T07:31:06.051 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-16T07:31:06.051 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:06.051 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:06.069 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:06.069 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:06.069 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2023-12-16T07:31:06.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:06.071 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 161 k 2023-12-16T07:31:06.071 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 490 k 2023-12-16T07:31:06.071 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:06.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-base 2023-12-16T07:31:06.331 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 620 kB/s | 161 kB 00:00 2023-12-16T07:31:06.332 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:06.332 INFO:teuthology.orchestra.run.smithi049.stdout:Total 617 kB/s | 161 kB 00:00 2023-12-16T07:31:06.332 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:06.344 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:06.344 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:06.396 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:06.400 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:06.517 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:06.726 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T07:31:07.136 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:17 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:07.140 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T07:31:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T07:31:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:07.827 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:07.827 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:08.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr 2023-12-16T07:31:08.592 INFO:teuthology.orchestra.run.smithi133.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:31:08.819 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:08.820 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:31:08.820 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:08.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install cephadm 2023-12-16T07:31:08.947 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:29 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:09.794 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:19 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:10.500 INFO:teuthology.orchestra.run.smithi049.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:31:10.741 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:10.743 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:31:10.743 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:10.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T07:31:11.485 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:11.485 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:31:11.485 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:11.485 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:31:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-16T07:31:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:11.486 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:31:11.486 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:11.486 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2023-12-16T07:31:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:11.487 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 80 k 2023-12-16T07:31:11.487 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 364 k 2023-12-16T07:31:11.487 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:31:11.743 INFO:teuthology.orchestra.run.smithi133.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 313 kB/s | 80 kB 00:00 2023-12-16T07:31:11.744 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:11.744 INFO:teuthology.orchestra.run.smithi133.stdout:Total 311 kB/s | 80 kB 00:00 2023-12-16T07:31:11.744 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:31:11.750 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:32 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:11.752 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:31:11.752 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:31:11.754 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:31:11.757 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:31:11.800 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:31:12.297 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:12.507 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:12.735 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-16T07:31:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:13.399 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:31:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:13.399 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:13.562 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:13.563 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:13.563 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:13.564 INFO:teuthology.orchestra.run.smithi049.stdout:Install 6 Packages 2023-12-16T07:31:13.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:13.566 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 2.0 M 2023-12-16T07:31:13.566 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 8.0 M 2023-12-16T07:31:13.566 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:13.634 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-immutable-object-cache 2023-12-16T07:31:13.808 INFO:teuthology.orchestra.run.smithi049.stdout:(1/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 133 kB/s | 23 kB 00:00 2023-12-16T07:31:13.910 INFO:teuthology.orchestra.run.smithi049.stdout:(2/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 52 kB/s | 14 kB 00:00 2023-12-16T07:31:13.935 INFO:teuthology.orchestra.run.smithi049.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 336 kB/s | 43 kB 00:00 2023-12-16T07:31:13.977 INFO:teuthology.orchestra.run.smithi049.stdout:(4/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 4.9 MB/s | 1.7 MB 00:00 2023-12-16T07:31:14.069 INFO:teuthology.orchestra.run.smithi049.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 212 kB/s | 34 kB 00:00 2023-12-16T07:31:14.136 INFO:teuthology.orchestra.run.smithi049.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 980 kB/s | 196 kB 00:00 2023-12-16T07:31:14.139 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:14.139 INFO:teuthology.orchestra.run.smithi049.stdout:Total 3.5 MB/s | 2.0 MB 00:00 2023-12-16T07:31:14.151 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:14.161 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:14.161 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:14.243 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:14.246 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:14.494 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:24 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:14.499 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:14.716 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-16T07:31:15.002 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-16T07:31:15.178 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-16T07:31:15.315 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-16T07:31:15.672 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-16T07:31:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T07:31:16.183 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:31:16.184 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:16.185 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2023-12-16T07:31:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:16.185 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 161 k 2023-12-16T07:31:16.185 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 490 k 2023-12-16T07:31:16.185 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:31:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T07:31:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-16T07:31:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-16T07:31:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-16T07:31:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-16T07:31:16.384 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-16T07:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 180 kB/s | 161 kB 00:00 2023-12-16T07:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout:Total 180 kB/s | 161 kB 00:00 2023-12-16T07:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:31:17.107 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-16T07:31:17.107 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:17.107 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:17.107 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:17.107 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:17.107 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:17.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-16T07:31:17.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-16T07:31:17.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-16T07:31:17.108 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:17.108 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:17.147 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:31:17.150 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:31:17.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T07:31:17.284 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:31:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T07:31:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T07:31:18.133 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:39 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-16T07:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:18.855 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr 2023-12-16T07:31:19.723 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:29 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:19.955 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:19.956 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2023-12-16T07:31:19.956 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:31:19.956 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2023-12-16T07:31:19.956 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2023-12-16T07:31:19.957 INFO:teuthology.orchestra.run.smithi049.stdout:Install 8 Packages 2023-12-16T07:31:19.958 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:19.958 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 36 M 2023-12-16T07:31:19.958 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 210 M 2023-12-16T07:31:19.958 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:20.493 INFO:teuthology.orchestra.run.smithi049.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-12-16T07:31:20.592 INFO:teuthology.orchestra.run.smithi049.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 8.8 MB/s | 4.9 MB 00:00 2023-12-16T07:31:20.660 INFO:teuthology.orchestra.run.smithi049.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.2 MB/s | 225 kB 00:00 2023-12-16T07:31:20.719 INFO:teuthology.orchestra.run.smithi049.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 17 MB/s | 3.7 MB 00:00 2023-12-16T07:31:20.836 INFO:teuthology.orchestra.run.smithi049.stdout:(5/8): ceph-mgr-diskprediction-local-17.2.7-125 9.3 MB/s | 7.4 MB 00:00 2023-12-16T07:31:20.903 INFO:teuthology.orchestra.run.smithi049.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2023-12-16T07:31:20.937 INFO:teuthology.orchestra.run.smithi049.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-12-16T07:31:21.187 INFO:teuthology.orchestra.run.smithi133.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:31:21.221 INFO:teuthology.orchestra.run.smithi049.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 25 MB/s | 14 MB 00:00 2023-12-16T07:31:21.221 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:21.221 INFO:teuthology.orchestra.run.smithi049.stdout:Total 28 MB/s | 36 MB 00:01 2023-12-16T07:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:21.463 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:21.484 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:21.485 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:21.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-dashboard 2023-12-16T07:31:22.286 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:22.289 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:22.371 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:32 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:23.067 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:23.208 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T07:31:23.532 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T07:31:24.042 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:24.043 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:24.043 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-16T07:31:24.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-16T07:31:24.045 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-16T07:31:24.045 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:24.045 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:31:24.045 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:24.045 INFO:teuthology.orchestra.run.smithi133.stdout:Install 6 Packages 2023-12-16T07:31:24.045 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:24.046 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 2.0 M 2023-12-16T07:31:24.046 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 8.0 M 2023-12-16T07:31:24.046 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:31:24.170 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T07:31:24.316 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T07:31:24.747 INFO:teuthology.orchestra.run.smithi133.stdout:(1/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 82 kB/s | 14 kB 00:00 2023-12-16T07:31:24.842 INFO:teuthology.orchestra.run.smithi133.stdout:(2/6): python3-jwt-1.6.1-2.el8.noarch.rpm 448 kB/s | 43 kB 00:00 2023-12-16T07:31:24.868 INFO:teuthology.orchestra.run.smithi133.stdout:(3/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 78 kB/s | 23 kB 00:00 2023-12-16T07:31:24.963 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T07:31:25.043 INFO:teuthology.orchestra.run.smithi133.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 168 kB/s | 34 kB 00:00 2023-12-16T07:31:25.085 INFO:teuthology.orchestra.run.smithi133.stdout:(5/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 3.3 MB/s | 1.7 MB 00:00 2023-12-16T07:31:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T07:31:25.127 INFO:teuthology.orchestra.run.smithi133.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 760 kB/s | 196 kB 00:00 2023-12-16T07:31:25.128 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:25.129 INFO:teuthology.orchestra.run.smithi133.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2023-12-16T07:31:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:31:25.151 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:31:25.151 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:31:25.237 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:31:25.241 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:31:25.508 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:31:25.722 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-16T07:31:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T07:31:26.009 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-16T07:31:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T07:31:26.194 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-16T07:31:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-16T07:31:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T07:31:26.668 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-16T07:31:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T07:31:27.218 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-16T07:31:27.218 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-16T07:31:27.218 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-16T07:31:27.218 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-16T07:31:27.218 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-16T07:31:27.218 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-16T07:31:27.913 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-16T07:31:27.914 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-16T07:31:27.914 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:27.914 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:28.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-16T07:31:28.296 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T07:31:28.890 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:38 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:29.553 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-16T07:31:29.755 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-16T07:31:30.085 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-16T07:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2023-12-16T07:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2023-12-16T07:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout:Install 8 Packages 2023-12-16T07:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 36 M 2023-12-16T07:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 210 M 2023-12-16T07:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:31:30.847 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-16T07:31:30.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:30.847 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:30.847 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:30.847 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-16T07:31:30.847 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-16T07:31:30.848 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-16T07:31:30.848 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-16T07:31:30.848 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-16T07:31:30.848 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-16T07:31:30.848 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-16T07:31:30.848 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:30.848 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:30.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-rook 2023-12-16T07:31:31.209 INFO:teuthology.orchestra.run.smithi133.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2023-12-16T07:31:31.267 INFO:teuthology.orchestra.run.smithi133.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-12-16T07:31:31.378 INFO:teuthology.orchestra.run.smithi133.stdout:(3/8): ceph-mgr-diskprediction-local-17.2.7-125 13 MB/s | 7.4 MB 00:00 2023-12-16T07:31:31.410 INFO:teuthology.orchestra.run.smithi133.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.6 MB/s | 225 kB 00:00 2023-12-16T07:31:31.468 INFO:teuthology.orchestra.run.smithi133.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2023-12-16T07:31:31.569 INFO:teuthology.orchestra.run.smithi133.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-12-16T07:31:31.594 INFO:teuthology.orchestra.run.smithi133.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2023-12-16T07:31:31.879 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:52 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:32.069 INFO:teuthology.orchestra.run.smithi133.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 21 MB/s | 14 MB 00:00 2023-12-16T07:31:32.069 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:32.069 INFO:teuthology.orchestra.run.smithi133.stdout:Total 24 MB/s | 36 MB 00:01 2023-12-16T07:31:32.302 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:31:32.320 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:31:32.321 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:31:32.705 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:31:33.687 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-16T07:31:33.689 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout:Install 13 Packages 2023-12-16T07:31:33.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:33.691 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 1.9 M 2023-12-16T07:31:33.691 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 25 M 2023-12-16T07:31:33.691 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:34.135 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:31:34.219 INFO:teuthology.orchestra.run.smithi049.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 231 kB/s | 27 kB 00:00 2023-12-16T07:31:34.236 INFO:teuthology.orchestra.run.smithi049.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 151 kB/s | 20 kB 00:00 2023-12-16T07:31:34.262 INFO:teuthology.orchestra.run.smithi049.stdout:(3/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 301 kB/s | 47 kB 00:00 2023-12-16T07:31:34.282 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T07:31:34.354 INFO:teuthology.orchestra.run.smithi049.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 941 kB/s | 110 kB 00:00 2023-12-16T07:31:34.379 INFO:teuthology.orchestra.run.smithi049.stdout:(5/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 888 kB/s | 126 kB 00:00 2023-12-16T07:31:34.404 INFO:teuthology.orchestra.run.smithi049.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.1 MB/s | 155 kB 00:00 2023-12-16T07:31:34.429 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-16T07:31:34.446 INFO:teuthology.orchestra.run.smithi049.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 462 kB/s | 43 kB 00:00 2023-12-16T07:31:34.530 INFO:teuthology.orchestra.run.smithi049.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 219 kB/s | 33 kB 00:00 2023-12-16T07:31:34.555 INFO:teuthology.orchestra.run.smithi049.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 108 kB/s | 16 kB 00:00 2023-12-16T07:31:34.581 INFO:teuthology.orchestra.run.smithi049.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 607 kB/s | 81 kB 00:00 2023-12-16T07:31:34.617 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T07:31:34.648 INFO:teuthology.orchestra.run.smithi049.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 699 kB/s | 64 kB 00:00 2023-12-16T07:31:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 613 kB/s | 61 kB 00:00 2023-12-16T07:31:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.4 MB/s | 1.2 MB 00:00 2023-12-16T07:31:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:34.748 INFO:teuthology.orchestra.run.smithi049.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2023-12-16T07:31:34.808 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:34.824 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:34.824 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:34.917 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:34.920 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-16T07:31:35.390 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T07:31:35.549 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:35.784 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-16T07:31:36.006 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-16T07:31:36.010 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-16T07:31:36.224 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T07:31:36.224 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-16T07:31:36.462 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-16T07:31:36.645 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-16T07:31:36.869 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-16T07:31:36.920 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-16T07:31:37.196 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-16T07:31:37.301 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T07:31:37.443 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-16T07:31:37.530 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T07:31:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-16T07:31:38.795 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-16T07:31:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-16T07:31:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-16T07:31:39.282 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-16T07:31:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-16T07:31:39.707 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-16T07:31:39.708 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-16T07:31:39.708 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-16T07:31:39.708 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-16T07:31:40.488 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-16T07:31:40.511 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-16T07:31:40.512 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-16T07:31:40.513 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-16T07:31:40.513 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-16T07:31:40.513 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:40.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T07:31:40.747 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T07:31:41.078 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-16T07:31:41.078 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-16T07:31:41.079 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-16T07:31:41.079 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-16T07:31:41.079 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-16T07:31:41.079 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-16T07:31:41.079 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-16T07:31:41.079 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-16T07:31:41.536 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:02 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:41.798 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:41.799 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:41.928 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-rook 2023-12-16T07:31:42.783 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:52 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:43.345 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:43.346 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:43.346 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:31:43.346 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:43.346 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:43.346 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout:Install 5 Packages 2023-12-16T07:31:43.347 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:43.348 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 6.0 M 2023-12-16T07:31:43.348 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 26 M 2023-12-16T07:31:43.348 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:43.822 INFO:teuthology.orchestra.run.smithi049.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.2 MB/s | 538 kB 00:00 2023-12-16T07:31:43.855 INFO:teuthology.orchestra.run.smithi049.stdout:(2/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 436 kB/s | 121 kB 00:00 2023-12-16T07:31:43.950 INFO:teuthology.orchestra.run.smithi049.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 642 kB/s | 60 kB 00:00 2023-12-16T07:31:44.025 INFO:teuthology.orchestra.run.smithi049.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-12-16T07:31:44.050 INFO:teuthology.orchestra.run.smithi049.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.0 MB/s | 476 kB 00:00 2023-12-16T07:31:44.051 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:44.051 INFO:teuthology.orchestra.run.smithi049.stdout:Total 8.5 MB/s | 6.0 MB 00:00 2023-12-16T07:31:44.106 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:44.118 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:44.118 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:44.221 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:44.224 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:44.459 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-16T07:31:44.461 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout:Install 13 Packages 2023-12-16T07:31:44.462 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:44.463 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 1.9 M 2023-12-16T07:31:44.463 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 25 M 2023-12-16T07:31:44.463 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:31:44.489 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:44.850 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-16T07:31:44.942 INFO:teuthology.orchestra.run.smithi133.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 170 kB/s | 20 kB 00:00 2023-12-16T07:31:44.967 INFO:teuthology.orchestra.run.smithi133.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 186 kB/s | 27 kB 00:00 2023-12-16T07:31:44.993 INFO:teuthology.orchestra.run.smithi133.stdout:(3/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 282 kB/s | 47 kB 00:00 2023-12-16T07:31:45.068 INFO:teuthology.orchestra.run.smithi133.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-12-16T07:31:45.093 INFO:teuthology.orchestra.run.smithi133.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 875 kB/s | 110 kB 00:00 2023-12-16T07:31:45.119 INFO:teuthology.orchestra.run.smithi133.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.2 MB/s | 155 kB 00:00 2023-12-16T07:31:45.153 INFO:teuthology.orchestra.run.smithi133.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 507 kB/s | 43 kB 00:00 2023-12-16T07:31:45.194 INFO:teuthology.orchestra.run.smithi133.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 217 kB/s | 16 kB 00:00 2023-12-16T07:31:45.219 INFO:teuthology.orchestra.run.smithi133.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 262 kB/s | 33 kB 00:00 2023-12-16T07:31:45.278 INFO:teuthology.orchestra.run.smithi133.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 648 kB/s | 81 kB 00:00 2023-12-16T07:31:45.295 INFO:teuthology.orchestra.run.smithi133.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 853 kB/s | 64 kB 00:00 2023-12-16T07:31:45.328 INFO:teuthology.orchestra.run.smithi133.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2023-12-16T07:31:45.404 INFO:teuthology.orchestra.run.smithi133.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.6 MB/s | 1.2 MB 00:00 2023-12-16T07:31:45.404 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:45.404 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.1 MB/s | 1.9 MB 00:00 2023-12-16T07:31:45.457 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:31:45.474 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:31:45.474 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:31:45.560 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:31:45.563 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:31:45.869 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-16T07:31:46.170 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:31:46.224 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-16T07:31:46.441 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-16T07:31:46.473 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-16T07:31:46.638 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-16T07:31:46.678 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T07:31:46.907 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-16T07:31:46.975 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T07:31:46.975 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-16T07:31:46.975 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-16T07:31:46.975 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-16T07:31:46.975 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-16T07:31:47.137 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-16T07:31:47.351 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-16T07:31:47.570 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-16T07:31:47.690 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-16T07:31:47.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:47.690 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:47.691 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:47.691 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-16T07:31:47.691 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-16T07:31:47.691 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-16T07:31:47.691 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-16T07:31:47.691 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:47.691 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:47.830 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-fuse 2023-12-16T07:31:47.838 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-16T07:31:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-16T07:31:48.727 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:09 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:49.111 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-16T07:31:49.394 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-16T07:31:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-16T07:31:49.779 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-16T07:31:49.971 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T07:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-16T07:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-16T07:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-16T07:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-16T07:31:50.524 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:50.524 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout:Install 2 Packages 2023-12-16T07:31:50.525 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:50.526 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 958 k 2023-12-16T07:31:50.526 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 3.0 M 2023-12-16T07:31:50.526 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:50.659 INFO:teuthology.orchestra.run.smithi049.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 871 kB/s | 83 kB 00:00 2023-12-16T07:31:51.009 INFO:teuthology.orchestra.run.smithi049.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 1.9 MB/s | 875 kB 00:00 2023-12-16T07:31:51.010 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:51.010 INFO:teuthology.orchestra.run.smithi049.stdout:Total 1.9 MB/s | 958 kB 00:00 2023-12-16T07:31:51.020 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:51.042 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:51.042 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-16T07:31:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:51.043 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-16T07:31:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-16T07:31:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-16T07:31:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-16T07:31:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-16T07:31:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-16T07:31:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-16T07:31:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:51.045 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:51.134 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:51.137 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:51.165 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-cephadm 2023-12-16T07:31:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:51.617 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-16T07:31:51.827 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T07:31:52.018 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:02 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:31:52.232 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T07:31:52.233 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-16T07:31:52.991 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-16T07:31:52.992 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:52.992 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:52.992 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-16T07:31:52.992 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:52.992 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:53.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librados-devel 2023-12-16T07:31:53.759 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-16T07:31:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-16T07:31:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-16T07:31:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-16T07:31:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:53.761 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:31:53.761 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:31:53.761 INFO:teuthology.orchestra.run.smithi133.stdout:Install 5 Packages 2023-12-16T07:31:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:53.762 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 6.0 M 2023-12-16T07:31:53.762 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 26 M 2023-12-16T07:31:53.762 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:31:54.111 INFO:teuthology.orchestra.run.smithi133.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.9 MB/s | 538 kB 00:00 2023-12-16T07:31:54.126 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:15 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:54.127 INFO:teuthology.orchestra.run.smithi133.stdout:(2/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 404 kB/s | 121 kB 00:00 2023-12-16T07:31:54.261 INFO:teuthology.orchestra.run.smithi133.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-12-16T07:31:54.336 INFO:teuthology.orchestra.run.smithi133.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 289 kB/s | 60 kB 00:00 2023-12-16T07:31:54.487 INFO:teuthology.orchestra.run.smithi133.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.2 MB/s | 476 kB 00:00 2023-12-16T07:31:54.487 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:54.487 INFO:teuthology.orchestra.run.smithi133.stdout:Total 8.2 MB/s | 6.0 MB 00:00 2023-12-16T07:31:54.538 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:31:54.549 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:31:54.549 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:31:54.648 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:31:54.651 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:31:54.915 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:31:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-16T07:31:55.970 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:31:55.970 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:55.970 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2023-12-16T07:31:55.970 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:55.970 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:31:55.971 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-16T07:31:55.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:55.971 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:31:55.971 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:31:55.971 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2023-12-16T07:31:55.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:55.971 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 130 k 2023-12-16T07:31:55.972 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 464 k 2023-12-16T07:31:55.972 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:31:56.171 INFO:teuthology.orchestra.run.smithi049.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 651 kB/s | 130 kB 00:00 2023-12-16T07:31:56.172 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:31:56.172 INFO:teuthology.orchestra.run.smithi049.stdout:Total 647 kB/s | 130 kB 00:00 2023-12-16T07:31:56.172 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:31:56.178 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:31:56.178 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:31:56.231 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:31:56.234 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:31:56.285 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-16T07:31:56.345 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:31:56.567 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:31:56.656 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-16T07:31:56.861 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:31:56.912 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-16T07:31:57.136 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T07:31:57.424 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-16T07:31:57.424 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-16T07:31:57.424 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-16T07:31:57.424 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-16T07:31:57.424 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-16T07:31:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:31:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:57.557 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:31:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:31:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:31:57.558 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:31:57.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install libcephfs2 2023-12-16T07:31:58.098 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-16T07:31:58.098 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:58.098 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:31:58.098 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-16T07:31:58.098 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-16T07:31:58.099 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-16T07:31:58.099 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-16T07:31:58.099 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-16T07:31:58.099 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:31:58.099 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:31:58.225 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-fuse 2023-12-16T07:31:58.671 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:19 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:31:59.085 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:09 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:00.225 INFO:teuthology.orchestra.run.smithi049.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:00.469 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:32:00.470 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:00.761 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:00.761 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:00.761 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-16T07:32:00.761 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout:Install 2 Packages 2023-12-16T07:32:00.762 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:00.763 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 958 k 2023-12-16T07:32:00.763 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 3.0 M 2023-12-16T07:32:00.763 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:32:00.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install libcephfs-devel 2023-12-16T07:32:01.062 INFO:teuthology.orchestra.run.smithi133.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 712 kB/s | 83 kB 00:00 2023-12-16T07:32:01.187 INFO:teuthology.orchestra.run.smithi133.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 3.5 MB/s | 875 kB 00:00 2023-12-16T07:32:01.187 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:01.188 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.2 MB/s | 958 kB 00:00 2023-12-16T07:32:01.198 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:32:01.220 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:32:01.220 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:32:01.307 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:32:01.310 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:32:01.474 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:32:01.759 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:22 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:01.778 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-16T07:32:01.985 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T07:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-16T07:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-16T07:32:03.104 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-16T07:32:03.104 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:03.104 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:32:03.104 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-16T07:32:03.104 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:03.104 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:03.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librados-devel 2023-12-16T07:32:03.568 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:03.569 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2023-12-16T07:32:03.569 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:03.569 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:32:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-16T07:32:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:03.570 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:32:03.570 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:03.570 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2023-12-16T07:32:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:03.570 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 25 k 2023-12-16T07:32:03.570 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 109 k 2023-12-16T07:32:03.570 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:32:03.719 INFO:teuthology.orchestra.run.smithi049.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 167 kB/s | 25 kB 00:00 2023-12-16T07:32:03.719 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:03.719 INFO:teuthology.orchestra.run.smithi049.stdout:Total 165 kB/s | 25 kB 00:00 2023-12-16T07:32:03.720 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:32:03.723 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:32:03.724 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:32:03.725 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:32:03.729 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:32:03.783 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:32:03.974 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:04.215 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:14 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:04.269 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:04.952 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:04.952 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:04.952 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:32:04.952 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:04.952 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:04.952 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:05.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librados2 2023-12-16T07:32:05.883 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:05.883 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2023-12-16T07:32:05.884 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:05.885 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 130 k 2023-12-16T07:32:05.885 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 464 k 2023-12-16T07:32:05.885 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:32:05.993 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:26 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:06.067 INFO:teuthology.orchestra.run.smithi133.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 713 kB/s | 130 kB 00:00 2023-12-16T07:32:06.068 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:06.068 INFO:teuthology.orchestra.run.smithi133.stdout:Total 706 kB/s | 130 kB 00:00 2023-12-16T07:32:06.069 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:32:06.074 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:32:06.074 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:32:06.124 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:32:06.128 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:32:06.235 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:32:06.492 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:06.798 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:07.472 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:07.554 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:07.682 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install libcephfs2 2023-12-16T07:32:07.797 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:07.798 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:32:07.798 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:07.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librbd1 2023-12-16T07:32:08.544 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:18 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:08.799 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:29 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:10.012 INFO:teuthology.orchestra.run.smithi133.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:10.239 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:10.240 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:32:10.240 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:10.353 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:10.600 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:10.601 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:32:10.601 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:10.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rados 2023-12-16T07:32:11.026 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install libcephfs-devel 2023-12-16T07:32:11.791 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:32 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:11.882 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:21 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:13.354 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:13.571 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:13.572 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:13.572 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2023-12-16T07:32:13.572 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 25 k 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 109 k 2023-12-16T07:32:13.573 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:32:13.595 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:13.597 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:32:13.597 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:13.739 INFO:teuthology.orchestra.run.smithi133.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 149 kB/s | 25 kB 00:00 2023-12-16T07:32:13.740 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:13.740 INFO:teuthology.orchestra.run.smithi133.stdout:Total 148 kB/s | 25 kB 00:00 2023-12-16T07:32:13.740 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:32:13.744 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:32:13.744 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:32:13.745 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:32:13.749 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:32:13.760 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rgw 2023-12-16T07:32:13.800 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:32:14.024 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:14.290 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:14.657 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:35 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:14.938 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:14.939 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:14.939 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:32:14.939 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:14.939 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:14.939 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:15.071 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librados2 2023-12-16T07:32:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:25 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:16.219 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:16.463 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:16.465 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:32:16.465 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:16.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-cephfs 2023-12-16T07:32:17.368 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:17.467 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:38 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:32:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:17.700 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librbd1 2023-12-16T07:32:18.552 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:28 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:19.021 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:19.270 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:19.271 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:32:19.271 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:19.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rbd 2023-12-16T07:32:20.028 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:20.258 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:20.259 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:32:20.259 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:20.280 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:41 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:20.363 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rados 2023-12-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:31 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:22.067 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:22.068 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2023-12-16T07:32:22.068 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:22.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-fuse 2023-12-16T07:32:22.679 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:22.905 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:22.906 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:32:22.906 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:23.013 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rgw 2023-12-16T07:32:23.074 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:44 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:23.871 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:33 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:24.883 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:24.883 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2023-12-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:24.885 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 90 k 2023-12-16T07:32:24.885 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 264 k 2023-12-16T07:32:24.885 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:32:25.066 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 499 kB/s | 90 kB 00:00 2023-12-16T07:32:25.067 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:25.067 INFO:teuthology.orchestra.run.smithi049.stdout:Total 496 kB/s | 90 kB 00:00 2023-12-16T07:32:25.067 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:32:25.077 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:32:25.078 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:32:25.132 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:32:25.135 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:32:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:32:25.293 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:25.523 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:25.524 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:32:25.525 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:25.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-cephfs 2023-12-16T07:32:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:26.469 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:32:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:26.469 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:26.496 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:36 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:26.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-mirror 2023-12-16T07:32:27.607 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:48 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:27.953 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:28.188 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:28.189 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:32:28.189 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:28.294 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rbd 2023-12-16T07:32:29.151 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:39 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:29.407 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2023-12-16T07:32:29.408 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:29.409 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 3.5 M 2023-12-16T07:32:29.409 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 16 M 2023-12-16T07:32:29.409 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:32:30.044 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 5.4 MB/s | 3.5 MB 00:00 2023-12-16T07:32:30.045 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:30.045 INFO:teuthology.orchestra.run.smithi049.stdout:Total 5.4 MB/s | 3.5 MB 00:00 2023-12-16T07:32:30.045 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:32:30.058 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:32:30.058 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:32:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:32:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:32:30.594 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-16T07:32:30.754 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:30.822 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:30.823 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-16T07:32:30.823 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:30.933 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-fuse 2023-12-16T07:32:31.186 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:31.781 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:41 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:31.917 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:31.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:31.918 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:32:31.918 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:31.918 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:31.918 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:32.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-nbd 2023-12-16T07:32:33.088 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:54 ago on Sat 16 Dec 2023 07:29:39 AM UTC. 2023-12-16T07:32:33.469 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:33.486 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:33.486 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2023-12-16T07:32:33.486 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:33.486 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:32:33.486 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-16T07:32:33.486 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:33.487 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:32:33.487 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:33.487 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2023-12-16T07:32:33.487 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:33.487 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 90 k 2023-12-16T07:32:33.487 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 264 k 2023-12-16T07:32:33.487 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:32:33.770 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 302 kB/s | 90 kB 00:00 2023-12-16T07:32:33.771 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:33.771 INFO:teuthology.orchestra.run.smithi133.stdout:Total 301 kB/s | 90 kB 00:00 2023-12-16T07:32:33.772 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:32:33.781 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:32:33.781 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:32:33.831 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:32:33.833 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:32:33.946 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:32:34.195 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:34.485 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:34.881 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2023-12-16T07:32:34.882 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:34.882 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2023-12-16T07:32:34.882 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:34.882 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2023-12-16T07:32:34.882 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-16T07:32:34.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:34.883 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2023-12-16T07:32:34.883 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2023-12-16T07:32:34.883 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2023-12-16T07:32:34.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:34.883 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 173 k 2023-12-16T07:32:34.883 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 552 k 2023-12-16T07:32:34.884 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2023-12-16T07:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 523 kB/s | 173 kB 00:00 2023-12-16T07:32:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:Total 521 kB/s | 173 kB 00:00 2023-12-16T07:32:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2023-12-16T07:32:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2023-12-16T07:32:35.227 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2023-12-16T07:32:35.279 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2023-12-16T07:32:35.282 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2023-12-16T07:32:35.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-mirror 2023-12-16T07:32:35.402 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2023-12-16T07:32:35.561 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:35.879 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:36.212 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:46 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:36.603 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2023-12-16T07:32:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:32:36.603 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2023-12-16T07:32:36.822 DEBUG:teuthology.parallel:result is None 2023-12-16T07:32:37.905 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:37.905 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:37.905 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2023-12-16T07:32:37.905 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:37.905 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:32:37.905 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-16T07:32:37.905 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:37.906 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:32:37.906 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:37.906 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2023-12-16T07:32:37.906 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:37.906 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 3.5 M 2023-12-16T07:32:37.906 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 16 M 2023-12-16T07:32:37.907 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:32:38.922 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 3.4 MB/s | 3.5 MB 00:01 2023-12-16T07:32:38.923 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:38.923 INFO:teuthology.orchestra.run.smithi133.stdout:Total 3.4 MB/s | 3.5 MB 00:01 2023-12-16T07:32:38.923 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:32:38.935 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:32:38.935 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:32:38.996 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:32:38.999 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:32:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:32:39.646 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:40.075 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:40.748 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:40.748 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:40.748 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:32:40.748 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:40.748 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:40.748 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:40.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-nbd 2023-12-16T07:32:41.834 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:51 ago on Sat 16 Dec 2023 07:29:50 AM UTC. 2023-12-16T07:32:43.516 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-16T07:32:43.516 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:43.516 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2023-12-16T07:32:43.516 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 173 k 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 552 k 2023-12-16T07:32:43.517 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-16T07:32:43.824 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 563 kB/s | 173 kB 00:00 2023-12-16T07:32:43.824 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:32:43.825 INFO:teuthology.orchestra.run.smithi133.stdout:Total 561 kB/s | 173 kB 00:00 2023-12-16T07:32:43.825 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-16T07:32:43.836 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-16T07:32:43.836 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-16T07:32:43.886 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-16T07:32:43.889 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-16T07:32:43.998 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-16T07:32:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:44.482 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:45.209 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-16T07:32:45.209 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:45.209 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-16T07:32:45.210 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-16T07:32:45.210 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:32:45.210 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-16T07:32:45.414 DEBUG:teuthology.parallel:result is None 2023-12-16T07:32:45.414 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T07:32:45.414 INFO:teuthology.packaging:ref: None 2023-12-16T07:32:45.415 INFO:teuthology.packaging:tag: None 2023-12-16T07:32:45.415 INFO:teuthology.packaging:branch: quincy 2023-12-16T07:32:45.415 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:32:45.415 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T07:32:45.670 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T07:32:45.699 INFO:teuthology.orchestra.run.smithi049.stdout:17.2.7-125.g1f2f5510.el8 2023-12-16T07:32:45.699 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-16T07:32:45.700 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T07:32:45.701 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T07:32:45.701 INFO:teuthology.packaging:ref: None 2023-12-16T07:32:45.701 INFO:teuthology.packaging:tag: None 2023-12-16T07:32:45.701 INFO:teuthology.packaging:branch: quincy 2023-12-16T07:32:45.701 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:32:45.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-16T07:32:45.942 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-16T07:32:45.966 INFO:teuthology.orchestra.run.smithi133.stdout:17.2.7-125.g1f2f5510.el8 2023-12-16T07:32:45.966 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-16T07:32:45.966 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-16T07:32:45.968 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T07:32:45.968 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:32:45.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T07:32:46.003 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:32:46.004 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T07:32:46.034 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T07:32:46.034 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:32:46.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T07:32:46.078 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T07:32:46.149 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:32:46.149 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T07:32:46.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T07:32:46.243 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T07:32:46.243 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:32:46.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T07:32:46.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T07:32:46.345 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:32:46.345 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T07:32:46.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T07:32:46.438 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T07:32:46.438 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:32:46.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T07:32:46.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T07:32:46.541 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:32:46.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T07:32:46.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T07:32:46.634 INFO:teuthology.run_tasks:Running task print... 2023-12-16T07:32:46.643 INFO:teuthology.task.print:**** done install task... 2023-12-16T07:32:46.644 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-16T07:32:46.775 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T07:32:46.776 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-16T07:32:46.776 INFO:tasks.cephadm:Cluster fsid is 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:32:46.776 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-16T07:32:46.776 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-16T07:32:46.777 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi049': '172.21.15.49', 'mon.smithi133': '172.21.15.133'} 2023-12-16T07:32:46.777 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-16T07:32:46.777 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2023-12-16T07:32:46.810 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname $(hostname -s) 2023-12-16T07:32:46.837 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-16T07:32:46.838 DEBUG:teuthology.orchestra.run.smithi049:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T07:32:46.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 16 07:32 /home/ubuntu/cephtest/cephadm 2023-12-16T07:32:46.996 DEBUG:teuthology.orchestra.run.smithi133:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-16T07:32:47.155 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 16 07:32 /home/ubuntu/cephtest/cephadm 2023-12-16T07:32:47.155 DEBUG:teuthology.orchestra.run.smithi049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T07:32:47.178 DEBUG:teuthology.orchestra.run.smithi133:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-16T07:32:47.207 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-16T07:32:47.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T07:32:47.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-16T07:32:48.332 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T07:32:48.389 INFO:teuthology.orchestra.run.smithi133.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T07:33:13.117 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-16T07:33:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T07:33:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T07:33:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: "repo_digests": [ 2023-12-16T07:33:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T07:33:13.118 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-16T07:33:13.118 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-16T07:33:17.882 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:33:17.883 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-16T07:33:17.883 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-16T07:33:17.883 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2023-12-16T07:33:17.883 INFO:teuthology.orchestra.run.smithi049.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-16T07:33:17.883 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2023-12-16T07:33:17.883 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:33:17.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2023-12-16T07:33:17.933 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph 2023-12-16T07:33:17.970 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2023-12-16T07:33:18.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /etc/ceph 2023-12-16T07:33:18.041 INFO:tasks.cephadm:Writing seed config... 2023-12-16T07:33:18.042 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-16T07:33:18.042 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-16T07:33:18.042 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-16T07:33:18.042 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-16T07:33:18.043 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-16T07:33:18.044 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-16T07:33:18.045 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-16T07:33:18.045 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-16T07:33:18.045 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-16T07:33:18.045 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-16T07:33:18.045 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-16T07:33:18.045 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-16T07:33:18.045 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-16T07:33:18.046 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:33:18.046 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-16T07:33:18.064 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4ed9995e-9be5-11ee-95a5-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-16T07:33:18.064 DEBUG:teuthology.orchestra.run.smithi049:mon.smithi049> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049.service 2023-12-16T07:33:18.106 INFO:tasks.cephadm:Bootstrapping... 2023-12-16T07:33:18.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.49 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-16T07:33:18.133 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:-- Logs begin at Sat 2023-12-16 07:20:18 UTC. -- 2023-12-16T07:33:18.315 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2023-12-16T07:33:18.315 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '4ed9995e-9be5-11ee-95a5-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.49', '--skip-admin-label'] 2023-12-16T07:33:18.348 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 4.6.1 2023-12-16T07:33:18.349 INFO:teuthology.orchestra.run.smithi049.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-16T07:33:18.349 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying podman|docker is present... 2023-12-16T07:33:18.380 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 4.6.1 2023-12-16T07:33:18.380 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying lvm2 is present... 2023-12-16T07:33:18.380 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying time synchronization is in place... 2023-12-16T07:33:18.387 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T07:33:18.387 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T07:33:18.393 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T07:33:18.393 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2023-12-16T07:33:18.399 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2023-12-16T07:33:18.405 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2023-12-16T07:33:18.405 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2023-12-16T07:33:18.405 INFO:teuthology.orchestra.run.smithi049.stdout:Repeating the final host check... 2023-12-16T07:33:18.435 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 4.6.1 2023-12-16T07:33:18.435 INFO:teuthology.orchestra.run.smithi049.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-16T07:33:18.435 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl is present 2023-12-16T07:33:18.435 INFO:teuthology.orchestra.run.smithi049.stdout:lvcreate is present 2023-12-16T07:33:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-16T07:33:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-16T07:33:18.447 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-16T07:33:18.447 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2023-12-16T07:33:18.453 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2023-12-16T07:33:18.459 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2023-12-16T07:33:18.459 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2023-12-16T07:33:18.460 INFO:teuthology.orchestra.run.smithi049.stdout:Host looks OK 2023-12-16T07:33:18.460 INFO:teuthology.orchestra.run.smithi049.stdout:Cluster fsid: 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:18.460 INFO:teuthology.orchestra.run.smithi049.stdout:Acquiring lock 140118617610728 on /run/cephadm/4ed9995e-9be5-11ee-95a5-87774f69a715.lock 2023-12-16T07:33:18.460 INFO:teuthology.orchestra.run.smithi049.stdout:Lock 140118617610728 acquired on /run/cephadm/4ed9995e-9be5-11ee-95a5-87774f69a715.lock 2023-12-16T07:33:18.460 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 3300 ... 2023-12-16T07:33:18.460 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 6789 ... 2023-12-16T07:33:18.461 INFO:teuthology.orchestra.run.smithi049.stdout:Base mon IP(s) is [172.21.15.49:3300, 172.21.15.49:6789], mon addrv is [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2023-12-16T07:33:18.464 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.49 metric 100 2023-12-16T07:33:18.464 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.49 metric 100 2023-12-16T07:33:18.467 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-16T07:33:18.467 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-12-16T07:33:18.467 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2023-12-16T07:33:18.470 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-16T07:33:18.470 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-16T07:33:18.470 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T07:33:18.470 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-16T07:33:18.470 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-12-16T07:33:18.470 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-16T07:33:18.471 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2023-12-16T07:33:18.471 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2023-12-16T07:33:18.471 INFO:teuthology.orchestra.run.smithi049.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-16T07:33:18.472 INFO:teuthology.orchestra.run.smithi049.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-16T07:33:18.472 INFO:teuthology.orchestra.run.smithi049.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T07:33:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T07:33:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-16T07:33:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Getting image source signatures 2023-12-16T07:33:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2023-12-16T07:33:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:3c21fa6304a567e69d15522c48775b11468df75d53cc353263c55c753e1a9b4e 2023-12-16T07:33:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying config sha256:60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-16T07:33:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-16T07:33:19.521 INFO:teuthology.orchestra.run.smithi049.stdout:ceph: stdout ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T07:33:19.521 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph version: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-16T07:33:19.521 INFO:teuthology.orchestra.run.smithi049.stdout:Extracting ceph user uid/gid from container image... 2023-12-16T07:33:20.124 INFO:teuthology.orchestra.run.smithi049.stdout:stat: stdout 167 167 2023-12-16T07:33:20.124 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial keys... 2023-12-16T07:33:20.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQDAUn1lJnxRFhAAiLQdMjbkiPCrsat3MvXetw== 2023-12-16T07:33:21.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQDAUn1ldSHhOBAAfhC+LSuqrdKKlpDTbXXDAg== 2023-12-16T07:33:21.949 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQDBUn1l24EsJBAA9xiQ119tUC4rqzoX1OaGyA== 2023-12-16T07:33:21.949 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial monmap... 2023-12-16T07:33:22.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool for smithi049 [v2:172.21.15.49:3300,v1:172.21.15.49:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = octopus 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: set fsid to 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-16T07:33:22.524 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:33:22.525 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mon... 2023-12-16T07:33:23.118 INFO:teuthology.orchestra.run.smithi049.stdout:create mon.smithi049 on 2023-12-16T07:33:23.216 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-16T07:33:23.308 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-16T07:33:23.406 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715.target. 2023-12-16T07:33:23.406 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715.target. 2023-12-16T07:33:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049 2023-12-16T07:33:23.538 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049.service: Unit ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049.service not loaded. 2023-12-16T07:33:23.638 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715.target.wants/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049.service → /etc/systemd/system/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@.service. 2023-12-16T07:33:23.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:23 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:33:24.016 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T07:33:24.017 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2023-12-16T07:33:24.025 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T07:33:24.025 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2023-12-16T07:33:24.025 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2023-12-16T07:33:24.025 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T07:33:24.025 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon to start... 2023-12-16T07:33:24.026 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon... 2023-12-16T07:33:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:24 smithi049 bash[111417]: 5ebfcbb6bf99a976cce8d067a1f2a5bb5cd4cfd5c02bd788832be415343a5a4f 2023-12-16T07:33:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:24 smithi049 systemd[1]: Started Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:33:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:24 smithi049 ceph-mon[111454]: mkfs 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:24 smithi049 ceph-mon[111454]: mon.smithi049 is new leader, mons smithi049 in quorum (ranks 0) 2023-12-16T07:33:24.853 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout cluster: 2023-12-16T07:33:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout id: 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-16T07:33:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout services: 2023-12-16T07:33:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi049 (age 0.471137s) 2023-12-16T07:33:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-16T07:33:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout data: 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pgs: 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.421+0000 7f0b8d8fa700 1 Processor -- start 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.421+0000 7f0b8d8fa700 1 -- start start 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.421+0000 7f0b8d8fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.421+0000 7f0b8d8fa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88104310 con 0x7f0b881039c0 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49696/0 (socket says 172.21.15.49:49696) 2023-12-16T07:33:24.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b86ffd700 1 -- 172.21.15.49:0/1626453932 learned_addr learned my addr 172.21.15.49:0/1626453932 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b86ffd700 1 -- 172.21.15.49:0/1626453932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88101fb0 con 0x7f0b881039c0 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b86ffd700 1 --2- 172.21.15.49:0/1626453932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88103dd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0b700098e0 tx=0x7f0b70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59e87cddf551728 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b85ffb700 1 -- 172.21.15.49:0/1626453932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b7000b860 con 0x7f0b881039c0 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b85ffb700 1 -- 172.21.15.49:0/1626453932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000b9c0 con 0x7f0b881039c0 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.422+0000 7f0b85ffb700 1 -- 172.21.15.49:0/1626453932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b7000bc90 con 0x7f0b881039c0 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.423+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1626453932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 msgr2=0x7f0b88103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.423+0000 7f0b8d8fa700 1 --2- 172.21.15.49:0/1626453932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88103dd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0b700098e0 tx=0x7f0b70009250 comp rx=0 tx=0).stop 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.423+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1626453932 shutdown_connections 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.423+0000 7f0b8d8fa700 1 --2- 172.21.15.49:0/1626453932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88103dd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.423+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1626453932 >> 172.21.15.49:0/1626453932 conn(0x7f0b880fda40 msgr2=0x7f0b880ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.423+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1626453932 shutdown_connections 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.423+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1626453932 wait complete. 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b8d8fa700 1 Processor -- start 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b8d8fa700 1 -- start start 2023-12-16T07:33:24.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b8d8fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b8d8fa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88077190 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49704/0 (socket says 172.21.15.49:49704) 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b86ffd700 1 -- 172.21.15.49:0/1221130814 learned_addr learned my addr 172.21.15.49:0/1221130814 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b86ffd700 1 -- 172.21.15.49:0/1221130814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b700094f0 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b86ffd700 1 --2- 172.21.15.49:0/1221130814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88078d10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0b70003080 tx=0x7f0b70016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.424+0000 7f0b7f7fe700 1 -- 172.21.15.49:0/1221130814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b7001c5c0 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.425+0000 7f0b7f7fe700 1 -- 172.21.15.49:0/1221130814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7001c720 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.425+0000 7f0b7f7fe700 1 -- 172.21.15.49:0/1221130814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b7001ca30 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.425+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b88077390 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.425+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b880777a0 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.425+0000 7f0b7f7fe700 1 -- 172.21.15.49:0/1221130814 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0b7001a450 con 0x7f0b881039c0 2023-12-16T07:33:24.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.425+0000 7f0b7f7fe700 1 -- 172.21.15.49:0/1221130814 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0b7002e790 con 0x7f0b881039c0 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.425+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8805f270 con 0x7f0b881039c0 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.428+0000 7f0b7f7fe700 1 -- 172.21.15.49:0/1221130814 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0b7001a890 con 0x7f0b881039c0 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.501+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f0b8804bb80 con 0x7f0b881039c0 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.501+0000 7f0b7f7fe700 1 -- 172.21.15.49:0/1221130814 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f0b7001aa30 con 0x7f0b881039c0 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.502+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 msgr2=0x7f0b88078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.502+0000 7f0b8d8fa700 1 --2- 172.21.15.49:0/1221130814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88078d10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0b70003080 tx=0x7f0b70016000 comp rx=0 tx=0).stop 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.502+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 shutdown_connections 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.502+0000 7f0b8d8fa700 1 --2- 172.21.15.49:0/1221130814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b881039c0 0x7f0b88078d10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.502+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 >> 172.21.15.49:0/1221130814 conn(0x7f0b880fda40 msgr2=0x7f0b88105040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.502+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 shutdown_connections 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:24.502+0000 7f0b8d8fa700 1 -- 172.21.15.49:0/1221130814 wait complete. 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:mon is available 2023-12-16T07:33:24.858 INFO:teuthology.orchestra.run.smithi049.stdout:Assimilating anything we can from ceph.conf... 2023-12-16T07:33:25.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:25 smithi049 ceph-mon[111454]: mon.smithi049 is new leader, mons smithi049 in quorum (ranks 0) 2023-12-16T07:33:25.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:25 smithi049 ceph-mon[111454]: monmap e1: 1 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:33:25.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:25 smithi049 ceph-mon[111454]: fsmap 2023-12-16T07:33:25.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:25 smithi049 ceph-mon[111454]: osdmap e1: 0 total, 0 up, 0 in 2023-12-16T07:33:25.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:25 smithi049 ceph-mon[111454]: mgrmap e1: no daemons active 2023-12-16T07:33:25.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:25 smithi049 ceph-mon[111454]: from='client.? 172.21.15.49:0/1221130814' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-16T07:33:25.654 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:25.654 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T07:33:25.654 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T07:33:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be4660700 1 Processor -- start 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be4660700 1 -- start start 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be4660700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be4660700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc102c20 con 0x7f6bdc1022d0 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be23fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be23fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49714/0 (socket says 172.21.15.49:49714) 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be23fc700 1 -- 172.21.15.49:0/3918549255 learned_addr learned my addr 172.21.15.49:0/3918549255 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.220+0000 7f6be23fc700 1 -- 172.21.15.49:0/3918549255 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc102d60 con 0x7f6bdc1022d0 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be23fc700 1 --2- 172.21.15.49:0/3918549255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc1026e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80098e0 tx=0x7f6bd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73156cc1bada745f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be13fa700 1 -- 172.21.15.49:0/3918549255 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd800b860 con 0x7f6bdc1022d0 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be13fa700 1 -- 172.21.15.49:0/3918549255 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800b9c0 con 0x7f6bdc1022d0 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be13fa700 1 -- 172.21.15.49:0/3918549255 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd800bc90 con 0x7f6bdc1022d0 2023-12-16T07:33:25.656 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be4660700 1 -- 172.21.15.49:0/3918549255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 msgr2=0x7f6bdc1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be4660700 1 --2- 172.21.15.49:0/3918549255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc1026e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80098e0 tx=0x7f6bd8009250 comp rx=0 tx=0).stop 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be4660700 1 -- 172.21.15.49:0/3918549255 shutdown_connections 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be4660700 1 --2- 172.21.15.49:0/3918549255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc1026e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be4660700 1 -- 172.21.15.49:0/3918549255 >> 172.21.15.49:0/3918549255 conn(0x7f6bdc0fda50 msgr2=0x7f6bdc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be4660700 1 -- 172.21.15.49:0/3918549255 shutdown_connections 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.221+0000 7f6be4660700 1 -- 172.21.15.49:0/3918549255 wait complete. 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.222+0000 7f6be4660700 1 Processor -- start 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.222+0000 7f6be4660700 1 -- start start 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.222+0000 7f6be4660700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc112b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.222+0000 7f6be4660700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc113090 con 0x7f6bdc1022d0 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.222+0000 7f6be23fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.222+0000 7f6be23fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc112b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49722/0 (socket says 172.21.15.49:49722) 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.222+0000 7f6be23fc700 1 -- 172.21.15.49:0/2779098432 learned_addr learned my addr 172.21.15.49:0/2779098432 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6be23fc700 1 -- 172.21.15.49:0/2779098432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80094f0 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6be23fc700 1 --2- 172.21.15.49:0/2779098432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc112b50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8003080 tx=0x7f6bd8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd801c5c0 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd801c720 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc113290 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd801ca30 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc1136a0 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6bd801a450 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.223+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6bd802e790 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.224+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc04bb80 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.226+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6bd801ce10 con 0x7f6bdc1022d0 2023-12-16T07:33:25.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.297+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6bdc103640 con 0x7f6bdc1022d0 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.300+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6bd802e9a0 con 0x7f6bdc1022d0 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.300+0000 7f6bd2ffd700 1 -- 172.21.15.49:0/2779098432 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f6bd80246e0 con 0x7f6bdc1022d0 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.301+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 msgr2=0x7f6bdc112b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.301+0000 7f6be4660700 1 --2- 172.21.15.49:0/2779098432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc112b50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8003080 tx=0x7f6bd8016000 comp rx=0 tx=0).stop 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.301+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 shutdown_connections 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.301+0000 7f6be4660700 1 --2- 172.21.15.49:0/2779098432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bdc1022d0 0x7f6bdc112b50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.301+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 >> 172.21.15.49:0/2779098432 conn(0x7f6bdc0fda50 msgr2=0x7f6bdc075f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.301+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 shutdown_connections 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:25.301+0000 7f6be4660700 1 -- 172.21.15.49:0/2779098432 wait complete. 2023-12-16T07:33:25.659 INFO:teuthology.orchestra.run.smithi049.stdout:Generating new minimal ceph.conf... 2023-12-16T07:33:26.364 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:26 smithi049 ceph-mon[111454]: from='client.? 172.21.15.49:0/2779098432' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-16T07:33:26.365 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:26 smithi049 ceph-mon[111454]: from='client.? 172.21.15.49:0/2779098432' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-16T07:33:26.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.014+0000 7f49937e7700 1 Processor -- start 2023-12-16T07:33:26.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.014+0000 7f49937e7700 1 -- start start 2023-12-16T07:33:26.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.014+0000 7f49937e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:26.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.014+0000 7f49937e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c105420 con 0x7f498c070fc0 2023-12-16T07:33:26.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.014+0000 7f4991583700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:26.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.014+0000 7f4991583700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49732/0 (socket says 172.21.15.49:49732) 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.014+0000 7f4991583700 1 -- 172.21.15.49:0/2678095013 learned_addr learned my addr 172.21.15.49:0/2678095013 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.015+0000 7f4991583700 1 -- 172.21.15.49:0/2678095013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c105560 con 0x7f498c070fc0 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.015+0000 7f4991583700 1 --2- 172.21.15.49:0/2678095013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c104ee0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49880098e0 tx=0x7f4988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c9895e458f71e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.015+0000 7f4983fff700 1 -- 172.21.15.49:0/2678095013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f498800b860 con 0x7f498c070fc0 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.015+0000 7f4983fff700 1 -- 172.21.15.49:0/2678095013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f498800be30 con 0x7f498c070fc0 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.015+0000 7f4983fff700 1 -- 172.21.15.49:0/2678095013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4988010380 con 0x7f498c070fc0 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 -- 172.21.15.49:0/2678095013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 msgr2=0x7f498c104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 --2- 172.21.15.49:0/2678095013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c104ee0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49880098e0 tx=0x7f4988009250 comp rx=0 tx=0).stop 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 -- 172.21.15.49:0/2678095013 shutdown_connections 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 --2- 172.21.15.49:0/2678095013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c104ee0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 -- 172.21.15.49:0/2678095013 >> 172.21.15.49:0/2678095013 conn(0x7f498c0fc970 msgr2=0x7f498c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 -- 172.21.15.49:0/2678095013 shutdown_connections 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 -- 172.21.15.49:0/2678095013 wait complete. 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 Processor -- start 2023-12-16T07:33:26.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 -- start start 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.016+0000 7f49937e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c100de0 con 0x7f498c070fc0 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4991583700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4991583700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49736/0 (socket says 172.21.15.49:49736) 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4991583700 1 -- 172.21.15.49:0/1359668042 learned_addr learned my addr 172.21.15.49:0/1359668042 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4991583700 1 -- 172.21.15.49:0/1359668042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880094f0 con 0x7f498c070fc0 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4991583700 1 --2- 172.21.15.49:0/1359668042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c102960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4988006d40 tx=0x7f4988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4981ffb700 1 -- 172.21.15.49:0/1359668042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49880109b0 con 0x7f498c070fc0 2023-12-16T07:33:26.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4981ffb700 1 -- 172.21.15.49:0/1359668042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4988024440 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c100fe0 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f4981ffb700 1 -- 172.21.15.49:0/1359668042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f498801a5f0 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.017+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c1013f0 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.018+0000 7f4981ffb700 1 -- 172.21.15.49:0/1359668042 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f498801aaa0 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.018+0000 7f4981ffb700 1 -- 172.21.15.49:0/1359668042 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f498802da00 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.018+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c04bb80 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.021+0000 7f4981ffb700 1 -- 172.21.15.49:0/1359668042 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4988024970 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.091+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f498c106400 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.091+0000 7f4981ffb700 1 -- 172.21.15.49:0/1359668042 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f49880245b0 con 0x7f498c070fc0 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.092+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 msgr2=0x7f498c102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.092+0000 7f49937e7700 1 --2- 172.21.15.49:0/1359668042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c102960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4988006d40 tx=0x7f4988009250 comp rx=0 tx=0).stop 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.092+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 shutdown_connections 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.092+0000 7f49937e7700 1 --2- 172.21.15.49:0/1359668042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f498c070fc0 0x7f498c102960 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:26.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.092+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 >> 172.21.15.49:0/1359668042 conn(0x7f498c0fc970 msgr2=0x7f498c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:26.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.092+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 shutdown_connections 2023-12-16T07:33:26.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:26.092+0000 7f49937e7700 1 -- 172.21.15.49:0/1359668042 wait complete. 2023-12-16T07:33:26.454 INFO:teuthology.orchestra.run.smithi049.stdout:Restarting the monitor... 2023-12-16T07:33:26.636 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:26 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:33:26.896 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:26 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[111431]: 2023-12-16T07:33:26.635+0000 7f57d5962700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:33:26.896 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:26 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[111431]: 2023-12-16T07:33:26.635+0000 7f57d5962700 -1 mon.smithi049@0(leader) e1 *** Got Signal Terminated *** 2023-12-16T07:33:26.896 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:26 smithi049 bash[111779]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049 2023-12-16T07:33:27.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049.service: Succeeded. 2023-12-16T07:33:27.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 systemd[1]: Stopped Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:33:27.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:33:27.463 INFO:teuthology.orchestra.run.smithi049.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 7 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: pidfile_write: ignore empty --pid-file 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: load: jerasure load: lrc 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: RocksDB version: 6.15.5 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Compile date Dec 13 2023 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: DB SUMMARY 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: DB Session ID: S75B0Z04L3BT5RNABLQU 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: CURRENT file: CURRENT 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T07:33:27.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi049/store.db dir, Total Num: 1, files: 000008.sst 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi049/store.db: 000010.log size: 95334 ; 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.error_if_exists: 0 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.create_if_missing: 0 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.paranoid_checks: 1 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.env: 0x56457c1e5a80 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.fs: Posix File System 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.info_log: 0x56457e268780 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.statistics: (nil) 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.use_fsync: 0 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_log_file_size: 0 2023-12-16T07:33:27.712 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.allow_fallocate: 1 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.use_direct_reads: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.db_log_dir: 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi049/store.db 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T07:33:27.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.write_buffer_manager: 0x56457efd89f0 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T07:33:27.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.unordered_write: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.row_cache: None 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.wal_filter: None 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.preserve_deletes: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.two_write_queues: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.atomic_flush: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T07:33:27.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.log_readahead_size: 0 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 bash[111902]: 456fd7e429533704b084950cc1c12acba56dfe86e8db2e3b64720b28c6783eac 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_background_jobs: 2 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_background_compactions: -1 2023-12-16T07:33:27.716 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_subcompactions: 1 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_open_files: -1 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T07:33:27.717 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_background_flushes: -1 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Compression algorithms supported: 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kZSTD supported: 0 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kXpressCompression supported: 0 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kZlibCompression supported: 1 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kSnappyCompression supported: 1 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kLZ4Compression supported: 1 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: kBZip2Compression supported: 0 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000009 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-16T07:33:27.718 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.merge_operator: 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_filter: None 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56457e2b8f90) 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks: 1 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_top_level_index_and_filter: 1 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_type: 0 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_index_type: 0 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_shortening: 1 2023-12-16T07:33:27.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: hash_index_allow_collision: 1 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: checksum: 1 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: no_block_cache: 0 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache: 0x56457e2eb090 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_name: BinnedLRUCache 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_options: 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: capacity : 536870912 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_shard_bits : 4 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: strict_capacity_limit : 0 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: high_pri_pool_ratio: 0.000 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_compressed: (nil) 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: persistent_cache: (nil) 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size: 4096 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size_deviation: 10 2023-12-16T07:33:27.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_restart_interval: 16 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_block_restart_interval: 1 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_block_size: 4096 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: partition_filters: 0 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: use_delta_encoding: 1 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: whole_key_filtering: 1 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: verify_compression: 0 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: read_amp_bytes_per_bit: 0 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: format_version: 4 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_index_compression: 1 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_align: 0 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T07:33:27.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression: NoCompression 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.num_levels: 7 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T07:33:27.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T07:33:27.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.arena_block_size: 4194304 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T07:33:27.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.table_properties_collectors: 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.inplace_update_support: 0 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T07:33:27.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.bloom_locality: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.max_successive_merges: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.ttl: 2592000 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.enable_blob_files: false 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.min_blob_size: 0 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T07:33:27.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712007460236, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712007461090, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90860, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88955, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81733, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702712007, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "90771433-885f-4799-9aeb-a4f8e278a245", "db_session_id": "S75B0Z04L3BT5RNABLQU"}} 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712007461460, "job": 1, "event": "recovery_finished"} 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi049/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x56457e27f180 2023-12-16T07:33:27.727 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: DB pointer 0x56457e354000 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** DB Stats ** 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T07:33:27.728 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.4 0.00 0.00 1 0.001 0 0 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T07:33:27.729 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative compaction: 0.00 GB write, 27.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval compaction: 0.00 GB write, 27.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.4 0.00 0.00 1 0.001 0 0 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:33:27.730 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.4 0.00 0.00 1 0.001 0 0 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative compaction: 0.00 GB write, 27.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T07:33:27.731 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 systemd[1]: Started Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: starting mon.smithi049 rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi049 fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???) e1 preinit fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???).mds e1 new map 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???).mds e1 print_map 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: e1 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: legacy client fscid: -1 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: No filesystems configured 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T07:33:27.732 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T07:33:27.733 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T07:33:27.733 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T07:33:27.733 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:27 smithi049 ceph-mon[111939]: mon.smithi049@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.802+0000 7f992e868700 1 Processor -- start 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.802+0000 7f992e868700 1 -- start start 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.802+0000 7f992e868700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.802+0000 7f992e868700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9928105430 con 0x7f9928076c00 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.803+0000 7f9927fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.803+0000 7f9927fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34070/0 (socket says 172.21.15.49:34070) 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.803+0000 7f9927fff700 1 -- 172.21.15.49:0/2138770649 learned_addr learned my addr 172.21.15.49:0/2138770649 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.803+0000 7f9927fff700 1 -- 172.21.15.49:0/2138770649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9928105570 con 0x7f9928076c00 2023-12-16T07:33:28.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.803+0000 7f9927fff700 1 --2- 172.21.15.49:0/2138770649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928104ef0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f99180098e0 tx=0x7f9918009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53e8628a2bcec6e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.803+0000 7f9926ffd700 1 -- 172.21.15.49:0/2138770649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f991800b860 con 0x7f9928076c00 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f9926ffd700 1 -- 172.21.15.49:0/2138770649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f991800be30 con 0x7f9928076c00 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f9926ffd700 1 -- 172.21.15.49:0/2138770649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9918010380 con 0x7f9928076c00 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f992e868700 1 -- 172.21.15.49:0/2138770649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 msgr2=0x7f9928104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f992e868700 1 --2- 172.21.15.49:0/2138770649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928104ef0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f99180098e0 tx=0x7f9918009250 comp rx=0 tx=0).stop 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f992e868700 1 -- 172.21.15.49:0/2138770649 shutdown_connections 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f992e868700 1 --2- 172.21.15.49:0/2138770649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928104ef0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:28.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f992e868700 1 -- 172.21.15.49:0/2138770649 >> 172.21.15.49:0/2138770649 conn(0x7f99280fc980 msgr2=0x7f99280fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f992e868700 1 -- 172.21.15.49:0/2138770649 shutdown_connections 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.804+0000 7f992e868700 1 -- 172.21.15.49:0/2138770649 wait complete. 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.805+0000 7f992e868700 1 Processor -- start 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.805+0000 7f992e868700 1 -- start start 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.805+0000 7f992e868700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.805+0000 7f992e868700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99281116d0 con 0x7f9928076c00 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.805+0000 7f9927fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.805+0000 7f9927fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34080/0 (socket says 172.21.15.49:34080) 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.805+0000 7f9927fff700 1 -- 172.21.15.49:0/1729354390 learned_addr learned my addr 172.21.15.49:0/1729354390 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f9927fff700 1 -- 172.21.15.49:0/1729354390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180094f0 con 0x7f9928076c00 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f9927fff700 1 --2- 172.21.15.49:0/1729354390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928111190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9918006d40 tx=0x7f9918009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f9924ff9700 1 -- 172.21.15.49:0/1729354390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99180109b0 con 0x7f9928076c00 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f9924ff9700 1 -- 172.21.15.49:0/1729354390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9918024440 con 0x7f9928076c00 2023-12-16T07:33:28.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99281118d0 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f9924ff9700 1 -- 172.21.15.49:0/1729354390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f991801a5f0 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9928111ce0 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f9924ff9700 1 -- 172.21.15.49:0/1729354390 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f991801aaa0 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.806+0000 7f9924ff9700 1 -- 172.21.15.49:0/1729354390 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f991802da40 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.807+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992804bb80 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.809+0000 7f9924ff9700 1 -- 172.21.15.49:0/1729354390 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9918024970 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.879+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f99281062f0 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.881+0000 7f9924ff9700 1 -- 172.21.15.49:0/1729354390 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f99281062f0 con 0x7f9928076c00 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.882+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 msgr2=0x7f9928111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.882+0000 7f992e868700 1 --2- 172.21.15.49:0/1729354390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928111190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9918006d40 tx=0x7f9918009250 comp rx=0 tx=0).stop 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.882+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 shutdown_connections 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.882+0000 7f992e868700 1 --2- 172.21.15.49:0/1729354390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9928076c00 0x7f9928111190 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.882+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 >> 172.21.15.49:0/1729354390 conn(0x7f99280fc980 msgr2=0x7f99280fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.882+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 shutdown_connections 2023-12-16T07:33:28.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:27.882+0000 7f992e868700 1 -- 172.21.15.49:0/1729354390 wait complete. 2023-12-16T07:33:28.313 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-16T07:33:28.313 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-16T07:33:28.313 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mgr... 2023-12-16T07:33:28.313 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 9283 ... 2023-12-16T07:33:28.442 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mgr.smithi049.rqlvwo 2023-12-16T07:33:28.443 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mgr.smithi049.rqlvwo.service: Unit ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mgr.smithi049.rqlvwo.service not loaded. 2023-12-16T07:33:28.536 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715.target.wants/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mgr.smithi049.rqlvwo.service → /etc/systemd/system/ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@.service. 2023-12-16T07:33:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:28 smithi049 ceph-mon[111939]: mon.smithi049 is new leader, mons smithi049 in quorum (ranks 0) 2023-12-16T07:33:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:28 smithi049 ceph-mon[111939]: monmap e1: 1 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:33:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:28 smithi049 ceph-mon[111939]: fsmap 2023-12-16T07:33:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:28 smithi049 ceph-mon[111939]: osdmap e1: 0 total, 0 up, 0 in 2023-12-16T07:33:28.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:28 smithi049 ceph-mon[111939]: mgrmap e1: no daemons active 2023-12-16T07:33:28.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:28 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1729354390' entity='client.admin' 2023-12-16T07:33:28.976 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T07:33:28.976 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2023-12-16T07:33:28.985 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T07:33:28.985 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2023-12-16T07:33:28.985 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2023-12-16T07:33:28.985 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2023-12-16T07:33:28.993 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T07:33:28.994 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2023-12-16T07:33:29.002 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T07:33:29.002 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2023-12-16T07:33:29.002 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2023-12-16T07:33:29.002 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-16T07:33:29.003 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr to start... 2023-12-16T07:33:29.003 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr... 2023-12-16T07:33:29.610 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:29 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2452251835' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "4ed9995e-9be5-11ee-95a5-87774f69a715", 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2023-12-16T07:33:30.838 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "smithi049" 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T07:33:30.839 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:30.840 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:30.841 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T07:33:24.032682+0000", 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.403+0000 7fc7bb805700 1 Processor -- start 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.403+0000 7fc7bb805700 1 -- start start 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.403+0000 7fc7bb805700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b41015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.403+0000 7fc7bb805700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4101b20 con 0x7fc7b41011d0 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.404+0000 7fc7b95a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b41015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.404+0000 7fc7b95a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b41015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34120/0 (socket says 172.21.15.49:34120) 2023-12-16T07:33:30.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.404+0000 7fc7b95a1700 1 -- 172.21.15.49:0/3092797137 learned_addr learned my addr 172.21.15.49:0/3092797137 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.404+0000 7fc7b95a1700 1 -- 172.21.15.49:0/3092797137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4101c60 con 0x7fc7b41011d0 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.404+0000 7fc7b95a1700 1 --2- 172.21.15.49:0/3092797137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b41015e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00098e0 tx=0x7fc7b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcc42820317232a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.404+0000 7fc7abfff700 1 -- 172.21.15.49:0/3092797137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7b000b860 con 0x7fc7b41011d0 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.404+0000 7fc7abfff700 1 -- 172.21.15.49:0/3092797137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc7b000be30 con 0x7fc7b41011d0 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7abfff700 1 -- 172.21.15.49:0/3092797137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7b0010380 con 0x7fc7b41011d0 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7bb805700 1 -- 172.21.15.49:0/3092797137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 msgr2=0x7fc7b41015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7bb805700 1 --2- 172.21.15.49:0/3092797137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b41015e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00098e0 tx=0x7fc7b0009250 comp rx=0 tx=0).stop 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7bb805700 1 -- 172.21.15.49:0/3092797137 shutdown_connections 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7bb805700 1 --2- 172.21.15.49:0/3092797137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b41015e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7bb805700 1 -- 172.21.15.49:0/3092797137 >> 172.21.15.49:0/3092797137 conn(0x7fc7b40fc970 msgr2=0x7fc7b40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7bb805700 1 -- 172.21.15.49:0/3092797137 shutdown_connections 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.405+0000 7fc7bb805700 1 -- 172.21.15.49:0/3092797137 wait complete. 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7bb805700 1 Processor -- start 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7bb805700 1 -- start start 2023-12-16T07:33:30.843 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7bb805700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b4113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7bb805700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4070fb0 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7b95a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b4113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7b95a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b4113e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34130/0 (socket says 172.21.15.49:34130) 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7b95a1700 1 -- 172.21.15.49:0/2452251835 learned_addr learned my addr 172.21.15.49:0/2452251835 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.406+0000 7fc7b95a1700 1 -- 172.21.15.49:0/2452251835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00094f0 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7b95a1700 1 --2- 172.21.15.49:0/2452251835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b4113e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000c00 tx=0x7fc7b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7a9ffb700 1 -- 172.21.15.49:0/2452251835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7b0010a80 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7a9ffb700 1 -- 172.21.15.49:0/2452251835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc7b001a430 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b40711b0 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7a9ffb700 1 -- 172.21.15.49:0/2452251835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7b00245b0 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b4114530 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7a9ffb700 1 -- 172.21.15.49:0/2452251835 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc7b0024a20 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.407+0000 7fc7a9ffb700 1 -- 172.21.15.49:0/2452251835 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc7b002eb00 con 0x7fc7b41011d0 2023-12-16T07:33:30.844 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.408+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b410a050 con 0x7fc7b41011d0 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.410+0000 7fc7a9ffb700 1 -- 172.21.15.49:0/2452251835 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc7b001a960 con 0x7fc7b41011d0 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.484+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc7b4102fe0 con 0x7fc7b41011d0 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.485+0000 7fc7a9ffb700 1 -- 172.21.15.49:0/2452251835 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc7b002ecc0 con 0x7fc7b41011d0 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.486+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 msgr2=0x7fc7b4113e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.486+0000 7fc7bb805700 1 --2- 172.21.15.49:0/2452251835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b4113e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000c00 tx=0x7fc7b0009250 comp rx=0 tx=0).stop 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.486+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 shutdown_connections 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.486+0000 7fc7bb805700 1 --2- 172.21.15.49:0/2452251835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b41011d0 0x7fc7b4113e30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.486+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 >> 172.21.15.49:0/2452251835 conn(0x7fc7b40fc970 msgr2=0x7fc7b40fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.486+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 shutdown_connections 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:29.486+0000 7fc7bb805700 1 -- 172.21.15.49:0/2452251835 wait complete. 2023-12-16T07:33:30.845 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (1/15)... 2023-12-16T07:33:33.506 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:33 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/306442265' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T07:33:33.652 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:33.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:33:33.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "4ed9995e-9be5-11ee-95a5-87774f69a715", 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "smithi049" 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-12-16T07:33:33.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:33.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T07:33:33.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T07:33:33.666 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:33.669 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T07:33:24.032682+0000", 2023-12-16T07:33:33.669 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.216+0000 7ff9bd74e700 1 Processor -- start 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.216+0000 7ff9bd74e700 1 -- start start 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.217+0000 7ff9bd74e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.217+0000 7ff9bd74e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8077fc0 con 0x7ff9b8077bb0 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.217+0000 7ff9b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.217+0000 7ff9b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34136/0 (socket says 172.21.15.49:34136) 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.217+0000 7ff9b6ffd700 1 -- 172.21.15.49:0/1430832858 learned_addr learned my addr 172.21.15.49:0/1430832858 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.217+0000 7ff9b6ffd700 1 -- 172.21.15.49:0/1430832858 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8076600 con 0x7ff9b8077bb0 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.217+0000 7ff9b6ffd700 1 --2- 172.21.15.49:0/1430832858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b80760c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80098e0 tx=0x7ff9a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8eed6562cbb0364 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.218+0000 7ff9b5ffb700 1 -- 172.21.15.49:0/1430832858 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a800b860 con 0x7ff9b8077bb0 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.218+0000 7ff9b5ffb700 1 -- 172.21.15.49:0/1430832858 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff9a800be30 con 0x7ff9b8077bb0 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.218+0000 7ff9b5ffb700 1 -- 172.21.15.49:0/1430832858 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a8010380 con 0x7ff9b8077bb0 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.218+0000 7ff9bd74e700 1 -- 172.21.15.49:0/1430832858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 msgr2=0x7ff9b80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.218+0000 7ff9bd74e700 1 --2- 172.21.15.49:0/1430832858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b80760c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80098e0 tx=0x7ff9a8009250 comp rx=0 tx=0).stop 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 -- 172.21.15.49:0/1430832858 shutdown_connections 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 --2- 172.21.15.49:0/1430832858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b80760c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 -- 172.21.15.49:0/1430832858 >> 172.21.15.49:0/1430832858 conn(0x7ff9b80fda50 msgr2=0x7ff9b80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 -- 172.21.15.49:0/1430832858 shutdown_connections 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 -- 172.21.15.49:0/1430832858 wait complete. 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 Processor -- start 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 -- start start 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.219+0000 7ff9bd74e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8113910 con 0x7ff9b8077bb0 2023-12-16T07:33:33.671 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff9b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff9b6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34138/0 (socket says 172.21.15.49:34138) 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff9b6ffd700 1 -- 172.21.15.49:0/306442265 learned_addr learned my addr 172.21.15.49:0/306442265 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff9b6ffd700 1 -- 172.21.15.49:0/306442265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80094f0 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff9b6ffd700 1 --2- 172.21.15.49:0/306442265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b81133d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8006fd0 tx=0x7ff9a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff99f7fe700 1 -- 172.21.15.49:0/306442265 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a8010750 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff99f7fe700 1 -- 172.21.15.49:0/306442265 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff9a8010d20 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b8113b10 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff99f7fe700 1 -- 172.21.15.49:0/306442265 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a801ada0 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.220+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b8113f20 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.221+0000 7ff99f7fe700 1 -- 172.21.15.49:0/306442265 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff9a8024680 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.221+0000 7ff99f7fe700 1 -- 172.21.15.49:0/306442265 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff9a8019840 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.221+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b804bb80 con 0x7ff9b8077bb0 2023-12-16T07:33:33.672 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.223+0000 7ff99f7fe700 1 -- 172.21.15.49:0/306442265 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff9a8029060 con 0x7ff9b8077bb0 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.297+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff9b810cdb0 con 0x7ff9b8077bb0 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.298+0000 7ff99f7fe700 1 -- 172.21.15.49:0/306442265 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7ff9a8020070 con 0x7ff9b8077bb0 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.299+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 msgr2=0x7ff9b81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.299+0000 7ff9bd74e700 1 --2- 172.21.15.49:0/306442265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b81133d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8006fd0 tx=0x7ff9a8009250 comp rx=0 tx=0).stop 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.299+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 shutdown_connections 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.299+0000 7ff9bd74e700 1 --2- 172.21.15.49:0/306442265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b8077bb0 0x7ff9b81133d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.299+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 >> 172.21.15.49:0/306442265 conn(0x7ff9b80fda50 msgr2=0x7ff9b80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.299+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 shutdown_connections 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:33.299+0000 7ff9bd74e700 1 -- 172.21.15.49:0/306442265 wait complete. 2023-12-16T07:33:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (2/15)... 2023-12-16T07:33:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: mgrmap e2: smithi049.rqlvwo(active, starting, since 0.00284353s) 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:33:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:33:35.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:35.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:33:35.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:35.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:35 smithi049 ceph-mon[111939]: from='mgr.14100 172.21.15.49:0/502849553' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "4ed9995e-9be5-11ee-95a5-87774f69a715", 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:36.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T07:33:36.438 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "smithi049" 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T07:33:36.447 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T07:33:36.448 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T07:33:36.449 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T07:33:36.449 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T07:33:36.449 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T07:33:36.449 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T07:33:36.449 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T07:33:36.449 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T07:33:36.449 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T07:33:24.032682+0000", 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a0e872700 1 Processor -- start 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a0e872700 1 -- start start 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a0e872700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a081026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a0e872700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08102c20 con 0x7f0a081022d0 2023-12-16T07:33:36.451 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a081026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a081026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34210/0 (socket says 172.21.15.49:34210) 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a07fff700 1 -- 172.21.15.49:0/53904322 learned_addr learned my addr 172.21.15.49:0/53904322 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a07fff700 1 -- 172.21.15.49:0/53904322 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a08102d60 con 0x7f0a081022d0 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a07fff700 1 --2- 172.21.15.49:0/53904322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a081026e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f09f80098e0 tx=0x7f09f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e88791b09a5530 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a06ffd700 1 -- 172.21.15.49:0/53904322 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f800b860 con 0x7f0a081022d0 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a06ffd700 1 -- 172.21.15.49:0/53904322 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f09f800be30 con 0x7f0a081022d0 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.012+0000 7f0a06ffd700 1 -- 172.21.15.49:0/53904322 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f8010380 con 0x7f0a081022d0 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.013+0000 7f0a0e872700 1 -- 172.21.15.49:0/53904322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 msgr2=0x7f0a081026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.013+0000 7f0a0e872700 1 --2- 172.21.15.49:0/53904322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a081026e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f09f80098e0 tx=0x7f09f8009250 comp rx=0 tx=0).stop 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.013+0000 7f0a0e872700 1 -- 172.21.15.49:0/53904322 shutdown_connections 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.013+0000 7f0a0e872700 1 --2- 172.21.15.49:0/53904322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a081026e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.013+0000 7f0a0e872700 1 -- 172.21.15.49:0/53904322 >> 172.21.15.49:0/53904322 conn(0x7f0a080fda50 msgr2=0x7f0a080ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.013+0000 7f0a0e872700 1 -- 172.21.15.49:0/53904322 shutdown_connections 2023-12-16T07:33:36.452 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.013+0000 7f0a0e872700 1 -- 172.21.15.49:0/53904322 wait complete. 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.014+0000 7f0a0e872700 1 Processor -- start 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.014+0000 7f0a0e872700 1 -- start start 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.014+0000 7f0a0e872700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a08111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.014+0000 7f0a0e872700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08111680 con 0x7f0a081022d0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.014+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a08111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.014+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a08111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34220/0 (socket says 172.21.15.49:34220) 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.014+0000 7f0a07fff700 1 -- 172.21.15.49:0/1797249471 learned_addr learned my addr 172.21.15.49:0/1797249471 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.015+0000 7f0a07fff700 1 -- 172.21.15.49:0/1797249471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f80094f0 con 0x7f0a081022d0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.015+0000 7f0a07fff700 1 --2- 172.21.15.49:0/1797249471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a08111140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f09f8006b00 tx=0x7f09f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.015+0000 7f0a04ff9700 1 -- 172.21.15.49:0/1797249471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f80109b0 con 0x7f0a081022d0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.015+0000 7f0a04ff9700 1 -- 172.21.15.49:0/1797249471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f09f8024440 con 0x7f0a081022d0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.015+0000 7f0a04ff9700 1 -- 172.21.15.49:0/1797249471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09f801a5f0 con 0x7f0a081022d0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.015+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a08111880 con 0x7f0a081022d0 2023-12-16T07:33:36.453 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.015+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a08111c90 con 0x7f0a081022d0 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.016+0000 7f0a04ff9700 1 -- 172.21.15.49:0/1797249471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 2) v1 ==== 43037+0+0 (secure 0 0 0) 0x7f09f801a860 con 0x7f0a081022d0 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.016+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0804bb80 con 0x7f0a081022d0 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.016+0000 7f0a04ff9700 1 -- 172.21.15.49:0/1797249471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f09f804a1c0 con 0x7f0a081022d0 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.019+0000 7f0a04ff9700 1 -- 172.21.15.49:0/1797249471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f09f8024790 con 0x7f0a081022d0 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.092+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0a0810af50 con 0x7f0a081022d0 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.092+0000 7f0a04ff9700 1 -- 172.21.15.49:0/1797249471 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f09f8023b50 con 0x7f0a081022d0 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.093+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 msgr2=0x7f0a08111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.093+0000 7f0a0e872700 1 --2- 172.21.15.49:0/1797249471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a08111140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f09f8006b00 tx=0x7f09f8009250 comp rx=0 tx=0).stop 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.093+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 shutdown_connections 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.093+0000 7f0a0e872700 1 --2- 172.21.15.49:0/1797249471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a081022d0 0x7f0a08111140 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.093+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 >> 172.21.15.49:0/1797249471 conn(0x7f0a080fda50 msgr2=0x7f0a080ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.093+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 shutdown_connections 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:36.093+0000 7f0a0e872700 1 -- 172.21.15.49:0/1797249471 wait complete. 2023-12-16T07:33:36.454 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (3/15)... 2023-12-16T07:33:37.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:36 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1797249471' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T07:33:37.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:36 smithi049 ceph-mon[111939]: mgrmap e3: smithi049.rqlvwo(active, since 1.00592s) 2023-12-16T07:33:39.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:39.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:33:39.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "4ed9995e-9be5-11ee-95a5-87774f69a715", 2023-12-16T07:33:39.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2023-12-16T07:33:39.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-16T07:33:39.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-16T07:33:39.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-16T07:33:39.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:39.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-16T07:33:39.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-16T07:33:39.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2023-12-16T07:33:39.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:39.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-16T07:33:39.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "smithi049" 2023-12-16T07:33:39.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:39.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-12-16T07:33:39.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-16T07:33:39.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:39.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-16T07:33:39.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-16T07:33:39.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:39.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-16T07:33:39.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:39.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-16T07:33:39.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-16T07:33:39.470 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-16T07:33:39.471 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-16T07:33:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-16T07:33:39.473 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-16T07:33:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2023-12-16T07:33:24.032682+0000", 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.822+0000 7f8ce6f0e700 1 Processor -- start 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.822+0000 7f8ce6f0e700 1 -- start start 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.822+0000 7f8ce6f0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce01072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.822+0000 7f8ce6f0e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0102cd0 con 0x7f8ce0070fc0 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.822+0000 7f8ce4caa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce01072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.822+0000 7f8ce4caa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce01072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44296/0 (socket says 172.21.15.49:44296) 2023-12-16T07:33:39.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.822+0000 7f8ce4caa700 1 -- 172.21.15.49:0/3272422982 learned_addr learned my addr 172.21.15.49:0/3272422982 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce4caa700 1 -- 172.21.15.49:0/3272422982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0107820 con 0x7f8ce0070fc0 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce4caa700 1 --2- 172.21.15.49:0/3272422982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce01072e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40098e0 tx=0x7f8cd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4ecc6c0b6672d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8cdf7fe700 1 -- 172.21.15.49:0/3272422982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd400b860 con 0x7f8ce0070fc0 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8cdf7fe700 1 -- 172.21.15.49:0/3272422982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8cd400be30 con 0x7f8ce0070fc0 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8cdf7fe700 1 -- 172.21.15.49:0/3272422982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd4010380 con 0x7f8ce0070fc0 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/3272422982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 msgr2=0x7f8ce01072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce6f0e700 1 --2- 172.21.15.49:0/3272422982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce01072e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40098e0 tx=0x7f8cd4009250 comp rx=0 tx=0).stop 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/3272422982 shutdown_connections 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce6f0e700 1 --2- 172.21.15.49:0/3272422982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce01072e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/3272422982 >> 172.21.15.49:0/3272422982 conn(0x7f8ce00fc970 msgr2=0x7f8ce00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.823+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/3272422982 shutdown_connections 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/3272422982 wait complete. 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce6f0e700 1 Processor -- start 2023-12-16T07:33:39.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce6f0e700 1 -- start start 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce6f0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce0113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce6f0e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce01138c0 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce4caa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce0113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce4caa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce0113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44310/0 (socket says 172.21.15.49:44310) 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.824+0000 7f8ce4caa700 1 -- 172.21.15.49:0/774990087 learned_addr learned my addr 172.21.15.49:0/774990087 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.825+0000 7f8ce4caa700 1 -- 172.21.15.49:0/774990087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40094f0 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.825+0000 7f8ce4caa700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce0113380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4006b00 tx=0x7f8cd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.825+0000 7f8cdd7fa700 1 -- 172.21.15.49:0/774990087 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd4010a80 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.825+0000 7f8cdd7fa700 1 -- 172.21.15.49:0/774990087 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8cd401a430 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.825+0000 7f8cdd7fa700 1 -- 172.21.15.49:0/774990087 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd40245b0 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.825+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce0113ac0 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.825+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce0113ed0 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.826+0000 7f8cdd7fa700 1 -- 172.21.15.49:0/774990087 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f8cd4024830 con 0x7f8ce0070fc0 2023-12-16T07:33:39.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.826+0000 7f8cdd7fa700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f8cd00365a0 0x7f8cd0038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.826+0000 7f8cdd7fa700 1 -- 172.21.15.49:0/774990087 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8cd404aa80 con 0x7f8ce0070fc0 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.826+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce004bb80 con 0x7f8ce0070fc0 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.826+0000 7f8cdffff700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f8cd00365a0 0x7f8cd0038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.826+0000 7f8cdffff700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f8cd00365a0 0x7f8cd0038a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009990 tx=0x7f8ccc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:38.831+0000 7f8cdd7fa700 1 -- 172.21.15.49:0/774990087 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8cd4018350 con 0x7f8ce0070fc0 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.105+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8ce010d140 con 0x7f8ce0070fc0 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.105+0000 7f8cdd7fa700 1 -- 172.21.15.49:0/774990087 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f8cd402cb30 con 0x7f8ce0070fc0 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f8cd00365a0 msgr2=0x7f8cd0038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f8cd00365a0 0x7f8cd0038a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009990 tx=0x7f8ccc006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 msgr2=0x7f8ce0113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce0113380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4006b00 tx=0x7f8cd4009250 comp rx=0 tx=0).stop 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 shutdown_connections 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f8cd00365a0 0x7f8cd0038a50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:39.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 --2- 172.21.15.49:0/774990087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ce0070fc0 0x7f8ce0113380 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:39.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 >> 172.21.15.49:0/774990087 conn(0x7f8ce00fc970 msgr2=0x7f8ce00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:39.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 shutdown_connections 2023-12-16T07:33:39.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.107+0000 7f8ce6f0e700 1 -- 172.21.15.49:0/774990087 wait complete. 2023-12-16T07:33:39.479 INFO:teuthology.orchestra.run.smithi049.stdout:mgr is available 2023-12-16T07:33:39.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:39 smithi049 ceph-mon[111939]: mgrmap e4: smithi049.rqlvwo(active, since 2s) 2023-12-16T07:33:39.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:39 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/774990087' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:40.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.845+0000 7fed3fa9d700 1 Processor -- start 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.845+0000 7fed3fa9d700 1 -- start start 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.845+0000 7fed3fa9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.845+0000 7fed3fa9d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38104240 con 0x7fed381038f0 2023-12-16T07:33:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.845+0000 7fed3d839700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.845+0000 7fed3d839700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44320/0 (socket says 172.21.15.49:44320) 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.845+0000 7fed3d839700 1 -- 172.21.15.49:0/778809491 learned_addr learned my addr 172.21.15.49:0/778809491 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.846+0000 7fed3d839700 1 -- 172.21.15.49:0/778809491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38104380 con 0x7fed381038f0 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.846+0000 7fed3d839700 1 --2- 172.21.15.49:0/778809491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38103d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed340098e0 tx=0x7fed34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf8633e1097c50a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.846+0000 7fed3c837700 1 -- 172.21.15.49:0/778809491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed3400b860 con 0x7fed381038f0 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.846+0000 7fed3c837700 1 -- 172.21.15.49:0/778809491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fed3400be30 con 0x7fed381038f0 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.846+0000 7fed3c837700 1 -- 172.21.15.49:0/778809491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed34010380 con 0x7fed381038f0 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 -- 172.21.15.49:0/778809491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 msgr2=0x7fed38103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 --2- 172.21.15.49:0/778809491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38103d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed340098e0 tx=0x7fed34009250 comp rx=0 tx=0).stop 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 -- 172.21.15.49:0/778809491 shutdown_connections 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 --2- 172.21.15.49:0/778809491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38103d00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 -- 172.21.15.49:0/778809491 >> 172.21.15.49:0/778809491 conn(0x7fed380fc010 msgr2=0x7fed380fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 -- 172.21.15.49:0/778809491 shutdown_connections 2023-12-16T07:33:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 -- 172.21.15.49:0/778809491 wait complete. 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 Processor -- start 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 -- start start 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38111010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.847+0000 7fed3fa9d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38111550 con 0x7fed381038f0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed3d839700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38111010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed3d839700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38111010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44334/0 (socket says 172.21.15.49:44334) 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed3d839700 1 -- 172.21.15.49:0/4292689046 learned_addr learned my addr 172.21.15.49:0/4292689046 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed3d839700 1 -- 172.21.15.49:0/4292689046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340094f0 con 0x7fed381038f0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed3d839700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38111010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fed34006b00 tx=0x7fed34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed2e7fc700 1 -- 172.21.15.49:0/4292689046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed340109b0 con 0x7fed381038f0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed2e7fc700 1 -- 172.21.15.49:0/4292689046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fed3401a430 con 0x7fed381038f0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed38111750 con 0x7fed381038f0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed2e7fc700 1 -- 172.21.15.49:0/4292689046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed340245b0 con 0x7fed381038f0 2023-12-16T07:33:40.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.848+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed38111b60 con 0x7fed381038f0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.849+0000 7fed2e7fc700 1 -- 172.21.15.49:0/4292689046 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fed340247e0 con 0x7fed381038f0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.849+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3804bb80 con 0x7fed381038f0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.849+0000 7fed2e7fc700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7fed240365f0 0x7fed24038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.849+0000 7fed2e7fc700 1 -- 172.21.15.49:0/4292689046 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fed3404ac50 con 0x7fed381038f0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.849+0000 7fed3d038700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7fed240365f0 0x7fed24038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.850+0000 7fed3d038700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7fed240365f0 0x7fed24038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fed28009990 tx=0x7fed28006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:39.854+0000 7fed2e7fc700 1 -- 172.21.15.49:0/4292689046 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fed34018350 con 0x7fed381038f0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.051+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fed38100d40 con 0x7fed381038f0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.052+0000 7fed2e7fc700 1 -- 172.21.15.49:0/4292689046 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fed3402cb30 con 0x7fed381038f0 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.054+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7fed240365f0 msgr2=0x7fed24038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.054+0000 7fed3fa9d700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7fed240365f0 0x7fed24038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fed28009990 tx=0x7fed28006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.054+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 msgr2=0x7fed38111010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:40.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.054+0000 7fed3fa9d700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38111010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fed34006b00 tx=0x7fed34009250 comp rx=0 tx=0).stop 2023-12-16T07:33:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.054+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 shutdown_connections 2023-12-16T07:33:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.054+0000 7fed3fa9d700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7fed240365f0 0x7fed24038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.054+0000 7fed3fa9d700 1 --2- 172.21.15.49:0/4292689046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed381038f0 0x7fed38111010 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.055+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 >> 172.21.15.49:0/4292689046 conn(0x7fed380fc010 msgr2=0x7fed380fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.055+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 shutdown_connections 2023-12-16T07:33:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.055+0000 7fed3fa9d700 1 -- 172.21.15.49:0/4292689046 wait complete. 2023-12-16T07:33:40.413 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling cephadm module... 2023-12-16T07:33:40.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:40 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/4292689046' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-16T07:33:41.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:41 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2571998279' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-16T07:33:41.832 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.805+0000 7f7096d11700 1 Processor -- start 2023-12-16T07:33:41.832 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.805+0000 7f7096d11700 1 -- start start 2023-12-16T07:33:41.832 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.805+0000 7f7096d11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f70900771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:41.832 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.805+0000 7f7096d11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090077710 con 0x7f7090078dc0 2023-12-16T07:33:41.832 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.805+0000 7f7094aad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f70900771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:41.832 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.805+0000 7f7094aad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f70900771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44348/0 (socket says 172.21.15.49:44348) 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.805+0000 7f7094aad700 1 -- 172.21.15.49:0/2902999538 learned_addr learned my addr 172.21.15.49:0/2902999538 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.806+0000 7f7094aad700 1 -- 172.21.15.49:0/2902999538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090077850 con 0x7f7090078dc0 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.806+0000 7f7094aad700 1 --2- 172.21.15.49:0/2902999538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f70900771d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f70840098e0 tx=0x7f7084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134a375c8dca35a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.806+0000 7f708f7fe700 1 -- 172.21.15.49:0/2902999538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f708400b860 con 0x7f7090078dc0 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.806+0000 7f708f7fe700 1 -- 172.21.15.49:0/2902999538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f708400be30 con 0x7f7090078dc0 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.806+0000 7f708f7fe700 1 -- 172.21.15.49:0/2902999538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7084010380 con 0x7f7090078dc0 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.806+0000 7f7096d11700 1 -- 172.21.15.49:0/2902999538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 msgr2=0x7f70900771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.806+0000 7f7096d11700 1 --2- 172.21.15.49:0/2902999538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f70900771d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f70840098e0 tx=0x7f7084009250 comp rx=0 tx=0).stop 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.807+0000 7f7096d11700 1 -- 172.21.15.49:0/2902999538 shutdown_connections 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.807+0000 7f7096d11700 1 --2- 172.21.15.49:0/2902999538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f70900771d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.807+0000 7f7096d11700 1 -- 172.21.15.49:0/2902999538 >> 172.21.15.49:0/2902999538 conn(0x7f70900fda40 msgr2=0x7f70900ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.807+0000 7f7096d11700 1 -- 172.21.15.49:0/2902999538 shutdown_connections 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.807+0000 7f7096d11700 1 -- 172.21.15.49:0/2902999538 wait complete. 2023-12-16T07:33:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.807+0000 7f7096d11700 1 Processor -- start 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.807+0000 7f7096d11700 1 -- start start 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f7096d11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f7090113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f7096d11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090113880 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f7094aad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f7090113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f7094aad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f7090113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44364/0 (socket says 172.21.15.49:44364) 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f7094aad700 1 -- 172.21.15.49:0/2571998279 learned_addr learned my addr 172.21.15.49:0/2571998279 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f7094aad700 1 -- 172.21.15.49:0/2571998279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840094f0 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f7094aad700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f7090113340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f70840090b0 tx=0x7f7084009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7084010a80 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.808+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f708401a430 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.809+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7090113a80 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.809+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70840245b0 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.809+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7090113e90 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.809+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f7084010be0 con 0x7f7090078dc0 2023-12-16T07:33:41.834 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.810+0000 7f708d7fa700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f70800365a0 0x7f7080038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.810+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7090108620 con 0x7f7090078dc0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.810+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f708404a120 con 0x7f7090078dc0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.810+0000 7f708ffff700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f70800365a0 0x7f7080038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.810+0000 7f708ffff700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f70800365a0 0x7f7080038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f707c009990 tx=0x7f707c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:40.814+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f708401a5a0 con 0x7f7090078dc0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.066+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f709010d1f0 con 0x7f7090078dc0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.473+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f708402d3f0 con 0x7f7090078dc0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.475+0000 7f708d7fa700 1 -- 172.21.15.49:0/2571998279 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f7084019ae0 con 0x7f7090078dc0 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f70800365a0 msgr2=0x7f7080038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f70800365a0 0x7f7080038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f707c009990 tx=0x7f707c006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 msgr2=0x7f7090113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f7090113340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f70840090b0 tx=0x7f7084009250 comp rx=0 tx=0).stop 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 shutdown_connections 2023-12-16T07:33:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f70800365a0 0x7f7080038a50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:41.836 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 --2- 172.21.15.49:0/2571998279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090078dc0 0x7f7090113340 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:41.836 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 >> 172.21.15.49:0/2571998279 conn(0x7f70900fda40 msgr2=0x7f70900ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:41.836 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 shutdown_connections 2023-12-16T07:33:41.836 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:41.477+0000 7f7096d11700 1 -- 172.21.15.49:0/2571998279 wait complete. 2023-12-16T07:33:42.876 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:42 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2571998279' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-16T07:33:42.877 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:42 smithi049 ceph-mon[111939]: mgrmap e5: smithi049.rqlvwo(active, since 5s) 2023-12-16T07:33:42.877 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:42 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2403995940' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "smithi049.rqlvwo", 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.182+0000 7f56cfc74700 1 Processor -- start 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.183+0000 7f56cfc74700 1 -- start start 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.183+0000 7f56cfc74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.183+0000 7f56cfc74700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8078000 con 0x7f56c8077bf0 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.183+0000 7f56cda10700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.183+0000 7f56cda10700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44396/0 (socket says 172.21.15.49:44396) 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.183+0000 7f56cda10700 1 -- 172.21.15.49:0/2187775876 learned_addr learned my addr 172.21.15.49:0/2187775876 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.184+0000 7f56cda10700 1 -- 172.21.15.49:0/2187775876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c8076640 con 0x7f56c8077bf0 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.184+0000 7f56cda10700 1 --2- 172.21.15.49:0/2187775876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8076100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56c40098e0 tx=0x7f56c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e310531afd42504 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.184+0000 7f56cca0e700 1 -- 172.21.15.49:0/2187775876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c400b860 con 0x7f56c8077bf0 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.184+0000 7f56cca0e700 1 -- 172.21.15.49:0/2187775876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f56c400be30 con 0x7f56c8077bf0 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.184+0000 7f56cca0e700 1 -- 172.21.15.49:0/2187775876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c4010380 con 0x7f56c8077bf0 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.184+0000 7f56cfc74700 1 -- 172.21.15.49:0/2187775876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 msgr2=0x7f56c8076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 --2- 172.21.15.49:0/2187775876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8076100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56c40098e0 tx=0x7f56c4009250 comp rx=0 tx=0).stop 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 -- 172.21.15.49:0/2187775876 shutdown_connections 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 --2- 172.21.15.49:0/2187775876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8076100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 -- 172.21.15.49:0/2187775876 >> 172.21.15.49:0/2187775876 conn(0x7f56c80fda50 msgr2=0x7f56c80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 -- 172.21.15.49:0/2187775876 shutdown_connections 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 -- 172.21.15.49:0/2187775876 wait complete. 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 Processor -- start 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 -- start start 2023-12-16T07:33:43.919 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.185+0000 7f56cfc74700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c81138c0 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56cda10700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56cda10700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44402/0 (socket says 172.21.15.49:44402) 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56cda10700 1 -- 172.21.15.49:0/2403995940 learned_addr learned my addr 172.21.15.49:0/2403995940 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56cda10700 1 -- 172.21.15.49:0/2403995940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c40094f0 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56cda10700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8113380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006b00 tx=0x7f56c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56be7fc700 1 -- 172.21.15.49:0/2403995940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c4010a80 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56be7fc700 1 -- 172.21.15.49:0/2403995940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f56c401a430 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c8113ac0 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56be7fc700 1 -- 172.21.15.49:0/2403995940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c40245b0 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.186+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8113ed0 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.187+0000 7f56be7fc700 1 -- 172.21.15.49:0/2403995940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f56c40247e0 con 0x7f56c8077bf0 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.187+0000 7f56be7fc700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 0x7f56b4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:43.920 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.188+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c804bb80 con 0x7f56c8077bf0 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.188+0000 7f56be7fc700 1 -- 172.21.15.49:0/2403995940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f56c404aad0 con 0x7f56c8077bf0 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.188+0000 7f56cd20f700 1 -- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 msgr2=0x7f56b4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1241362817 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.188+0000 7f56cd20f700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 0x7f56b4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.192+0000 7f56be7fc700 1 -- 172.21.15.49:0/2403995940 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f56c4024b30 con 0x7f56c8077bf0 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.389+0000 7f56cd20f700 1 -- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 msgr2=0x7f56b4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1241362817 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.389+0000 7f56cd20f700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 0x7f56b4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.443+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f56c810d140 con 0x7f56c8077bf0 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.443+0000 7f56be7fc700 1 -- 172.21.15.49:0/2403995940 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f56c4048070 con 0x7f56c8077bf0 2023-12-16T07:33:43.921 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.445+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 msgr2=0x7f56b4038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:33:43.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.445+0000 7f56cfc74700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 0x7f56b4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:43.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.445+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 msgr2=0x7f56c8113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:43.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.446+0000 7f56cfc74700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8113380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006b00 tx=0x7f56c4009250 comp rx=0 tx=0).stop 2023-12-16T07:33:43.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.446+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 shutdown_connections 2023-12-16T07:33:43.922 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.446+0000 7f56cfc74700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f56b4036640 0x7f56b4038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:43.925 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.446+0000 7f56cfc74700 1 --2- 172.21.15.49:0/2403995940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56c8077bf0 0x7f56c8113380 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:43.925 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.446+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 >> 172.21.15.49:0/2403995940 conn(0x7f56c80fda50 msgr2=0x7f56c80ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:43.925 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.446+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 shutdown_connections 2023-12-16T07:33:43.925 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:42.446+0000 7f56cfc74700 1 -- 172.21.15.49:0/2403995940 wait complete. 2023-12-16T07:33:43.925 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2023-12-16T07:33:43.925 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 5... 2023-12-16T07:33:48.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:33:48.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:33:48.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: osdmap e2: 0 total, 0 up, 0 in 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: mgrmap e6: smithi049.rqlvwo(active, starting, since 0.0032769s) 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:33:48.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:48.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:48.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:33:48.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:33:48.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:33:48.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:33:48.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:48 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:33:49.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:49 smithi049 ceph-mon[111939]: Found migration_current of "None". Setting to last migration. 2023-12-16T07:33:49.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:49 smithi049 ceph-mon[111939]: mgrmap e7: smithi049.rqlvwo(active, since 1.00535s) 2023-12-16T07:33:50.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:50 smithi049 ceph-mon[111939]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T07:33:50.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:50 smithi049 ceph-mon[111939]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T07:33:50.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:50 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:50.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:50 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.981+0000 7f6f66706700 1 Processor -- start 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.981+0000 7f6f66706700 1 -- start start 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.981+0000 7f6f66706700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.981+0000 7f6f66706700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60102d10 con 0x7f6f60070f80 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.981+0000 7f6f5ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.981+0000 7f6f5ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44416/0 (socket says 172.21.15.49:44416) 2023-12-16T07:33:51.103 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.981+0000 7f6f5ffff700 1 -- 172.21.15.49:0/2372162222 learned_addr learned my addr 172.21.15.49:0/2372162222 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.982+0000 7f6f5ffff700 1 -- 172.21.15.49:0/2372162222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60107860 con 0x7f6f60070f80 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.982+0000 7f6f5ffff700 1 --2- 172.21.15.49:0/2372162222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60107320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f500098e0 tx=0x7f6f50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1607e6326914ba59 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.982+0000 7f6f5effd700 1 -- 172.21.15.49:0/2372162222 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f5000b860 con 0x7f6f60070f80 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.982+0000 7f6f5effd700 1 -- 172.21.15.49:0/2372162222 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6f5000be30 con 0x7f6f60070f80 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.982+0000 7f6f5effd700 1 -- 172.21.15.49:0/2372162222 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f50010380 con 0x7f6f60070f80 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.982+0000 7f6f66706700 1 -- 172.21.15.49:0/2372162222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 msgr2=0x7f6f60107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.983+0000 7f6f66706700 1 --2- 172.21.15.49:0/2372162222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60107320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f500098e0 tx=0x7f6f50009250 comp rx=0 tx=0).stop 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.983+0000 7f6f66706700 1 -- 172.21.15.49:0/2372162222 shutdown_connections 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.983+0000 7f6f66706700 1 --2- 172.21.15.49:0/2372162222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60107320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.983+0000 7f6f66706700 1 -- 172.21.15.49:0/2372162222 >> 172.21.15.49:0/2372162222 conn(0x7f6f600fc970 msgr2=0x7f6f600fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.983+0000 7f6f66706700 1 -- 172.21.15.49:0/2372162222 shutdown_connections 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.983+0000 7f6f66706700 1 -- 172.21.15.49:0/2372162222 wait complete. 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.983+0000 7f6f66706700 1 Processor -- start 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.984+0000 7f6f66706700 1 -- start start 2023-12-16T07:33:51.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.984+0000 7f6f66706700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.984+0000 7f6f66706700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f601138c0 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.984+0000 7f6f5ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.984+0000 7f6f5ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44432/0 (socket says 172.21.15.49:44432) 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.984+0000 7f6f5ffff700 1 -- 172.21.15.49:0/3166940163 learned_addr learned my addr 172.21.15.49:0/3166940163 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.984+0000 7f6f5ffff700 1 -- 172.21.15.49:0/3166940163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500094f0 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.985+0000 7f6f5ffff700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60113380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f50006d40 tx=0x7f6f50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.985+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f500109b0 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.985+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6f50024440 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.985+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f60113ac0 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.985+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f5001a5f0 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.985+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f60113ed0 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.986+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6f5001a820 con 0x7f6f60070f80 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.986+0000 7f6f5cff9700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:51.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.986+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 --> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f6004bb80 con 0x7f6f48036640 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.986+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6f5004b3d0 con 0x7f6f60070f80 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.986+0000 7f6f5f7fe700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 msgr2=0x7f6f48038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1241362817 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:44.986+0000 7f6f5f7fe700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:45.187+0000 7f6f5f7fe700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 msgr2=0x7f6f48038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1241362817 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:45.187+0000 7f6f5f7fe700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:45.588+0000 7f6f5f7fe700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 msgr2=0x7f6f48038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1241362817 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:45.588+0000 7f6f5f7fe700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:46.389+0000 7f6f5f7fe700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 msgr2=0x7f6f48038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1241362817 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:46.389+0000 7f6f5f7fe700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:47.990+0000 7f6f5f7fe700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 msgr2=0x7f6f48038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1241362817 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:47.990+0000 7f6f5f7fe700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:48.312+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f6f5000fdc0 con 0x7f6f60070f80 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:48.312+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 msgr2=0x7f6f48038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:33:51.106 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:48.312+0000 7f6f5cff9700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.313+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f6f5004a200 con 0x7f6f60070f80 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.313+0000 7f6f5cff9700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f6f48039db0 0x7f6f4803c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.313+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f6004bb80 con 0x7f6f48039db0 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.313+0000 7f6f5f7fe700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f6f48039db0 0x7f6f4803c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.314+0000 7f6f5f7fe700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f6f48039db0 0x7f6f4803c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6f540039d0 tx=0x7f6f54009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.315+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f6f6004bb80 con 0x7f6f48039db0 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6f601084f0 con 0x7f6f48039db0 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f5cff9700 1 -- 172.21.15.49:0/3166940163 <== mgr.14120 v2:172.21.15.49:6800/3810957388 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6f601084f0 con 0x7f6f48039db0 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f6f48039db0 msgr2=0x7f6f4803c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f6f48039db0 0x7f6f4803c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6f540039d0 tx=0x7f6f54009350 comp rx=0 tx=0).stop 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 msgr2=0x7f6f60113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60113380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f50006d40 tx=0x7f6f50009250 comp rx=0 tx=0).stop 2023-12-16T07:33:51.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 shutdown_connections 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f6f48039db0 0x7f6f4803c190 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f60070f80 0x7f6f60113380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 --2- 172.21.15.49:0/3166940163 >> [v2:172.21.15.49:6800/1241362817,v1:172.21.15.49:6801/1241362817] conn(0x7f6f48036640 0x7f6f48038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.321+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 >> 172.21.15.49:0/3166940163 conn(0x7f6f600fc970 msgr2=0x7f6f600fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.322+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 shutdown_connections 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:49.322+0000 7f6f66706700 1 -- 172.21.15.49:0/3166940163 wait complete. 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 5 is available 2023-12-16T07:33:51.108 INFO:teuthology.orchestra.run.smithi049.stdout:Setting orchestrator backend to cephadm... 2023-12-16T07:33:51.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:51 smithi049 ceph-mon[111939]: [16/Dec/2023:07:33:49] ENGINE Bus STARTING 2023-12-16T07:33:51.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:51 smithi049 ceph-mon[111939]: [16/Dec/2023:07:33:49] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:33:51.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:51 smithi049 ceph-mon[111939]: [16/Dec/2023:07:33:49] ENGINE Bus STARTED 2023-12-16T07:33:51.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:51 smithi049 ceph-mon[111939]: mgrmap e8: smithi049.rqlvwo(active, since 2s) 2023-12-16T07:33:52.021 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fc2589700 1 Processor -- start 2023-12-16T07:33:52.021 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fc2589700 1 -- start start 2023-12-16T07:33:52.021 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fc2589700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc107290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fc2589700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc102c80 con 0x7f2fbc076c60 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37210/0 (socket says 172.21.15.49:37210) 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3013099694 learned_addr learned my addr 172.21.15.49:0/3013099694 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3013099694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc1077d0 con 0x7f2fbc076c60 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.448+0000 7f2fbbfff700 1 --2- 172.21.15.49:0/3013099694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc107290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0098e0 tx=0x7f2fac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90cb47e7e0bb312 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fbaffd700 1 -- 172.21.15.49:0/3013099694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fac00b860 con 0x7f2fbc076c60 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fbaffd700 1 -- 172.21.15.49:0/3013099694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2fac00be30 con 0x7f2fbc076c60 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fbaffd700 1 -- 172.21.15.49:0/3013099694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fac010380 con 0x7f2fbc076c60 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fc2589700 1 -- 172.21.15.49:0/3013099694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 msgr2=0x7f2fbc107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fc2589700 1 --2- 172.21.15.49:0/3013099694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc107290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0098e0 tx=0x7f2fac009250 comp rx=0 tx=0).stop 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fc2589700 1 -- 172.21.15.49:0/3013099694 shutdown_connections 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fc2589700 1 --2- 172.21.15.49:0/3013099694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc107290 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:52.022 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fc2589700 1 -- 172.21.15.49:0/3013099694 >> 172.21.15.49:0/3013099694 conn(0x7f2fbc0fc980 msgr2=0x7f2fbc0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fc2589700 1 -- 172.21.15.49:0/3013099694 shutdown_connections 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.449+0000 7f2fc2589700 1 -- 172.21.15.49:0/3013099694 wait complete. 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fc2589700 1 Processor -- start 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fc2589700 1 -- start start 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fc2589700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fc2589700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc113880 con 0x7f2fbc076c60 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37216/0 (socket says 172.21.15.49:37216) 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3391768712 learned_addr learned my addr 172.21.15.49:0/3391768712 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.450+0000 7f2fbbfff700 1 -- 172.21.15.49:0/3391768712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0094f0 con 0x7f2fbc076c60 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.451+0000 7f2fbbfff700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc113340 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006d40 tx=0x7f2fac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.451+0000 7f2fb8ff9700 1 -- 172.21.15.49:0/3391768712 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fac0109b0 con 0x7f2fbc076c60 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.451+0000 7f2fb8ff9700 1 -- 172.21.15.49:0/3391768712 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2fac024440 con 0x7f2fbc076c60 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.451+0000 7f2fc2589700 1 -- 172.21.15.49:0/3391768712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc113a80 con 0x7f2fbc076c60 2023-12-16T07:33:52.023 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.451+0000 7f2fb8ff9700 1 -- 172.21.15.49:0/3391768712 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fac01a5f0 con 0x7f2fbc076c60 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.451+0000 7f2fc2589700 1 -- 172.21.15.49:0/3391768712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc113e90 con 0x7f2fbc076c60 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.452+0000 7f2fb8ff9700 1 -- 172.21.15.49:0/3391768712 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f2fac01a820 con 0x7f2fbc076c60 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.452+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa00052b0 con 0x7f2fbc076c60 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.452+0000 7f2fb8ff9700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f2fa8036640 0x7f2fa8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.452+0000 7f2fb8ff9700 1 -- 172.21.15.49:0/3391768712 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2fac04a530 con 0x7f2fbc076c60 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.452+0000 7f2fbb7fe700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f2fa8036640 0x7f2fa8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.452+0000 7f2fbb7fe700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f2fa8036640 0x7f2fa8038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009990 tx=0x7f2fa4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.457+0000 7f2fb8ff9700 1 -- 172.21.15.49:0/3391768712 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2fac018ce0 con 0x7f2fbc076c60 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.666+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fa0000bc0 con 0x7f2fa8036640 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.672+0000 7f2fb8ff9700 1 -- 172.21.15.49:0/3391768712 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2fa0000bc0 con 0x7f2fa8036640 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f2fa8036640 msgr2=0x7f2fa8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f2fa8036640 0x7f2fa8038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009990 tx=0x7f2fa4006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 msgr2=0x7f2fbc113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc113340 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006d40 tx=0x7f2fac009250 comp rx=0 tx=0).stop 2023-12-16T07:33:52.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 shutdown_connections 2023-12-16T07:33:52.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f2fa8036640 0x7f2fa8038af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:52.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 --2- 172.21.15.49:0/3391768712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2fbc076c60 0x7f2fbc113340 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:52.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 >> 172.21.15.49:0/3391768712 conn(0x7f2fbc0fc980 msgr2=0x7f2fbc0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:52.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 shutdown_connections 2023-12-16T07:33:52.025 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:51.674+0000 7f2fb27fc700 1 -- 172.21.15.49:0/3391768712 wait complete. 2023-12-16T07:33:52.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:52 smithi049 ceph-mon[111939]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:33:52.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:52 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:52.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:52 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda215eb700 1 Processor -- start 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda215eb700 1 -- start start 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda215eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c102bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda215eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c103100 con 0x7fda1c1027b0 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda1affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda1affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c102bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37218/0 (socket says 172.21.15.49:37218) 2023-12-16T07:33:52.955 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda1affd700 1 -- 172.21.15.49:0/1568442338 learned_addr learned my addr 172.21.15.49:0/1568442338 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.394+0000 7fda1affd700 1 -- 172.21.15.49:0/1568442338 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c103240 con 0x7fda1c1027b0 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda1affd700 1 --2- 172.21.15.49:0/1568442338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c102bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098e0 tx=0x7fda0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7acb531d8e01a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda19ffb700 1 -- 172.21.15.49:0/1568442338 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c00b860 con 0x7fda1c1027b0 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda19ffb700 1 -- 172.21.15.49:0/1568442338 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fda0c00be30 con 0x7fda1c1027b0 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda19ffb700 1 -- 172.21.15.49:0/1568442338 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c010380 con 0x7fda1c1027b0 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda215eb700 1 -- 172.21.15.49:0/1568442338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 msgr2=0x7fda1c102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda215eb700 1 --2- 172.21.15.49:0/1568442338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c102bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098e0 tx=0x7fda0c009250 comp rx=0 tx=0).stop 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda215eb700 1 -- 172.21.15.49:0/1568442338 shutdown_connections 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda215eb700 1 --2- 172.21.15.49:0/1568442338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c102bc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda215eb700 1 -- 172.21.15.49:0/1568442338 >> 172.21.15.49:0/1568442338 conn(0x7fda1c0fc0b0 msgr2=0x7fda1c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda215eb700 1 -- 172.21.15.49:0/1568442338 shutdown_connections 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.395+0000 7fda215eb700 1 -- 172.21.15.49:0/1568442338 wait complete. 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.396+0000 7fda215eb700 1 Processor -- start 2023-12-16T07:33:52.956 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.396+0000 7fda215eb700 1 -- start start 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.396+0000 7fda215eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c107590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.396+0000 7fda215eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c105a10 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.396+0000 7fda1affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c107590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.396+0000 7fda1affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c107590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37226/0 (socket says 172.21.15.49:37226) 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.396+0000 7fda1affd700 1 -- 172.21.15.49:0/1321108915 learned_addr learned my addr 172.21.15.49:0/1321108915 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.397+0000 7fda1affd700 1 -- 172.21.15.49:0/1321108915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0094f0 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.397+0000 7fda1affd700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c107590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.397+0000 7fda037fe700 1 -- 172.21.15.49:0/1321108915 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c010a80 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.397+0000 7fda037fe700 1 -- 172.21.15.49:0/1321108915 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fda0c01a430 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.397+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c105c10 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.397+0000 7fda037fe700 1 -- 172.21.15.49:0/1321108915 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c0245b0 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.397+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c106020 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.398+0000 7fda037fe700 1 -- 172.21.15.49:0/1321108915 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fda0c0247a0 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.398+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c04bb80 con 0x7fda1c1027b0 2023-12-16T07:33:52.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.398+0000 7fda037fe700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fda04036640 0x7fda04038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.398+0000 7fda037fe700 1 -- 172.21.15.49:0/1321108915 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fda0c04ad00 con 0x7fda1c1027b0 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.398+0000 7fda1a7fc700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fda04036640 0x7fda04038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.399+0000 7fda1a7fc700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fda04036640 0x7fda04038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda10009990 tx=0x7fda10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.403+0000 7fda037fe700 1 -- 172.21.15.49:0/1321108915 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fda0c051080 con 0x7fda1c1027b0 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.601+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fda1c1067a0 con 0x7fda04036640 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.602+0000 7fda037fe700 1 -- 172.21.15.49:0/1321108915 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fda1c1067a0 con 0x7fda04036640 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fda04036640 msgr2=0x7fda04038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fda04036640 0x7fda04038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda10009990 tx=0x7fda10006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 msgr2=0x7fda1c107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c107590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c009250 comp rx=0 tx=0).stop 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 shutdown_connections 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fda04036640 0x7fda04038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 --2- 172.21.15.49:0/1321108915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda1c1027b0 0x7fda1c107590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 >> 172.21.15.49:0/1321108915 conn(0x7fda1c0fc0b0 msgr2=0x7fda1c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:52.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 shutdown_connections 2023-12-16T07:33:52.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:52.604+0000 7fda215eb700 1 -- 172.21.15.49:0/1321108915 wait complete. 2023-12-16T07:33:52.959 INFO:teuthology.orchestra.run.smithi049.stdout:Generating ssh key... 2023-12-16T07:33:53.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:53 smithi049 ceph-mon[111939]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:33:53.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:53 smithi049 ceph-mon[111939]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:33:53.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:53 smithi049 ceph-mon[111939]: Generating ssh key... 2023-12-16T07:33:54.129 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.291+0000 7fe7d007f700 1 Processor -- start 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7d007f700 1 -- start start 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7d007f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7d007f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c8105460 con 0x7fe7c8070f80 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7cde1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7cde1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37238/0 (socket says 172.21.15.49:37238) 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7cde1b700 1 -- 172.21.15.49:0/1286611133 learned_addr learned my addr 172.21.15.49:0/1286611133 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7cde1b700 1 -- 172.21.15.49:0/1286611133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c81055a0 con 0x7fe7c8070f80 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.292+0000 7fe7cde1b700 1 --2- 172.21.15.49:0/1286611133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8104f20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098e0 tx=0x7fe7c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138f5e7084c533bc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7cce19700 1 -- 172.21.15.49:0/1286611133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7c400b860 con 0x7fe7c8070f80 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7cce19700 1 -- 172.21.15.49:0/1286611133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe7c400be30 con 0x7fe7c8070f80 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7cce19700 1 -- 172.21.15.49:0/1286611133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7c4010380 con 0x7fe7c8070f80 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7d007f700 1 -- 172.21.15.49:0/1286611133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 msgr2=0x7fe7c8104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:54.130 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7d007f700 1 --2- 172.21.15.49:0/1286611133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8104f20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098e0 tx=0x7fe7c4009250 comp rx=0 tx=0).stop 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7d007f700 1 -- 172.21.15.49:0/1286611133 shutdown_connections 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7d007f700 1 --2- 172.21.15.49:0/1286611133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8104f20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7d007f700 1 -- 172.21.15.49:0/1286611133 >> 172.21.15.49:0/1286611133 conn(0x7fe7c80fc970 msgr2=0x7fe7c80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7d007f700 1 -- 172.21.15.49:0/1286611133 shutdown_connections 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.293+0000 7fe7d007f700 1 -- 172.21.15.49:0/1286611133 wait complete. 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.294+0000 7fe7d007f700 1 Processor -- start 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.294+0000 7fe7d007f700 1 -- start start 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.294+0000 7fe7d007f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.294+0000 7fe7d007f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c81116b0 con 0x7fe7c8070f80 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.294+0000 7fe7cde1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.294+0000 7fe7cde1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37242/0 (socket says 172.21.15.49:37242) 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.294+0000 7fe7cde1b700 1 -- 172.21.15.49:0/2485166632 learned_addr learned my addr 172.21.15.49:0/2485166632 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.295+0000 7fe7cde1b700 1 -- 172.21.15.49:0/2485166632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40094f0 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.295+0000 7fe7cde1b700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8111170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4006b00 tx=0x7fe7c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.295+0000 7fe7ba7fc700 1 -- 172.21.15.49:0/2485166632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7c4010a80 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.295+0000 7fe7ba7fc700 1 -- 172.21.15.49:0/2485166632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe7c401a430 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.295+0000 7fe7ba7fc700 1 -- 172.21.15.49:0/2485166632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7c40245b0 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.295+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c81118b0 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.295+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c8111cc0 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.296+0000 7fe7ba7fc700 1 -- 172.21.15.49:0/2485166632 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe7c4024760 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.296+0000 7fe7ba7fc700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fe7b4036640 0x7fe7b4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.296+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c804bb80 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.296+0000 7fe7ba7fc700 1 -- 172.21.15.49:0/2485166632 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe7c404ac90 con 0x7fe7c8070f80 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.296+0000 7fe7cd61a700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fe7b4036640 0x7fe7b4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:54.132 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.296+0000 7fe7cd61a700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fe7b4036640 0x7fe7b4038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009990 tx=0x7fe7bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.301+0000 7fe7ba7fc700 1 -- 172.21.15.49:0/2485166632 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe7c402c570 con 0x7fe7c8070f80 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.498+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7c80008d0 con 0x7fe7b4036640 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.776+0000 7fe7ba7fc700 1 -- 172.21.15.49:0/2485166632 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe7c80008d0 con 0x7fe7b4036640 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fe7b4036640 msgr2=0x7fe7b4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fe7b4036640 0x7fe7b4038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009990 tx=0x7fe7bc006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 msgr2=0x7fe7c8111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8111170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4006b00 tx=0x7fe7c4009250 comp rx=0 tx=0).stop 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 shutdown_connections 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fe7b4036640 0x7fe7b4038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 --2- 172.21.15.49:0/2485166632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8070f80 0x7fe7c8111170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 >> 172.21.15.49:0/2485166632 conn(0x7fe7c80fc970 msgr2=0x7fe7c80fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 shutdown_connections 2023-12-16T07:33:54.133 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:53.779+0000 7fe7d007f700 1 -- 172.21.15.49:0/2485166632 wait complete. 2023-12-16T07:33:55.002 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:54 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:55.002 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:54 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFhF8Ddxw6SN2/Ngm4K8lB7aqaaIBkC4cSmw+HsArtD4WQSKEhmr67Q/or1kLCpLhJd5ovokLwEC5a177h/8kDuqmvUqkA3Ou7eJoVkxDDiZ3ag9zMjZC6csSeXcCrTyonArW6/JAD2IXRzzB9bN3HmPZmKlZL7vk4WVge6SkU8CC5qxfRfdV1pS/AsxY+1I0aIwquV+I+53w0Wbyf+qMnpujHikykL23j+iOX4HdZUoeLkL3TGuQNnJxv8jnzz2EivU4N8/q8bNSUodYnX8U7W8ezuvsZemw9zzguogyaVs4txBp9Lso+3bTPAMyY9LtDJty69kqkLKeBdp4HAtTsTdlI0Ev2VYMkOFBGAUQxKXD1ielZ30BGdX8gO1XubXwtDNLwAp4HA3M8rVMtkUarCntZkG/isiUx9rA6Bvf9hzwj8ucvxuKnUMxiBxseH2jDNkWm3A1w9Ip3qMyyRe6Wsb6OpfarYuJM7vNkoeZ9u1/BsBz0H78+FGvpR2rKgE8= ceph-4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.500+0000 7fb754d4a700 1 Processor -- start 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.500+0000 7fb754d4a700 1 -- start start 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.500+0000 7fb754d4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.500+0000 7fb754d4a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501053d0 con 0x7fb750076c60 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.500+0000 7fb74e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.500+0000 7fb74e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37256/0 (socket says 172.21.15.49:37256) 2023-12-16T07:33:55.071 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.500+0000 7fb74e59c700 1 -- 172.21.15.49:0/407337888 learned_addr learned my addr 172.21.15.49:0/407337888 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.501+0000 7fb74e59c700 1 -- 172.21.15.49:0/407337888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750105510 con 0x7fb750076c60 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.501+0000 7fb74e59c700 1 --2- 172.21.15.49:0/407337888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750104e90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098e0 tx=0x7fb740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adceb07c02113751 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.501+0000 7fb74d59a700 1 -- 172.21.15.49:0/407337888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb74000b860 con 0x7fb750076c60 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.501+0000 7fb74d59a700 1 -- 172.21.15.49:0/407337888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb74000be30 con 0x7fb750076c60 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.501+0000 7fb74d59a700 1 -- 172.21.15.49:0/407337888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb740010380 con 0x7fb750076c60 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.501+0000 7fb754d4a700 1 -- 172.21.15.49:0/407337888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 msgr2=0x7fb750104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.501+0000 7fb754d4a700 1 --2- 172.21.15.49:0/407337888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750104e90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098e0 tx=0x7fb740009250 comp rx=0 tx=0).stop 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 -- 172.21.15.49:0/407337888 shutdown_connections 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 --2- 172.21.15.49:0/407337888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750104e90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 -- 172.21.15.49:0/407337888 >> 172.21.15.49:0/407337888 conn(0x7fb7500fc980 msgr2=0x7fb7500fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 -- 172.21.15.49:0/407337888 shutdown_connections 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 -- 172.21.15.49:0/407337888 wait complete. 2023-12-16T07:33:55.072 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 Processor -- start 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 -- start start 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.502+0000 7fb754d4a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750111660 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb74e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb74e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750111120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37266/0 (socket says 172.21.15.49:37266) 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb74e59c700 1 -- 172.21.15.49:0/604763979 learned_addr learned my addr 172.21.15.49:0/604763979 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb74e59c700 1 -- 172.21.15.49:0/604763979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400094f0 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb74e59c700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750111120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb740006d40 tx=0x7fb740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb73effd700 1 -- 172.21.15.49:0/604763979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7400109b0 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb73effd700 1 -- 172.21.15.49:0/604763979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb740024440 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb73effd700 1 -- 172.21.15.49:0/604763979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb74001a5f0 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb750111860 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.503+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb750111c70 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.504+0000 7fb73effd700 1 -- 172.21.15.49:0/604763979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb74001a820 con 0x7fb750076c60 2023-12-16T07:33:55.073 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.504+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75004bb80 con 0x7fb750076c60 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.504+0000 7fb73effd700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb738036640 0x7fb738038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.504+0000 7fb73effd700 1 -- 172.21.15.49:0/604763979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb74004a540 con 0x7fb750076c60 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.504+0000 7fb74dd9b700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb738036640 0x7fb738038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.505+0000 7fb74dd9b700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb738036640 0x7fb738038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb744009990 tx=0x7fb744006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.509+0000 7fb73effd700 1 -- 172.21.15.49:0/604763979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb74001aad0 con 0x7fb750076c60 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.708+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb75010afa0 con 0x7fb738036640 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.709+0000 7fb73effd700 1 -- 172.21.15.49:0/604763979 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb75010afa0 con 0x7fb738036640 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb738036640 msgr2=0x7fb738038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:55.074 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb738036640 0x7fb738038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb744009990 tx=0x7fb744006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 msgr2=0x7fb750111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750111120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb740006d40 tx=0x7fb740009250 comp rx=0 tx=0).stop 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 shutdown_connections 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb738036640 0x7fb738038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 --2- 172.21.15.49:0/604763979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb750076c60 0x7fb750111120 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 >> 172.21.15.49:0/604763979 conn(0x7fb7500fc980 msgr2=0x7fb7500fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.711+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 shutdown_connections 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:54.712+0000 7fb754d4a700 1 -- 172.21.15.49:0/604763979 wait complete. 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:Adding key to root@localhost authorized_keys... 2023-12-16T07:33:55.075 INFO:teuthology.orchestra.run.smithi049.stdout:Adding host smithi049... 2023-12-16T07:33:55.897 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:55 smithi049 ceph-mon[111939]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:33:57.035 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:56 smithi049 ceph-mon[111939]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:33:57.035 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:56 smithi049 ceph-mon[111939]: Deploying cephadm binary to smithi049 2023-12-16T07:33:57.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Added host 'smithi049' with addr '172.21.15.49' 2023-12-16T07:33:57.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.408+0000 7f115d747700 1 Processor -- start 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.408+0000 7f115d747700 1 -- start start 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.408+0000 7f115d747700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.408+0000 7f115d747700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158104240 con 0x7f11581038f0 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37274/0 (socket says 172.21.15.49:37274) 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1156ffd700 1 -- 172.21.15.49:0/3851707518 learned_addr learned my addr 172.21.15.49:0/3851707518 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1156ffd700 1 -- 172.21.15.49:0/3851707518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158104380 con 0x7f11581038f0 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1156ffd700 1 --2- 172.21.15.49:0/3851707518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158103d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11480098e0 tx=0x7f1148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1039d0664692ead server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1155ffb700 1 -- 172.21.15.49:0/3851707518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f114800b860 con 0x7f11581038f0 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1155ffb700 1 -- 172.21.15.49:0/3851707518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f114800be30 con 0x7f11581038f0 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.409+0000 7f1155ffb700 1 -- 172.21.15.49:0/3851707518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1148010380 con 0x7f11581038f0 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.410+0000 7f115d747700 1 -- 172.21.15.49:0/3851707518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 msgr2=0x7f1158103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.410+0000 7f115d747700 1 --2- 172.21.15.49:0/3851707518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158103d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f11480098e0 tx=0x7f1148009250 comp rx=0 tx=0).stop 2023-12-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.410+0000 7f115d747700 1 -- 172.21.15.49:0/3851707518 shutdown_connections 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.410+0000 7f115d747700 1 --2- 172.21.15.49:0/3851707518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158103d00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.410+0000 7f115d747700 1 -- 172.21.15.49:0/3851707518 >> 172.21.15.49:0/3851707518 conn(0x7f11580fc0b0 msgr2=0x7f11580fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.410+0000 7f115d747700 1 -- 172.21.15.49:0/3851707518 shutdown_connections 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.410+0000 7f115d747700 1 -- 172.21.15.49:0/3851707518 wait complete. 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f115d747700 1 Processor -- start 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f115d747700 1 -- start start 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f115d747700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158111130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f115d747700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158111670 con 0x7f11581038f0 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37288/0 (socket says 172.21.15.49:37288) 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f1156ffd700 1 -- 172.21.15.49:0/1488280250 learned_addr learned my addr 172.21.15.49:0/1488280250 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f1156ffd700 1 -- 172.21.15.49:0/1488280250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480094f0 con 0x7f11581038f0 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f1156ffd700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158111130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1148006b00 tx=0x7f1148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f113f7fe700 1 -- 172.21.15.49:0/1488280250 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11480109b0 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f113f7fe700 1 -- 172.21.15.49:0/1488280250 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1148024440 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1158111870 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f113f7fe700 1 -- 172.21.15.49:0/1488280250 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f114801a5f0 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.411+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1158111c80 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.412+0000 7f113f7fe700 1 -- 172.21.15.49:0/1488280250 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f114801a860 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.412+0000 7f113f7fe700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f1140036640 0x7f1140038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.412+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115804bb80 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.413+0000 7f113f7fe700 1 -- 172.21.15.49:0/1488280250 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f114804a7a0 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.413+0000 7f11567fc700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f1140036640 0x7f1140038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.413+0000 7f11567fc700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f1140036640 0x7f1140038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f114c009990 tx=0x7f114c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.417+0000 7f113f7fe700 1 -- 172.21.15.49:0/1488280250 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1148022340 con 0x7f11581038f0 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:55.617+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}) v1 -- 0x7f115810afd0 con 0x7f1140036640 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.351+0000 7f113f7fe700 1 -- 172.21.15.49:0/1488280250 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f115810afd0 con 0x7f1140036640 2023-12-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f1140036640 msgr2=0x7f1140038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f1140036640 0x7f1140038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f114c009990 tx=0x7f114c006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 msgr2=0x7f1158111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158111130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1148006b00 tx=0x7f1148009250 comp rx=0 tx=0).stop 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 shutdown_connections 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f1140036640 0x7f1140038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 --2- 172.21.15.49:0/1488280250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11581038f0 0x7f1158111130 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.353+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 >> 172.21.15.49:0/1488280250 conn(0x7f11580fc0b0 msgr2=0x7f11580fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.354+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 shutdown_connections 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:57.354+0000 7f115d747700 1 -- 172.21.15.49:0/1488280250 wait complete. 2023-12-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying mon service with default placement... 2023-12-16T07:33:58.524 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:58 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:58.524 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:58 smithi049 ceph-mon[111939]: Added host smithi049 2023-12-16T07:33:58.524 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:58 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:33:58.524 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:58 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:58.686 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.009+0000 7f3d631db700 1 Processor -- start 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.009+0000 7f3d631db700 1 -- start start 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.009+0000 7f3d631db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.009+0000 7f3d631db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c1053d0 con 0x7f3d5c076c60 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d60f77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d60f77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40390/0 (socket says 172.21.15.49:40390) 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d60f77700 1 -- 172.21.15.49:0/934416321 learned_addr learned my addr 172.21.15.49:0/934416321 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d60f77700 1 -- 172.21.15.49:0/934416321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c105510 con 0x7f3d5c076c60 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d60f77700 1 --2- 172.21.15.49:0/934416321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098e0 tx=0x7f3d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc04eeaa1fa881b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d5b7fe700 1 -- 172.21.15.49:0/934416321 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d5000b860 con 0x7f3d5c076c60 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d5b7fe700 1 -- 172.21.15.49:0/934416321 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3d5000be30 con 0x7f3d5c076c60 2023-12-16T07:33:58.687 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.010+0000 7f3d5b7fe700 1 -- 172.21.15.49:0/934416321 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d50010380 con 0x7f3d5c076c60 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.011+0000 7f3d631db700 1 -- 172.21.15.49:0/934416321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 msgr2=0x7f3d5c104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.011+0000 7f3d631db700 1 --2- 172.21.15.49:0/934416321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d500098e0 tx=0x7f3d50009250 comp rx=0 tx=0).stop 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.011+0000 7f3d631db700 1 -- 172.21.15.49:0/934416321 shutdown_connections 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.011+0000 7f3d631db700 1 --2- 172.21.15.49:0/934416321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c104e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.011+0000 7f3d631db700 1 -- 172.21.15.49:0/934416321 >> 172.21.15.49:0/934416321 conn(0x7f3d5c0fc980 msgr2=0x7f3d5c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.011+0000 7f3d631db700 1 -- 172.21.15.49:0/934416321 shutdown_connections 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.011+0000 7f3d631db700 1 -- 172.21.15.49:0/934416321 wait complete. 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d631db700 1 Processor -- start 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d631db700 1 -- start start 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d631db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d631db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c100d90 con 0x7f3d5c076c60 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d60f77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d60f77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40396/0 (socket says 172.21.15.49:40396) 2023-12-16T07:33:58.688 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d60f77700 1 -- 172.21.15.49:0/1631809824 learned_addr learned my addr 172.21.15.49:0/1631809824 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d60f77700 1 -- 172.21.15.49:0/1631809824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500094f0 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.012+0000 7f3d60f77700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c102910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d50006d40 tx=0x7f3d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.013+0000 7f3d597fa700 1 -- 172.21.15.49:0/1631809824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d500109b0 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.013+0000 7f3d597fa700 1 -- 172.21.15.49:0/1631809824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3d50024440 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.013+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c100f90 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.013+0000 7f3d597fa700 1 -- 172.21.15.49:0/1631809824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d5001a5f0 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.013+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c1013a0 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.013+0000 7f3d597fa700 1 -- 172.21.15.49:0/1631809824 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3d50010b10 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.014+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c04bb80 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.014+0000 7f3d597fa700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f3d4c036640 0x7f3d4c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.014+0000 7f3d597fa700 1 -- 172.21.15.49:0/1631809824 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3d5004a4d0 con 0x7f3d5c076c60 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.014+0000 7f3d5bfff700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f3d4c036640 0x7f3d4c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.014+0000 7f3d5bfff700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f3d4c036640 0x7f3d4c038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009990 tx=0x7f3d48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:58.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.019+0000 7f3d597fa700 1 -- 172.21.15.49:0/1631809824 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3d500245b0 con 0x7f3d5c076c60 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.244+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d5c10ada0 con 0x7f3d4c036640 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.249+0000 7f3d597fa700 1 -- 172.21.15.49:0/1631809824 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3d5c10ada0 con 0x7f3d4c036640 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.251+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f3d4c036640 msgr2=0x7f3d4c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.251+0000 7f3d631db700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f3d4c036640 0x7f3d4c038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009990 tx=0x7f3d48006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.251+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 msgr2=0x7f3d5c102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.251+0000 7f3d631db700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c102910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d50006d40 tx=0x7f3d50009250 comp rx=0 tx=0).stop 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.252+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 shutdown_connections 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.252+0000 7f3d631db700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f3d4c036640 0x7f3d4c038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.252+0000 7f3d631db700 1 --2- 172.21.15.49:0/1631809824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d5c076c60 0x7f3d5c102910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.252+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 >> 172.21.15.49:0/1631809824 conn(0x7f3d5c0fc980 msgr2=0x7f3d5c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.252+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 shutdown_connections 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:58.252+0000 7f3d631db700 1 -- 172.21.15.49:0/1631809824 wait complete. 2023-12-16T07:33:58.690 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying mgr service with default placement... 2023-12-16T07:33:59.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:59 smithi049 ceph-mon[111939]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:33:59.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:59 smithi049 ceph-mon[111939]: Saving service mon spec with placement count:5 2023-12-16T07:33:59.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:59 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:59.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:33:59 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.177+0000 7fa646e2f700 1 Processor -- start 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.177+0000 7fa646e2f700 1 -- start start 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.178+0000 7fa646e2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa6401015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.178+0000 7fa646e2f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640101b20 con 0x7fa6401011d0 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.178+0000 7fa644bcb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa6401015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.178+0000 7fa644bcb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa6401015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40404/0 (socket says 172.21.15.49:40404) 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.178+0000 7fa644bcb700 1 -- 172.21.15.49:0/769867755 learned_addr learned my addr 172.21.15.49:0/769867755 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:59.762 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.178+0000 7fa644bcb700 1 -- 172.21.15.49:0/769867755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640101c60 con 0x7fa6401011d0 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.179+0000 7fa644bcb700 1 --2- 172.21.15.49:0/769867755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa6401015e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6340098e0 tx=0x7fa634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf1b908cf90e002 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.179+0000 7fa63f7fe700 1 -- 172.21.15.49:0/769867755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63400b860 con 0x7fa6401011d0 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.179+0000 7fa63f7fe700 1 -- 172.21.15.49:0/769867755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa63400be70 con 0x7fa6401011d0 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.179+0000 7fa63f7fe700 1 -- 172.21.15.49:0/769867755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa634010380 con 0x7fa6401011d0 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.180+0000 7fa646e2f700 1 -- 172.21.15.49:0/769867755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 msgr2=0x7fa6401015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.180+0000 7fa646e2f700 1 --2- 172.21.15.49:0/769867755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa6401015e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6340098e0 tx=0x7fa634009250 comp rx=0 tx=0).stop 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.180+0000 7fa646e2f700 1 -- 172.21.15.49:0/769867755 shutdown_connections 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.180+0000 7fa646e2f700 1 --2- 172.21.15.49:0/769867755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa6401015e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.180+0000 7fa646e2f700 1 -- 172.21.15.49:0/769867755 >> 172.21.15.49:0/769867755 conn(0x7fa6400fc970 msgr2=0x7fa6400fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.180+0000 7fa646e2f700 1 -- 172.21.15.49:0/769867755 shutdown_connections 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.180+0000 7fa646e2f700 1 -- 172.21.15.49:0/769867755 wait complete. 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa646e2f700 1 Processor -- start 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa646e2f700 1 -- start start 2023-12-16T07:33:59.763 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa646e2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa640113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa646e2f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640070f90 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa644bcb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa640113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa644bcb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa640113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40410/0 (socket says 172.21.15.49:40410) 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa644bcb700 1 -- 172.21.15.49:0/518558715 learned_addr learned my addr 172.21.15.49:0/518558715 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.181+0000 7fa644bcb700 1 -- 172.21.15.49:0/518558715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340094f0 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.182+0000 7fa644bcb700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa640113e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c010 tx=0x7fa634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.182+0000 7fa63d7fa700 1 -- 172.21.15.49:0/518558715 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa634010960 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.182+0000 7fa63d7fa700 1 -- 172.21.15.49:0/518558715 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa63401a430 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.182+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa640071190 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.182+0000 7fa63d7fa700 1 -- 172.21.15.49:0/518558715 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa634019580 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.182+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa640114590 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.183+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64010a090 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.183+0000 7fa63d7fa700 1 -- 172.21.15.49:0/518558715 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa63401a980 con 0x7fa6401011d0 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.184+0000 7fa63d7fa700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fa630036640 0x7fa630038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:33:59.764 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.184+0000 7fa63d7fa700 1 -- 172.21.15.49:0/518558715 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa63404a4a0 con 0x7fa6401011d0 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.184+0000 7fa63ffff700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fa630036640 0x7fa630038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.184+0000 7fa63ffff700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fa630036640 0x7fa630038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009990 tx=0x7fa62c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.188+0000 7fa63d7fa700 1 -- 172.21.15.49:0/518558715 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa634018d20 con 0x7fa6401011d0 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.397+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fa64002b220 con 0x7fa630036640 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.401+0000 7fa63d7fa700 1 -- 172.21.15.49:0/518558715 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa64002b220 con 0x7fa630036640 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.403+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fa630036640 msgr2=0x7fa630038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.403+0000 7fa646e2f700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fa630036640 0x7fa630038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009990 tx=0x7fa62c006e40 comp rx=0 tx=0).stop 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.403+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 msgr2=0x7fa640113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.403+0000 7fa646e2f700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa640113e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c010 tx=0x7fa634009250 comp rx=0 tx=0).stop 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.404+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 shutdown_connections 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.404+0000 7fa646e2f700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fa630036640 0x7fa630038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.404+0000 7fa646e2f700 1 --2- 172.21.15.49:0/518558715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6401011d0 0x7fa640113e90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:33:59.765 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.404+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 >> 172.21.15.49:0/518558715 conn(0x7fa6400fc970 msgr2=0x7fa6400fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:33:59.766 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.404+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 shutdown_connections 2023-12-16T07:33:59.766 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:33:59.404+0000 7fa646e2f700 1 -- 172.21.15.49:0/518558715 wait complete. 2023-12-16T07:33:59.766 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying crash service with default placement... 2023-12-16T07:34:00.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:00 smithi049 ceph-mon[111939]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:00.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:00 smithi049 ceph-mon[111939]: Saving service mgr spec with placement count:2 2023-12-16T07:34:00.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:00 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:00.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:00 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:00.684 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:00 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:00.753 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-16T07:34:00.753 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.144+0000 7f9f375fd700 1 Processor -- start 2023-12-16T07:34:00.753 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.144+0000 7f9f375fd700 1 -- start start 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.144+0000 7f9f375fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30102c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.145+0000 7f9f375fd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f301031c0 con 0x7f9f30076c60 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.145+0000 7f9f35399700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.145+0000 7f9f35399700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30102c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40420/0 (socket says 172.21.15.49:40420) 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.145+0000 7f9f35399700 1 -- 172.21.15.49:0/3148211200 learned_addr learned my addr 172.21.15.49:0/3148211200 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.145+0000 7f9f35399700 1 -- 172.21.15.49:0/3148211200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f30103300 con 0x7f9f30076c60 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.146+0000 7f9f35399700 1 --2- 172.21.15.49:0/3148211200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30102c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0098e0 tx=0x7f9f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417e1e46f7f41da7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.146+0000 7f9f27fff700 1 -- 172.21.15.49:0/3148211200 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c00b860 con 0x7f9f30076c60 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.146+0000 7f9f27fff700 1 -- 172.21.15.49:0/3148211200 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f2c00be70 con 0x7f9f30076c60 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.146+0000 7f9f27fff700 1 -- 172.21.15.49:0/3148211200 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c010380 con 0x7f9f30076c60 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.146+0000 7f9f375fd700 1 -- 172.21.15.49:0/3148211200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 msgr2=0x7f9f30102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.146+0000 7f9f375fd700 1 --2- 172.21.15.49:0/3148211200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30102c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0098e0 tx=0x7f9f2c009250 comp rx=0 tx=0).stop 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 -- 172.21.15.49:0/3148211200 shutdown_connections 2023-12-16T07:34:00.754 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 --2- 172.21.15.49:0/3148211200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30102c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 -- 172.21.15.49:0/3148211200 >> 172.21.15.49:0/3148211200 conn(0x7f9f300fc980 msgr2=0x7f9f300fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 -- 172.21.15.49:0/3148211200 shutdown_connections 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 -- 172.21.15.49:0/3148211200 wait complete. 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 Processor -- start 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 -- start start 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30117760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.147+0000 7f9f375fd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f30117ca0 con 0x7f9f30076c60 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f35399700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30117760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f35399700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30117760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40426/0 (socket says 172.21.15.49:40426) 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f35399700 1 -- 172.21.15.49:0/3870524997 learned_addr learned my addr 172.21.15.49:0/3870524997 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f35399700 1 -- 172.21.15.49:0/3870524997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0094f0 con 0x7f9f30076c60 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f35399700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30117760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c006d40 tx=0x7f9f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f25ffb700 1 -- 172.21.15.49:0/3870524997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c010960 con 0x7f9f30076c60 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f30117ea0 con 0x7f9f30076c60 2023-12-16T07:34:00.755 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f25ffb700 1 -- 172.21.15.49:0/3870524997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f2c01a430 con 0x7f9f30076c60 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.148+0000 7f9f25ffb700 1 -- 172.21.15.49:0/3870524997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c0245b0 con 0x7f9f30076c60 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.149+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f301182b0 con 0x7f9f30076c60 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.150+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3004bb80 con 0x7f9f30076c60 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.150+0000 7f9f25ffb700 1 -- 172.21.15.49:0/3870524997 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9f2c01a9f0 con 0x7f9f30076c60 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.150+0000 7f9f25ffb700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f9f1c0365f0 0x7f9f1c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.150+0000 7f9f25ffb700 1 -- 172.21.15.49:0/3870524997 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9f2c04a160 con 0x7f9f30076c60 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.150+0000 7f9f34b98700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f9f1c0365f0 0x7f9f1c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.151+0000 7f9f34b98700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f9f1c0365f0 0x7f9f1c038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009990 tx=0x7f9f20006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.155+0000 7f9f25ffb700 1 -- 172.21.15.49:0/3870524997 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9f2c02b8e0 con 0x7f9f30076c60 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.388+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f301067f0 con 0x7f9f1c0365f0 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.393+0000 7f9f25ffb700 1 -- 172.21.15.49:0/3870524997 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f9f301067f0 con 0x7f9f1c0365f0 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f9f1c0365f0 msgr2=0x7f9f1c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f9f1c0365f0 0x7f9f1c038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009990 tx=0x7f9f20006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 msgr2=0x7f9f30117760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:00.756 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30117760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c006d40 tx=0x7f9f2c009250 comp rx=0 tx=0).stop 2023-12-16T07:34:00.757 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 shutdown_connections 2023-12-16T07:34:00.757 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f9f1c0365f0 0x7f9f1c038aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:00.757 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 --2- 172.21.15.49:0/3870524997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f30076c60 0x7f9f30117760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:00.757 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.395+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 >> 172.21.15.49:0/3870524997 conn(0x7f9f300fc980 msgr2=0x7f9f300fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:00.757 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.396+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 shutdown_connections 2023-12-16T07:34:00.757 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:00.396+0000 7f9f375fd700 1 -- 172.21.15.49:0/3870524997 wait complete. 2023-12-16T07:34:00.757 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying prometheus service with default placement... 2023-12-16T07:34:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:01 smithi049 ceph-mon[111939]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:01 smithi049 ceph-mon[111939]: Saving service crash spec with placement * 2023-12-16T07:34:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:01 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:01 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.111+0000 7f5fa655a700 1 Processor -- start 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5fa655a700 1 -- start start 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5fa655a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa01026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5fa655a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0102c20 con 0x7f5fa01022d0 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa01026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa01026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40430/0 (socket says 172.21.15.49:40430) 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5f9ffff700 1 -- 172.21.15.49:0/3492759649 learned_addr learned my addr 172.21.15.49:0/3492759649 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:01.746 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5f9ffff700 1 -- 172.21.15.49:0/3492759649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa0102d60 con 0x7f5fa01022d0 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.112+0000 7f5f9ffff700 1 --2- 172.21.15.49:0/3492759649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa01026e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f900098e0 tx=0x7f5f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76fa90489c7e855 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5f9effd700 1 -- 172.21.15.49:0/3492759649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f9000b860 con 0x7f5fa01022d0 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5f9effd700 1 -- 172.21.15.49:0/3492759649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f9000be70 con 0x7f5fa01022d0 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5f9effd700 1 -- 172.21.15.49:0/3492759649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f90010380 con 0x7f5fa01022d0 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5fa655a700 1 -- 172.21.15.49:0/3492759649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 msgr2=0x7f5fa01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5fa655a700 1 --2- 172.21.15.49:0/3492759649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa01026e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f900098e0 tx=0x7f5f90009250 comp rx=0 tx=0).stop 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5fa655a700 1 -- 172.21.15.49:0/3492759649 shutdown_connections 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5fa655a700 1 --2- 172.21.15.49:0/3492759649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa01026e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5fa655a700 1 -- 172.21.15.49:0/3492759649 >> 172.21.15.49:0/3492759649 conn(0x7f5fa00fda50 msgr2=0x7f5fa00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5fa655a700 1 -- 172.21.15.49:0/3492759649 shutdown_connections 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.113+0000 7f5fa655a700 1 -- 172.21.15.49:0/3492759649 wait complete. 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.114+0000 7f5fa655a700 1 Processor -- start 2023-12-16T07:34:01.747 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.114+0000 7f5fa655a700 1 -- start start 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.114+0000 7f5fa655a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa0077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.114+0000 7f5fa655a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0076080 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.114+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa0077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.114+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa0077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40436/0 (socket says 172.21.15.49:40436) 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.114+0000 7f5f9ffff700 1 -- 172.21.15.49:0/4005469966 learned_addr learned my addr 172.21.15.49:0/4005469966 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.115+0000 7f5f9ffff700 1 -- 172.21.15.49:0/4005469966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900094f0 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.115+0000 7f5f9ffff700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa0077c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f90011b60 tx=0x7f5f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.115+0000 7f5f9cff9700 1 -- 172.21.15.49:0/4005469966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f90010850 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.115+0000 7f5f9cff9700 1 -- 172.21.15.49:0/4005469966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f90010e60 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.115+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa0076280 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.115+0000 7f5f9cff9700 1 -- 172.21.15.49:0/4005469966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f9001ae20 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.115+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa0076690 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.116+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa004bb80 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.116+0000 7f5f9cff9700 1 -- 172.21.15.49:0/4005469966 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5f900109b0 con 0x7f5fa01022d0 2023-12-16T07:34:01.748 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.117+0000 7f5f9cff9700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f5f88036640 0x7f5f88038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.117+0000 7f5f9cff9700 1 -- 172.21.15.49:0/4005469966 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5f9004a1a0 con 0x7f5fa01022d0 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.117+0000 7f5f9f7fe700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f5f88036640 0x7f5f88038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.117+0000 7f5f9f7fe700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f5f88036640 0x7f5f88038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009990 tx=0x7f5f94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.121+0000 7f5f9cff9700 1 -- 172.21.15.49:0/4005469966 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f9001a6a0 con 0x7f5fa01022d0 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.331+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fa010ae00 con 0x7f5f88036640 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.336+0000 7f5f9cff9700 1 -- 172.21.15.49:0/4005469966 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f5fa010ae00 con 0x7f5f88036640 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f5f88036640 msgr2=0x7f5f88038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f5f88036640 0x7f5f88038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009990 tx=0x7f5f94006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 msgr2=0x7f5fa0077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa0077c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f90011b60 tx=0x7f5f90009250 comp rx=0 tx=0).stop 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 shutdown_connections 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f5f88036640 0x7f5f88038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 --2- 172.21.15.49:0/4005469966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fa01022d0 0x7f5fa0077c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 >> 172.21.15.49:0/4005469966 conn(0x7f5fa00fda50 msgr2=0x7f5fa00ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:01.750 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 shutdown_connections 2023-12-16T07:34:01.750 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:01.339+0000 7f5fa655a700 1 -- 172.21.15.49:0/4005469966 wait complete. 2023-12-16T07:34:01.750 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying grafana service with default placement... 2023-12-16T07:34:02.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:02 smithi049 ceph-mon[111939]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:02 smithi049 ceph-mon[111939]: Saving service prometheus spec with placement count:1 2023-12-16T07:34:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:02 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:02.770 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.113+0000 7faa50640700 1 Processor -- start 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.113+0000 7faa50640700 1 -- start start 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.114+0000 7faa50640700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa481015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.114+0000 7faa50640700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48101b20 con 0x7faa481011d0 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.114+0000 7faa4e3dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa481015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.114+0000 7faa4e3dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa481015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40448/0 (socket says 172.21.15.49:40448) 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.114+0000 7faa4e3dc700 1 -- 172.21.15.49:0/2863605730 learned_addr learned my addr 172.21.15.49:0/2863605730 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.114+0000 7faa4e3dc700 1 -- 172.21.15.49:0/2863605730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48101c60 con 0x7faa481011d0 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.114+0000 7faa4e3dc700 1 --2- 172.21.15.49:0/2863605730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa481015e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa44009e50 tx=0x7faa44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15456d6dad114345 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa4d3da700 1 -- 172.21.15.49:0/2863605730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa440092e0 con 0x7faa481011d0 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa4d3da700 1 -- 172.21.15.49:0/2863605730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa44012430 con 0x7faa481011d0 2023-12-16T07:34:02.771 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa4d3da700 1 -- 172.21.15.49:0/2863605730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa440075c0 con 0x7faa481011d0 2023-12-16T07:34:02.772 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa50640700 1 -- 172.21.15.49:0/2863605730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 msgr2=0x7faa481015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:02.772 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa50640700 1 --2- 172.21.15.49:0/2863605730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa481015e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa44009e50 tx=0x7faa44009840 comp rx=0 tx=0).stop 2023-12-16T07:34:02.772 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa50640700 1 -- 172.21.15.49:0/2863605730 shutdown_connections 2023-12-16T07:34:02.772 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa50640700 1 --2- 172.21.15.49:0/2863605730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa481015e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:02.772 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa50640700 1 -- 172.21.15.49:0/2863605730 >> 172.21.15.49:0/2863605730 conn(0x7faa480fc970 msgr2=0x7faa480fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:02.772 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa50640700 1 -- 172.21.15.49:0/2863605730 shutdown_connections 2023-12-16T07:34:02.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.115+0000 7faa50640700 1 -- 172.21.15.49:0/2863605730 wait complete. 2023-12-16T07:34:02.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa50640700 1 Processor -- start 2023-12-16T07:34:02.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa50640700 1 -- start start 2023-12-16T07:34:02.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa50640700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa4810eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:02.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa50640700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4810f530 con 0x7faa481011d0 2023-12-16T07:34:02.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa4e3dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa4810eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa4e3dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa4810eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40456/0 (socket says 172.21.15.49:40456) 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa4e3dc700 1 -- 172.21.15.49:0/454099252 learned_addr learned my addr 172.21.15.49:0/454099252 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.116+0000 7faa4e3dc700 1 -- 172.21.15.49:0/454099252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009ae0 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.117+0000 7faa4e3dc700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa4810eff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa440127d0 tx=0x7faa44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.117+0000 7faa3effd700 1 -- 172.21.15.49:0/454099252 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa440092e0 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.117+0000 7faa3effd700 1 -- 172.21.15.49:0/454099252 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa44007ce0 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.117+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4810f730 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.117+0000 7faa3effd700 1 -- 172.21.15.49:0/454099252 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa4401c910 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.117+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa481103d0 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.118+0000 7faa3effd700 1 -- 172.21.15.49:0/454099252 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7faa44019070 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.118+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4805f270 con 0x7faa481011d0 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.118+0000 7faa3effd700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7faa34038870 0x7faa3403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:02.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.118+0000 7faa3effd700 1 -- 172.21.15.49:0/454099252 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faa44049d80 con 0x7faa481011d0 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.118+0000 7faa4dbdb700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7faa34038870 0x7faa3403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.119+0000 7faa4dbdb700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7faa34038870 0x7faa3403ad20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faa38009990 tx=0x7faa38006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.123+0000 7faa3effd700 1 -- 172.21.15.49:0/454099252 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faa44019500 con 0x7faa481011d0 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.344+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7faa48110ef0 con 0x7faa34038870 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.349+0000 7faa3effd700 1 -- 172.21.15.49:0/454099252 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7faa48110ef0 con 0x7faa34038870 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7faa34038870 msgr2=0x7faa3403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7faa34038870 0x7faa3403ad20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faa38009990 tx=0x7faa38006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 msgr2=0x7faa4810eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa4810eff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa440127d0 tx=0x7faa44009840 comp rx=0 tx=0).stop 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 shutdown_connections 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7faa34038870 0x7faa3403ad20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 --2- 172.21.15.49:0/454099252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa481011d0 0x7faa4810eff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:02.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 >> 172.21.15.49:0/454099252 conn(0x7faa480fc970 msgr2=0x7faa48105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:02.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 shutdown_connections 2023-12-16T07:34:02.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:02.351+0000 7faa50640700 1 -- 172.21.15.49:0/454099252 wait complete. 2023-12-16T07:34:02.776 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying node-exporter service with default placement... 2023-12-16T07:34:03.633 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:03 smithi049 ceph-mon[111939]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:03.634 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:03 smithi049 ceph-mon[111939]: Saving service grafana spec with placement count:1 2023-12-16T07:34:03.634 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:03 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:03.705 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-16T07:34:03.706 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.129+0000 7fea70195700 1 Processor -- start 2023-12-16T07:34:03.706 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.130+0000 7fea70195700 1 -- start start 2023-12-16T07:34:03.706 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.130+0000 7fea70195700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea68107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:03.706 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.130+0000 7fea70195700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68102d10 con 0x7fea68070f80 2023-12-16T07:34:03.706 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.130+0000 7fea6df31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea68107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:03.706 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.130+0000 7fea6df31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea68107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40464/0 (socket says 172.21.15.49:40464) 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.130+0000 7fea6df31700 1 -- 172.21.15.49:0/4190354893 learned_addr learned my addr 172.21.15.49:0/4190354893 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea6df31700 1 -- 172.21.15.49:0/4190354893 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea68107860 con 0x7fea68070f80 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea6df31700 1 --2- 172.21.15.49:0/4190354893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea68107320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea580098e0 tx=0x7fea58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7c305f9ea99732 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea6cf2f700 1 -- 172.21.15.49:0/4190354893 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea5800b860 con 0x7fea68070f80 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea6cf2f700 1 -- 172.21.15.49:0/4190354893 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea5800be70 con 0x7fea68070f80 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea6cf2f700 1 -- 172.21.15.49:0/4190354893 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea58010380 con 0x7fea68070f80 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea70195700 1 -- 172.21.15.49:0/4190354893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 msgr2=0x7fea68107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:03.707 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea70195700 1 --2- 172.21.15.49:0/4190354893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea68107320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea580098e0 tx=0x7fea58009250 comp rx=0 tx=0).stop 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea70195700 1 -- 172.21.15.49:0/4190354893 shutdown_connections 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea70195700 1 --2- 172.21.15.49:0/4190354893 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea68107320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.131+0000 7fea70195700 1 -- 172.21.15.49:0/4190354893 >> 172.21.15.49:0/4190354893 conn(0x7fea680fc970 msgr2=0x7fea680fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea70195700 1 -- 172.21.15.49:0/4190354893 shutdown_connections 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea70195700 1 -- 172.21.15.49:0/4190354893 wait complete. 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea70195700 1 Processor -- start 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea70195700 1 -- start start 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea70195700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea681133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:03.708 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea70195700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68113900 con 0x7fea68070f80 2023-12-16T07:34:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea6df31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea681133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea6df31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea681133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40474/0 (socket says 172.21.15.49:40474) 2023-12-16T07:34:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.132+0000 7fea6df31700 1 -- 172.21.15.49:0/2130210163 learned_addr learned my addr 172.21.15.49:0/2130210163 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.133+0000 7fea6df31700 1 -- 172.21.15.49:0/2130210163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580094f0 con 0x7fea68070f80 2023-12-16T07:34:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.133+0000 7fea6df31700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea681133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea58003080 tx=0x7fea58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.133+0000 7fea5e7fc700 1 -- 172.21.15.49:0/2130210163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea58010960 con 0x7fea68070f80 2023-12-16T07:34:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.133+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea68113b00 con 0x7fea68070f80 2023-12-16T07:34:03.710 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.133+0000 7fea5e7fc700 1 -- 172.21.15.49:0/2130210163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea5801a430 con 0x7fea68070f80 2023-12-16T07:34:03.710 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.133+0000 7fea5e7fc700 1 -- 172.21.15.49:0/2130210163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea580245b0 con 0x7fea68070f80 2023-12-16T07:34:03.710 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.133+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea68113f10 con 0x7fea68070f80 2023-12-16T07:34:03.710 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.134+0000 7fea5e7fc700 1 -- 172.21.15.49:0/2130210163 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fea58010ac0 con 0x7fea68070f80 2023-12-16T07:34:03.710 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.134+0000 7fea5e7fc700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fea540365f0 0x7fea54038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:03.710 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.134+0000 7fea5e7fc700 1 -- 172.21.15.49:0/2130210163 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fea5804a110 con 0x7fea68070f80 2023-12-16T07:34:03.711 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.134+0000 7fea6d730700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fea540365f0 0x7fea54038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:03.711 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.134+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6804bb80 con 0x7fea68070f80 2023-12-16T07:34:03.711 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.135+0000 7fea6d730700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fea540365f0 0x7fea54038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fea64009990 tx=0x7fea64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:03.711 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.139+0000 7fea5e7fc700 1 -- 172.21.15.49:0/2130210163 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fea5801a9f0 con 0x7fea68070f80 2023-12-16T07:34:03.711 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.344+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fea6810ceb0 con 0x7fea540365f0 2023-12-16T07:34:03.711 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.348+0000 7fea5e7fc700 1 -- 172.21.15.49:0/2130210163 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fea6810ceb0 con 0x7fea540365f0 2023-12-16T07:34:03.711 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fea540365f0 msgr2=0x7fea54038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fea540365f0 0x7fea54038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fea64009990 tx=0x7fea64006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 msgr2=0x7fea681133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea681133c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea58003080 tx=0x7fea58009250 comp rx=0 tx=0).stop 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 shutdown_connections 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fea540365f0 0x7fea54038aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 --2- 172.21.15.49:0/2130210163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea68070f80 0x7fea681133c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 >> 172.21.15.49:0/2130210163 conn(0x7fea680fc970 msgr2=0x7fea680fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.350+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 shutdown_connections 2023-12-16T07:34:03.712 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:03.351+0000 7fea70195700 1 -- 172.21.15.49:0/2130210163 wait complete. 2023-12-16T07:34:03.713 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying alertmanager service with default placement... 2023-12-16T07:34:04.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-16T07:34:04.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a8310700 1 Processor -- start 2023-12-16T07:34:04.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a8310700 1 -- start start 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a8310700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a0104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a8310700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0105460 con 0x7fc4a0070f80 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a60ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a0104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a60ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a0104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40486/0 (socket says 172.21.15.49:40486) 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a60ac700 1 -- 172.21.15.49:0/2497410219 learned_addr learned my addr 172.21.15.49:0/2497410219 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.059+0000 7fc4a60ac700 1 -- 172.21.15.49:0/2497410219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a01055a0 con 0x7fc4a0070f80 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a60ac700 1 --2- 172.21.15.49:0/2497410219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a0104f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0098e0 tx=0x7fc49c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c902c7548ab05e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a50aa700 1 -- 172.21.15.49:0/2497410219 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c00b860 con 0x7fc4a0070f80 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a50aa700 1 -- 172.21.15.49:0/2497410219 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc49c00be70 con 0x7fc4a0070f80 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a50aa700 1 -- 172.21.15.49:0/2497410219 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c010380 con 0x7fc4a0070f80 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a8310700 1 -- 172.21.15.49:0/2497410219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 msgr2=0x7fc4a0104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a8310700 1 --2- 172.21.15.49:0/2497410219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a0104f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0098e0 tx=0x7fc49c009250 comp rx=0 tx=0).stop 2023-12-16T07:34:04.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a8310700 1 -- 172.21.15.49:0/2497410219 shutdown_connections 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a8310700 1 --2- 172.21.15.49:0/2497410219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a0104f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a8310700 1 -- 172.21.15.49:0/2497410219 >> 172.21.15.49:0/2497410219 conn(0x7fc4a00fc970 msgr2=0x7fc4a00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a8310700 1 -- 172.21.15.49:0/2497410219 shutdown_connections 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.060+0000 7fc4a8310700 1 -- 172.21.15.49:0/2497410219 wait complete. 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.061+0000 7fc4a8310700 1 Processor -- start 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.061+0000 7fc4a8310700 1 -- start start 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.061+0000 7fc4a8310700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a01111b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.061+0000 7fc4a8310700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01116f0 con 0x7fc4a0070f80 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.061+0000 7fc4a60ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a01111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:04.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.061+0000 7fc4a60ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a01111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40500/0 (socket says 172.21.15.49:40500) 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.061+0000 7fc4a60ac700 1 -- 172.21.15.49:0/4109956280 learned_addr learned my addr 172.21.15.49:0/4109956280 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.062+0000 7fc4a60ac700 1 -- 172.21.15.49:0/4109956280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0094f0 con 0x7fc4a0070f80 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.062+0000 7fc4a60ac700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a01111b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0094c0 tx=0x7fc49c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.062+0000 7fc492ffd700 1 -- 172.21.15.49:0/4109956280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c010850 con 0x7fc4a0070f80 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.062+0000 7fc492ffd700 1 -- 172.21.15.49:0/4109956280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc49c010e60 con 0x7fc4a0070f80 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.062+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a01118f0 con 0x7fc4a0070f80 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.062+0000 7fc492ffd700 1 -- 172.21.15.49:0/4109956280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c01a430 con 0x7fc4a0070f80 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.062+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a0111d00 con 0x7fc4a0070f80 2023-12-16T07:34:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.063+0000 7fc492ffd700 1 -- 172.21.15.49:0/4109956280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc49c01a6b0 con 0x7fc4a0070f80 2023-12-16T07:34:04.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.063+0000 7fc492ffd700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc48c0365f0 0x7fc48c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:04.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.063+0000 7fc492ffd700 1 -- 172.21.15.49:0/4109956280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc49c04a420 con 0x7fc4a0070f80 2023-12-16T07:34:04.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.063+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a004bb80 con 0x7fc4a0070f80 2023-12-16T07:34:04.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.063+0000 7fc4a58ab700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc48c0365f0 0x7fc48c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:04.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.063+0000 7fc4a58ab700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc48c0365f0 0x7fc48c038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc494009990 tx=0x7fc494006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:04.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.068+0000 7fc492ffd700 1 -- 172.21.15.49:0/4109956280 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc49c018d90 con 0x7fc4a0070f80 2023-12-16T07:34:04.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.274+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4a010ad90 con 0x7fc48c0365f0 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.279+0000 7fc492ffd700 1 -- 172.21.15.49:0/4109956280 <== mgr.14120 v2:172.21.15.49:6800/3810957388 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fc4a010ad90 con 0x7fc48c0365f0 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc48c0365f0 msgr2=0x7fc48c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc48c0365f0 0x7fc48c038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc494009990 tx=0x7fc494006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 msgr2=0x7fc4a01111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a01111b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0094c0 tx=0x7fc49c009250 comp rx=0 tx=0).stop 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 shutdown_connections 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc48c0365f0 0x7fc48c038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 --2- 172.21.15.49:0/4109956280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4a0070f80 0x7fc4a01111b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 >> 172.21.15.49:0/4109956280 conn(0x7fc4a00fc970 msgr2=0x7fc4a00fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 shutdown_connections 2023-12-16T07:34:04.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.281+0000 7fc4a8310700 1 -- 172.21.15.49:0/4109956280 wait complete. 2023-12-16T07:34:04.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:04 smithi049 ceph-mon[111939]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:04.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:04 smithi049 ceph-mon[111939]: Saving service node-exporter spec with placement * 2023-12-16T07:34:04.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:04 smithi049 ceph-mon[111939]: from='mgr.14120 172.21.15.49:0/3194874233' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:05.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:05 smithi049 ceph-mon[111939]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:05.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:05 smithi049 ceph-mon[111939]: Saving service alertmanager spec with placement count:1 2023-12-16T07:34:05.565 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.992+0000 7fb04083f700 1 Processor -- start 2023-12-16T07:34:05.565 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.992+0000 7fb04083f700 1 -- start start 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.992+0000 7fb04083f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.992+0000 7fb04083f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1053e0 con 0x7fb03c071000 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40512/0 (socket says 172.21.15.49:40512) 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03a59c700 1 -- 172.21.15.49:0/1826806569 learned_addr learned my addr 172.21.15.49:0/1826806569 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03a59c700 1 -- 172.21.15.49:0/1826806569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c105520 con 0x7fb03c071000 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03a59c700 1 --2- 172.21.15.49:0/1826806569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c104ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0300098e0 tx=0x7fb030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2870ca5369f44d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03959a700 1 -- 172.21.15.49:0/1826806569 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb03000b860 con 0x7fb03c071000 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03959a700 1 -- 172.21.15.49:0/1826806569 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb03000be70 con 0x7fb03c071000 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.993+0000 7fb03959a700 1 -- 172.21.15.49:0/1826806569 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb030010380 con 0x7fb03c071000 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.994+0000 7fb04083f700 1 -- 172.21.15.49:0/1826806569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 msgr2=0x7fb03c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.994+0000 7fb04083f700 1 --2- 172.21.15.49:0/1826806569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c104ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0300098e0 tx=0x7fb030009250 comp rx=0 tx=0).stop 2023-12-16T07:34:05.566 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.994+0000 7fb04083f700 1 -- 172.21.15.49:0/1826806569 shutdown_connections 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.994+0000 7fb04083f700 1 --2- 172.21.15.49:0/1826806569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c104ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.994+0000 7fb04083f700 1 -- 172.21.15.49:0/1826806569 >> 172.21.15.49:0/1826806569 conn(0x7fb03c0fc970 msgr2=0x7fb03c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.994+0000 7fb04083f700 1 -- 172.21.15.49:0/1826806569 shutdown_connections 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.994+0000 7fb04083f700 1 -- 172.21.15.49:0/1826806569 wait complete. 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb04083f700 1 Processor -- start 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb04083f700 1 -- start start 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb04083f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c1111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb04083f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c111700 con 0x7fb03c071000 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb03a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c1111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb03a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c1111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40518/0 (socket says 172.21.15.49:40518) 2023-12-16T07:34:05.567 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb03a59c700 1 -- 172.21.15.49:0/3915224257 learned_addr learned my addr 172.21.15.49:0/3915224257 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb03a59c700 1 -- 172.21.15.49:0/3915224257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300094f0 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb03a59c700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c1111c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb030006d40 tx=0x7fb030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb02affd700 1 -- 172.21.15.49:0/3915224257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb030010960 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb02affd700 1 -- 172.21.15.49:0/3915224257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb03001a430 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c111900 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb02affd700 1 -- 172.21.15.49:0/3915224257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0300245b0 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.995+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c111d10 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.996+0000 7fb02affd700 1 -- 172.21.15.49:0/3915224257 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb03001a9f0 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.996+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c04bb80 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.996+0000 7fb02affd700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb024036640 0x7fb024038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.996+0000 7fb02affd700 1 -- 172.21.15.49:0/3915224257 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb03004a090 con 0x7fb03c071000 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.997+0000 7fb039d9b700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb024036640 0x7fb024038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:04.997+0000 7fb039d9b700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb024036640 0x7fb024038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009990 tx=0x7fb02c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:05.568 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.001+0000 7fb02affd700 1 -- 172.21.15.49:0/3915224257 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb03002b8c0 con 0x7fb03c071000 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.194+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fb03c106300 con 0x7fb03c071000 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.197+0000 7fb02affd700 1 -- 172.21.15.49:0/3915224257 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb03002b2f0 con 0x7fb03c071000 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb024036640 msgr2=0x7fb024038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb024036640 0x7fb024038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009990 tx=0x7fb02c006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 msgr2=0x7fb03c1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c1111c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb030006d40 tx=0x7fb030009250 comp rx=0 tx=0).stop 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 shutdown_connections 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fb024036640 0x7fb024038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 --2- 172.21.15.49:0/3915224257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb03c071000 0x7fb03c1111c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 >> 172.21.15.49:0/3915224257 conn(0x7fb03c0fc970 msgr2=0x7fb03c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:05.569 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 shutdown_connections 2023-12-16T07:34:05.570 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.200+0000 7fb04083f700 1 -- 172.21.15.49:0/3915224257 wait complete. 2023-12-16T07:34:05.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:05 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3915224257' entity='client.admin' 2023-12-16T07:34:06.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.926+0000 7f559fe87700 1 Processor -- start 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.926+0000 7f559fe87700 1 -- start start 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.926+0000 7f559fe87700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f55981015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.926+0000 7f559fe87700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5598101b20 con 0x7f55981011d0 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559dc23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f55981015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559dc23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f55981015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40534/0 (socket says 172.21.15.49:40534) 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559dc23700 1 -- 172.21.15.49:0/3227318059 learned_addr learned my addr 172.21.15.49:0/3227318059 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559dc23700 1 -- 172.21.15.49:0/3227318059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598101c60 con 0x7f55981011d0 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559dc23700 1 --2- 172.21.15.49:0/3227318059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f55981015e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f558800bb80 tx=0x7f558800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b0594f96add96e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559cc21700 1 -- 172.21.15.49:0/3227318059 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f558800dd00 con 0x7f55981011d0 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559cc21700 1 -- 172.21.15.49:0/3227318059 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f558800de60 con 0x7f55981011d0 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.927+0000 7f559cc21700 1 -- 172.21.15.49:0/3227318059 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55880188d0 con 0x7f55981011d0 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 -- 172.21.15.49:0/3227318059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 msgr2=0x7f55981015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 --2- 172.21.15.49:0/3227318059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f55981015e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f558800bb80 tx=0x7f558800b4f0 comp rx=0 tx=0).stop 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 -- 172.21.15.49:0/3227318059 shutdown_connections 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 --2- 172.21.15.49:0/3227318059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f55981015e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 -- 172.21.15.49:0/3227318059 >> 172.21.15.49:0/3227318059 conn(0x7f55980fc970 msgr2=0x7f55980fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 -- 172.21.15.49:0/3227318059 shutdown_connections 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 -- 172.21.15.49:0/3227318059 wait complete. 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 Processor -- start 2023-12-16T07:34:06.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.928+0000 7f559fe87700 1 -- start start 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559fe87700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f559810ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559fe87700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559810f470 con 0x7f55981011d0 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559dc23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f559810ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559dc23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f559810ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40542/0 (socket says 172.21.15.49:40542) 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559dc23700 1 -- 172.21.15.49:0/464203897 learned_addr learned my addr 172.21.15.49:0/464203897 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559dc23700 1 -- 172.21.15.49:0/464203897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558800b790 con 0x7f55981011d0 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559dc23700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f559810ef30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55880184f0 tx=0x7f558800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f558e7fc700 1 -- 172.21.15.49:0/464203897 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5588010bd0 con 0x7f55981011d0 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559810f670 con 0x7f55981011d0 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f558e7fc700 1 -- 172.21.15.49:0/464203897 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f558801d050 con 0x7f55981011d0 2023-12-16T07:34:06.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f558e7fc700 1 -- 172.21.15.49:0/464203897 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5588022590 con 0x7f55981011d0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.929+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559810fa80 con 0x7f55981011d0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.930+0000 7f558e7fc700 1 -- 172.21.15.49:0/464203897 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5588023470 con 0x7f55981011d0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.930+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559804bb80 con 0x7f55981011d0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.930+0000 7f558e7fc700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f55840365f0 0x7f5584038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.930+0000 7f558e7fc700 1 -- 172.21.15.49:0/464203897 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5588014070 con 0x7f55981011d0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.930+0000 7f559d422700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f55840365f0 0x7f5584038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.931+0000 7f559d422700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f55840365f0 0x7f5584038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5594009990 tx=0x7f5594006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:05.935+0000 7f558e7fc700 1 -- 172.21.15.49:0/464203897 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f558802d460 con 0x7f55981011d0 2023-12-16T07:34:06.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.129+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5598102fb0 con 0x7f55981011d0 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.132+0000 7f558e7fc700 1 -- 172.21.15.49:0/464203897 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f558800e360 con 0x7f55981011d0 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f55840365f0 msgr2=0x7f5584038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f55840365f0 0x7f5584038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5594009990 tx=0x7f5594006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 msgr2=0x7f559810ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f559810ef30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55880184f0 tx=0x7f558800b4f0 comp rx=0 tx=0).stop 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 shutdown_connections 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f55840365f0 0x7f5584038aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 --2- 172.21.15.49:0/464203897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55981011d0 0x7f559810ef30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 >> 172.21.15.49:0/464203897 conn(0x7f55980fc970 msgr2=0x7f5598105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:06.741 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 shutdown_connections 2023-12-16T07:34:06.742 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:06.134+0000 7f559fe87700 1 -- 172.21.15.49:0/464203897 wait complete. 2023-12-16T07:34:06.742 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling the dashboard module... 2023-12-16T07:34:07.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:07 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/464203897' entity='client.admin' 2023-12-16T07:34:08.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:08 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1092510316' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-16T07:34:08.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60f929700 1 Processor -- start 2023-12-16T07:34:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60f929700 1 -- start start 2023-12-16T07:34:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60f929700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc608102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60f929700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc608103250 con 0x7fc608102900 2023-12-16T07:34:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60d6c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc608102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60d6c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc608102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40544/0 (socket says 172.21.15.49:40544) 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60d6c5700 1 -- 172.21.15.49:0/2081596545 learned_addr learned my addr 172.21.15.49:0/2081596545 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.080+0000 7fc60d6c5700 1 -- 172.21.15.49:0/2081596545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608103390 con 0x7fc608102900 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60d6c5700 1 --2- 172.21.15.49:0/2081596545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc608102d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098e0 tx=0x7fc604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6f8cf12162296f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc5fbfff700 1 -- 172.21.15.49:0/2081596545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc60400b860 con 0x7fc608102900 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc5fbfff700 1 -- 172.21.15.49:0/2081596545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc60400be70 con 0x7fc608102900 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc5fbfff700 1 -- 172.21.15.49:0/2081596545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc604010380 con 0x7fc608102900 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60f929700 1 -- 172.21.15.49:0/2081596545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 msgr2=0x7fc608102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60f929700 1 --2- 172.21.15.49:0/2081596545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc608102d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098e0 tx=0x7fc604009250 comp rx=0 tx=0).stop 2023-12-16T07:34:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60f929700 1 -- 172.21.15.49:0/2081596545 shutdown_connections 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60f929700 1 --2- 172.21.15.49:0/2081596545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc608102d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60f929700 1 -- 172.21.15.49:0/2081596545 >> 172.21.15.49:0/2081596545 conn(0x7fc6080fc0b0 msgr2=0x7fc6080fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60f929700 1 -- 172.21.15.49:0/2081596545 shutdown_connections 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.081+0000 7fc60f929700 1 -- 172.21.15.49:0/2081596545 wait complete. 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.082+0000 7fc60f929700 1 Processor -- start 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.082+0000 7fc60f929700 1 -- start start 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.082+0000 7fc60f929700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc6081133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.082+0000 7fc60f929700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6081138e0 con 0x7fc608102900 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.082+0000 7fc60d6c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc6081133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.082+0000 7fc60d6c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc6081133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40554/0 (socket says 172.21.15.49:40554) 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.082+0000 7fc60d6c5700 1 -- 172.21.15.49:0/1092510316 learned_addr learned my addr 172.21.15.49:0/1092510316 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.083+0000 7fc60d6c5700 1 -- 172.21.15.49:0/1092510316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040094f0 con 0x7fc608102900 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.083+0000 7fc60d6c5700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc6081133a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc604011b60 tx=0x7fc604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:08.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.083+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc604010850 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.083+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc604010e60 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.083+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc608113ae0 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.083+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc60401ae20 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.083+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc608113ef0 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.084+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60804bb80 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.084+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc6040109b0 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.085+0000 7fc5f9ffb700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc5f4036640 0x7fc5f4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.085+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc60404a400 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.085+0000 7fc60cec4700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc5f4036640 0x7fc5f4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.085+0000 7fc60cec4700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc5f4036640 0x7fc5f4038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009990 tx=0x7fc5fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.089+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc60401a6a0 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:07.341+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fc60810d1a0 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.135+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fc6040495a0 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.136+0000 7fc5f9ffb700 1 -- 172.21.15.49:0/1092510316 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fc604017c10 con 0x7fc608102900 2023-12-16T07:34:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc5f4036640 msgr2=0x7fc5f4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc5f4036640 0x7fc5f4038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009990 tx=0x7fc5fc006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 msgr2=0x7fc6081133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc6081133a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc604011b60 tx=0x7fc604009250 comp rx=0 tx=0).stop 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 shutdown_connections 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7fc5f4036640 0x7fc5f4038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 --2- 172.21.15.49:0/1092510316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608102900 0x7fc6081133a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 >> 172.21.15.49:0/1092510316 conn(0x7fc6080fc0b0 msgr2=0x7fc6080fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 shutdown_connections 2023-12-16T07:34:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.140+0000 7fc60f929700 1 -- 172.21.15.49:0/1092510316 wait complete. 2023-12-16T07:34:09.449 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:09 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1092510316' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-16T07:34:09.449 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:09 smithi049 ceph-mon[111939]: mgrmap e9: smithi049.rqlvwo(active, since 19s) 2023-12-16T07:34:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:34:09.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "smithi049.rqlvwo", 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.919+0000 7f6349bc3700 1 Processor -- start 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.919+0000 7f6349bc3700 1 -- start start 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.919+0000 7f6349bc3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f63440771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.919+0000 7f6349bc3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63440790d0 con 0x7f6344078cc0 2023-12-16T07:34:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.919+0000 7f63437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f63440771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:09.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.919+0000 7f63437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f63440771d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57052/0 (socket says 172.21.15.49:57052) 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.919+0000 7f63437fe700 1 -- 172.21.15.49:0/1295285733 learned_addr learned my addr 172.21.15.49:0/1295285733 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.920+0000 7f63437fe700 1 -- 172.21.15.49:0/1295285733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344077710 con 0x7f6344078cc0 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.920+0000 7f63437fe700 1 --2- 172.21.15.49:0/1295285733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f63440771d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63340098e0 tx=0x7f6334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0c9dbfd061a795 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.920+0000 7f63427fc700 1 -- 172.21.15.49:0/1295285733 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f633400b860 con 0x7f6344078cc0 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.920+0000 7f63427fc700 1 -- 172.21.15.49:0/1295285733 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f633400be70 con 0x7f6344078cc0 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.920+0000 7f63427fc700 1 -- 172.21.15.49:0/1295285733 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6334010380 con 0x7f6344078cc0 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 -- 172.21.15.49:0/1295285733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 msgr2=0x7f63440771d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:09.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 --2- 172.21.15.49:0/1295285733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f63440771d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63340098e0 tx=0x7f6334009250 comp rx=0 tx=0).stop 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 -- 172.21.15.49:0/1295285733 shutdown_connections 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 --2- 172.21.15.49:0/1295285733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f63440771d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 -- 172.21.15.49:0/1295285733 >> 172.21.15.49:0/1295285733 conn(0x7f63440fda10 msgr2=0x7f63440ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 -- 172.21.15.49:0/1295285733 shutdown_connections 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 -- 172.21.15.49:0/1295285733 wait complete. 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.921+0000 7f6349bc3700 1 Processor -- start 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f6349bc3700 1 -- start start 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f6349bc3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f6344113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f6349bc3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344113870 con 0x7f6344078cc0 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f63437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f6344113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f63437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f6344113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57066/0 (socket says 172.21.15.49:57066) 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f63437fe700 1 -- 172.21.15.49:0/2421262912 learned_addr learned my addr 172.21.15.49:0/2421262912 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f63437fe700 1 -- 172.21.15.49:0/2421262912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340094f0 con 0x7f6344078cc0 2023-12-16T07:34:09.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f63437fe700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f6344113330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63340094c0 tx=0x7f6334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f632bfff700 1 -- 172.21.15.49:0/2421262912 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6334010850 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f632bfff700 1 -- 172.21.15.49:0/2421262912 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6334010e60 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6344113a70 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.922+0000 7f632bfff700 1 -- 172.21.15.49:0/2421262912 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63340243f0 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.923+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344113e80 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.923+0000 7f632bfff700 1 -- 172.21.15.49:0/2421262912 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f6334024660 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.923+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634404bb80 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.924+0000 7f632bfff700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 0x7f632c038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.924+0000 7f632bfff700 1 -- 172.21.15.49:0/2421262912 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f633404a670 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.924+0000 7f6342ffd700 1 -- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 msgr2=0x7f632c038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3810957388 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.924+0000 7f6342ffd700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 0x7f632c038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:08.928+0000 7f632bfff700 1 -- 172.21.15.49:0/2421262912 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6334018d90 con 0x7f6344078cc0 2023-12-16T07:34:09.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.125+0000 7f6342ffd700 1 -- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 msgr2=0x7f632c038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3810957388 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.125+0000 7f6342ffd700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 0x7f632c038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.179+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f634410d170 con 0x7f6344078cc0 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.180+0000 7f632bfff700 1 -- 172.21.15.49:0/2421262912 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f6334018350 con 0x7f6344078cc0 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 msgr2=0x7f632c038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 0x7f632c038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 msgr2=0x7f6344113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f6344113330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63340094c0 tx=0x7f6334009250 comp rx=0 tx=0).stop 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 shutdown_connections 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f632c036690 0x7f632c038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 --2- 172.21.15.49:0/2421262912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344078cc0 0x7f6344113330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 >> 172.21.15.49:0/2421262912 conn(0x7f63440fda10 msgr2=0x7f63440ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 shutdown_connections 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.182+0000 7f6349bc3700 1 -- 172.21.15.49:0/2421262912 wait complete. 2023-12-16T07:34:09.542 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2023-12-16T07:34:09.543 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 9... 2023-12-16T07:34:10.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:10 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2421262912' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-16T07:34:15.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:34:15.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:34:15.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: osdmap e3: 0 total, 0 up, 0 in 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: mgrmap e10: smithi049.rqlvwo(active, starting, since 0.00335123s) 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:34:15.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:15 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:34:16.265 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:16 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:34:16.265 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:16 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:34:16.265 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:16 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:16.265 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:16 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:16.265 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:16 smithi049 ceph-mon[111939]: mgrmap e11: smithi049.rqlvwo(active, since 1.00558s) 2023-12-16T07:34:16.353 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f470dc9a700 1 Processor -- start 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f470dc9a700 1 -- start start 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f470dc9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47080760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f470dc9a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4708077fe0 con 0x7f4708077bd0 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f47077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47080760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f47077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47080760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57078/0 (socket says 172.21.15.49:57078) 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f47077fe700 1 -- 172.21.15.49:0/427427889 learned_addr learned my addr 172.21.15.49:0/427427889 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.933+0000 7f47077fe700 1 -- 172.21.15.49:0/427427889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708076620 con 0x7f4708077bd0 2023-12-16T07:34:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f47077fe700 1 --2- 172.21.15.49:0/427427889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47080760e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46f80098e0 tx=0x7f46f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e47afeb2fcd7d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f47067fc700 1 -- 172.21.15.49:0/427427889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f800b860 con 0x7f4708077bd0 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f47067fc700 1 -- 172.21.15.49:0/427427889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46f800be70 con 0x7f4708077bd0 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f47067fc700 1 -- 172.21.15.49:0/427427889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f8010380 con 0x7f4708077bd0 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f470dc9a700 1 -- 172.21.15.49:0/427427889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 msgr2=0x7f47080760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f470dc9a700 1 --2- 172.21.15.49:0/427427889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47080760e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46f80098e0 tx=0x7f46f8009250 comp rx=0 tx=0).stop 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f470dc9a700 1 -- 172.21.15.49:0/427427889 shutdown_connections 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f470dc9a700 1 --2- 172.21.15.49:0/427427889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47080760e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.934+0000 7f470dc9a700 1 -- 172.21.15.49:0/427427889 >> 172.21.15.49:0/427427889 conn(0x7f47080fda50 msgr2=0x7f47080ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.935+0000 7f470dc9a700 1 -- 172.21.15.49:0/427427889 shutdown_connections 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.935+0000 7f470dc9a700 1 -- 172.21.15.49:0/427427889 wait complete. 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.935+0000 7f470dc9a700 1 Processor -- start 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.935+0000 7f470dc9a700 1 -- start start 2023-12-16T07:34:16.355 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.935+0000 7f470dc9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47081133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.935+0000 7f470dc9a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4708113900 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f47077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47081133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f47077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47081133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57086/0 (socket says 172.21.15.49:57086) 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f47077fe700 1 -- 172.21.15.49:0/2206287296 learned_addr learned my addr 172.21.15.49:0/2206287296 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f47077fe700 1 -- 172.21.15.49:0/2206287296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80094f0 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f47077fe700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47081133c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46f80094c0 tx=0x7f46f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f8010850 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46f8010e60 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f801a430 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4708113b00 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.936+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708113f10 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.937+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f46f801a660 con 0x7f4708077bd0 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.937+0000 7f46effff700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.937+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 --> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f470804bb80 con 0x7f46f0036690 2023-12-16T07:34:16.356 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.937+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f46f804b460 con 0x7f4708077bd0 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.937+0000 7f4706ffd700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 msgr2=0x7f46f0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3810957388 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:09.937+0000 7f4706ffd700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:10.138+0000 7f4706ffd700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 msgr2=0x7f46f0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3810957388 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:10.138+0000 7f4706ffd700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:10.539+0000 7f4706ffd700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 msgr2=0x7f46f0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3810957388 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:10.539+0000 7f4706ffd700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:11.340+0000 7f4706ffd700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 msgr2=0x7f46f0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3810957388 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:11.340+0000 7f4706ffd700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:12.941+0000 7f4706ffd700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 msgr2=0x7f46f0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3810957388 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:12.941+0000 7f4706ffd700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:14.966+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f46f800fdc0 con 0x7f4708077bd0 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:14.966+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 msgr2=0x7f46f0038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:34:16.357 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:14.966+0000 7f46effff700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.967+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f46f8018350 con 0x7f4708077bd0 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.968+0000 7f46effff700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f46f0039f90 0x7f46f003c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.968+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f470804bb80 con 0x7f46f0039f90 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.968+0000 7f4706ffd700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f46f0039f90 0x7f46f003c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.969+0000 7f4706ffd700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f46f0039f90 0x7f46f003c370 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0039d0 tx=0x7f46fc009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.969+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mgr.14162 v2:172.21.15.49:6800/1804466564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f470804bb80 con 0x7f46f0039f90 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.975+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f4708108540 con 0x7f46f0039f90 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.975+0000 7f46effff700 1 -- 172.21.15.49:0/2206287296 <== mgr.14162 v2:172.21.15.49:6800/1804466564 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f4708108540 con 0x7f46f0039f90 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f46f0039f90 msgr2=0x7f46f003c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f46f0039f90 0x7f46f003c370 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0039d0 tx=0x7f46fc009350 comp rx=0 tx=0).stop 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 msgr2=0x7f47081133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47081133c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46f80094c0 tx=0x7f46f8009250 comp rx=0 tx=0).stop 2023-12-16T07:34:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 shutdown_connections 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f46f0039f90 0x7f46f003c370 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4708077bd0 0x7f47081133c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 --2- 172.21.15.49:0/2206287296 >> [v2:172.21.15.49:6800/3810957388,v1:172.21.15.49:6801/3810957388] conn(0x7f46f0036690 0x7f46f0038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 >> 172.21.15.49:0/2206287296 conn(0x7f47080fda50 msgr2=0x7f47080ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 shutdown_connections 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:15.976+0000 7f470dc9a700 1 -- 172.21.15.49:0/2206287296 wait complete. 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 9 is available 2023-12-16T07:34:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:Generating a dashboard self-signed certificate... 2023-12-16T07:34:17.298 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: [16/Dec/2023:07:34:15] ENGINE Bus STARTING 2023-12-16T07:34:17.298 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: [16/Dec/2023:07:34:15] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:34:17.298 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: [16/Dec/2023:07:34:15] ENGINE Bus STARTED 2023-12-16T07:34:17.299 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-16T07:34:17.299 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-16T07:34:17.299 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:17.299 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:17.299 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:17 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:17.379 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-16T07:34:17.379 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.718+0000 7fe4ab265700 1 Processor -- start 2023-12-16T07:34:17.379 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.718+0000 7fe4ab265700 1 -- start start 2023-12-16T07:34:17.379 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.718+0000 7fe4ab265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:17.379 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.718+0000 7fe4ab265700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41053e0 con 0x7fe4a4076c60 2023-12-16T07:34:17.379 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe4a9001700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:17.379 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe4a9001700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57166/0 (socket says 172.21.15.49:57166) 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe4a9001700 1 -- 172.21.15.49:0/3196697313 learned_addr learned my addr 172.21.15.49:0/3196697313 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe4a9001700 1 -- 172.21.15.49:0/3196697313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4105520 con 0x7fe4a4076c60 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe4a9001700 1 --2- 172.21.15.49:0/3196697313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4104ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098e0 tx=0x7fe4a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f987348a514ade server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe49bfff700 1 -- 172.21.15.49:0/3196697313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a000b860 con 0x7fe4a4076c60 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe49bfff700 1 -- 172.21.15.49:0/3196697313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4a000be70 con 0x7fe4a4076c60 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.719+0000 7fe49bfff700 1 -- 172.21.15.49:0/3196697313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a0010380 con 0x7fe4a4076c60 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.720+0000 7fe4ab265700 1 -- 172.21.15.49:0/3196697313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 msgr2=0x7fe4a4104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.720+0000 7fe4ab265700 1 --2- 172.21.15.49:0/3196697313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4104ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098e0 tx=0x7fe4a0009250 comp rx=0 tx=0).stop 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.720+0000 7fe4ab265700 1 -- 172.21.15.49:0/3196697313 shutdown_connections 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.720+0000 7fe4ab265700 1 --2- 172.21.15.49:0/3196697313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4104ea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.720+0000 7fe4ab265700 1 -- 172.21.15.49:0/3196697313 >> 172.21.15.49:0/3196697313 conn(0x7fe4a40fc950 msgr2=0x7fe4a40fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.720+0000 7fe4ab265700 1 -- 172.21.15.49:0/3196697313 shutdown_connections 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.720+0000 7fe4ab265700 1 -- 172.21.15.49:0/3196697313 wait complete. 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.721+0000 7fe4ab265700 1 Processor -- start 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.721+0000 7fe4ab265700 1 -- start start 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.721+0000 7fe4ab265700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.721+0000 7fe4ab265700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41116d0 con 0x7fe4a4076c60 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.721+0000 7fe4a9001700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.721+0000 7fe4a9001700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57168/0 (socket says 172.21.15.49:57168) 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.721+0000 7fe4a9001700 1 -- 172.21.15.49:0/176304362 learned_addr learned my addr 172.21.15.49:0/176304362 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.722+0000 7fe4a9001700 1 -- 172.21.15.49:0/176304362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00094f0 con 0x7fe4a4076c60 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.722+0000 7fe4a9001700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4111190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00094c0 tx=0x7fe4a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.722+0000 7fe499ffb700 1 -- 172.21.15.49:0/176304362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a0010850 con 0x7fe4a4076c60 2023-12-16T07:34:17.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.722+0000 7fe499ffb700 1 -- 172.21.15.49:0/176304362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4a0010e60 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.722+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a41118d0 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.722+0000 7fe499ffb700 1 -- 172.21.15.49:0/176304362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4a001a430 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.722+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a4111ce0 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.723+0000 7fe499ffb700 1 -- 172.21.15.49:0/176304362 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fe4a001a6b0 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.724+0000 7fe499ffb700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fe490036510 0x7fe4900389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.724+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a404bb80 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.724+0000 7fe499ffb700 1 -- 172.21.15.49:0/176304362 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe4a004a400 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.724+0000 7fe4a8800700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fe490036510 0x7fe4900389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.724+0000 7fe4a8800700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fe490036510 0x7fe4900389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe494009990 tx=0x7fe494006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.729+0000 7fe499ffb700 1 -- 172.21.15.49:0/176304362 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe4a0022340 con 0x7fe4a4076c60 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:16.931+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4a410aff0 con 0x7fe490036510 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.013+0000 7fe499ffb700 1 -- 172.21.15.49:0/176304362 <== mgr.14162 v2:172.21.15.49:6800/1804466564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fe4a410aff0 con 0x7fe490036510 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fe490036510 msgr2=0x7fe4900389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fe490036510 0x7fe4900389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe494009990 tx=0x7fe494006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:17.382 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 msgr2=0x7fe4a4111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4111190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00094c0 tx=0x7fe4a0009250 comp rx=0 tx=0).stop 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 shutdown_connections 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fe490036510 0x7fe4900389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 --2- 172.21.15.49:0/176304362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe4a4076c60 0x7fe4a4111190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 >> 172.21.15.49:0/176304362 conn(0x7fe4a40fc950 msgr2=0x7fe4a40fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 shutdown_connections 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.015+0000 7fe4ab265700 1 -- 172.21.15.49:0/176304362 wait complete. 2023-12-16T07:34:17.383 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial admin user... 2023-12-16T07:34:18.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:18 smithi049 ceph-mon[111939]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:18.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:18 smithi049 ceph-mon[111939]: mgrmap e12: smithi049.rqlvwo(active, since 2s) 2023-12-16T07:34:18.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$9hurQAie5s6EZEkpEm.rW.pa8zIIiotBKQAFQZkF//1OeWQGHbnLS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702712058, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-16T07:34:18.600 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.778+0000 7ff6362a7700 1 Processor -- start 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.778+0000 7ff6362a7700 1 -- start start 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff6362a7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff630104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff6362a7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6301053e0 con 0x7ff630071000 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff630104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff630104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49104/0 (socket says 172.21.15.49:49104) 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62ffff700 1 -- 172.21.15.49:0/1298298342 learned_addr learned my addr 172.21.15.49:0/1298298342 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62ffff700 1 -- 172.21.15.49:0/1298298342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630105520 con 0x7ff630071000 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62ffff700 1 --2- 172.21.15.49:0/1298298342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff630104ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff6180098e0 tx=0x7ff618009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1567ceeb4ee4aa2f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62effd700 1 -- 172.21.15.49:0/1298298342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff61800b860 con 0x7ff630071000 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62effd700 1 -- 172.21.15.49:0/1298298342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff61800be70 con 0x7ff630071000 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.779+0000 7ff62effd700 1 -- 172.21.15.49:0/1298298342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff618010380 con 0x7ff630071000 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.780+0000 7ff6362a7700 1 -- 172.21.15.49:0/1298298342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 msgr2=0x7ff630104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:18.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.780+0000 7ff6362a7700 1 --2- 172.21.15.49:0/1298298342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff630104ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff6180098e0 tx=0x7ff618009250 comp rx=0 tx=0).stop 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.780+0000 7ff6362a7700 1 -- 172.21.15.49:0/1298298342 shutdown_connections 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.780+0000 7ff6362a7700 1 --2- 172.21.15.49:0/1298298342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff630104ea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.780+0000 7ff6362a7700 1 -- 172.21.15.49:0/1298298342 >> 172.21.15.49:0/1298298342 conn(0x7ff6300fc970 msgr2=0x7ff6300fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.780+0000 7ff6362a7700 1 -- 172.21.15.49:0/1298298342 shutdown_connections 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.780+0000 7ff6362a7700 1 -- 172.21.15.49:0/1298298342 wait complete. 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff6362a7700 1 Processor -- start 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff6362a7700 1 -- start start 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff6362a7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff6301111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff6362a7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff630111700 con 0x7ff630071000 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff62ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff6301111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff62ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff6301111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49118/0 (socket says 172.21.15.49:49118) 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff62ffff700 1 -- 172.21.15.49:0/2015639318 learned_addr learned my addr 172.21.15.49:0/2015639318 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.781+0000 7ff62ffff700 1 -- 172.21.15.49:0/2015639318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6180094f0 con 0x7ff630071000 2023-12-16T07:34:18.602 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.782+0000 7ff62ffff700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff6301111c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff618006d40 tx=0x7ff618009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.782+0000 7ff62cff9700 1 -- 172.21.15.49:0/2015639318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff618010960 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.782+0000 7ff62cff9700 1 -- 172.21.15.49:0/2015639318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff61801a430 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.782+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff630111900 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.782+0000 7ff62cff9700 1 -- 172.21.15.49:0/2015639318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6180245b0 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.782+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff630111d10 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.783+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63004bb80 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.783+0000 7ff62cff9700 1 -- 172.21.15.49:0/2015639318 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7ff61801a9f0 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.783+0000 7ff62cff9700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7ff61c036640 0x7ff61c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.783+0000 7ff62cff9700 1 -- 172.21.15.49:0/2015639318 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff61804a4e0 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.783+0000 7ff62f7fe700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7ff61c036640 0x7ff61c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.784+0000 7ff62f7fe700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7ff61c036640 0x7ff61c038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff620009990 tx=0x7ff620006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:17.788+0000 7ff62cff9700 1 -- 172.21.15.49:0/2015639318 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff618018db0 con 0x7ff630071000 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.004+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff63010ad60 con 0x7ff61c036640 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.250+0000 7ff62cff9700 1 -- 172.21.15.49:0/2015639318 <== mgr.14162 v2:172.21.15.49:6800/1804466564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff63010ad60 con 0x7ff61c036640 2023-12-16T07:34:18.603 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7ff61c036640 msgr2=0x7ff61c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7ff61c036640 0x7ff61c038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff620009990 tx=0x7ff620006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 msgr2=0x7ff6301111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff6301111c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff618006d40 tx=0x7ff618009250 comp rx=0 tx=0).stop 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 shutdown_connections 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7ff61c036640 0x7ff61c038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 --2- 172.21.15.49:0/2015639318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff630071000 0x7ff6301111c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 >> 172.21.15.49:0/2015639318 conn(0x7ff6300fc970 msgr2=0x7ff6300fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 shutdown_connections 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.252+0000 7ff6362a7700 1 -- 172.21.15.49:0/2015639318 wait complete. 2023-12-16T07:34:18.604 INFO:teuthology.orchestra.run.smithi049.stdout:Fetching dashboard port number... 2023-12-16T07:34:19.336 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:19 smithi049 ceph-mon[111939]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:19.336 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:19 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:19.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 8443 2023-12-16T07:34:19.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.970+0000 7f6a1cd88700 1 Processor -- start 2023-12-16T07:34:19.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.970+0000 7f6a1cd88700 1 -- start start 2023-12-16T07:34:19.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.970+0000 7f6a1cd88700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a181026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:19.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.970+0000 7f6a1cd88700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18102c00 con 0x7f6a181022b0 2023-12-16T07:34:19.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a181026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:19.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a181026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49128/0 (socket says 172.21.15.49:49128) 2023-12-16T07:34:19.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1659c700 1 -- 172.21.15.49:0/1926383130 learned_addr learned my addr 172.21.15.49:0/1926383130 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:19.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1659c700 1 -- 172.21.15.49:0/1926383130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18102d40 con 0x7f6a181022b0 2023-12-16T07:34:19.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1659c700 1 --2- 172.21.15.49:0/1926383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a181026c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098e0 tx=0x7f6a08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb70487283c2b05 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:19.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1559a700 1 -- 172.21.15.49:0/1926383130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a0800b860 con 0x7f6a181022b0 2023-12-16T07:34:19.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1559a700 1 -- 172.21.15.49:0/1926383130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a0800be70 con 0x7f6a181022b0 2023-12-16T07:34:19.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.971+0000 7f6a1559a700 1 -- 172.21.15.49:0/1926383130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a08010380 con 0x7f6a181022b0 2023-12-16T07:34:19.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 -- 172.21.15.49:0/1926383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 msgr2=0x7f6a181026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:19.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 --2- 172.21.15.49:0/1926383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a181026c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098e0 tx=0x7f6a08009250 comp rx=0 tx=0).stop 2023-12-16T07:34:19.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 -- 172.21.15.49:0/1926383130 shutdown_connections 2023-12-16T07:34:19.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 --2- 172.21.15.49:0/1926383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a181026c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:19.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 -- 172.21.15.49:0/1926383130 >> 172.21.15.49:0/1926383130 conn(0x7f6a180fda10 msgr2=0x7f6a180ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:19.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 -- 172.21.15.49:0/1926383130 shutdown_connections 2023-12-16T07:34:19.543 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 -- 172.21.15.49:0/1926383130 wait complete. 2023-12-16T07:34:19.543 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.972+0000 7f6a1cd88700 1 Processor -- start 2023-12-16T07:34:19.543 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1cd88700 1 -- start start 2023-12-16T07:34:19.543 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1cd88700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a18111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:19.543 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1cd88700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181116d0 con 0x7f6a181022b0 2023-12-16T07:34:19.543 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a18111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:19.544 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a18111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49132/0 (socket says 172.21.15.49:49132) 2023-12-16T07:34:19.544 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1659c700 1 -- 172.21.15.49:0/2321633079 learned_addr learned my addr 172.21.15.49:0/2321633079 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:19.544 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1659c700 1 -- 172.21.15.49:0/2321633079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080094f0 con 0x7f6a181022b0 2023-12-16T07:34:19.544 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1659c700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a18111190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a08011b60 tx=0x7f6a08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:19.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a0effd700 1 -- 172.21.15.49:0/2321633079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a08010850 con 0x7f6a181022b0 2023-12-16T07:34:19.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a0effd700 1 -- 172.21.15.49:0/2321633079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a08010e60 con 0x7f6a181022b0 2023-12-16T07:34:19.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a181118d0 con 0x7f6a181022b0 2023-12-16T07:34:19.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.973+0000 7f6a0effd700 1 -- 172.21.15.49:0/2321633079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a0801ae20 con 0x7f6a181022b0 2023-12-16T07:34:19.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.974+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a18111ce0 con 0x7f6a181022b0 2023-12-16T07:34:19.545 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.974+0000 7f6a0effd700 1 -- 172.21.15.49:0/2321633079 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f6a080109b0 con 0x7f6a181022b0 2023-12-16T07:34:19.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.974+0000 7f6a0effd700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a04036640 0x7f6a04038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:19.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.974+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1804bb80 con 0x7f6a181022b0 2023-12-16T07:34:19.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.975+0000 7f6a0effd700 1 -- 172.21.15.49:0/2321633079 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6a0804a330 con 0x7f6a181022b0 2023-12-16T07:34:19.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.975+0000 7f6a15d9b700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a04036640 0x7f6a04038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:19.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.975+0000 7f6a15d9b700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a04036640 0x7f6a04038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009990 tx=0x7f6a00006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:19.546 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:18.980+0000 7f6a0effd700 1 -- 172.21.15.49:0/2321633079 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6a0802d3f0 con 0x7f6a181022b0 2023-12-16T07:34:19.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.172+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f6a18104090 con 0x7f6a181022b0 2023-12-16T07:34:19.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.173+0000 7f6a0effd700 1 -- 172.21.15.49:0/2321633079 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f6a0802d3f0 con 0x7f6a181022b0 2023-12-16T07:34:19.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a04036640 msgr2=0x7f6a04038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:19.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a04036640 0x7f6a04038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009990 tx=0x7f6a00006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:19.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 msgr2=0x7f6a18111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:19.547 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a18111190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a08011b60 tx=0x7f6a08009250 comp rx=0 tx=0).stop 2023-12-16T07:34:19.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 shutdown_connections 2023-12-16T07:34:19.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a04036640 0x7f6a04038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:19.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 --2- 172.21.15.49:0/2321633079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a181022b0 0x7f6a18111190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:19.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 >> 172.21.15.49:0/2321633079 conn(0x7f6a180fda10 msgr2=0x7f6a180ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:19.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 shutdown_connections 2023-12-16T07:34:19.548 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.175+0000 7f6a1cd88700 1 -- 172.21.15.49:0/2321633079 wait complete. 2023-12-16T07:34:19.549 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-16T07:34:19.550 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2023-12-16T07:34:19.550 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-16T07:34:19.550 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2023-12-16T07:34:19.550 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2023-12-16T07:34:19.550 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-16T07:34:19.551 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph Dashboard is now available at: 2023-12-16T07:34:19.551 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:19.551 INFO:teuthology.orchestra.run.smithi049.stdout: URL: https://smithi049.front.sepia.ceph.com:8443/ 2023-12-16T07:34:19.552 INFO:teuthology.orchestra.run.smithi049.stdout: User: admin 2023-12-16T07:34:19.552 INFO:teuthology.orchestra.run.smithi049.stdout: Password: sgtntvc239 2023-12-16T07:34:19.552 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:19.552 INFO:teuthology.orchestra.run.smithi049.stdout:Saving cluster configuration to /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config directory 2023-12-16T07:34:19.552 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling autotune for osd_memory_target 2023-12-16T07:34:20.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:20 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2321633079' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.887+0000 7f1e5e5bf700 1 Processor -- start 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.887+0000 7f1e5e5bf700 1 -- start start 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.887+0000 7f1e5e5bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e58104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.887+0000 7f1e5e5bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e581053e0 con 0x7f1e58071000 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e58104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e58104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49138/0 (socket says 172.21.15.49:49138) 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e57fff700 1 -- 172.21.15.49:0/3090623635 learned_addr learned my addr 172.21.15.49:0/3090623635 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e57fff700 1 -- 172.21.15.49:0/3090623635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58105520 con 0x7f1e58071000 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e57fff700 1 --2- 172.21.15.49:0/3090623635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e58104ea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e480098e0 tx=0x7f1e48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ad7d99cd6c81bd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e56ffd700 1 -- 172.21.15.49:0/3090623635 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e4800b860 con 0x7f1e58071000 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e56ffd700 1 -- 172.21.15.49:0/3090623635 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e4800be70 con 0x7f1e58071000 2023-12-16T07:34:20.458 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.888+0000 7f1e56ffd700 1 -- 172.21.15.49:0/3090623635 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e48010380 con 0x7f1e58071000 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3090623635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 msgr2=0x7f1e58104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 --2- 172.21.15.49:0/3090623635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e58104ea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e480098e0 tx=0x7f1e48009250 comp rx=0 tx=0).stop 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3090623635 shutdown_connections 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 --2- 172.21.15.49:0/3090623635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e58104ea0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3090623635 >> 172.21.15.49:0/3090623635 conn(0x7f1e580fc970 msgr2=0x7f1e580fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3090623635 shutdown_connections 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3090623635 wait complete. 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.889+0000 7f1e5e5bf700 1 Processor -- start 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e5e5bf700 1 -- start start 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e5e5bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e581111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e5e5bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e58111700 con 0x7f1e58071000 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e581111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e57fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e581111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49142/0 (socket says 172.21.15.49:49142) 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e57fff700 1 -- 172.21.15.49:0/3189740118 learned_addr learned my addr 172.21.15.49:0/3189740118 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:20.459 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e57fff700 1 -- 172.21.15.49:0/3189740118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480094f0 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.890+0000 7f1e57fff700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e581111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1e480094c0 tx=0x7f1e48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.891+0000 7f1e54ff9700 1 -- 172.21.15.49:0/3189740118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e48010850 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.891+0000 7f1e54ff9700 1 -- 172.21.15.49:0/3189740118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e48010e60 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.891+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e58111900 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.891+0000 7f1e54ff9700 1 -- 172.21.15.49:0/3189740118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e4801a430 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.891+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e58111d10 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.891+0000 7f1e54ff9700 1 -- 172.21.15.49:0/3189740118 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f1e4801a660 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.892+0000 7f1e54ff9700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f1e44036690 0x7f1e44038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.892+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5804bb80 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.892+0000 7f1e54ff9700 1 -- 172.21.15.49:0/3189740118 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1e4804a510 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.892+0000 7f1e577fe700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f1e44036690 0x7f1e44038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.892+0000 7f1e577fe700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f1e44036690 0x7f1e44038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009990 tx=0x7f1e40006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:19.897+0000 7f1e54ff9700 1 -- 172.21.15.49:0/3189740118 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1e48022340 con 0x7f1e58071000 2023-12-16T07:34:20.460 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.093+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f1e58106300 con 0x7f1e58071000 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.093+0000 7f1e54ff9700 1 -- 172.21.15.49:0/3189740118 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f1e48018b40 con 0x7f1e58071000 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f1e44036690 msgr2=0x7f1e44038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f1e44036690 0x7f1e44038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009990 tx=0x7f1e40006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 msgr2=0x7f1e581111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e581111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1e480094c0 tx=0x7f1e48009250 comp rx=0 tx=0).stop 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 shutdown_connections 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f1e44036690 0x7f1e44038b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 --2- 172.21.15.49:0/3189740118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e58071000 0x7f1e581111c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.095+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 >> 172.21.15.49:0/3189740118 conn(0x7f1e580fc970 msgr2=0x7f1e580fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.096+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 shutdown_connections 2023-12-16T07:34:20.461 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.096+0000 7f1e5e5bf700 1 -- 172.21.15.49:0/3189740118 wait complete. 2023-12-16T07:34:21.494 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.815+0000 7fdc51d61700 1 Processor -- start 2023-12-16T07:34:21.494 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.815+0000 7fdc51d61700 1 -- start start 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.815+0000 7fdc51d61700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.815+0000 7fdc51d61700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c101b20 con 0x7fdc4c1011d0 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.815+0000 7fdc4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.815+0000 7fdc4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49144/0 (socket says 172.21.15.49:49144) 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.815+0000 7fdc4b7fe700 1 -- 172.21.15.49:0/4159410946 learned_addr learned my addr 172.21.15.49:0/4159410946 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc4b7fe700 1 -- 172.21.15.49:0/4159410946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c101c60 con 0x7fdc4c1011d0 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc4b7fe700 1 --2- 172.21.15.49:0/4159410946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c1015e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc400098e0 tx=0x7fdc40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb112fe45e7c92a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc4a7fc700 1 -- 172.21.15.49:0/4159410946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc4000b860 con 0x7fdc4c1011d0 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc4a7fc700 1 -- 172.21.15.49:0/4159410946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc4000be70 con 0x7fdc4c1011d0 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc4a7fc700 1 -- 172.21.15.49:0/4159410946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc40010380 con 0x7fdc4c1011d0 2023-12-16T07:34:21.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc51d61700 1 -- 172.21.15.49:0/4159410946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 msgr2=0x7fdc4c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc51d61700 1 --2- 172.21.15.49:0/4159410946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c1015e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc400098e0 tx=0x7fdc40009250 comp rx=0 tx=0).stop 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.816+0000 7fdc51d61700 1 -- 172.21.15.49:0/4159410946 shutdown_connections 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 --2- 172.21.15.49:0/4159410946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c1015e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 -- 172.21.15.49:0/4159410946 >> 172.21.15.49:0/4159410946 conn(0x7fdc4c0fc950 msgr2=0x7fdc4c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 -- 172.21.15.49:0/4159410946 shutdown_connections 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 -- 172.21.15.49:0/4159410946 wait complete. 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 Processor -- start 2023-12-16T07:34:21.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 -- start start 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.817+0000 7fdc51d61700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c076bf0 con 0x7fdc4c1011d0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49152/0 (socket says 172.21.15.49:49152) 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc4b7fe700 1 -- 172.21.15.49:0/1561353726 learned_addr learned my addr 172.21.15.49:0/1561353726 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc4b7fe700 1 -- 172.21.15.49:0/1561353726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400094f0 con 0x7fdc4c1011d0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc4b7fe700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c113e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc40011b60 tx=0x7fdc40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc40010850 con 0x7fdc4c1011d0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c076df0 con 0x7fdc4c1011d0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc40010e60 con 0x7fdc4c1011d0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc4001ae20 con 0x7fdc4c1011d0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.818+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c114590 con 0x7fdc4c1011d0 2023-12-16T07:34:21.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.819+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fdc4002d3f0 con 0x7fdc4c1011d0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.819+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c10a090 con 0x7fdc4c1011d0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.819+0000 7fdc33fff700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdc34036640 0x7fdc34038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.819+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdc4004a330 con 0x7fdc4c1011d0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.819+0000 7fdc4affd700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdc34036640 0x7fdc34038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.820+0000 7fdc4affd700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdc34036640 0x7fdc34038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009990 tx=0x7fdc3c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:20.824+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdc4002b670 con 0x7fdc4c1011d0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.019+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fdc4002d6a0 con 0x7fdc4c1011d0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.128+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fdc4c04bb80 con 0x7fdc4c1011d0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.130+0000 7fdc33fff700 1 -- 172.21.15.49:0/1561353726 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fdc4002b670 con 0x7fdc4c1011d0 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.132+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdc34036640 msgr2=0x7fdc34038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.132+0000 7fdc51d61700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdc34036640 0x7fdc34038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009990 tx=0x7fdc3c006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.132+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 msgr2=0x7fdc4c113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.132+0000 7fdc51d61700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c113e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc40011b60 tx=0x7fdc40009250 comp rx=0 tx=0).stop 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.132+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 shutdown_connections 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.132+0000 7fdc51d61700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdc34036640 0x7fdc34038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.132+0000 7fdc51d61700 1 --2- 172.21.15.49:0/1561353726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc4c1011d0 0x7fdc4c113e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.133+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 >> 172.21.15.49:0/1561353726 conn(0x7fdc4c0fc950 msgr2=0x7fdc4c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.133+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 shutdown_connections 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2023-12-16T07:34:21.133+0000 7fdc51d61700 1 -- 172.21.15.49:0/1561353726 wait complete. 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout:Or, if you are only running a single cluster on this host: 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.499 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-16T07:34:21.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.500 INFO:teuthology.orchestra.run.smithi049.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-16T07:34:21.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.500 INFO:teuthology.orchestra.run.smithi049.stdout: ceph telemetry on 2023-12-16T07:34:21.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.500 INFO:teuthology.orchestra.run.smithi049.stdout:For more information see: 2023-12-16T07:34:21.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.501 INFO:teuthology.orchestra.run.smithi049.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-16T07:34:21.501 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:21.501 INFO:teuthology.orchestra.run.smithi049.stdout:Bootstrap complete. 2023-12-16T07:34:21.525 INFO:tasks.cephadm:Fetching config... 2023-12-16T07:34:21.526 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:34:21.526 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-16T07:34:21.586 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-16T07:34:21.586 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:34:21.586 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-16T07:34:21.645 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-16T07:34:21.645 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:34:21.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/keyring of=/dev/stdout 2023-12-16T07:34:21.715 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-16T07:34:21.715 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:34:21.715 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-16T07:34:21.774 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-16T07:34:21.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFhF8Ddxw6SN2/Ngm4K8lB7aqaaIBkC4cSmw+HsArtD4WQSKEhmr67Q/or1kLCpLhJd5ovokLwEC5a177h/8kDuqmvUqkA3Ou7eJoVkxDDiZ3ag9zMjZC6csSeXcCrTyonArW6/JAD2IXRzzB9bN3HmPZmKlZL7vk4WVge6SkU8CC5qxfRfdV1pS/AsxY+1I0aIwquV+I+53w0Wbyf+qMnpujHikykL23j+iOX4HdZUoeLkL3TGuQNnJxv8jnzz2EivU4N8/q8bNSUodYnX8U7W8ezuvsZemw9zzguogyaVs4txBp9Lso+3bTPAMyY9LtDJty69kqkLKeBdp4HAtTsTdlI0Ev2VYMkOFBGAUQxKXD1ielZ30BGdX8gO1XubXwtDNLwAp4HA3M8rVMtkUarCntZkG/isiUx9rA6Bvf9hzwj8ucvxuKnUMxiBxseH2jDNkWm3A1w9Ip3qMyyRe6Wsb6OpfarYuJM7vNkoeZ9u1/BsBz0H78+FGvpR2rKgE8= ceph-4ed9995e-9be5-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T07:34:21.851 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFhF8Ddxw6SN2/Ngm4K8lB7aqaaIBkC4cSmw+HsArtD4WQSKEhmr67Q/or1kLCpLhJd5ovokLwEC5a177h/8kDuqmvUqkA3Ou7eJoVkxDDiZ3ag9zMjZC6csSeXcCrTyonArW6/JAD2IXRzzB9bN3HmPZmKlZL7vk4WVge6SkU8CC5qxfRfdV1pS/AsxY+1I0aIwquV+I+53w0Wbyf+qMnpujHikykL23j+iOX4HdZUoeLkL3TGuQNnJxv8jnzz2EivU4N8/q8bNSUodYnX8U7W8ezuvsZemw9zzguogyaVs4txBp9Lso+3bTPAMyY9LtDJty69kqkLKeBdp4HAtTsTdlI0Ev2VYMkOFBGAUQxKXD1ielZ30BGdX8gO1XubXwtDNLwAp4HA3M8rVMtkUarCntZkG/isiUx9rA6Bvf9hzwj8ucvxuKnUMxiBxseH2jDNkWm3A1w9Ip3qMyyRe6Wsb6OpfarYuJM7vNkoeZ9u1/BsBz0H78+FGvpR2rKgE8= ceph-4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:34:21.863 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFhF8Ddxw6SN2/Ngm4K8lB7aqaaIBkC4cSmw+HsArtD4WQSKEhmr67Q/or1kLCpLhJd5ovokLwEC5a177h/8kDuqmvUqkA3Ou7eJoVkxDDiZ3ag9zMjZC6csSeXcCrTyonArW6/JAD2IXRzzB9bN3HmPZmKlZL7vk4WVge6SkU8CC5qxfRfdV1pS/AsxY+1I0aIwquV+I+53w0Wbyf+qMnpujHikykL23j+iOX4HdZUoeLkL3TGuQNnJxv8jnzz2EivU4N8/q8bNSUodYnX8U7W8ezuvsZemw9zzguogyaVs4txBp9Lso+3bTPAMyY9LtDJty69kqkLKeBdp4HAtTsTdlI0Ev2VYMkOFBGAUQxKXD1ielZ30BGdX8gO1XubXwtDNLwAp4HA3M8rVMtkUarCntZkG/isiUx9rA6Bvf9hzwj8ucvxuKnUMxiBxseH2jDNkWm3A1w9Ip3qMyyRe6Wsb6OpfarYuJM7vNkoeZ9u1/BsBz0H78+FGvpR2rKgE8= ceph-4ed9995e-9be5-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-16T07:34:21.908 INFO:teuthology.orchestra.run.smithi133.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFhF8Ddxw6SN2/Ngm4K8lB7aqaaIBkC4cSmw+HsArtD4WQSKEhmr67Q/or1kLCpLhJd5ovokLwEC5a177h/8kDuqmvUqkA3Ou7eJoVkxDDiZ3ag9zMjZC6csSeXcCrTyonArW6/JAD2IXRzzB9bN3HmPZmKlZL7vk4WVge6SkU8CC5qxfRfdV1pS/AsxY+1I0aIwquV+I+53w0Wbyf+qMnpujHikykL23j+iOX4HdZUoeLkL3TGuQNnJxv8jnzz2EivU4N8/q8bNSUodYnX8U7W8ezuvsZemw9zzguogyaVs4txBp9Lso+3bTPAMyY9LtDJty69kqkLKeBdp4HAtTsTdlI0Ev2VYMkOFBGAUQxKXD1ielZ30BGdX8gO1XubXwtDNLwAp4HA3M8rVMtkUarCntZkG/isiUx9rA6Bvf9hzwj8ucvxuKnUMxiBxseH2jDNkWm3A1w9Ip3qMyyRe6Wsb6OpfarYuJM7vNkoeZ9u1/BsBz0H78+FGvpR2rKgE8= ceph-4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:34:21.920 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-16T07:34:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:34:22.344 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:22 smithi049 ceph-mon[111939]: mgrmap e13: smithi049.rqlvwo(active, since 6s) 2023-12-16T07:34:22.344 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:22 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1561353726' entity='client.admin' 2023-12-16T07:34:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.516+0000 7f1071359700 1 -- 172.21.15.49:0/682648029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 msgr2=0x7f106c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:23.517 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.516+0000 7f1071359700 1 --2- 172.21.15.49:0/682648029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c070030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f105c0048c0 tx=0x7f105c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.516+0000 7f1071359700 1 -- 172.21.15.49:0/682648029 shutdown_connections 2023-12-16T07:34:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.516+0000 7f1071359700 1 --2- 172.21.15.49:0/682648029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c070030 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.516+0000 7f1071359700 1 -- 172.21.15.49:0/682648029 >> 172.21.15.49:0/682648029 conn(0x7f106c0f7f20 msgr2=0x7f106c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.516+0000 7f1071359700 1 -- 172.21.15.49:0/682648029 shutdown_connections 2023-12-16T07:34:23.518 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.516+0000 7f1071359700 1 -- 172.21.15.49:0/682648029 wait complete. 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.517+0000 7f1071359700 1 Processor -- start 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.517+0000 7f1071359700 1 -- start start 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f1071359700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c10ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f1071359700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c10f270 con 0x7f106c071bc0 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f106affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c10ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f106affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c10ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49172/0 (socket says 172.21.15.49:49172) 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f106affd700 1 -- 172.21.15.49:0/2357725503 learned_addr learned my addr 172.21.15.49:0/2357725503 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f106affd700 1 -- 172.21.15.49:0/2357725503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c005040 con 0x7f106c071bc0 2023-12-16T07:34:23.519 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f106affd700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c10ed30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b690 tx=0x7f105c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f10537fe700 1 -- 172.21.15.49:0/2357725503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f105c009650 con 0x7f106c071bc0 2023-12-16T07:34:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.518+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c10f470 con 0x7f106c071bc0 2023-12-16T07:34:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.519+0000 7f10537fe700 1 -- 172.21.15.49:0/2357725503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f105c0097b0 con 0x7f106c071bc0 2023-12-16T07:34:23.520 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.519+0000 7f10537fe700 1 -- 172.21.15.49:0/2357725503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f105c01c5b0 con 0x7f106c071bc0 2023-12-16T07:34:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.519+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c110030 con 0x7f106c071bc0 2023-12-16T07:34:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.520+0000 7f10537fe700 1 -- 172.21.15.49:0/2357725503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f105c01c870 con 0x7f106c071bc0 2023-12-16T07:34:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.520+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c05f270 con 0x7f106c071bc0 2023-12-16T07:34:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.520+0000 7f10537fe700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f10540366d0 0x7f1054038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.520+0000 7f10537fe700 1 -- 172.21.15.49:0/2357725503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f105c0499a0 con 0x7f106c071bc0 2023-12-16T07:34:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.520+0000 7f106a7fc700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f10540366d0 0x7f1054038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:23.521 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.520+0000 7f106a7fc700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f10540366d0 0x7f1054038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1060009990 tx=0x7f1060006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:23.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.525+0000 7f10537fe700 1 -- 172.21.15.49:0/2357725503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f105c011370 con 0x7f106c071bc0 2023-12-16T07:34:23.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.720+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f106c04bb80 con 0x7f106c071bc0 2023-12-16T07:34:23.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.724+0000 7f10537fe700 1 -- 172.21.15.49:0/2357725503 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f105c0137a0 con 0x7f106c071bc0 2023-12-16T07:34:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f10540366d0 msgr2=0x7f1054038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:23.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f10540366d0 0x7f1054038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1060009990 tx=0x7f1060006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 msgr2=0x7f106c10ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c10ed30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b690 tx=0x7f105c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 shutdown_connections 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f10540366d0 0x7f1054038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 --2- 172.21.15.49:0/2357725503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f106c071bc0 0x7f106c10ed30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 >> 172.21.15.49:0/2357725503 conn(0x7f106c0f7f20 msgr2=0x7f106c0f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 shutdown_connections 2023-12-16T07:34:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:23.726+0000 7f1071359700 1 -- 172.21.15.49:0/2357725503 wait complete. 2023-12-16T07:34:24.102 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-16T07:34:24.102 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-16T07:34:24.447 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:34:24.885 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2357725503' entity='client.admin' 2023-12-16T07:34:24.885 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:24.885 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:24.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:34:24.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:24.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:34:24.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T07:34:24.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:24 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:34:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.500+0000 7f3ed33f4700 1 -- 172.21.15.49:0/924714607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 msgr2=0x7f3ecc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.500+0000 7f3ed33f4700 1 --2- 172.21.15.49:0/924714607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc0fcc80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00048c0 tx=0x7f3ec0009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.500+0000 7f3ed33f4700 1 -- 172.21.15.49:0/924714607 shutdown_connections 2023-12-16T07:34:25.502 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.500+0000 7f3ed33f4700 1 --2- 172.21.15.49:0/924714607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc0fcc80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.500+0000 7f3ed33f4700 1 -- 172.21.15.49:0/924714607 >> 172.21.15.49:0/924714607 conn(0x7f3ecc0f7f50 msgr2=0x7f3ecc0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.500+0000 7f3ed33f4700 1 -- 172.21.15.49:0/924714607 shutdown_connections 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.500+0000 7f3ed33f4700 1 -- 172.21.15.49:0/924714607 wait complete. 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.501+0000 7f3ed33f4700 1 Processor -- start 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.501+0000 7f3ed33f4700 1 -- start start 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.501+0000 7f3ed33f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.501+0000 7f3ed33f4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc06ff90 con 0x7f3ecc0fc870 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.501+0000 7f3ed1190700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.501+0000 7f3ed1190700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49190/0 (socket says 172.21.15.49:49190) 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.501+0000 7f3ed1190700 1 -- 172.21.15.49:0/1728903028 learned_addr learned my addr 172.21.15.49:0/1728903028 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.502+0000 7f3ed1190700 1 -- 172.21.15.49:0/1728903028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0005040 con 0x7f3ecc0fc870 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.502+0000 7f3ed1190700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc071b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009330 tx=0x7f3ec0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.502+0000 7f3ebdffb700 1 -- 172.21.15.49:0/1728903028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ec00096b0 con 0x7f3ecc0fc870 2023-12-16T07:34:25.503 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.502+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc070190 con 0x7f3ecc0fc870 2023-12-16T07:34:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.502+0000 7f3ebdffb700 1 -- 172.21.15.49:0/1728903028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ec0009810 con 0x7f3ecc0fc870 2023-12-16T07:34:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.502+0000 7f3ebdffb700 1 -- 172.21.15.49:0/1728903028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ec001c5b0 con 0x7f3ecc0fc870 2023-12-16T07:34:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.502+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc070680 con 0x7f3ecc0fc870 2023-12-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.503+0000 7f3ebdffb700 1 -- 172.21.15.49:0/1728903028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f3ec001c870 con 0x7f3ecc0fc870 2023-12-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.503+0000 7f3ebdffb700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f3eb80366d0 0x7f3eb8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.503+0000 7f3ebdffb700 1 -- 172.21.15.49:0/1728903028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3ec0049a10 con 0x7f3ecc0fc870 2023-12-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.503+0000 7f3ed098f700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f3eb80366d0 0x7f3eb8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.503+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc106500 con 0x7f3ecc0fc870 2023-12-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.504+0000 7f3ed098f700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f3eb80366d0 0x7f3eb8038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009990 tx=0x7f3ec8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.508+0000 7f3ebdffb700 1 -- 172.21.15.49:0/1728903028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3ec0011dd0 con 0x7f3ecc0fc870 2023-12-16T07:34:25.710 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.710+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ecc1026b0 con 0x7f3eb80366d0 2023-12-16T07:34:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.713+0000 7f3ebdffb700 1 -- 172.21.15.49:0/1728903028 <== mgr.14162 v2:172.21.15.49:6800/1804466564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3ecc1026b0 con 0x7f3eb80366d0 2023-12-16T07:34:25.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f3eb80366d0 msgr2=0x7f3eb8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f3eb80366d0 0x7f3eb8038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009990 tx=0x7f3ec8006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 msgr2=0x7f3ecc071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc071b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009330 tx=0x7f3ec0009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 shutdown_connections 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f3eb80366d0 0x7f3eb8038b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 --2- 172.21.15.49:0/1728903028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ecc0fc870 0x7f3ecc071b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 >> 172.21.15.49:0/1728903028 conn(0x7f3ecc0f7f50 msgr2=0x7f3ecc0f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 shutdown_connections 2023-12-16T07:34:25.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:25.715+0000 7f3ed33f4700 1 -- 172.21.15.49:0/1728903028 wait complete. 2023-12-16T07:34:25.979 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:25 smithi049 ceph-mon[111939]: Deploying daemon crash.smithi049 on smithi049 2023-12-16T07:34:25.980 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:25 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:26.103 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi133 2023-12-16T07:34:26.103 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:34:26.103 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.conf 2023-12-16T07:34:26.125 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:34:26.125 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:34:26.185 INFO:tasks.cephadm:Adding host smithi133 to orchestrator... 2023-12-16T07:34:26.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch host add smithi133 2023-12-16T07:34:26.568 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:34:26.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:26 smithi049 ceph-mon[111939]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:26.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:26 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:26.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:26 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:26.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:26 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:26.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:26 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:27.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.661+0000 7f6a6ac99700 1 -- 172.21.15.49:0/2909697465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 msgr2=0x7f6a640ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.661+0000 7f6a6ac99700 1 --2- 172.21.15.49:0/2909697465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a640ff450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a580048c0 tx=0x7f6a58009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.662+0000 7f6a6ac99700 1 -- 172.21.15.49:0/2909697465 shutdown_connections 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.662+0000 7f6a6ac99700 1 --2- 172.21.15.49:0/2909697465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a640ff450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.662+0000 7f6a6ac99700 1 -- 172.21.15.49:0/2909697465 >> 172.21.15.49:0/2909697465 conn(0x7f6a640f6ec0 msgr2=0x7f6a640f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.662+0000 7f6a6ac99700 1 -- 172.21.15.49:0/2909697465 shutdown_connections 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.662+0000 7f6a6ac99700 1 -- 172.21.15.49:0/2909697465 wait complete. 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.662+0000 7f6a6ac99700 1 Processor -- start 2023-12-16T07:34:27.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.662+0000 7f6a6ac99700 1 -- start start 2023-12-16T07:34:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.663+0000 7f6a6ac99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a6410ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.663+0000 7f6a6ac99700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6410cfd0 con 0x7f6a64066490 2023-12-16T07:34:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.663+0000 7f6a68a35700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a6410ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.663+0000 7f6a68a35700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a6410ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51582/0 (socket says 172.21.15.49:51582) 2023-12-16T07:34:27.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.663+0000 7f6a68a35700 1 -- 172.21.15.49:0/568182199 learned_addr learned my addr 172.21.15.49:0/568182199 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.663+0000 7f6a68a35700 1 -- 172.21.15.49:0/568182199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58005040 con 0x7f6a64066490 2023-12-16T07:34:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.663+0000 7f6a68a35700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a6410ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009330 tx=0x7f6a58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.664+0000 7f6a617fa700 1 -- 172.21.15.49:0/568182199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a580096b0 con 0x7f6a64066490 2023-12-16T07:34:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.664+0000 7f6a617fa700 1 -- 172.21.15.49:0/568182199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a58009810 con 0x7f6a64066490 2023-12-16T07:34:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.664+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6410d1d0 con 0x7f6a64066490 2023-12-16T07:34:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.664+0000 7f6a617fa700 1 -- 172.21.15.49:0/568182199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a5801c5b0 con 0x7f6a64066490 2023-12-16T07:34:27.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.664+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6410de70 con 0x7f6a64066490 2023-12-16T07:34:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.664+0000 7f6a617fa700 1 -- 172.21.15.49:0/568182199 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f6a5801c870 con 0x7f6a64066490 2023-12-16T07:34:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.665+0000 7f6a617fa700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a540366d0 0x7f6a54038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.665+0000 7f6a617fa700 1 -- 172.21.15.49:0/568182199 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6a58049a00 con 0x7f6a64066490 2023-12-16T07:34:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.665+0000 7f6a63fff700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a540366d0 0x7f6a54038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.665+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6405f270 con 0x7f6a64066490 2023-12-16T07:34:27.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.665+0000 7f6a63fff700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a540366d0 0x7f6a54038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009990 tx=0x7f6a50006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:27.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.674+0000 7f6a617fa700 1 -- 172.21.15.49:0/568182199 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6a58011dd0 con 0x7f6a64066490 2023-12-16T07:34:27.880 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:27.879+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a6410e170 con 0x7f6a540366d0 2023-12-16T07:34:28.168 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:27 smithi049 ceph-mon[111939]: Deploying daemon node-exporter.smithi049 on smithi049 2023-12-16T07:34:29.095 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:28 smithi049 ceph-mon[111939]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:29.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.664+0000 7f6a617fa700 1 -- 172.21.15.49:0/568182199 <== mgr.14162 v2:172.21.15.49:6800/1804466564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6a6410e170 con 0x7f6a540366d0 2023-12-16T07:34:29.665 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi133' with addr '172.21.15.133' 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a540366d0 msgr2=0x7f6a54038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a540366d0 0x7f6a54038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009990 tx=0x7f6a50006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 msgr2=0x7f6a6410ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a6410ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009330 tx=0x7f6a58009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 shutdown_connections 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6a540366d0 0x7f6a54038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 --2- 172.21.15.49:0/568182199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a64066490 0x7f6a6410ca90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 >> 172.21.15.49:0/568182199 conn(0x7f6a640f6ec0 msgr2=0x7f6a640f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 shutdown_connections 2023-12-16T07:34:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:29.667+0000 7f6a6ac99700 1 -- 172.21.15.49:0/568182199 wait complete. 2023-12-16T07:34:29.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:29 smithi049 ceph-mon[111939]: Deploying cephadm binary to smithi133 2023-12-16T07:34:29.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:29 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:30.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-16T07:34:30.349 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:34:31.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:30 smithi049 ceph-mon[111939]: Added host smithi133 2023-12-16T07:34:31.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:30 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:30 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:30 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:30 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:30 smithi049 ceph-mon[111939]: Deploying daemon alertmanager.smithi049 on smithi049 2023-12-16T07:34:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:30 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.732+0000 7f1077558700 1 -- 172.21.15.49:0/3905096676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 msgr2=0x7f10700faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.732+0000 7f1077558700 1 --2- 172.21.15.49:0/3905096676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f10700faf40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f106c0048c0 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.732+0000 7f1077558700 1 -- 172.21.15.49:0/3905096676 shutdown_connections 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.732+0000 7f1077558700 1 --2- 172.21.15.49:0/3905096676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f10700faf40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.732+0000 7f1077558700 1 -- 172.21.15.49:0/3905096676 >> 172.21.15.49:0/3905096676 conn(0x7f10700f65d0 msgr2=0x7f10700f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.732+0000 7f1077558700 1 -- 172.21.15.49:0/3905096676 shutdown_connections 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.732+0000 7f1077558700 1 -- 172.21.15.49:0/3905096676 wait complete. 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f1077558700 1 Processor -- start 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f1077558700 1 -- start start 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f1077558700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f107010ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f1077558700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107010cf90 con 0x7f10700fab30 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f10752f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f107010ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f10752f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f107010ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51594/0 (socket says 172.21.15.49:51594) 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f10752f4700 1 -- 172.21.15.49:0/3798675067 learned_addr learned my addr 172.21.15.49:0/3798675067 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f10752f4700 1 -- 172.21.15.49:0/3798675067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c005040 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.733+0000 7f10752f4700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f107010ca50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f106c009040 tx=0x7f106c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.734+0000 7f1061ffb700 1 -- 172.21.15.49:0/3798675067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f106c009650 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.734+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107010d190 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.734+0000 7f1061ffb700 1 -- 172.21.15.49:0/3798675067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f106c0097b0 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.734+0000 7f1061ffb700 1 -- 172.21.15.49:0/3798675067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f106c01c5b0 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.734+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107010de30 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.735+0000 7f1061ffb700 1 -- 172.21.15.49:0/3798675067 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f106c01c870 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.735+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107005f270 con 0x7f10700fab30 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.735+0000 7f1061ffb700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f105c036720 0x7f105c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.735+0000 7f1061ffb700 1 -- 172.21.15.49:0/3798675067 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f106c049a50 con 0x7f10700fab30 2023-12-16T07:34:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.735+0000 7f1074af3700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f105c036720 0x7f105c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.736+0000 7f1074af3700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f105c036720 0x7f105c038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1064009990 tx=0x7f1064006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.740+0000 7f1061ffb700 1 -- 172.21.15.49:0/3798675067 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f106c011d80 con 0x7f10700fab30 2023-12-16T07:34:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.944+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f107010e9f0 con 0x7f105c036720 2023-12-16T07:34:32.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.945+0000 7f1061ffb700 1 -- 172.21.15.49:0/3798675067 <== mgr.14162 v2:172.21.15.49:6800/1804466564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f107010e9f0 con 0x7f105c036720 2023-12-16T07:34:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:34:32.945 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.133", "hostname": "smithi133", "labels": [], "status": ""}] 2023-12-16T07:34:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f105c036720 msgr2=0x7f105c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f105c036720 0x7f105c038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1064009990 tx=0x7f1064006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 msgr2=0x7f107010ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f107010ca50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f106c009040 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 shutdown_connections 2023-12-16T07:34:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f105c036720 0x7f105c038bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 --2- 172.21.15.49:0/3798675067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700fab30 0x7f107010ca50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 >> 172.21.15.49:0/3798675067 conn(0x7f10700f65d0 msgr2=0x7f10700f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 shutdown_connections 2023-12-16T07:34:32.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:32.947+0000 7f1077558700 1 -- 172.21.15.49:0/3798675067 wait complete. 2023-12-16T07:34:33.400 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-16T07:34:33.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd crush tunables default 2023-12-16T07:34:33.695 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:33 smithi049 ceph-mon[111939]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T07:34:33.989 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:34:35.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.413+0000 7fc1dd53b700 1 -- 172.21.15.49:0/287614693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 msgr2=0x7fc1d80ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.413+0000 7fc1dd53b700 1 --2- 172.21.15.49:0/287614693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d80ff4f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80048c0 tx=0x7fc1c8009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 -- 172.21.15.49:0/287614693 shutdown_connections 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 --2- 172.21.15.49:0/287614693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d80ff4f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 -- 172.21.15.49:0/287614693 >> 172.21.15.49:0/287614693 conn(0x7fc1d80f6ec0 msgr2=0x7fc1d80f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 -- 172.21.15.49:0/287614693 shutdown_connections 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 -- 172.21.15.49:0/287614693 wait complete. 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 Processor -- start 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 -- start start 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d810ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.414+0000 7fc1dd53b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d810cfb0 con 0x7fc1d80663f0 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d810ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d810ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51612/0 (socket says 172.21.15.49:51612) 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/2563700463 learned_addr learned my addr 172.21.15.49:0/2563700463 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/2563700463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8005040 con 0x7fc1d80663f0 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1d6ffd700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d810ca70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800bc00 tx=0x7fc1c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1bf7fe700 1 -- 172.21.15.49:0/2563700463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1c8009940 con 0x7fc1d80663f0 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d810d1b0 con 0x7fc1d80663f0 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1bf7fe700 1 -- 172.21.15.49:0/2563700463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1c8004e60 con 0x7fc1d80663f0 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1bf7fe700 1 -- 172.21.15.49:0/2563700463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1c801c590 con 0x7fc1d80663f0 2023-12-16T07:34:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.415+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d810de50 con 0x7fc1d80663f0 2023-12-16T07:34:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.416+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d805f270 con 0x7fc1d80663f0 2023-12-16T07:34:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.417+0000 7fc1bf7fe700 1 -- 172.21.15.49:0/2563700463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc1c8013ad0 con 0x7fc1d80663f0 2023-12-16T07:34:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.417+0000 7fc1bf7fe700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc1c00366d0 0x7fc1c0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.417+0000 7fc1bf7fe700 1 -- 172.21.15.49:0/2563700463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc1c804a430 con 0x7fc1d80663f0 2023-12-16T07:34:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.417+0000 7fc1d67fc700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc1c00366d0 0x7fc1c0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.417+0000 7fc1d67fc700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc1c00366d0 0x7fc1c0038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009990 tx=0x7fc1cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:35.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.422+0000 7fc1bf7fe700 1 -- 172.21.15.49:0/2563700463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc1c8024dc0 con 0x7fc1d80663f0 2023-12-16T07:34:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:35.629+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc1d810e920 con 0x7fc1d80663f0 2023-12-16T07:34:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2563700463' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-16T07:34:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T07:34:36.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:35 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:36.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.471+0000 7fc1bf7fe700 1 -- 172.21.15.49:0/2563700463 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc1c800fe90 con 0x7fc1d80663f0 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc1c00366d0 msgr2=0x7fc1c0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc1c00366d0 0x7fc1c0038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009990 tx=0x7fc1cc006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 msgr2=0x7fc1d810ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d810ca70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800bc00 tx=0x7fc1c8009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 shutdown_connections 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc1c00366d0 0x7fc1c0038b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 --2- 172.21.15.49:0/2563700463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d80663f0 0x7fc1d810ca70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.473+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 >> 172.21.15.49:0/2563700463 conn(0x7fc1d80f6ec0 msgr2=0x7fc1d80f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.474+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 shutdown_connections 2023-12-16T07:34:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:34:36.474+0000 7fc1dd53b700 1 -- 172.21.15.49:0/2563700463 wait complete. 2023-12-16T07:34:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2023-12-16T07:34:36.890 INFO:tasks.cephadm:Adding mon.smithi049 on smithi049 2023-12-16T07:34:36.890 INFO:tasks.cephadm:Adding mon.smithi133 on smithi133 2023-12-16T07:34:36.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch apply mon '2;smithi049:172.21.15.49=smithi049;smithi133:172.21.15.133=smithi133' 2023-12-16T07:34:37.176 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:36 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-16T07:34:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:36 smithi049 ceph-mon[111939]: Deploying daemon grafana.smithi049 on smithi049 2023-12-16T07:34:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:36 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2563700463' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-16T07:34:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:36 smithi049 ceph-mon[111939]: osdmap e4: 0 total, 0 up, 0 in 2023-12-16T07:34:37.236 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:38.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.457+0000 7f51e2841700 1 -- 172.21.15.133:0/767280466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 msgr2=0x7f51dc0ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:38.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.457+0000 7f51e2841700 1 --2- 172.21.15.133:0/767280466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc0ff450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51c40048c0 tx=0x7f51c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:38.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.457+0000 7f51e2841700 1 -- 172.21.15.133:0/767280466 shutdown_connections 2023-12-16T07:34:38.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.457+0000 7f51e2841700 1 --2- 172.21.15.133:0/767280466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc0ff450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:38.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.457+0000 7f51e2841700 1 -- 172.21.15.133:0/767280466 >> 172.21.15.133:0/767280466 conn(0x7f51dc0f6ec0 msgr2=0x7f51dc0f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:38.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.457+0000 7f51e2841700 1 -- 172.21.15.133:0/767280466 shutdown_connections 2023-12-16T07:34:38.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.457+0000 7f51e2841700 1 -- 172.21.15.133:0/767280466 wait complete. 2023-12-16T07:34:38.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.458+0000 7f51e2841700 1 Processor -- start 2023-12-16T07:34:38.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.458+0000 7f51e2841700 1 -- start start 2023-12-16T07:34:38.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.458+0000 7f51e2841700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:38.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.458+0000 7f51e2841700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc10cfd0 con 0x7f51dc066490 2023-12-16T07:34:38.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.458+0000 7f51dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:38.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.458+0000 7f51dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:41044/0 (socket says 172.21.15.133:41044) 2023-12-16T07:34:38.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51dbfff700 1 -- 172.21.15.133:0/4001770195 learned_addr learned my addr 172.21.15.133:0/4001770195 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:38.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51dbfff700 1 -- 172.21.15.133:0/4001770195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4005040 con 0x7f51dc066490 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51dbfff700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc10ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51c400b690 tx=0x7f51c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51d8ff9700 1 -- 172.21.15.133:0/4001770195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51c4009650 con 0x7f51dc066490 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc10d1d0 con 0x7f51dc066490 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51d8ff9700 1 -- 172.21.15.133:0/4001770195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51c40097b0 con 0x7f51dc066490 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51d8ff9700 1 -- 172.21.15.133:0/4001770195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51c401c5d0 con 0x7f51dc066490 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.459+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc10de70 con 0x7f51dc066490 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.460+0000 7f51d8ff9700 1 -- 172.21.15.133:0/4001770195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f51c401c840 con 0x7f51dc066490 2023-12-16T07:34:38.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.460+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc05f270 con 0x7f51dc066490 2023-12-16T07:34:38.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.460+0000 7f51d8ff9700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f51c80366d0 0x7f51c8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:38.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.460+0000 7f51d8ff9700 1 -- 172.21.15.133:0/4001770195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f51c4049a20 con 0x7f51dc066490 2023-12-16T07:34:38.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.461+0000 7f51db7fe700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f51c80366d0 0x7f51c8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:38.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.461+0000 7f51db7fe700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f51c80366d0 0x7f51c8038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009990 tx=0x7f51cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:38.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:37 smithi049 ceph-mon[111939]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:38.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.466+0000 7f51d8ff9700 1 -- 172.21.15.133:0/4001770195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f51c4023950 con 0x7f51dc066490 2023-12-16T07:34:38.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.658+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 --> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi049:172.21.15.49=smithi049;smithi133:172.21.15.133=smithi133", "target": ["mon-mgr", ""]}) v1 -- 0x7f51dc10eae0 con 0x7f51c80366d0 2023-12-16T07:34:38.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.664+0000 7f51d8ff9700 1 -- 172.21.15.133:0/4001770195 <== mgr.14162 v2:172.21.15.49:6800/1804466564 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f51dc10eae0 con 0x7f51c80366d0 2023-12-16T07:34:38.669 INFO:teuthology.orchestra.run.smithi133.stdout:Scheduled mon update... 2023-12-16T07:34:38.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f51c80366d0 msgr2=0x7f51c8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:38.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f51c80366d0 0x7f51c8038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009990 tx=0x7f51cc006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:38.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 msgr2=0x7f51dc10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:38.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc10ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51c400b690 tx=0x7f51c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:38.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 shutdown_connections 2023-12-16T07:34:38.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f51c80366d0 0x7f51c8038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:38.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 --2- 172.21.15.133:0/4001770195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc066490 0x7f51dc10ca90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:38.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 >> 172.21.15.133:0/4001770195 conn(0x7f51dc0f6ec0 msgr2=0x7f51dc0f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:38.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 shutdown_connections 2023-12-16T07:34:38.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:38.666+0000 7f51e2841700 1 -- 172.21.15.133:0/4001770195 wait complete. 2023-12-16T07:34:39.052 DEBUG:teuthology.orchestra.run.smithi133:mon.smithi133> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi133.service 2023-12-16T07:34:39.054 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:34:39.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:34:39.084 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:-- Logs begin at Sat 2023-12-16 07:19:48 UTC. -- 2023-12-16T07:34:39.356 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:39.420 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:39 smithi049 ceph-mon[111939]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi049:172.21.15.49=smithi049;smithi133:172.21.15.133=smithi133", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:34:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:39 smithi049 ceph-mon[111939]: Saving service mon spec with placement smithi049:172.21.15.49=smithi049;smithi133:172.21.15.133=smithi133;count:2 2023-12-16T07:34:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:39 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:39 smithi049 ceph-mon[111939]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.436+0000 7f039cdd8700 1 -- 172.21.15.133:0/2149660240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 msgr2=0x7f03980ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.436+0000 7f039cdd8700 1 --2- 172.21.15.133:0/2149660240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f03980ff440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f038c0048c0 tx=0x7f038c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.436+0000 7f039cdd8700 1 -- 172.21.15.133:0/2149660240 shutdown_connections 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.436+0000 7f039cdd8700 1 --2- 172.21.15.133:0/2149660240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f03980ff440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.436+0000 7f039cdd8700 1 -- 172.21.15.133:0/2149660240 >> 172.21.15.133:0/2149660240 conn(0x7f03980f6e50 msgr2=0x7f03980f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.436+0000 7f039cdd8700 1 -- 172.21.15.133:0/2149660240 shutdown_connections 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.436+0000 7f039cdd8700 1 -- 172.21.15.133:0/2149660240 wait complete. 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039cdd8700 1 Processor -- start 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039cdd8700 1 -- start start 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039cdd8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f039810ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039cdd8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039810cfb0 con 0x7f0398066310 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f039810ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f039810ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:41056/0 (socket says 172.21.15.133:41056) 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039659c700 1 -- 172.21.15.133:0/695173770 learned_addr learned my addr 172.21.15.133:0/695173770 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039659c700 1 -- 172.21.15.133:0/695173770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c005040 con 0x7f0398066310 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f039659c700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f039810ca70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f038c009040 tx=0x7f038c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.437+0000 7f0386ffd700 1 -- 172.21.15.133:0/695173770 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038c009620 con 0x7f0398066310 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.438+0000 7f0386ffd700 1 -- 172.21.15.133:0/695173770 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f038c009780 con 0x7f0398066310 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.438+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039810d1b0 con 0x7f0398066310 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.438+0000 7f0386ffd700 1 -- 172.21.15.133:0/695173770 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038c01c5b0 con 0x7f0398066310 2023-12-16T07:34:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.438+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039810de50 con 0x7f0398066310 2023-12-16T07:34:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.438+0000 7f0386ffd700 1 -- 172.21.15.133:0/695173770 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f038c013420 con 0x7f0398066310 2023-12-16T07:34:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.438+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039805f270 con 0x7f0398066310 2023-12-16T07:34:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.439+0000 7f0386ffd700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f03800366d0 0x7f0380038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.439+0000 7f0386ffd700 1 -- 172.21.15.133:0/695173770 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f038c0498e0 con 0x7f0398066310 2023-12-16T07:34:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.439+0000 7f0395d9b700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f03800366d0 0x7f0380038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.439+0000 7f0395d9b700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f03800366d0 0x7f0380038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0388009990 tx=0x7f0388006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:40.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.444+0000 7f0386ffd700 1 -- 172.21.15.133:0/695173770 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f038c011370 con 0x7f0398066310 2023-12-16T07:34:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.700+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f039810e9a0 con 0x7f0398066310 2023-12-16T07:34:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.700+0000 7f0386ffd700 1 -- 172.21.15.133:0/695173770 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f038c011370 con 0x7f0398066310 2023-12-16T07:34:40.700 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:34:40.701 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f03800366d0 msgr2=0x7f0380038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f03800366d0 0x7f0380038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0388009990 tx=0x7f0388006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 msgr2=0x7f039810ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f039810ca70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f038c009040 tx=0x7f038c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 shutdown_connections 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f03800366d0 0x7f0380038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 --2- 172.21.15.133:0/695173770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0398066310 0x7f039810ca70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 >> 172.21.15.133:0/695173770 conn(0x7f03980f6e50 msgr2=0x7f03980f7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 shutdown_connections 2023-12-16T07:34:40.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:40.702+0000 7f039cdd8700 1 -- 172.21.15.133:0/695173770 wait complete. 2023-12-16T07:34:40.703 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:34:41.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:41 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:41 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/695173770' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:34:42.081 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:34:42.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:34:42.369 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:42.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:42 smithi049 ceph-mon[111939]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:43.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 -- 172.21.15.133:0/205428210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 msgr2=0x7f7f1c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 --2- 172.21.15.133:0/205428210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c0fbb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0048c0 tx=0x7f7f0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 -- 172.21.15.133:0/205428210 shutdown_connections 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 --2- 172.21.15.133:0/205428210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c0fbb90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 -- 172.21.15.133:0/205428210 >> 172.21.15.133:0/205428210 conn(0x7f7f1c0f6e40 msgr2=0x7f7f1c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 -- 172.21.15.133:0/205428210 shutdown_connections 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 -- 172.21.15.133:0/205428210 wait complete. 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 Processor -- start 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.432+0000 7f7f20b14700 1 -- start start 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f20b14700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f20b14700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c10add0 con 0x7f7f1c0fb780 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f1a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f1a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:41074/0 (socket says 172.21.15.133:41074) 2023-12-16T07:34:43.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f1a59c700 1 -- 172.21.15.133:0/534606874 learned_addr learned my addr 172.21.15.133:0/534606874 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:43.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f1a59c700 1 -- 172.21.15.133:0/534606874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c005040 con 0x7f7f1c0fb780 2023-12-16T07:34:43.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f1a59c700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009330 tx=0x7f7f0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:43.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f0affd700 1 -- 172.21.15.133:0/534606874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f0c0096b0 con 0x7f7f1c0fb780 2023-12-16T07:34:43.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c10afd0 con 0x7f7f1c0fb780 2023-12-16T07:34:43.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f0affd700 1 -- 172.21.15.133:0/534606874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f0c009810 con 0x7f7f1c0fb780 2023-12-16T07:34:43.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f0affd700 1 -- 172.21.15.133:0/534606874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f0c01c5b0 con 0x7f7f1c0fb780 2023-12-16T07:34:43.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.433+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c10bc70 con 0x7f7f1c0fb780 2023-12-16T07:34:43.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.434+0000 7f7f0affd700 1 -- 172.21.15.133:0/534606874 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f7f0c01c830 con 0x7f7f1c0fb780 2023-12-16T07:34:43.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.434+0000 7f7f0affd700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f04038930 0x7f7f0403ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:43.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.434+0000 7f7f0affd700 1 -- 172.21.15.133:0/534606874 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7f0c049ab0 con 0x7f7f1c0fb780 2023-12-16T07:34:43.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.434+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c05f270 con 0x7f7f1c0fb780 2023-12-16T07:34:43.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.434+0000 7f7f19d9b700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f04038930 0x7f7f0403ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:43.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.435+0000 7f7f19d9b700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f04038930 0x7f7f0403ade0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009990 tx=0x7f7f10006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:43.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.440+0000 7f7f0affd700 1 -- 172.21.15.133:0/534606874 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7f0c011dd0 con 0x7f7f1c0fb780 2023-12-16T07:34:43.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.695+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7f1c04bb80 con 0x7f7f1c0fb780 2023-12-16T07:34:43.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.695+0000 7f7f0affd700 1 -- 172.21.15.133:0/534606874 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7f0c034090 con 0x7f7f1c0fb780 2023-12-16T07:34:43.695 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:34:43.696 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:34:43.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f04038930 msgr2=0x7f7f0403ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f04038930 0x7f7f0403ade0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009990 tx=0x7f7f10006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 msgr2=0x7f7f1c10a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009330 tx=0x7f7f0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 shutdown_connections 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f04038930 0x7f7f0403ade0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 --2- 172.21.15.133:0/534606874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10a890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.697+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 >> 172.21.15.133:0/534606874 conn(0x7f7f1c0f6e40 msgr2=0x7f7f1c0f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.698+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 shutdown_connections 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:43.698+0000 7f7f20b14700 1 -- 172.21.15.133:0/534606874 wait complete. 2023-12-16T07:34:43.698 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:34:43.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:43 smithi049 ceph-mon[111939]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:44.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:44 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/534606874' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:34:45.074 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:34:45.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:34:45.374 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:45.430 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:45 smithi049 ceph-mon[111939]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.394+0000 7f8c7aa49700 1 -- 172.21.15.133:0/3967392557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 msgr2=0x7f8c740faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:46.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.394+0000 7f8c7aa49700 1 --2- 172.21.15.133:0/3967392557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c740faf40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c680048c0 tx=0x7f8c68009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.394+0000 7f8c7aa49700 1 -- 172.21.15.133:0/3967392557 shutdown_connections 2023-12-16T07:34:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.394+0000 7f8c7aa49700 1 --2- 172.21.15.133:0/3967392557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c740faf40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.394+0000 7f8c7aa49700 1 -- 172.21.15.133:0/3967392557 >> 172.21.15.133:0/3967392557 conn(0x7f8c740f65d0 msgr2=0x7f8c740f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.394+0000 7f8c7aa49700 1 -- 172.21.15.133:0/3967392557 shutdown_connections 2023-12-16T07:34:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.394+0000 7f8c7aa49700 1 -- 172.21.15.133:0/3967392557 wait complete. 2023-12-16T07:34:46.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.395+0000 7f8c7aa49700 1 Processor -- start 2023-12-16T07:34:46.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.395+0000 7f8c7aa49700 1 -- start start 2023-12-16T07:34:46.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.395+0000 7f8c7aa49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c7410ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:46.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.395+0000 7f8c7aa49700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7410f230 con 0x7f8c740fab30 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.395+0000 7f8c73fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c7410ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.395+0000 7f8c73fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c7410ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:41094/0 (socket says 172.21.15.133:41094) 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.395+0000 7f8c73fff700 1 -- 172.21.15.133:0/2660512908 learned_addr learned my addr 172.21.15.133:0/2660512908 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.396+0000 7f8c73fff700 1 -- 172.21.15.133:0/2660512908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68005040 con 0x7f8c740fab30 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.396+0000 7f8c73fff700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c7410ecf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009040 tx=0x7f8c68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.396+0000 7f8c70ff9700 1 -- 172.21.15.133:0/2660512908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c68009650 con 0x7f8c740fab30 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.396+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7410f430 con 0x7f8c740fab30 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.396+0000 7f8c70ff9700 1 -- 172.21.15.133:0/2660512908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c680097b0 con 0x7f8c740fab30 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.396+0000 7f8c70ff9700 1 -- 172.21.15.133:0/2660512908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c6801c5b0 con 0x7f8c740fab30 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.396+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7410ff90 con 0x7f8c740fab30 2023-12-16T07:34:46.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.397+0000 7f8c70ff9700 1 -- 172.21.15.133:0/2660512908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f8c68013420 con 0x7f8c740fab30 2023-12-16T07:34:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.397+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7404bb80 con 0x7f8c740fab30 2023-12-16T07:34:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.397+0000 7f8c70ff9700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f8c5c0366d0 0x7f8c5c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.397+0000 7f8c70ff9700 1 -- 172.21.15.133:0/2660512908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8c68049970 con 0x7f8c740fab30 2023-12-16T07:34:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.397+0000 7f8c737fe700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f8c5c0366d0 0x7f8c5c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:46.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.397+0000 7f8c737fe700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f8c5c0366d0 0x7f8c5c038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009990 tx=0x7f8c64006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:46.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.402+0000 7f8c70ff9700 1 -- 172.21.15.133:0/2660512908 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8c680139d0 con 0x7f8c740fab30 2023-12-16T07:34:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.659+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8c74110e10 con 0x7f8c740fab30 2023-12-16T07:34:46.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.660+0000 7f8c70ff9700 1 -- 172.21.15.133:0/2660512908 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8c68011370 con 0x7f8c740fab30 2023-12-16T07:34:46.660 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:34:46.660 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f8c5c0366d0 msgr2=0x7f8c5c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f8c5c0366d0 0x7f8c5c038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009990 tx=0x7f8c64006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 msgr2=0x7f8c7410ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c7410ecf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009040 tx=0x7f8c68009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 shutdown_connections 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f8c5c0366d0 0x7f8c5c038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 --2- 172.21.15.133:0/2660512908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c740fab30 0x7f8c7410ecf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:46.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 >> 172.21.15.133:0/2660512908 conn(0x7f8c740f65d0 msgr2=0x7f8c740f7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:46.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 shutdown_connections 2023-12-16T07:34:46.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:46.662+0000 7f8c7aa49700 1 -- 172.21.15.133:0/2660512908 wait complete. 2023-12-16T07:34:46.663 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:34:46.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:46 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/2660512908' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:34:46.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:46 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:46.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:46 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:46.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:46 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:46.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:46 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:46.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:46 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:47.965 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:47 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:47.965 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:47 smithi049 ceph-mon[111939]: Deploying daemon prometheus.smithi049 on smithi049 2023-12-16T07:34:47.965 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:47 smithi049 ceph-mon[111939]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:48.049 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:34:48.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:34:48.332 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:48.400 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 -- 172.21.15.133:0/808879556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 msgr2=0x7f9a0c0ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 --2- 172.21.15.133:0/808879556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c0ff440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99f40048c0 tx=0x7f99f4009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 -- 172.21.15.133:0/808879556 shutdown_connections 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 --2- 172.21.15.133:0/808879556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c0ff440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 -- 172.21.15.133:0/808879556 >> 172.21.15.133:0/808879556 conn(0x7f9a0c0f6e50 msgr2=0x7f9a0c0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 -- 172.21.15.133:0/808879556 shutdown_connections 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 -- 172.21.15.133:0/808879556 wait complete. 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.392+0000 7f9a1280f700 1 Processor -- start 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.393+0000 7f9a1280f700 1 -- start start 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.393+0000 7f9a1280f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c10ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.393+0000 7f9a1280f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c10cfb0 con 0x7f9a0c066310 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.393+0000 7f9a0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c10ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.393+0000 7f9a0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c10ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:60642/0 (socket says 172.21.15.133:60642) 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.393+0000 7f9a0bfff700 1 -- 172.21.15.133:0/3371752697 learned_addr learned my addr 172.21.15.133:0/3371752697 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.393+0000 7f9a0bfff700 1 -- 172.21.15.133:0/3371752697 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4005040 con 0x7f9a0c066310 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.394+0000 7f9a0bfff700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c10ca70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99f400b690 tx=0x7f99f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.394+0000 7f9a08ff9700 1 -- 172.21.15.133:0/3371752697 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f4009650 con 0x7f9a0c066310 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.394+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c10d1b0 con 0x7f9a0c066310 2023-12-16T07:34:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.394+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c10de50 con 0x7f9a0c066310 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.394+0000 7f9a08ff9700 1 -- 172.21.15.133:0/3371752697 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99f40097b0 con 0x7f9a0c066310 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.394+0000 7f9a08ff9700 1 -- 172.21.15.133:0/3371752697 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f40255c0 con 0x7f9a0c066310 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.395+0000 7f9a08ff9700 1 -- 172.21.15.133:0/3371752697 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f99f4013420 con 0x7f9a0c066310 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.395+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c05f270 con 0x7f9a0c066310 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.395+0000 7f9a08ff9700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f99f80366d0 0x7f99f8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.395+0000 7f9a08ff9700 1 -- 172.21.15.133:0/3371752697 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f99f4049980 con 0x7f9a0c066310 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.395+0000 7f9a0b7fe700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f99f80366d0 0x7f99f8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.395+0000 7f9a0b7fe700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f99f80366d0 0x7f99f8038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009990 tx=0x7f99fc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.401+0000 7f9a08ff9700 1 -- 172.21.15.133:0/3371752697 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f99f40123c0 con 0x7f9a0c066310 2023-12-16T07:34:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.660+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9a0c04bb80 con 0x7f9a0c066310 2023-12-16T07:34:49.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.661+0000 7f9a08ff9700 1 -- 172.21.15.133:0/3371752697 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f99f4023300 con 0x7f9a0c066310 2023-12-16T07:34:49.661 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:34:49.661 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f99f80366d0 msgr2=0x7f99f8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f99f80366d0 0x7f99f8038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009990 tx=0x7f99fc006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 msgr2=0x7f9a0c10ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c10ca70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99f400b690 tx=0x7f99f4009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 shutdown_connections 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f99f80366d0 0x7f99f8038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 --2- 172.21.15.133:0/3371752697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a0c066310 0x7f9a0c10ca70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:49.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 >> 172.21.15.133:0/3371752697 conn(0x7f9a0c0f6e50 msgr2=0x7f9a0c0f7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:49.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 shutdown_connections 2023-12-16T07:34:49.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:49.663+0000 7f9a1280f700 1 -- 172.21.15.133:0/3371752697 wait complete. 2023-12-16T07:34:49.664 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:34:50.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:50 smithi049 ceph-mon[111939]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:50.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:50 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3371752697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:34:51.043 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:34:51.044 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:34:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:51.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:51 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:52.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 -- 172.21.15.133:0/894129678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 msgr2=0x7fc1600fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 --2- 172.21.15.133:0/894129678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600fbb80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc1500048c0 tx=0x7fc150009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 -- 172.21.15.133:0/894129678 shutdown_connections 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 --2- 172.21.15.133:0/894129678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600fbb80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 -- 172.21.15.133:0/894129678 >> 172.21.15.133:0/894129678 conn(0x7fc1600f6e50 msgr2=0x7fc1600f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 -- 172.21.15.133:0/894129678 shutdown_connections 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 -- 172.21.15.133:0/894129678 wait complete. 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 Processor -- start 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 -- start start 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.418+0000 7fc16815b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600f73c0 con 0x7fc1600fb770 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc165ef7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc165ef7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600f8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:60666/0 (socket says 172.21.15.133:60666) 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc165ef7700 1 -- 172.21.15.133:0/4119132783 learned_addr learned my addr 172.21.15.133:0/4119132783 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:52.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc165ef7700 1 -- 172.21.15.133:0/4119132783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc150005040 con 0x7fc1600fb770 2023-12-16T07:34:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc165ef7700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600f8f40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc15000b690 tx=0x7fc150009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc1567fc700 1 -- 172.21.15.133:0/4119132783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc150009650 con 0x7fc1600fb770 2023-12-16T07:34:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc1567fc700 1 -- 172.21.15.133:0/4119132783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1500097b0 con 0x7fc1600fb770 2023-12-16T07:34:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1600f75c0 con 0x7fc1600fb770 2023-12-16T07:34:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc1567fc700 1 -- 172.21.15.133:0/4119132783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc15001c5d0 con 0x7fc1600fb770 2023-12-16T07:34:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.419+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1600f7ab0 con 0x7fc1600fb770 2023-12-16T07:34:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.420+0000 7fc1567fc700 1 -- 172.21.15.133:0/4119132783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fc15001c730 con 0x7fc1600fb770 2023-12-16T07:34:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.420+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc160106410 con 0x7fc1600fb770 2023-12-16T07:34:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.420+0000 7fc1567fc700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc14c036720 0x7fc14c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.420+0000 7fc1567fc700 1 -- 172.21.15.133:0/4119132783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc150049b70 con 0x7fc1600fb770 2023-12-16T07:34:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.420+0000 7fc1656f6700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc14c036720 0x7fc14c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.421+0000 7fc1656f6700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc14c036720 0x7fc14c038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009990 tx=0x7fc15c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:52.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.425+0000 7fc1567fc700 1 -- 172.21.15.133:0/4119132783 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc1500123c0 con 0x7fc1600fb770 2023-12-16T07:34:52.439 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:52 smithi049 ceph-mon[111939]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:52.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.680+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc16004bb80 con 0x7fc1600fb770 2023-12-16T07:34:52.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.681+0000 7fc1567fc700 1 -- 172.21.15.133:0/4119132783 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc150023300 con 0x7fc1600fb770 2023-12-16T07:34:52.681 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:34:52.682 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:34:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc14c036720 msgr2=0x7fc14c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc14c036720 0x7fc14c038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009990 tx=0x7fc15c006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 msgr2=0x7fc1600f8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600f8f40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc15000b690 tx=0x7fc150009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 shutdown_connections 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fc14c036720 0x7fc14c038bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 --2- 172.21.15.133:0/4119132783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1600fb770 0x7fc1600f8f40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 >> 172.21.15.133:0/4119132783 conn(0x7fc1600f6e50 msgr2=0x7fc160065e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:52.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 shutdown_connections 2023-12-16T07:34:52.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:52.683+0000 7fc16815b700 1 -- 172.21.15.133:0/4119132783 wait complete. 2023-12-16T07:34:52.685 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:34:53.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:53 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/4119132783' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:34:53.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:53 smithi049 ceph-mon[111939]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:54.062 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:34:54.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:34:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:54.400 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.486+0000 7f7f22bfb700 1 -- 172.21.15.133:0/943719823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 msgr2=0x7f7f1c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.486+0000 7f7f22bfb700 1 --2- 172.21.15.133:0/943719823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c0fbb90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0048c0 tx=0x7f7f0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.486+0000 7f7f22bfb700 1 -- 172.21.15.133:0/943719823 shutdown_connections 2023-12-16T07:34:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.486+0000 7f7f22bfb700 1 --2- 172.21.15.133:0/943719823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c0fbb90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.486+0000 7f7f22bfb700 1 -- 172.21.15.133:0/943719823 >> 172.21.15.133:0/943719823 conn(0x7f7f1c0f6e40 msgr2=0x7f7f1c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.486+0000 7f7f22bfb700 1 -- 172.21.15.133:0/943719823 shutdown_connections 2023-12-16T07:34:55.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.486+0000 7f7f22bfb700 1 -- 172.21.15.133:0/943719823 wait complete. 2023-12-16T07:34:55.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.487+0000 7f7f22bfb700 1 Processor -- start 2023-12-16T07:34:55.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.487+0000 7f7f22bfb700 1 -- start start 2023-12-16T07:34:55.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.487+0000 7f7f22bfb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:55.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.487+0000 7f7f22bfb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c10bee0 con 0x7f7f1c0fb780 2023-12-16T07:34:55.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f20997700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:55.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f20997700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:60676/0 (socket says 172.21.15.133:60676) 2023-12-16T07:34:55.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f20997700 1 -- 172.21.15.133:0/3549658976 learned_addr learned my addr 172.21.15.133:0/3549658976 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:55.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f20997700 1 -- 172.21.15.133:0/3549658976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c005040 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f20997700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10b9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00b690 tx=0x7f7f0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f197fa700 1 -- 172.21.15.133:0/3549658976 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f0c009650 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c10c0e0 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f197fa700 1 -- 172.21.15.133:0/3549658976 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f0c0097b0 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f197fa700 1 -- 172.21.15.133:0/3549658976 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f0c01c5d0 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.488+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c10cd80 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.489+0000 7f7f197fa700 1 -- 172.21.15.133:0/3549658976 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f7f0c013420 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.489+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c05f270 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.489+0000 7f7f197fa700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f040366d0 0x7f7f04038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.489+0000 7f7f197fa700 1 -- 172.21.15.133:0/3549658976 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7f0c049a10 con 0x7f7f1c0fb780 2023-12-16T07:34:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.489+0000 7f7f1bfff700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f040366d0 0x7f7f04038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:55.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.490+0000 7f7f1bfff700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f040366d0 0x7f7f04038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009990 tx=0x7f7f10006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.495+0000 7f7f197fa700 1 -- 172.21.15.133:0/3549658976 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7f0c025400 con 0x7f7f1c0fb780 2023-12-16T07:34:55.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.750+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7f1c10d8d0 con 0x7f7f1c0fb780 2023-12-16T07:34:55.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.751+0000 7f7f197fa700 1 -- 172.21.15.133:0/3549658976 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7f0c011370 con 0x7f7f1c0fb780 2023-12-16T07:34:55.752 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:34:55.752 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:34:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f040366d0 msgr2=0x7f7f04038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f040366d0 0x7f7f04038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009990 tx=0x7f7f10006e40 comp rx=0 tx=0).stop 2023-12-16T07:34:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 msgr2=0x7f7f1c10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10b9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00b690 tx=0x7f7f0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 shutdown_connections 2023-12-16T07:34:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f7f040366d0 0x7f7f04038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 --2- 172.21.15.133:0/3549658976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f1c0fb780 0x7f7f1c10b9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 >> 172.21.15.133:0/3549658976 conn(0x7f7f1c0f6e40 msgr2=0x7f7f1c0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 shutdown_connections 2023-12-16T07:34:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:55.753+0000 7f7f22bfb700 1 -- 172.21.15.133:0/3549658976 wait complete. 2023-12-16T07:34:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:34:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:56 smithi049 ceph-mon[111939]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:34:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:56 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:56 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:56 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:34:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:56 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T07:34:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:56 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3549658976' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:34:57.085 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:34:57.085 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:34:57.367 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:34:57.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:57 smithi049 ceph-mon[111939]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T07:34:57.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:57 smithi049 ceph-mon[111939]: mgrmap e14: smithi049.rqlvwo(active, since 41s) 2023-12-16T07:34:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 -- 172.21.15.133:0/1816570478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 msgr2=0x7fe0000fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 --2- 172.21.15.133:0/1816570478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe0000fcc90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdff00048c0 tx=0x7fdff0009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 -- 172.21.15.133:0/1816570478 shutdown_connections 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 --2- 172.21.15.133:0/1816570478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe0000fcc90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 -- 172.21.15.133:0/1816570478 >> 172.21.15.133:0/1816570478 conn(0x7fe0000f7f20 msgr2=0x7fe0000fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 -- 172.21.15.133:0/1816570478 shutdown_connections 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 -- 172.21.15.133:0/1816570478 wait complete. 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 Processor -- start 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.500+0000 7fe00694d700 1 -- start start 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fe00694d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe00010cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fe00694d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00010d010 con 0x7fe0000fc880 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe00010cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:34:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe00010cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:41538/0 (socket says 172.21.15.133:41538) 2023-12-16T07:34:58.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffffff700 1 -- 172.21.15.133:0/1686942010 learned_addr learned my addr 172.21.15.133:0/1686942010 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffffff700 1 -- 172.21.15.133:0/1686942010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0005040 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffffff700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe00010cad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009330 tx=0x7fdff0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffcff9700 1 -- 172.21.15.133:0/1686942010 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdff00096b0 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00010d210 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffcff9700 1 -- 172.21.15.133:0/1686942010 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdff0009810 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fdffcff9700 1 -- 172.21.15.133:0/1686942010 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdff001c5b0 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.501+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00010deb0 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.502+0000 7fdffcff9700 1 -- 172.21.15.133:0/1686942010 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7fdff0013420 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.502+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00005f270 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.502+0000 7fdffcff9700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 0x7fdfe8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.502+0000 7fdffcff9700 1 -- 172.21.15.133:0/1686942010 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdff0049ae0 con 0x7fe0000fc880 2023-12-16T07:34:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.502+0000 7fdfff7fe700 1 -- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 msgr2=0x7fdfe8038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1804466564 2023-12-16T07:34:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.503+0000 7fdfff7fe700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 0x7fdfe8038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:34:58.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.507+0000 7fdffcff9700 1 -- 172.21.15.133:0/1686942010 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdff00119c0 con 0x7fe0000fc880 2023-12-16T07:34:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.704+0000 7fdfff7fe700 1 -- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 msgr2=0x7fdfe8038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1804466564 2023-12-16T07:34:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.704+0000 7fdfff7fe700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 0x7fdfe8038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T07:34:58.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.761+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe00010ea00 con 0x7fe0000fc880 2023-12-16T07:34:58.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.762+0000 7fdffcff9700 1 -- 172.21.15.133:0/1686942010 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fdff0011370 con 0x7fe0000fc880 2023-12-16T07:34:58.762 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:34:58.762 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 msgr2=0x7fdfe8038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 0x7fdfe8038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 msgr2=0x7fe00010cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe00010cad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009330 tx=0x7fdff0009e30 comp rx=0 tx=0).stop 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 shutdown_connections 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7fdfe8036720 0x7fdfe8038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 --2- 172.21.15.133:0/1686942010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0000fc880 0x7fe00010cad0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 >> 172.21.15.133:0/1686942010 conn(0x7fe0000f7f20 msgr2=0x7fe0000f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:34:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 shutdown_connections 2023-12-16T07:34:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:34:58.764+0000 7fe00694d700 1 -- 172.21.15.133:0/1686942010 wait complete. 2023-12-16T07:34:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:34:59.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:34:58 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/1686942010' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:00.152 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:35:00.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:35:00.434 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:35:00.490 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:35:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.546+0000 7f6c06abd700 1 -- 172.21.15.133:0/3066472119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 msgr2=0x7f6c000ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.546+0000 7f6c06abd700 1 --2- 172.21.15.133:0/3066472119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c000ff450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40048c0 tx=0x7f6bf4009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.547+0000 7f6c06abd700 1 -- 172.21.15.133:0/3066472119 shutdown_connections 2023-12-16T07:35:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.547+0000 7f6c06abd700 1 --2- 172.21.15.133:0/3066472119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c000ff450 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.547+0000 7f6c06abd700 1 -- 172.21.15.133:0/3066472119 >> 172.21.15.133:0/3066472119 conn(0x7f6c000f6e40 msgr2=0x7f6c000f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:01.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.547+0000 7f6c06abd700 1 -- 172.21.15.133:0/3066472119 shutdown_connections 2023-12-16T07:35:01.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.547+0000 7f6c06abd700 1 -- 172.21.15.133:0/3066472119 wait complete. 2023-12-16T07:35:01.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.547+0000 7f6c06abd700 1 Processor -- start 2023-12-16T07:35:01.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.547+0000 7f6c06abd700 1 -- start start 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c06abd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c0010ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c06abd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0010cfb0 con 0x7f6c00066550 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c04859700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c0010ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c04859700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c0010ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:41546/0 (socket says 172.21.15.133:41546) 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c04859700 1 -- 172.21.15.133:0/965427184 learned_addr learned my addr 172.21.15.133:0/965427184 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c04859700 1 -- 172.21.15.133:0/965427184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4005040 con 0x7f6c00066550 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c04859700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c0010ca70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b690 tx=0x7f6bf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6bfd7fa700 1 -- 172.21.15.133:0/965427184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bf4009650 con 0x7f6c00066550 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0010d1b0 con 0x7f6c00066550 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6bfd7fa700 1 -- 172.21.15.133:0/965427184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bf40097b0 con 0x7f6c00066550 2023-12-16T07:35:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6bfd7fa700 1 -- 172.21.15.133:0/965427184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bf401c5b0 con 0x7f6c00066550 2023-12-16T07:35:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.548+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0010de50 con 0x7f6c00066550 2023-12-16T07:35:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.549+0000 7f6bfd7fa700 1 -- 172.21.15.133:0/965427184 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f6bf4013420 con 0x7f6c00066550 2023-12-16T07:35:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.549+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0005f270 con 0x7f6c00066550 2023-12-16T07:35:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.549+0000 7f6bfd7fa700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 0x7f6bf0038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.549+0000 7f6bfd7fa700 1 -- 172.21.15.133:0/965427184 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6bf4049a10 con 0x7f6c00066550 2023-12-16T07:35:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.549+0000 7f6bfffff700 1 -- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 msgr2=0x7f6bf0038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1804466564 2023-12-16T07:35:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.549+0000 7f6bfffff700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 0x7f6bf0038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:35:01.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.554+0000 7f6bfd7fa700 1 -- 172.21.15.133:0/965427184 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6bf40119c0 con 0x7f6c00066550 2023-12-16T07:35:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.750+0000 7f6bfffff700 1 -- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 msgr2=0x7f6bf0038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1804466564 2023-12-16T07:35:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.750+0000 7f6bfffff700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 0x7f6bf0038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T07:35:01.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.814+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6c0010e9a0 con 0x7f6c00066550 2023-12-16T07:35:01.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.814+0000 7f6bfd7fa700 1 -- 172.21.15.133:0/965427184 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6bf4011370 con 0x7f6c00066550 2023-12-16T07:35:01.816 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:35:01.816 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:35:01.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 msgr2=0x7f6bf0038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:35:01.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 0x7f6bf0038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:01.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 msgr2=0x7f6c0010ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:01.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c0010ca70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b690 tx=0x7f6bf4009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:01.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 shutdown_connections 2023-12-16T07:35:01.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:6800/1804466564,v1:172.21.15.49:6801/1804466564] conn(0x7f6bf0036770 0x7f6bf0038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:01.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 --2- 172.21.15.133:0/965427184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c00066550 0x7f6c0010ca70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:01.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 >> 172.21.15.133:0/965427184 conn(0x7f6c000f6e40 msgr2=0x7f6c000f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:01.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 shutdown_connections 2023-12-16T07:35:01.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:01.816+0000 7f6c06abd700 1 -- 172.21.15.133:0/965427184 wait complete. 2023-12-16T07:35:01.820 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:35:01.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:01 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/965427184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:03.208 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:35:03.208 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:35:03.500 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:35:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: mgrmap e15: smithi049.rqlvwo(active, starting, since 0.00313371s) 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:35:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:35:03.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:35:03.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:03.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:03.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:03.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:03.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:35:03.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.674+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/423036113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 msgr2=0x7fa2cc0fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.674+0000 7fa2d0ab7700 1 --2- 172.21.15.133:0/423036113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc0fbb80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0048c0 tx=0x7fa2bc009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.674+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/423036113 shutdown_connections 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.674+0000 7fa2d0ab7700 1 --2- 172.21.15.133:0/423036113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc0fbb80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.674+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/423036113 >> 172.21.15.133:0/423036113 conn(0x7fa2cc0f6e50 msgr2=0x7fa2cc0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.674+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/423036113 shutdown_connections 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.674+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/423036113 wait complete. 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2d0ab7700 1 Processor -- start 2023-12-16T07:35:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2d0ab7700 1 -- start start 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2d0ab7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc10f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2d0ab7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc0662c0 con 0x7fa2cc0fb770 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2ca59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc10f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2ca59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc10f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:41552/0 (socket says 172.21.15.133:41552) 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2ca59c700 1 -- 172.21.15.133:0/3667674791 learned_addr learned my addr 172.21.15.133:0/3667674791 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2ca59c700 1 -- 172.21.15.133:0/3667674791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc005040 con 0x7fa2cc0fb770 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.675+0000 7fa2ca59c700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc10f780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009330 tx=0x7fa2bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.676+0000 7fa2baffd700 1 -- 172.21.15.133:0/3667674791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2bc0096b0 con 0x7fa2cc0fb770 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.676+0000 7fa2baffd700 1 -- 172.21.15.133:0/3667674791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2bc009810 con 0x7fa2cc0fb770 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.676+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc0664c0 con 0x7fa2cc0fb770 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.676+0000 7fa2baffd700 1 -- 172.21.15.133:0/3667674791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2bc01c5b0 con 0x7fa2cc0fb770 2023-12-16T07:35:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.676+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc10ff00 con 0x7fa2cc0fb770 2023-12-16T07:35:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.676+0000 7fa2baffd700 1 -- 172.21.15.133:0/3667674791 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7fa2bc013420 con 0x7fa2cc0fb770 2023-12-16T07:35:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.676+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc105400 con 0x7fa2cc0fb770 2023-12-16T07:35:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.677+0000 7fa2baffd700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa2b4036560 0x7fa2b4038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.677+0000 7fa2baffd700 1 -- 172.21.15.133:0/3667674791 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa2bc049930 con 0x7fa2cc0fb770 2023-12-16T07:35:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.677+0000 7fa2c9d9b700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa2b4036560 0x7fa2b4038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.677+0000 7fa2c9d9b700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa2b4036560 0x7fa2b4038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009990 tx=0x7fa2c0006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:04.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.682+0000 7fa2baffd700 1 -- 172.21.15.133:0/3667674791 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa2bc0117e0 con 0x7fa2cc0fb770 2023-12-16T07:35:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:04 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:04 smithi049 ceph-mon[111939]: [16/Dec/2023:07:35:03] ENGINE Bus STARTING 2023-12-16T07:35:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:04 smithi049 ceph-mon[111939]: [16/Dec/2023:07:35:03] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:35:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:04 smithi049 ceph-mon[111939]: [16/Dec/2023:07:35:03] ENGINE Bus STARTED 2023-12-16T07:35:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:04 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:04 smithi049 ceph-mon[111939]: mgrmap e16: smithi049.rqlvwo(active, since 1.00609s) 2023-12-16T07:35:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:04 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:04.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.962+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa2cc04bb80 con 0x7fa2cc0fb770 2023-12-16T07:35:04.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.963+0000 7fa2baffd700 1 -- 172.21.15.133:0/3667674791 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa2bc01be90 con 0x7fa2cc0fb770 2023-12-16T07:35:04.964 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:35:04.964 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa2b4036560 msgr2=0x7fa2b4038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa2b4036560 0x7fa2b4038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009990 tx=0x7fa2c0006e40 comp rx=0 tx=0).stop 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 msgr2=0x7fa2cc10f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc10f780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009330 tx=0x7fa2bc009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 shutdown_connections 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa2b4036560 0x7fa2b4038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 --2- 172.21.15.133:0/3667674791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2cc0fb770 0x7fa2cc10f780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 >> 172.21.15.133:0/3667674791 conn(0x7fa2cc0f6e50 msgr2=0x7fa2cc0f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 shutdown_connections 2023-12-16T07:35:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:04.965+0000 7fa2d0ab7700 1 -- 172.21.15.133:0/3667674791 wait complete. 2023-12-16T07:35:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:35:05.877 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:05 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3667674791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:05.878 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:06.541 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:35:06.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:35:06.798 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:35:06.852 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-16T07:35:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:07 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:07 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:07 smithi049 ceph-mon[111939]: mgrmap e17: smithi049.rqlvwo(active, since 2s) 2023-12-16T07:35:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:07 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:07 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:07 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:35:08.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.117+0000 7f6d1d54e700 1 -- 172.21.15.133:0/1308733782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 msgr2=0x7f6d180fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:08.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.117+0000 7f6d1d54e700 1 --2- 172.21.15.133:0/1308733782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d180fbb80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d080048c0 tx=0x7f6d08009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:08.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.117+0000 7f6d1d54e700 1 -- 172.21.15.133:0/1308733782 shutdown_connections 2023-12-16T07:35:08.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.117+0000 7f6d1d54e700 1 --2- 172.21.15.133:0/1308733782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d180fbb80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:08.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.117+0000 7f6d1d54e700 1 -- 172.21.15.133:0/1308733782 >> 172.21.15.133:0/1308733782 conn(0x7f6d180f6e50 msgr2=0x7f6d180f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:08.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.117+0000 7f6d1d54e700 1 -- 172.21.15.133:0/1308733782 shutdown_connections 2023-12-16T07:35:08.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.117+0000 7f6d1d54e700 1 -- 172.21.15.133:0/1308733782 wait complete. 2023-12-16T07:35:08.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.118+0000 7f6d1d54e700 1 Processor -- start 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.118+0000 7f6d1d54e700 1 -- start start 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.118+0000 7f6d1d54e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d1810b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.118+0000 7f6d1d54e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1810bec0 con 0x7f6d180fb770 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.118+0000 7f6d16ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d1810b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.118+0000 7f6d16ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d1810b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:49800/0 (socket says 172.21.15.133:49800) 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.118+0000 7f6d16ffd700 1 -- 172.21.15.133:0/3182576021 learned_addr learned my addr 172.21.15.133:0/3182576021 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.119+0000 7f6d16ffd700 1 -- 172.21.15.133:0/3182576021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08005040 con 0x7f6d180fb770 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.119+0000 7f6d16ffd700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d1810b980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009330 tx=0x7f6d08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.119+0000 7f6cff7fe700 1 -- 172.21.15.133:0/3182576021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d080096b0 con 0x7f6d180fb770 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.119+0000 7f6cff7fe700 1 -- 172.21.15.133:0/3182576021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6d08009810 con 0x7f6d180fb770 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.119+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1810c0c0 con 0x7f6d180fb770 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.119+0000 7f6cff7fe700 1 -- 172.21.15.133:0/3182576021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d0801c5b0 con 0x7f6d180fb770 2023-12-16T07:35:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.119+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1810cd60 con 0x7f6d180fb770 2023-12-16T07:35:08.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.120+0000 7f6cff7fe700 1 -- 172.21.15.133:0/3182576021 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f6d08013420 con 0x7f6d180fb770 2023-12-16T07:35:08.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.120+0000 7f6cff7fe700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6d000367c0 0x7f6d00038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:08.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.120+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1805f270 con 0x7f6d180fb770 2023-12-16T07:35:08.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.120+0000 7f6cff7fe700 1 -- 172.21.15.133:0/3182576021 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6d08049ca0 con 0x7f6d180fb770 2023-12-16T07:35:08.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.120+0000 7f6d167fc700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6d000367c0 0x7f6d00038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:08.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.121+0000 7f6d167fc700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6d000367c0 0x7f6d00038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009990 tx=0x7f6d0c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:08.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.126+0000 7f6cff7fe700 1 -- 172.21.15.133:0/3182576021 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6d08049e60 con 0x7f6d180fb770 2023-12-16T07:35:08.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.403+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6d1810d8b0 con 0x7f6d180fb770 2023-12-16T07:35:08.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.403+0000 7f6cff7fe700 1 -- 172.21.15.133:0/3182576021 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6d080119c0 con 0x7f6d180fb770 2023-12-16T07:35:08.404 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:35:08.405 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6d000367c0 msgr2=0x7f6d00038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6d000367c0 0x7f6d00038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009990 tx=0x7f6d0c006e40 comp rx=0 tx=0).stop 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 msgr2=0x7f6d1810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d1810b980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009330 tx=0x7f6d08009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 shutdown_connections 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6d000367c0 0x7f6d00038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 --2- 172.21.15.133:0/3182576021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d180fb770 0x7f6d1810b980 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 >> 172.21.15.133:0/3182576021 conn(0x7f6d180f6e50 msgr2=0x7f6d180f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 shutdown_connections 2023-12-16T07:35:08.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:08.406+0000 7f6d1d54e700 1 -- 172.21.15.133:0/3182576021 wait complete. 2023-12-16T07:35:08.408 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:35:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:35:09.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:09.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:09.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:09 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3182576021' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:09.847 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:35:09.847 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:35:10.193 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:10.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:35:10.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:10.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:10 smithi049 ceph-mon[111939]: Deploying daemon crash.smithi133 on smithi133 2023-12-16T07:35:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 -- 172.21.15.133:0/236006180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 msgr2=0x7f2034102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 --2- 172.21.15.133:0/236006180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034102c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f20240048c0 tx=0x7f2024009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 -- 172.21.15.133:0/236006180 shutdown_connections 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 --2- 172.21.15.133:0/236006180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034102c70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 -- 172.21.15.133:0/236006180 >> 172.21.15.133:0/236006180 conn(0x7f2034071d60 msgr2=0x7f2034072160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 -- 172.21.15.133:0/236006180 shutdown_connections 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 -- 172.21.15.133:0/236006180 wait complete. 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 Processor -- start 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 -- start start 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.279+0000 7f203bc52700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20341130c0 con 0x7f20341028a0 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f20399ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f20399ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:49824/0 (socket says 172.21.15.133:49824) 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f20399ee700 1 -- 172.21.15.133:0/263852277 learned_addr learned my addr 172.21.15.133:0/263852277 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:35:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f20399ee700 1 -- 172.21.15.133:0/263852277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024005040 con 0x7f20341028a0 2023-12-16T07:35:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f20399ee700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034112b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2024009300 tx=0x7f2024009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f202a7fc700 1 -- 172.21.15.133:0/263852277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2024004e60 con 0x7f20341028a0 2023-12-16T07:35:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20341132c0 con 0x7f20341028a0 2023-12-16T07:35:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f202a7fc700 1 -- 172.21.15.133:0/263852277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2024013420 con 0x7f20341028a0 2023-12-16T07:35:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.280+0000 7f202a7fc700 1 -- 172.21.15.133:0/263852277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f202401c5b0 con 0x7f20341028a0 2023-12-16T07:35:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.281+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2034113730 con 0x7f20341028a0 2023-12-16T07:35:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.281+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203405f270 con 0x7f20341028a0 2023-12-16T07:35:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.281+0000 7f202a7fc700 1 -- 172.21.15.133:0/263852277 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f2024009600 con 0x7f20341028a0 2023-12-16T07:35:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.282+0000 7f202a7fc700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f20200367c0 0x7f2020038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.282+0000 7f202a7fc700 1 -- 172.21.15.133:0/263852277 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2024049980 con 0x7f20341028a0 2023-12-16T07:35:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.282+0000 7f20391ed700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f20200367c0 0x7f2020038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.282+0000 7f20391ed700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f20200367c0 0x7f2020038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2030009990 tx=0x7f2030006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.287+0000 7f202a7fc700 1 -- 172.21.15.133:0/263852277 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2024025400 con 0x7f20341028a0 2023-12-16T07:35:11.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.563+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f203404bc10 con 0x7f20341028a0 2023-12-16T07:35:11.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.563+0000 7f202a7fc700 1 -- 172.21.15.133:0/263852277 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2024011370 con 0x7f20341028a0 2023-12-16T07:35:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:35:11.565 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f20200367c0 msgr2=0x7f2020038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f20200367c0 0x7f2020038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2030009990 tx=0x7f2030006e40 comp rx=0 tx=0).stop 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 msgr2=0x7f2034112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034112b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2024009300 tx=0x7f2024009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 shutdown_connections 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f20200367c0 0x7f2020038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 --2- 172.21.15.133:0/263852277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20341028a0 0x7f2034112b80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:11.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 >> 172.21.15.133:0/263852277 conn(0x7f2034071d60 msgr2=0x7f20340f9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 shutdown_connections 2023-12-16T07:35:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:11.565+0000 7f203bc52700 1 -- 172.21.15.133:0/263852277 wait complete. 2023-12-16T07:35:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:35:12.886 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:35:12.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:35:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:12 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/263852277' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:12.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:12 smithi049 ceph-mon[111939]: Deploying daemon node-exporter.smithi133 on smithi133 2023-12-16T07:35:13.687 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:14.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:14 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:14.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.899+0000 7fd0b5810700 1 -- 172.21.15.133:0/285223199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 msgr2=0x7fd0b0102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.899+0000 7fd0b5810700 1 --2- 172.21.15.133:0/285223199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0102ca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00048c0 tx=0x7fd0a0009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.899+0000 7fd0b5810700 1 -- 172.21.15.133:0/285223199 shutdown_connections 2023-12-16T07:35:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.899+0000 7fd0b5810700 1 --2- 172.21.15.133:0/285223199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0102ca0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.899+0000 7fd0b5810700 1 -- 172.21.15.133:0/285223199 >> 172.21.15.133:0/285223199 conn(0x7fd0b00f8410 msgr2=0x7fd0b00fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.899+0000 7fd0b5810700 1 -- 172.21.15.133:0/285223199 shutdown_connections 2023-12-16T07:35:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.899+0000 7fd0b5810700 1 -- 172.21.15.133:0/285223199 wait complete. 2023-12-16T07:35:14.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.900+0000 7fd0b5810700 1 Processor -- start 2023-12-16T07:35:14.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.900+0000 7fd0b5810700 1 -- start start 2023-12-16T07:35:14.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.900+0000 7fd0b5810700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:14.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.901+0000 7fd0b5810700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01130a0 con 0x7fd0b01028d0 2023-12-16T07:35:14.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.901+0000 7fd0aeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:14.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.901+0000 7fd0aeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:49852/0 (socket says 172.21.15.133:49852) 2023-12-16T07:35:14.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.901+0000 7fd0aeffd700 1 -- 172.21.15.133:0/3531023925 learned_addr learned my addr 172.21.15.133:0/3531023925 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:35:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.901+0000 7fd0aeffd700 1 -- 172.21.15.133:0/3531023925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0005040 con 0x7fd0b01028d0 2023-12-16T07:35:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.901+0000 7fd0aeffd700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0112b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009300 tx=0x7fd0a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.902+0000 7fd0977fe700 1 -- 172.21.15.133:0/3531023925 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0a0004e60 con 0x7fd0b01028d0 2023-12-16T07:35:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.902+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b01132a0 con 0x7fd0b01028d0 2023-12-16T07:35:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.902+0000 7fd0977fe700 1 -- 172.21.15.133:0/3531023925 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0a0013420 con 0x7fd0b01028d0 2023-12-16T07:35:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.902+0000 7fd0977fe700 1 -- 172.21.15.133:0/3531023925 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0a001c5b0 con 0x7fd0b01028d0 2023-12-16T07:35:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.902+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b010ca20 con 0x7fd0b01028d0 2023-12-16T07:35:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.903+0000 7fd0977fe700 1 -- 172.21.15.133:0/3531023925 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fd0a001c7f0 con 0x7fd0b01028d0 2023-12-16T07:35:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.903+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b005f270 con 0x7fd0b01028d0 2023-12-16T07:35:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.903+0000 7fd0977fe700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd0980367c0 0x7fd098038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.903+0000 7fd0977fe700 1 -- 172.21.15.133:0/3531023925 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd0a0049930 con 0x7fd0b01028d0 2023-12-16T07:35:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.903+0000 7fd0ae7fc700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd0980367c0 0x7fd098038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.904+0000 7fd0ae7fc700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd0980367c0 0x7fd098038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009990 tx=0x7fd0a4006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:14.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:14.908+0000 7fd0977fe700 1 -- 172.21.15.133:0/3531023925 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd0a0025920 con 0x7fd0b01028d0 2023-12-16T07:35:15.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.197+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd0b004bbe0 con 0x7fd0b01028d0 2023-12-16T07:35:15.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.197+0000 7fd0977fe700 1 -- 172.21.15.133:0/3531023925 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd0a0023a00 con 0x7fd0b01028d0 2023-12-16T07:35:15.198 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:35:15.198 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.199+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd0980367c0 msgr2=0x7fd098038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.199+0000 7fd0b5810700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd0980367c0 0x7fd098038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009990 tx=0x7fd0a4006e40 comp rx=0 tx=0).stop 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.199+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 msgr2=0x7fd0b0112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.199+0000 7fd0b5810700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0112b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009300 tx=0x7fd0a0009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.199+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 shutdown_connections 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.200+0000 7fd0b5810700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd0980367c0 0x7fd098038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.200+0000 7fd0b5810700 1 --2- 172.21.15.133:0/3531023925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0b01028d0 0x7fd0b0112b60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.200+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 >> 172.21.15.133:0/3531023925 conn(0x7fd0b00f8410 msgr2=0x7fd0b00fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.200+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 shutdown_connections 2023-12-16T07:35:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:15.200+0000 7fd0b5810700 1 -- 172.21.15.133:0/3531023925 wait complete. 2023-12-16T07:35:15.201 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:35:15.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: Deploying daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:35:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:15 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3531023925' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:16.692 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:35:16.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:35:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:35:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:17 smithi049 ceph-mon[111939]: Deploying daemon mon.smithi133 on smithi133 2023-12-16T07:35:18.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 -- 172.21.15.133:0/193687032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 msgr2=0x7f97fc102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:18.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 --2- 172.21.15.133:0/193687032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc102cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0048c0 tx=0x7f97ec009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:18.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 -- 172.21.15.133:0/193687032 shutdown_connections 2023-12-16T07:35:18.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 --2- 172.21.15.133:0/193687032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc102cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:18.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 -- 172.21.15.133:0/193687032 >> 172.21.15.133:0/193687032 conn(0x7f97fc0715e0 msgr2=0x7f97fc0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:18.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 -- 172.21.15.133:0/193687032 shutdown_connections 2023-12-16T07:35:18.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 -- 172.21.15.133:0/193687032 wait complete. 2023-12-16T07:35:18.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.607+0000 7f9802424700 1 Processor -- start 2023-12-16T07:35:18.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.608+0000 7f9802424700 1 -- start start 2023-12-16T07:35:18.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.608+0000 7f9802424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc0fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:18.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.608+0000 7f9802424700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc0fbd20 con 0x7f97fc1028f0 2023-12-16T07:35:18.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.608+0000 7f97fbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc0fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:18.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.608+0000 7f97fbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc0fb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.133:40880/0 (socket says 172.21.15.133:40880) 2023-12-16T07:35:18.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.608+0000 7f97fbfff700 1 -- 172.21.15.133:0/3143388627 learned_addr learned my addr 172.21.15.133:0/3143388627 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:35:18.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.608+0000 7f97fbfff700 1 -- 172.21.15.133:0/3143388627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec005040 con 0x7f97fc1028f0 2023-12-16T07:35:18.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.609+0000 7f97fbfff700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc0fb7e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009300 tx=0x7f97ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:18.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.609+0000 7f97f8ff9700 1 -- 172.21.15.133:0/3143388627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97ec004e60 con 0x7f97fc1028f0 2023-12-16T07:35:18.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.609+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97fc0fbf20 con 0x7f97fc1028f0 2023-12-16T07:35:18.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.609+0000 7f97f8ff9700 1 -- 172.21.15.133:0/3143388627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97ec013420 con 0x7f97fc1028f0 2023-12-16T07:35:18.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.609+0000 7f97f8ff9700 1 -- 172.21.15.133:0/3143388627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97ec01c5b0 con 0x7f97fc1028f0 2023-12-16T07:35:18.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.609+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97fc0fc410 con 0x7f97fc1028f0 2023-12-16T07:35:18.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.610+0000 7f97f8ff9700 1 -- 172.21.15.133:0/3143388627 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f97ec01c7f0 con 0x7f97fc1028f0 2023-12-16T07:35:18.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.610+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97fc0fc650 con 0x7f97fc1028f0 2023-12-16T07:35:18.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.610+0000 7f97f8ff9700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f97e40367c0 0x7f97e4038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:18.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.610+0000 7f97f8ff9700 1 -- 172.21.15.133:0/3143388627 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f97ec049a10 con 0x7f97fc1028f0 2023-12-16T07:35:18.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.610+0000 7f97fb7fe700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f97e40367c0 0x7f97e4038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:18.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.611+0000 7f97fb7fe700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f97e40367c0 0x7f97e4038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009990 tx=0x7f97f0006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:18.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.615+0000 7f97f8ff9700 1 -- 172.21.15.133:0/3143388627 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f97fc0fc650 con 0x7f97fc1028f0 2023-12-16T07:35:18.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.903+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f97fc0fc650 con 0x7f97fc1028f0 2023-12-16T07:35:18.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.904+0000 7f97f8ff9700 1 -- 172.21.15.133:0/3143388627 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f97fc0fc650 con 0x7f97fc1028f0 2023-12-16T07:35:18.905 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:35:18.905 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:33:22.192917Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-16T07:35:18.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f97e40367c0 msgr2=0x7f97e4038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:18.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f97e40367c0 0x7f97e4038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009990 tx=0x7f97f0006e40 comp rx=0 tx=0).stop 2023-12-16T07:35:18.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 msgr2=0x7f97fc0fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc0fb7e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009300 tx=0x7f97ec009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 shutdown_connections 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f97e40367c0 0x7f97e4038c70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 --2- 172.21.15.133:0/3143388627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1028f0 0x7f97fc0fb7e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 >> 172.21.15.133:0/3143388627 conn(0x7f97fc0715e0 msgr2=0x7f97fc103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 shutdown_connections 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:18.907+0000 7f9802424700 1 -- 172.21.15.133:0/3143388627 wait complete. 2023-12-16T07:35:18.908 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2023-12-16T07:35:19.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:19 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:19 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:19.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:19 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3143388627' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 systemd[1]: Started Ceph mon.smithi133 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: starting mon.smithi133 rank -1 at public addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] at bind addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi133 fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(???) e0 preinit fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).mds e1 new map 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).mds e1 print_map 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: e1 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: legacy client fscid: -1 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: No filesystems configured 2023-12-16T07:35:19.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi049:172.21.15.49=smithi049;smithi133:172.21.15.133=smithi133", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:35:19.837 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Saving service mon spec with placement smithi049:172.21.15.49=smithi049;smithi133:172.21.15.133=smithi133;count:2 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/695173770' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/534606874' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/2660512908' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.838 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Deploying daemon prometheus.smithi049 on smithi049 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3371752697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/4119132783' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3549658976' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.839 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14162 172.21.15.49:0/3886590633' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-16T07:35:19.840 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mgrmap e14: smithi049.rqlvwo(active, since 41s) 2023-12-16T07:35:19.840 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/1686942010' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.840 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/965427184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.840 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:35:19.846 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:35:19.846 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T07:35:19.846 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mgrmap e15: smithi049.rqlvwo(active, starting, since 0.00313371s) 2023-12-16T07:35:19.846 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:35:19.847 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:35:19.847 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:35:19.847 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:35:19.847 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:35:19.847 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:35:19.847 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.847 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: [16/Dec/2023:07:35:03] ENGINE Bus STARTING 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: [16/Dec/2023:07:35:03] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: [16/Dec/2023:07:35:03] ENGINE Bus STARTED 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mgrmap e16: smithi049.rqlvwo(active, since 1.00609s) 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3667674791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.848 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.849 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.849 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.849 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mgrmap e17: smithi049.rqlvwo(active, since 2s) 2023-12-16T07:35:19.849 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.849 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.849 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:35:19.849 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:19.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3182576021' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Deploying daemon crash.smithi133 on smithi133 2023-12-16T07:35:19.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/263852277' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Deploying daemon node-exporter.smithi133 on smithi133 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:19.852 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Deploying daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3531023925' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: Deploying daemon mon.smithi133 on smithi133 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3143388627' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-16T07:35:19.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:19 smithi133 ceph-mon[120445]: mon.smithi133@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-16T07:35:20.304 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-16T07:35:20.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-16T07:35:20.579 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:35:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.792+0000 7f69da75f700 1 -- 172.21.15.133:0/3807500575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 msgr2=0x7f69bc005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.792+0000 7f69da75f700 1 --2- 172.21.15.133:0/3807500575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 0x7f69bc005a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f69d40fc8c0 tx=0x7f69c400b040 comp rx=0 tx=0).stop 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.792+0000 7f69da75f700 1 -- 172.21.15.133:0/3807500575 shutdown_connections 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.792+0000 7f69da75f700 1 --2- 172.21.15.133:0/3807500575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 0x7f69bc005a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.792+0000 7f69da75f700 1 -- 172.21.15.133:0/3807500575 >> 172.21.15.133:0/3807500575 conn(0x7f69d40f8510 msgr2=0x7f69d40fa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.792+0000 7f69da75f700 1 -- 172.21.15.133:0/3807500575 shutdown_connections 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.792+0000 7f69da75f700 1 -- 172.21.15.133:0/3807500575 wait complete. 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69da75f700 1 Processor -- start 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69da75f700 1 -- start start 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69da75f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 0x7f69d4112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69da75f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 0x7f69d410cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69da75f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d4113790 con 0x7f69bc003580 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69da75f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d410d090 con 0x7f69d41131d0 2023-12-16T07:35:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 0x7f69d410cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 0x7f69d410cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39514/0 (socket says 172.21.15.133:39514) 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.793+0000 7f69d37fe700 1 -- 172.21.15.133:0/3498010624 learned_addr learned my addr 172.21.15.133:0/3498010624 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d37fe700 1 -- 172.21.15.133:0/3498010624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 msgr2=0x7f69d410cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d37fe700 1 -- 172.21.15.133:0/3498010624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 msgr2=0x7f69d410cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d3fff700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 0x7f69d4112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d37fe700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 0x7f69d410cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d37fe700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 0x7f69d410cb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d3fff700 1 -- 172.21.15.133:0/3498010624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 msgr2=0x7f69d410cb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d3fff700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 0x7f69d410cb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d3fff700 1 -- 172.21.15.133:0/3498010624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4005040 con 0x7f69bc003580 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d3fff700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 0x7f69d4112c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69d40fc8c0 tx=0x7f69c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d0ff9700 1 -- 172.21.15.133:0/3498010624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c4015f00 con 0x7f69bc003580 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d0ff9700 1 -- 172.21.15.133:0/3498010624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69c40095c0 con 0x7f69bc003580 2023-12-16T07:35:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d410d310 con 0x7f69bc003580 2023-12-16T07:35:24.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69d0ff9700 1 -- 172.21.15.133:0/3498010624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c4020de0 con 0x7f69bc003580 2023-12-16T07:35:24.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.794+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d410d850 con 0x7f69bc003580 2023-12-16T07:35:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.796+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d405f270 con 0x7f69bc003580 2023-12-16T07:35:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.796+0000 7f69d0ff9700 1 -- 172.21.15.133:0/3498010624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f69c401e070 con 0x7f69bc003580 2023-12-16T07:35:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.796+0000 7f69d0ff9700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f69c0068fe0 0x7f69c006b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.796+0000 7f69d0ff9700 1 -- 172.21.15.133:0/3498010624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f69c401c070 con 0x7f69bc003580 2023-12-16T07:35:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.796+0000 7f69d37fe700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f69c0068fe0 0x7f69c006b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.797+0000 7f69d37fe700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f69c0068fe0 0x7f69c006b490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006fd0 tx=0x7f69c8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:24.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:24.801+0000 7f69d0ff9700 1 -- 172.21.15.133:0/3498010624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f69c4057fd0 con 0x7f69bc003580 2023-12-16T07:35:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:35:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: mon.smithi049 calling monitor election 2023-12-16T07:35:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: mon.smithi133 calling monitor election 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: mon.smithi049 is new leader, mons smithi049,smithi133 in quorum (ranks 0,1) 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: fsmap 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: mgrmap e17: smithi049.rqlvwo(active, since 21s) 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: overall HEALTH_OK 2023-12-16T07:35:24.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:35:24.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:35:24.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:24.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:24.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:24.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:24.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:25.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.076+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f69d410e200 con 0x7f69bc003580 2023-12-16T07:35:25.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.076+0000 7f69d0ff9700 1 -- 172.21.15.133:0/3498010624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f69c402e410 con 0x7f69bc003580 2023-12-16T07:35:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-16T07:35:25.076 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":2,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","modified":"2023-12-16T07:35:19.598641Z","created":"2023-12-16T07:33:22.192917Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi133","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:3300","nonce":0},{"type":"v1","addr":"172.21.15.133:6789","nonce":0}]},"addr":"172.21.15.133:6789/0","public_addr":"172.21.15.133:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-16T07:35:25.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f69c0068fe0 msgr2=0x7f69c006b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:25.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f69c0068fe0 0x7f69c006b490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006fd0 tx=0x7f69c8008040 comp rx=0 tx=0).stop 2023-12-16T07:35:25.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 msgr2=0x7f69d4112c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 0x7f69d4112c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69d40fc8c0 tx=0x7f69c400b040 comp rx=0 tx=0).stop 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 shutdown_connections 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f69c0068fe0 0x7f69c006b490 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69bc003580 0x7f69d4112c90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 --2- 172.21.15.133:0/3498010624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d41131d0 0x7f69d410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.079+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 >> 172.21.15.133:0/3498010624 conn(0x7f69d40f8510 msgr2=0x7f69d40fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.080+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 shutdown_connections 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:35:25.080+0000 7f69da75f700 1 -- 172.21.15.133:0/3498010624 wait complete. 2023-12-16T07:35:25.080 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 2 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: mon.smithi049 calling monitor election 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: mon.smithi133 calling monitor election 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:25.101 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: mon.smithi049 is new leader, mons smithi049,smithi133 in quorum (ranks 0,1) 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: fsmap 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: osdmap e5: 0 total, 0 up, 0 in 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: mgrmap e17: smithi049.rqlvwo(active, since 21s) 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: overall HEALTH_OK 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/791764931' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:25.102 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:25.103 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:25.103 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:25.103 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:25.611 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-16T07:35:25.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph config generate-minimal-conf 2023-12-16T07:35:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:25 smithi133 ceph-mon[120445]: mgrmap e18: smithi049.rqlvwo(active, since 21s), standbys: smithi133.wbiduk 2023-12-16T07:35:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:35:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:25 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3498010624' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:25.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:25 smithi133 ceph-mon[120445]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:25.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:25.896 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:35:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:25 smithi049 ceph-mon[111939]: mgrmap e18: smithi049.rqlvwo(active, since 21s), standbys: smithi133.wbiduk 2023-12-16T07:35:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:35:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:25 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3498010624' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-16T07:35:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:25 smithi049 ceph-mon[111939]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:35:27.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.302+0000 7f72ba3ed700 1 -- 172.21.15.49:0/1737196297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 msgr2=0x7f72b40fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.302+0000 7f72ba3ed700 1 --2- 172.21.15.49:0/1737196297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fdc50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72a40048c0 tx=0x7f72a4009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.303+0000 7f72ba3ed700 1 -- 172.21.15.49:0/1737196297 shutdown_connections 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.303+0000 7f72ba3ed700 1 --2- 172.21.15.49:0/1737196297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fdc50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.303+0000 7f72ba3ed700 1 -- 172.21.15.49:0/1737196297 >> 172.21.15.49:0/1737196297 conn(0x7f72b40f72f0 msgr2=0x7f72b40f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.303+0000 7f72ba3ed700 1 -- 172.21.15.49:0/1737196297 shutdown_connections 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.303+0000 7f72ba3ed700 1 -- 172.21.15.49:0/1737196297 wait complete. 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.303+0000 7f72ba3ed700 1 Processor -- start 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.303+0000 7f72ba3ed700 1 -- start start 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72ba3ed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72ba3ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b40fbbf0 0x7f72b40fc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72ba3ed700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4118fd0 con 0x7f72b40fd880 2023-12-16T07:35:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72ba3ed700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4119110 con 0x7f72b40fbbf0 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46042/0 (socket says 172.21.15.49:46042) 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b3fff700 1 -- 172.21.15.49:0/380258584 learned_addr learned my addr 172.21.15.49:0/380258584 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b37fe700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b40fbbf0 0x7f72b40fc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b3fff700 1 -- 172.21.15.49:0/380258584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b40fbbf0 msgr2=0x7f72b40fc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b3fff700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b40fbbf0 0x7f72b40fc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b3fff700 1 -- 172.21.15.49:0/380258584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4005040 con 0x7f72b40fd880 2023-12-16T07:35:27.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b37fe700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b40fbbf0 0x7f72b40fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b3fff700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fb6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72a400bfe0 tx=0x7f72a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b0ff9700 1 -- 172.21.15.49:0/380258584 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a400e040 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b0ff9700 1 -- 172.21.15.49:0/380258584 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f72a4013420 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b4119340 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72b0ff9700 1 -- 172.21.15.49:0/380258584 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a401c630 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.304+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b4119880 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.306+0000 7f72b0ff9700 1 -- 172.21.15.49:0/380258584 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f72a40139e0 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.306+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b41040c0 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.306+0000 7f72b0ff9700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f729c069030 0x7f729c06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.306+0000 7f72b0ff9700 1 -- 172.21.15.49:0/380258584 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f72a4086f80 con 0x7f72b40fd880 2023-12-16T07:35:27.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.306+0000 7f72b37fe700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f729c069030 0x7f729c06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:27.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.307+0000 7f72b37fe700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f729c069030 0x7f729c06b4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72a80079f0 tx=0x7f72a8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:27.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.311+0000 7f72b0ff9700 1 -- 172.21.15.49:0/380258584 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f72a40b8a00 con 0x7f72b40fd880 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.348 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.348 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.348 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.348 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:35:27.348 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:35:27.348 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.511+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f72b405f270 con 0x7f72b40fd880 2023-12-16T07:35:27.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.512+0000 7f72b0ff9700 1 -- 172.21.15.49:0/380258584 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f72a40545d0 con 0x7f72b40fd880 2023-12-16T07:35:27.513 INFO:teuthology.orchestra.run.smithi049.stdout:# minimal ceph.conf for 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:35:27.513 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2023-12-16T07:35:27.513 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:35:27.513 INFO:teuthology.orchestra.run.smithi049.stdout: mon_host = [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2023-12-16T07:35:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f729c069030 msgr2=0x7f729c06b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f729c069030 0x7f729c06b4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72a80079f0 tx=0x7f72a8008040 comp rx=0 tx=0).stop 2023-12-16T07:35:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 msgr2=0x7f72b40fb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fb6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72a400bfe0 tx=0x7f72a4009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 shutdown_connections 2023-12-16T07:35:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f729c069030 0x7f729c06b4e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b40fd880 0x7f72b40fb6b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 --2- 172.21.15.49:0/380258584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b40fbbf0 0x7f72b40fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 >> 172.21.15.49:0/380258584 conn(0x7f72b40f72f0 msgr2=0x7f72b4101240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 shutdown_connections 2023-12-16T07:35:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:27.514+0000 7f72ba3ed700 1 -- 172.21.15.49:0/380258584 wait complete. 2023-12-16T07:35:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:27.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:35:27.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:35:27.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:28.134 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-16T07:35:28.134 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:35:28.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T07:35:28.165 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:35:28.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:35:28.235 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:35:28.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.conf 2023-12-16T07:35:28.272 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:35:28.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:35:28.343 INFO:tasks.cephadm:Deploying OSDs... 2023-12-16T07:35:28.344 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:35:28.344 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T07:35:28.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T07:35:28.362 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2023-12-16T07:35:28.421 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 387028 Links: 1 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-16 07:34:53.448844214 +0000 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-16 07:28:09.352797132 +0000 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-16 07:28:09.352797132 +0000 2023-12-16T07:35:28.422 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-12-16T07:35:28.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T07:35:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: Reconfiguring mon.smithi049 (unknown last config time)... 2023-12-16T07:35:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: Reconfiguring daemon mon.smithi049 on smithi049 2023-12-16T07:35:28.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:28.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/380258584' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:28.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:28.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:28.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:35:28.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:35:28.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:28.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:28.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-16T07:35:28.489 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-16T07:35:28.489 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.8825e-05 s, 5.2 MB/s 2023-12-16T07:35:28.490 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T07:35:28.550 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2023-12-16T07:35:28.609 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T07:35:28.609 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:28.609 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 398829 Links: 1 2023-12-16T07:35:28.609 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:28.609 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:28.609 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-16 07:34:53.448844214 +0000 2023-12-16T07:35:28.609 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-16 07:28:09.896782055 +0000 2023-12-16T07:35:28.610 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-16 07:28:09.896782055 +0000 2023-12-16T07:35:28.610 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-12-16T07:35:28.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: Reconfiguring mon.smithi049 (unknown last config time)... 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: Reconfiguring daemon mon.smithi049 on smithi049 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/380258584' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:28.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:35:28.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:35:28.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:28.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:28.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-16T07:35:28.677 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-16T07:35:28.677 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.7167e-05 s, 5.3 MB/s 2023-12-16T07:35:28.678 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T07:35:28.738 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 393564 Links: 1 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-16 07:34:53.448844214 +0000 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-16 07:28:10.426767367 +0000 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-16 07:28:10.426767367 +0000 2023-12-16T07:35:28.797 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-12-16T07:35:28.798 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T07:35:28.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-16T07:35:28.864 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-16T07:35:28.864 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.531e-05 s, 5.4 MB/s 2023-12-16T07:35:28.865 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T07:35:28.925 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2023-12-16T07:35:28.984 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T07:35:28.984 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:28.984 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 396534 Links: 1 2023-12-16T07:35:28.984 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:28.984 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:28.984 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2023-12-16 07:34:53.449844186 +0000 2023-12-16T07:35:28.984 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-16 07:28:10.958752622 +0000 2023-12-16T07:35:28.985 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-16 07:28:10.958752622 +0000 2023-12-16T07:35:28.985 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2023-12-16T07:35:28.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T07:35:29.050 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2023-12-16T07:35:29.050 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2023-12-16T07:35:29.051 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000103531 s, 4.9 MB/s 2023-12-16T07:35:29.052 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T07:35:29.112 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:35:29.112 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T07:35:29.134 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T07:35:29.134 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-12-16T07:35:29.195 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 389734 Links: 1 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-16 07:35:19.081647309 +0000 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-16 07:28:00.483236580 +0000 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-16 07:28:00.483236580 +0000 2023-12-16T07:35:29.196 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-16T07:35:29.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T07:35:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-16T07:35:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-16T07:35:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000293781 s, 1.7 MB/s 2023-12-16T07:35:29.268 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T07:35:29.331 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-12-16T07:35:29.390 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T07:35:29.390 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:29.390 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 391674 Links: 1 2023-12-16T07:35:29.391 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:29.391 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:29.391 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-16 07:35:19.081647309 +0000 2023-12-16T07:35:29.391 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-16 07:28:00.984226948 +0000 2023-12-16T07:35:29.391 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-16 07:28:00.984226948 +0000 2023-12-16T07:35:29.391 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-16T07:35:29.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T07:35:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-16T07:35:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-16T07:35:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000236044 s, 2.2 MB/s 2023-12-16T07:35:29.461 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T07:35:29.521 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-12-16T07:35:29.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:29 smithi049 ceph-mon[111939]: Reconfiguring mgr.smithi049.rqlvwo (unknown last config time)... 2023-12-16T07:35:29.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:29 smithi049 ceph-mon[111939]: Reconfiguring daemon mgr.smithi049.rqlvwo on smithi049 2023-12-16T07:35:29.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:29.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:29.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:35:29.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:29.580 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T07:35:29.580 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:29.580 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 391811 Links: 1 2023-12-16T07:35:29.580 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:29.580 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:29.581 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-16 07:35:19.081647309 +0000 2023-12-16T07:35:29.581 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-16 07:28:01.496217104 +0000 2023-12-16T07:35:29.581 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-16 07:28:01.496217104 +0000 2023-12-16T07:35:29.581 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-16T07:35:29.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T07:35:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:29 smithi133 ceph-mon[120445]: Reconfiguring mgr.smithi049.rqlvwo (unknown last config time)... 2023-12-16T07:35:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:29 smithi133 ceph-mon[120445]: Reconfiguring daemon mgr.smithi049.rqlvwo on smithi049 2023-12-16T07:35:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:35:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-16T07:35:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-16T07:35:29.644 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.00023947 s, 2.1 MB/s 2023-12-16T07:35:29.645 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T07:35:29.705 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 393728 Links: 1 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-16 07:35:19.081647309 +0000 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-16 07:28:02.011207203 +0000 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-16 07:28:02.011207203 +0000 2023-12-16T07:35:29.763 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-16T07:35:29.764 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T07:35:29.829 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-16T07:35:29.829 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-16T07:35:29.829 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000291363 s, 1.8 MB/s 2023-12-16T07:35:29.830 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T07:35:29.890 INFO:tasks.cephadm:Deploying osd.0 on smithi049 with /dev/vg_nvme/lv_4... 2023-12-16T07:35:29.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T07:35:30.176 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:35:30.610 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:30 smithi049 ceph-mon[111939]: Reconfiguring crash.smithi049 (monmap changed)... 2023-12-16T07:35:30.610 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:30 smithi049 ceph-mon[111939]: Reconfiguring daemon crash.smithi049 on smithi049 2023-12-16T07:35:30.610 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:30 smithi049 ceph-mon[111939]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:30.610 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:30 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:30.610 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:30 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:30 smithi133 ceph-mon[120445]: Reconfiguring crash.smithi049 (monmap changed)... 2023-12-16T07:35:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:30 smithi133 ceph-mon[120445]: Reconfiguring daemon crash.smithi049 on smithi049 2023-12-16T07:35:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:30 smithi133 ceph-mon[120445]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:30 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:30 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:31.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:31 smithi049 ceph-mon[111939]: Reconfiguring alertmanager.smithi049 (dependencies changed)... 2023-12-16T07:35:31.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:31 smithi049 ceph-mon[111939]: Reconfiguring daemon alertmanager.smithi049 on smithi049 2023-12-16T07:35:31.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:31 smithi133 ceph-mon[120445]: Reconfiguring alertmanager.smithi049 (dependencies changed)... 2023-12-16T07:35:31.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:31 smithi133 ceph-mon[120445]: Reconfiguring daemon alertmanager.smithi049 on smithi049 2023-12-16T07:35:32.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:32 smithi049 ceph-mon[111939]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:32.486 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T07:35:32.487 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T07:35:32.487 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2023-12-16T07:35:32.487 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2023-12-16T07:35:32.487 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00868843 s, 1.2 GB/s 2023-12-16T07:35:32.487 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2023-12-16T07:35:32.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:32 smithi133 ceph-mon[120445]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:33.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2023-12-16T07:35:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:35:33.782 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:33 smithi049 ceph-mon[111939]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:33.782 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:33 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:33 smithi133 ceph-mon[120445]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:33 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:34.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.812+0000 7f95030fb700 1 -- 172.21.15.49:0/3292924569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fcd00 msgr2=0x7f94fc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:34.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.812+0000 7f95030fb700 1 --2- 172.21.15.49:0/3292924569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fcd00 0x7f94fc0fd150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f94e8004940 tx=0x7f94e8009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:34.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.812+0000 7f95030fb700 1 -- 172.21.15.49:0/3292924569 shutdown_connections 2023-12-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.812+0000 7f95030fb700 1 --2- 172.21.15.49:0/3292924569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fcd00 0x7f94fc0fd150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.812+0000 7f95030fb700 1 --2- 172.21.15.49:0/3292924569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94fc0fbaf0 0x7f94fc0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.812+0000 7f95030fb700 1 -- 172.21.15.49:0/3292924569 >> 172.21.15.49:0/3292924569 conn(0x7f94fc0f7190 msgr2=0x7f94fc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.812+0000 7f95030fb700 1 -- 172.21.15.49:0/3292924569 shutdown_connections 2023-12-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.813+0000 7f95030fb700 1 -- 172.21.15.49:0/3292924569 wait complete. 2023-12-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.813+0000 7f95030fb700 1 Processor -- start 2023-12-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.813+0000 7f95030fb700 1 -- start start 2023-12-16T07:35:34.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.813+0000 7f95030fb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fbaf0 0x7f94fc10f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:34.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.813+0000 7f95030fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94fc0fcd00 0x7f94fc10fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:34.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.813+0000 7f95030fb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1102a0 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.813+0000 7f95030fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc110b40 con 0x7f94fc0fcd00 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f9500e97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fbaf0 0x7f94fc10f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f9500e97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fbaf0 0x7f94fc10f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42514/0 (socket says 172.21.15.49:42514) 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f9500e97700 1 -- 172.21.15.49:0/1265095698 learned_addr learned my addr 172.21.15.49:0/1265095698 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f94fbfff700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94fc0fcd00 0x7f94fc10fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f9500e97700 1 -- 172.21.15.49:0/1265095698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94fc0fcd00 msgr2=0x7f94fc10fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f9500e97700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94fc0fcd00 0x7f94fc10fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f9500e97700 1 -- 172.21.15.49:0/1265095698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e8005040 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f9500e97700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fbaf0 0x7f94fc10f760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94f000c8b0 tx=0x7f94f0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f94f97fa700 1 -- 172.21.15.49:0/1265095698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f000a760 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc110e20 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f94f97fa700 1 -- 172.21.15.49:0/1265095698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f94f000ad70 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f94f97fa700 1 -- 172.21.15.49:0/1265095698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f00113a0 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.814+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc111360 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.815+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc04bb80 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.816+0000 7f94f97fa700 1 -- 172.21.15.49:0/1265095698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f94f0012400 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.816+0000 7f94f97fa700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f94ec068ed0 0x7f94ec06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:34.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.816+0000 7f94f97fa700 1 -- 172.21.15.49:0/1265095698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f94f0085cc0 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.816+0000 7f94fbfff700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f94ec068ed0 0x7f94ec06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:34.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.816+0000 7f94fbfff700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f94ec068ed0 0x7f94ec06b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f94e8004f90 tx=0x7f94e8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:34.821 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:34.821+0000 7f94f97fa700 1 -- 172.21.15.49:0/1265095698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f94f0056d00 con 0x7f94fc0fbaf0 2023-12-16T07:35:34.894 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:34.894 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:34.894 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:34 smithi049 ceph-mon[111939]: Reconfiguring grafana.smithi049 (dependencies changed)... 2023-12-16T07:35:34.894 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:34 smithi049 ceph-mon[111939]: Reconfiguring daemon grafana.smithi049 on smithi049 2023-12-16T07:35:35.034 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:35.033+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f94fc111810 con 0x7f94ec068ed0 2023-12-16T07:35:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:34 smithi133 ceph-mon[120445]: Reconfiguring grafana.smithi049 (dependencies changed)... 2023-12-16T07:35:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:34 smithi133 ceph-mon[120445]: Reconfiguring daemon grafana.smithi049 on smithi049 2023-12-16T07:35:35.890 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:35 smithi049 ceph-mon[111939]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:35:35.891 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:35 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:35:35.891 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:35 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:35:35.891 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:35 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:35.891 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:35 smithi049 ceph-mon[111939]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:35 smithi133 ceph-mon[120445]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:35:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:35 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:35:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:35 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:35:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:35 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:35 smithi133 ceph-mon[120445]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:38.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:38.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:38.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2023-12-16T07:35:38.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: Reconfiguring daemon prometheus.smithi049 on smithi049 2023-12-16T07:35:38.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:38.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3231293065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4530d745-4857-47b4-b774-3b7a5ec0b1a3"}]: dispatch 2023-12-16T07:35:38.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3231293065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4530d745-4857-47b4-b774-3b7a5ec0b1a3"}]': finished 2023-12-16T07:35:38.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T07:35:38.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:37 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: Reconfiguring daemon prometheus.smithi049 on smithi049 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3231293065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4530d745-4857-47b4-b774-3b7a5ec0b1a3"}]: dispatch 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3231293065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4530d745-4857-47b4-b774-3b7a5ec0b1a3"}]': finished 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: osdmap e6: 1 total, 0 up, 1 in 2023-12-16T07:35:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:37 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:39.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:38 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3002840163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:35:39.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:38 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3002840163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:35:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:40 smithi133 ceph-mon[120445]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:40.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:40 smithi049 ceph-mon[111939]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:42.562 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:42 smithi049 ceph-mon[111939]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:42.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:42 smithi133 ceph-mon[120445]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:43.692 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:43 smithi049 ceph-mon[111939]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:43.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:43 smithi133 ceph-mon[120445]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: Reconfiguring crash.smithi133 (monmap changed)... 2023-12-16T07:35:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:35:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: Reconfiguring daemon crash.smithi133 on smithi133 2023-12-16T07:35:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T07:35:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:45 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: Reconfiguring crash.smithi133 (monmap changed)... 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: Reconfiguring daemon crash.smithi133 on smithi133 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T07:35:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:45 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: Deploying daemon osd.0 on smithi049 2023-12-16T07:35:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: Reconfiguring mgr.smithi133.wbiduk (monmap changed)... 2023-12-16T07:35:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:35:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:35:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:47.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:46 smithi133 ceph-mon[120445]: Reconfiguring daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:35:47.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: Deploying daemon osd.0 on smithi049 2023-12-16T07:35:47.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:47.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:47.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: Reconfiguring mgr.smithi133.wbiduk (monmap changed)... 2023-12-16T07:35:47.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:35:47.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:35:47.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:47.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:46 smithi049 ceph-mon[111939]: Reconfiguring daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:35:48.022 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.022 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.022 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: Reconfiguring mon.smithi133 (monmap changed)... 2023-12-16T07:35:48.022 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: Reconfiguring daemon mon.smithi133 on smithi133 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T07:35:48.023 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: Reconfiguring mon.smithi133 (monmap changed)... 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: Reconfiguring daemon mon.smithi133 on smithi133 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T07:35:48.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:35:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T07:35:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:49.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:35:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2023-12-16T07:35:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:35:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:35:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T07:35:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:49.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:35:50.588 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:50 smithi049 ceph-mon[111939]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:50.588 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:50 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:50.588 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:50 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:50.589 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:50 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:50.589 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:50 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:50 smithi133 ceph-mon[120445]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:50 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:50 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:50 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:50 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.096 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 0 on host 'smithi049' 2023-12-16T07:35:52.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.095+0000 7f94f97fa700 1 -- 172.21.15.49:0/1265095698 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f94fc111810 con 0x7f94ec068ed0 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.097+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f94ec068ed0 msgr2=0x7f94ec06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.097+0000 7f95030fb700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f94ec068ed0 0x7f94ec06b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f94e8004f90 tx=0x7f94e8009e30 comp rx=0 tx=0).stop 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.097+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fbaf0 msgr2=0x7f94fc10f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.097+0000 7f95030fb700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fbaf0 0x7f94fc10f760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94f000c8b0 tx=0x7f94f0004470 comp rx=0 tx=0).stop 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.098+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 shutdown_connections 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.098+0000 7f95030fb700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f94ec068ed0 0x7f94ec06b380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.098+0000 7f95030fb700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94fc0fbaf0 0x7f94fc10f760 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.098+0000 7f95030fb700 1 --2- 172.21.15.49:0/1265095698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94fc0fcd00 0x7f94fc10fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.098+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 >> 172.21.15.49:0/1265095698 conn(0x7f94fc0f7190 msgr2=0x7f94fc065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.098+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 shutdown_connections 2023-12-16T07:35:52.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:52.098+0000 7f95030fb700 1 -- 172.21.15.49:0/1265095698 wait complete. 2023-12-16T07:35:52.571 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:52.571 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:52.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:52.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:52.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.596 DEBUG:teuthology.orchestra.run.smithi049:osd.0> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.0.service 2023-12-16T07:35:52.599 INFO:tasks.cephadm:Deploying osd.1 on smithi049 with /dev/vg_nvme/lv_3... 2023-12-16T07:35:52.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T07:35:52.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:52.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:52.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:52.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:52.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:52.632 INFO:journalctl@ceph.osd.0.smithi049.stdout:-- Logs begin at Sat 2023-12-16 07:20:18 UTC. -- 2023-12-16T07:35:53.140 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:35:53.959 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:35:53 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[134901]: 2023-12-16T07:35:53.628+0000 7fcfc8831540 -1 osd.0 0 log_to_monitors true 2023-12-16T07:35:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:53 smithi049 ceph-mon[111939]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:53 smithi049 ceph-mon[111939]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T07:35:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:53 smithi133 ceph-mon[120445]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:53 smithi133 ceph-mon[120445]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T07:35:54.829 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T07:35:54.829 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T07:35:54.829 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2023-12-16T07:35:54.829 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2023-12-16T07:35:54.829 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0117765 s, 890 MB/s 2023-12-16T07:35:54.829 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2023-12-16T07:35:55.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:54 smithi133 ceph-mon[120445]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T07:35:55.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:54 smithi133 ceph-mon[120445]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T07:35:55.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:54 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:55.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:54 smithi133 ceph-mon[120445]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:35:55.154 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:35:54 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[134901]: 2023-12-16T07:35:54.785+0000 7fcfbf016700 -1 osd.0 0 waiting for initial osdmap 2023-12-16T07:35:55.154 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:35:54 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[134901]: 2023-12-16T07:35:54.789+0000 7fcfba612700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:35:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:54 smithi049 ceph-mon[111939]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T07:35:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:54 smithi049 ceph-mon[111939]: osdmap e7: 1 total, 0 up, 1 in 2023-12-16T07:35:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:54 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:54 smithi049 ceph-mon[111939]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:35:55.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_3 2023-12-16T07:35:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:55 smithi049 ceph-mon[111939]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2023-12-16T07:35:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:55 smithi049 ceph-mon[111939]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T07:35:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:55 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:55 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:55 smithi049 ceph-mon[111939]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:55 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:55 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:55.961 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:35:56.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:55 smithi133 ceph-mon[120445]: from='osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2023-12-16T07:35:56.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:55 smithi133 ceph-mon[120445]: osdmap e8: 1 total, 0 up, 1 in 2023-12-16T07:35:56.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:55 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:56.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:55 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:56.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:55 smithi133 ceph-mon[120445]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-16T07:35:56.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:55 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:56.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:55 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:56 smithi049 ceph-mon[111939]: purged_snaps scrub starts 2023-12-16T07:35:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:56 smithi049 ceph-mon[111939]: purged_snaps scrub ok 2023-12-16T07:35:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:56 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:56 smithi049 ceph-mon[111939]: osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] boot 2023-12-16T07:35:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:56 smithi049 ceph-mon[111939]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T07:35:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:56 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:56 smithi133 ceph-mon[120445]: purged_snaps scrub starts 2023-12-16T07:35:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:56 smithi133 ceph-mon[120445]: purged_snaps scrub ok 2023-12-16T07:35:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:56 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:56 smithi133 ceph-mon[120445]: osd.0 [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] boot 2023-12-16T07:35:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:56 smithi133 ceph-mon[120445]: osdmap e9: 1 total, 1 up, 1 in 2023-12-16T07:35:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:56 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.119+0000 7f569702e700 1 -- 172.21.15.49:0/1119719792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 msgr2=0x7f56900ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.119+0000 7f569702e700 1 --2- 172.21.15.49:0/1119719792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f56900ff210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5680009ce0 tx=0x7f5680004d10 comp rx=0 tx=0).stop 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.119+0000 7f569702e700 1 -- 172.21.15.49:0/1119719792 shutdown_connections 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.119+0000 7f569702e700 1 --2- 172.21.15.49:0/1119719792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56900fff70 0x7f56901003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.119+0000 7f569702e700 1 --2- 172.21.15.49:0/1119719792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f56900ff210 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.119+0000 7f569702e700 1 -- 172.21.15.49:0/1119719792 >> 172.21.15.49:0/1119719792 conn(0x7f56900fa5d0 msgr2=0x7f56900fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.119+0000 7f569702e700 1 -- 172.21.15.49:0/1119719792 shutdown_connections 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.120+0000 7f569702e700 1 -- 172.21.15.49:0/1119719792 wait complete. 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.120+0000 7f569702e700 1 Processor -- start 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.120+0000 7f569702e700 1 -- start start 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f569702e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f569010f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:57.123 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f569702e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56900fff70 0x7f569010fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f569702e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690110430 con 0x7f56900fee00 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f569702e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690110cd0 con 0x7f56900fff70 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f5694dca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f569010f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f5694dca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f569010f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40332/0 (socket says 172.21.15.49:40332) 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f5694dca700 1 -- 172.21.15.49:0/3010487948 learned_addr learned my addr 172.21.15.49:0/3010487948 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f568ffff700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56900fff70 0x7f569010fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f5694dca700 1 -- 172.21.15.49:0/3010487948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56900fff70 msgr2=0x7f569010fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f5694dca700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56900fff70 0x7f569010fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:35:57.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.121+0000 7f5694dca700 1 -- 172.21.15.49:0/3010487948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680009940 con 0x7f56900fee00 2023-12-16T07:35:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.122+0000 7f5694dca700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f569010f8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5680015040 tx=0x7f5680004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.122+0000 7f568d7fa700 1 -- 172.21.15.49:0/3010487948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f568000e040 con 0x7f56900fee00 2023-12-16T07:35:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.122+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5690110f50 con 0x7f56900fee00 2023-12-16T07:35:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.122+0000 7f568d7fa700 1 -- 172.21.15.49:0/3010487948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5680008ea0 con 0x7f56900fee00 2023-12-16T07:35:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.122+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5690111490 con 0x7f56900fee00 2023-12-16T07:35:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.122+0000 7f568d7fa700 1 -- 172.21.15.49:0/3010487948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f568001c640 con 0x7f56900fee00 2023-12-16T07:35:57.125 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.123+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569004bb80 con 0x7f56900fee00 2023-12-16T07:35:57.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.123+0000 7f568d7fa700 1 -- 172.21.15.49:0/3010487948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f5680012ac0 con 0x7f56900fee00 2023-12-16T07:35:57.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.124+0000 7f568d7fa700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5678068ed0 0x7f567806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:35:57.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.124+0000 7f568d7fa700 1 -- 172.21.15.49:0/3010487948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f5680087af0 con 0x7f56900fee00 2023-12-16T07:35:57.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.124+0000 7f568ffff700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5678068ed0 0x7f567806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:35:57.126 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.124+0000 7f568ffff700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5678068ed0 0x7f567806b380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5684004f40 tx=0x7f568400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:35:57.133 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.132+0000 7f568d7fa700 1 -- 172.21.15.49:0/3010487948 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5680058850 con 0x7f56900fee00 2023-12-16T07:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:35:57.336+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5690104950 con 0x7f5678068ed0 2023-12-16T07:35:58.049 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:57 smithi049 ceph-mon[111939]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T07:35:58.050 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:57 smithi049 ceph-mon[111939]: pgmap v25: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:35:58.050 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:57 smithi049 ceph-mon[111939]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:35:58.050 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:57 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:35:58.050 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:57 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:35:58.050 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:57 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:58.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:57 smithi133 ceph-mon[120445]: osdmap e10: 1 total, 1 up, 1 in 2023-12-16T07:35:58.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:57 smithi133 ceph-mon[120445]: pgmap v25: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:35:58.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:57 smithi133 ceph-mon[120445]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:35:58.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:57 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:35:58.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:57 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:35:58.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:57 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: Detected new or changed devices on smithi049 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi049 to 12898M 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:35:59 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:35:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi049 2023-12-16T07:35:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:35:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi049 to 12898M 2023-12-16T07:35:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:35:59.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:35:59.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:35:59.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:35:59 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:00.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:00.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3951887615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f6c48cb-df63-42f1-9637-038a97b80255"}]: dispatch 2023-12-16T07:36:00.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3951887615' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f6c48cb-df63-42f1-9637-038a97b80255"}]': finished 2023-12-16T07:36:00.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T07:36:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:00 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1332947176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3951887615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f6c48cb-df63-42f1-9637-038a97b80255"}]: dispatch 2023-12-16T07:36:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3951887615' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f6c48cb-df63-42f1-9637-038a97b80255"}]': finished 2023-12-16T07:36:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: osdmap e11: 2 total, 1 up, 2 in 2023-12-16T07:36:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:00.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:00.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:00 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1332947176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:02 smithi049 ceph-mon[111939]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:02 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:02 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:02 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:02 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:02 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:02 smithi133 ceph-mon[120445]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:02 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:02 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:02 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:02 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:02 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:03 smithi133 ceph-mon[120445]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:03 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:03 smithi049 ceph-mon[111939]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:06.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:06 smithi049 ceph-mon[111939]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:06.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T07:36:06.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:06.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:06 smithi049 ceph-mon[111939]: Deploying daemon osd.1 on smithi049 2023-12-16T07:36:06.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:06 smithi133 ceph-mon[120445]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:06.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T07:36:06.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:06.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:06 smithi133 ceph-mon[120445]: Deploying daemon osd.1 on smithi049 2023-12-16T07:36:08.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:08 smithi133 ceph-mon[120445]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:08.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:08 smithi049 ceph-mon[111939]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:09.988 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:09.988 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:09.988 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:09.988 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:09 smithi049 ceph-mon[111939]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:10.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:10.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:10.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:10.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:09 smithi133 ceph-mon[120445]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:11.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.479+0000 7f568d7fa700 1 -- 172.21.15.49:0/3010487948 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5690104950 con 0x7f5678068ed0 2023-12-16T07:36:11.480 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 1 on host 'smithi049' 2023-12-16T07:36:11.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5678068ed0 msgr2=0x7f567806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:11.481 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5678068ed0 0x7f567806b380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5684004f40 tx=0x7f568400b040 comp rx=0 tx=0).stop 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 msgr2=0x7f569010f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f569010f8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5680015040 tx=0x7f5680004d10 comp rx=0 tx=0).stop 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 shutdown_connections 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5678068ed0 0x7f567806b380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56900fee00 0x7f569010f8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 --2- 172.21.15.49:0/3010487948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56900fff70 0x7f569010fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 >> 172.21.15.49:0/3010487948 conn(0x7f56900fa5d0 msgr2=0x7f5690103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 shutdown_connections 2023-12-16T07:36:11.482 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:11.481+0000 7f569702e700 1 -- 172.21.15.49:0/3010487948 wait complete. 2023-12-16T07:36:11.972 DEBUG:teuthology.orchestra.run.smithi049:osd.1> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.1.service 2023-12-16T07:36:11.974 INFO:tasks.cephadm:Deploying osd.2 on smithi049 with /dev/vg_nvme/lv_2... 2023-12-16T07:36:11.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T07:36:12.008 INFO:journalctl@ceph.osd.1.smithi049.stdout:-- Logs begin at Sat 2023-12-16 07:20:18 UTC. -- 2023-12-16T07:36:12.338 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:36:12.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:12 smithi049 ceph-mon[111939]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:12.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:12.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:12 smithi133 ceph-mon[120445]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:13.107 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:12 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[144670]: 2023-12-16T07:36:12.962+0000 7f1eaa9c5540 -1 osd.1 0 log_to_monitors true 2023-12-16T07:36:13.633 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T07:36:13.633 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T07:36:13.633 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2023-12-16T07:36:13.633 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2023-12-16T07:36:13.633 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00836585 s, 1.3 GB/s 2023-12-16T07:36:13.633 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2023-12-16T07:36:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:13 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:13 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:13 smithi133 ceph-mon[120445]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T07:36:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:13 smithi133 ceph-mon[120445]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:13.876 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:13 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:13.876 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:13 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:13.876 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:13 smithi049 ceph-mon[111939]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T07:36:13.876 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:13 smithi049 ceph-mon[111939]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:14.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_2 2023-12-16T07:36:14.699 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:36:14.824 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:14 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[144670]: 2023-12-16T07:36:14.542+0000 7f1ea11aa700 -1 osd.1 0 waiting for initial osdmap 2023-12-16T07:36:14.825 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:14 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[144670]: 2023-12-16T07:36:14.548+0000 7f1e99fa1700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:36:14.825 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:14 smithi049 ceph-mon[111939]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T07:36:14.825 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:14 smithi049 ceph-mon[111939]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T07:36:14.825 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:14 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:14.825 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:14 smithi049 ceph-mon[111939]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:36:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:14 smithi133 ceph-mon[120445]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T07:36:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:14 smithi133 ceph-mon[120445]: osdmap e12: 2 total, 1 up, 2 in 2023-12-16T07:36:14.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:14 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:14.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:14 smithi133 ceph-mon[120445]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:36:15.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:15 smithi049 ceph-mon[111939]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2023-12-16T07:36:15.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:15 smithi049 ceph-mon[111939]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T07:36:15.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:15.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:15.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:15 smithi049 ceph-mon[111939]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:15.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:15 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:15 smithi133 ceph-mon[120445]: from='osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2023-12-16T07:36:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:15 smithi133 ceph-mon[120445]: osdmap e13: 2 total, 1 up, 2 in 2023-12-16T07:36:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:15 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:15.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:15 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:15.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:15 smithi133 ceph-mon[120445]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-16T07:36:15.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:15 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:15.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 -- 172.21.15.49:0/413000478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec066090 msgr2=0x7ff3ec101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:15.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 --2- 172.21.15.49:0/413000478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec066090 0x7ff3ec101ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc004940 tx=0x7ff3dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:36:15.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 -- 172.21.15.49:0/413000478 shutdown_connections 2023-12-16T07:36:15.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 --2- 172.21.15.49:0/413000478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec1020e0 0x7ff3ec1044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:15.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 --2- 172.21.15.49:0/413000478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec066090 0x7ff3ec101ba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:15.915 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 -- 172.21.15.49:0/413000478 >> 172.21.15.49:0/413000478 conn(0x7ff3ec0f7190 msgr2=0x7ff3ec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 -- 172.21.15.49:0/413000478 shutdown_connections 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.912+0000 7ff3f2937700 1 -- 172.21.15.49:0/413000478 wait complete. 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3f2937700 1 Processor -- start 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3f2937700 1 -- start start 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3f2937700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec066090 0x7ff3ec10f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3f2937700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec1020e0 0x7ff3ec10fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3f2937700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec1102d0 con 0x7ff3ec1020e0 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3f2937700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec110b70 con 0x7ff3ec066090 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec1020e0 0x7ff3ec10fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec1020e0 0x7ff3ec10fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60884/0 (socket says 172.21.15.49:60884) 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3eb7fe700 1 -- 172.21.15.49:0/4250035001 learned_addr learned my addr 172.21.15.49:0/4250035001 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.913+0000 7ff3ebfff700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec066090 0x7ff3ec10f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:15.916 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3eb7fe700 1 -- 172.21.15.49:0/4250035001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec066090 msgr2=0x7ff3ec10f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3eb7fe700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec066090 0x7ff3ec10f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3eb7fe700 1 -- 172.21.15.49:0/4250035001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc005040 con 0x7ff3ec1020e0 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3eb7fe700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec1020e0 0x7ff3ec10fcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c890 tx=0x7ff3e00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3e8ff9700 1 -- 172.21.15.49:0/4250035001 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e000a700 con 0x7ff3ec1020e0 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3e8ff9700 1 -- 172.21.15.49:0/4250035001 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff3e000ad10 con 0x7ff3ec1020e0 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec110e50 con 0x7ff3ec1020e0 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3e8ff9700 1 -- 172.21.15.49:0/4250035001 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e0012e70 con 0x7ff3ec1020e0 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.914+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec111390 con 0x7ff3ec1020e0 2023-12-16T07:36:15.917 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.915+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ec1097e0 con 0x7ff3ec1020e0 2023-12-16T07:36:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.915+0000 7ff3e8ff9700 1 -- 172.21.15.49:0/4250035001 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7ff3e000a860 con 0x7ff3ec1020e0 2023-12-16T07:36:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.916+0000 7ff3e8ff9700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff3d4068ed0 0x7ff3d406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.916+0000 7ff3e8ff9700 1 -- 172.21.15.49:0/4250035001 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2410+0+0 (secure 0 0 0) 0x7ff3e0086110 con 0x7ff3ec1020e0 2023-12-16T07:36:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.916+0000 7ff3ebfff700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff3d4068ed0 0x7ff3d406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:15.918 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.916+0000 7ff3ebfff700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff3d4068ed0 0x7ff3d406b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0043d0 tx=0x7ff3dc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:36:15.920 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:15.920+0000 7ff3e8ff9700 1 -- 172.21.15.49:0/4250035001 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff3e0056d40 con 0x7ff3ec1020e0 2023-12-16T07:36:16.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:16.130+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3ec111610 con 0x7ff3d4068ed0 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: purged_snaps scrub starts 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: purged_snaps scrub ok 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] boot 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: Detected new or changed devices on smithi049 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:16.808 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi049 to 6449M 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:36:16.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: purged_snaps scrub starts 2023-12-16T07:36:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: purged_snaps scrub ok 2023-12-16T07:36:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: osd.1 [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] boot 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: osdmap e14: 2 total, 2 up, 2 in 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi049 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi049 to 6449M 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:16.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:16.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:36:16.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:36:16.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:36:16.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:17.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:17 smithi133 ceph-mon[120445]: osdmap e15: 2 total, 2 up, 2 in 2023-12-16T07:36:17.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:17 smithi133 ceph-mon[120445]: pgmap v40: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:17 smithi049 ceph-mon[111939]: osdmap e15: 2 total, 2 up, 2 in 2023-12-16T07:36:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:17 smithi049 ceph-mon[111939]: pgmap v40: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:18.824 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:18.824 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:18 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3816147061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc0f86d1-e690-4394-9f3b-45dc882e8df6"}]: dispatch 2023-12-16T07:36:18.824 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:18 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3816147061' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc0f86d1-e690-4394-9f3b-45dc882e8df6"}]': finished 2023-12-16T07:36:18.824 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:18 smithi049 ceph-mon[111939]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T07:36:18.824 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:18 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3816147061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc0f86d1-e690-4394-9f3b-45dc882e8df6"}]: dispatch 2023-12-16T07:36:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:18 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3816147061' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc0f86d1-e690-4394-9f3b-45dc882e8df6"}]': finished 2023-12-16T07:36:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:18 smithi133 ceph-mon[120445]: osdmap e16: 3 total, 2 up, 3 in 2023-12-16T07:36:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:20.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:20.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:20.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:20.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:20.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:20.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:20 smithi133 ceph-mon[120445]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:20.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:20 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/497063631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:20 smithi049 ceph-mon[111939]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:20 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/497063631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:22.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:22 smithi049 ceph-mon[111939]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:22.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:22 smithi133 ceph-mon[120445]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:23.683 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:23 smithi049 ceph-mon[111939]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:23.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:23 smithi133 ceph-mon[120445]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:24.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T07:36:24.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:24.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:24 smithi049 ceph-mon[111939]: Deploying daemon osd.2 on smithi049 2023-12-16T07:36:24.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T07:36:24.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:24.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:24 smithi133 ceph-mon[120445]: Deploying daemon osd.2 on smithi049 2023-12-16T07:36:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:25 smithi133 ceph-mon[120445]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:25 smithi049 ceph-mon[111939]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:28 smithi049 ceph-mon[111939]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:28 smithi133 ceph-mon[120445]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:30.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:30 smithi049 ceph-mon[111939]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:30 smithi133 ceph-mon[120445]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:30.624 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 2 on host 'smithi049' 2023-12-16T07:36:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.624+0000 7ff3e8ff9700 1 -- 172.21.15.49:0/4250035001 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff3ec111610 con 0x7ff3d4068ed0 2023-12-16T07:36:30.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff3d4068ed0 msgr2=0x7ff3d406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:30.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff3d4068ed0 0x7ff3d406b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0043d0 tx=0x7ff3dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:36:30.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec1020e0 msgr2=0x7ff3ec10fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:30.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec1020e0 0x7ff3ec10fcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c890 tx=0x7ff3e00044c0 comp rx=0 tx=0).stop 2023-12-16T07:36:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 shutdown_connections 2023-12-16T07:36:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff3d4068ed0 0x7ff3d406b380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec066090 0x7ff3ec10f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 --2- 172.21.15.49:0/4250035001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3ec1020e0 0x7ff3ec10fcd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 >> 172.21.15.49:0/4250035001 conn(0x7ff3ec0f7190 msgr2=0x7ff3ec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:36:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 shutdown_connections 2023-12-16T07:36:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:36:30.626+0000 7ff3f2937700 1 -- 172.21.15.49:0/4250035001 wait complete. 2023-12-16T07:36:31.144 DEBUG:teuthology.orchestra.run.smithi049:osd.2> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.2.service 2023-12-16T07:36:31.146 INFO:tasks.cephadm:Deploying osd.3 on smithi133 with /dev/vg_nvme/lv_4... 2023-12-16T07:36:31.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-16T07:36:31.180 INFO:journalctl@ceph.osd.2.smithi049.stdout:-- Logs begin at Sat 2023-12-16 07:20:18 UTC. -- 2023-12-16T07:36:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:36:31.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:31 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:31 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:31 smithi049 ceph-mon[111939]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:31.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:31 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:31.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:31 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:31.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:31 smithi133 ceph-mon[120445]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:32.459 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:32 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[153878]: 2023-12-16T07:36:32.117+0000 7fb1275b8540 -1 osd.2 0 log_to_monitors true 2023-12-16T07:36:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-16T07:36:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-16T07:36:32.766 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2023-12-16T07:36:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2023-12-16T07:36:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0166945 s, 628 MB/s 2023-12-16T07:36:32.766 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2023-12-16T07:36:32.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:32 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:32.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:32 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:32.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:32 smithi049 ceph-mon[111939]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T07:36:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:32 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:32 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:32 smithi133 ceph-mon[120445]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T07:36:33.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi133:vg_nvme/lv_4 2023-12-16T07:36:33.401 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:36:33.865 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:33 smithi133 ceph-mon[120445]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T07:36:33.865 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:33 smithi133 ceph-mon[120445]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T07:36:33.865 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:33 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:33.865 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:33 smithi133 ceph-mon[120445]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:36:33.865 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:33 smithi133 ceph-mon[120445]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:33.865 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:33 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:34.150 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[153878]: 2023-12-16T07:36:33.757+0000 7fb11dd9d700 -1 osd.2 0 waiting for initial osdmap 2023-12-16T07:36:34.151 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[153878]: 2023-12-16T07:36:33.763+0000 7fb118b98700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:36:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-mon[111939]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T07:36:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-mon[111939]: osdmap e17: 3 total, 2 up, 3 in 2023-12-16T07:36:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-mon[111939]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:36:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-mon[111939]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:33 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 -- 172.21.15.133:0/1716868929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 msgr2=0x7f3da40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 --2- 172.21.15.133:0/1716868929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da40fd150 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3d94004940 tx=0x7f3d94009e30 comp rx=0 tx=0).stop 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 -- 172.21.15.133:0/1716868929 shutdown_connections 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 --2- 172.21.15.133:0/1716868929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da40fd150 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 --2- 172.21.15.133:0/1716868929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3da40fbaf0 0x7f3da40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 -- 172.21.15.133:0/1716868929 >> 172.21.15.133:0/1716868929 conn(0x7f3da40f7190 msgr2=0x7f3da40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 -- 172.21.15.133:0/1716868929 shutdown_connections 2023-12-16T07:36:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.422+0000 7f3da978e700 1 -- 172.21.15.133:0/1716868929 wait complete. 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da978e700 1 Processor -- start 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da978e700 1 -- start start 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da978e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3da40fbaf0 0x7f3da410c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da978e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da410c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da978e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da410cfb0 con 0x7f3da40fbaf0 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da978e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da410d850 con 0x7f3da40fcd00 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da410c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da410c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60608/0 (socket says 172.21.15.133:60608) 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da27fc700 1 -- 172.21.15.133:0/3190430601 learned_addr learned my addr 172.21.15.133:0/3190430601 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da2ffd700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3da40fbaf0 0x7f3da410c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da27fc700 1 -- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3da40fbaf0 msgr2=0x7f3da410c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da27fc700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3da40fbaf0 0x7f3da410c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da27fc700 1 -- 172.21.15.133:0/3190430601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94005040 con 0x7f3da40fcd00 2023-12-16T07:36:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3da27fc700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da410c9b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009fd0 tx=0x7f3d94009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:36:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.423+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9400e040 con 0x7f3da40fcd00 2023-12-16T07:36:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.424+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d94004290 con 0x7f3da40fcd00 2023-12-16T07:36:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.424+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da410dad0 con 0x7f3da40fcd00 2023-12-16T07:36:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.424+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9401c3f0 con 0x7f3da40fcd00 2023-12-16T07:36:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.424+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da410e010 con 0x7f3da40fcd00 2023-12-16T07:36:34.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.425+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da404bb80 con 0x7f3da40fcd00 2023-12-16T07:36:34.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.425+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f3d9400bc50 con 0x7f3da40fcd00 2023-12-16T07:36:34.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.425+0000 7f3d8b7fe700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3d8c068ed0 0x7f3d8c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:34.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.426+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2562+0+0 (secure 0 0 0) 0x7f3d94087410 con 0x7f3da40fcd00 2023-12-16T07:36:34.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.426+0000 7f3da2ffd700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3d8c068ed0 0x7f3d8c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:34.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.426+0000 7f3da2ffd700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3d8c068ed0 0x7f3d8c06b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3da40fcb60 tx=0x7f3d9800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:36:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.430+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3d94058040 con 0x7f3da40fcd00 2023-12-16T07:36:34.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:34.627+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3da410e490 con 0x7f3d8c068ed0 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: osdmap e18: 3 total, 2 up, 3 in 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi049 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi049 to 4299M 2023-12-16T07:36:35.012 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:36:35.013 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2023-12-16T07:36:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: osdmap e18: 3 total, 2 up, 3 in 2023-12-16T07:36:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: Detected new or changed devices on smithi049 2023-12-16T07:36:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi049 to 4299M 2023-12-16T07:36:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:36:35.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: purged_snaps scrub starts 2023-12-16T07:36:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: purged_snaps scrub ok 2023-12-16T07:36:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:36:36.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] boot 2023-12-16T07:36:36.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: osdmap e19: 3 total, 3 up, 3 in 2023-12-16T07:36:36.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:36.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:36.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:35 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: purged_snaps scrub starts 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: purged_snaps scrub ok 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: osd.2 [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] boot 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: osdmap e19: 3 total, 3 up, 3 in 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-16T07:36:36.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:35 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-16T07:36:36.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T07:36:36.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: osdmap e20: 3 total, 3 up, 3 in 2023-12-16T07:36:36.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T07:36:36.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3531754604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d48037c4-bb53-46d8-ba71-0c726cd8ae95"}]: dispatch 2023-12-16T07:36:36.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d48037c4-bb53-46d8-ba71-0c726cd8ae95"}]: dispatch 2023-12-16T07:36:36.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T07:36:36.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d48037c4-bb53-46d8-ba71-0c726cd8ae95"}]': finished 2023-12-16T07:36:36.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T07:36:36.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:36 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-16T07:36:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: osdmap e20: 3 total, 3 up, 3 in 2023-12-16T07:36:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-16T07:36:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3531754604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d48037c4-bb53-46d8-ba71-0c726cd8ae95"}]: dispatch 2023-12-16T07:36:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d48037c4-bb53-46d8-ba71-0c726cd8ae95"}]: dispatch 2023-12-16T07:36:37.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-16T07:36:37.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d48037c4-bb53-46d8-ba71-0c726cd8ae95"}]': finished 2023-12-16T07:36:37.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: osdmap e21: 4 total, 3 up, 4 in 2023-12-16T07:36:37.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:36 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:37.208 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:36 smithi049 sudo[159947]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T07:36:37.209 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:36 smithi049 sudo[159947]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:37.209 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:36 smithi049 sudo[159947]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:37.209 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:36 smithi049 sudo[159947]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:37.708 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159950]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T07:36:37.709 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159950]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:37.709 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159950]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:37.709 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159950]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:37 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/13840511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:37 smithi133 ceph-mon[120445]: pgmap v56: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-16T07:36:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:37 smithi133 ceph-mon[120445]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T07:36:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:37 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:37 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:37 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/13840511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:37 smithi049 ceph-mon[111939]: pgmap v56: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-16T07:36:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:37 smithi049 ceph-mon[111939]: osdmap e22: 4 total, 3 up, 4 in 2023-12-16T07:36:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:37 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:37 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:38.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159953]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T07:36:38.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159953]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:38.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159953]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:38.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:37 smithi049 sudo[159953]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:38.507+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3d94054980 con 0x7f3da40fcd00 2023-12-16T07:36:38.709 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159956]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T07:36:38.709 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159956]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:38.709 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159956]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:38.709 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159956]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:39.206 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159959]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T07:36:39.206 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159959]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:39.207 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159959]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:39.207 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:38 smithi049 sudo[159959]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:39.458 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159962]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T07:36:39.459 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159962]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:39.459 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159962]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:39.459 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159962]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159965]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T07:36:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159965]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159965]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:39 smithi049 sudo[159965]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:40.363 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 ceph-mon[120445]: mgrmap e19: smithi049.rqlvwo(active, since 95s), standbys: smithi133.wbiduk 2023-12-16T07:36:40.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 ceph-mon[120445]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T07:36:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:40 smithi049 sudo[159968]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T07:36:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:40 smithi049 sudo[159968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:40 smithi049 sudo[159968]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:40 smithi049 sudo[159968]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:40 smithi049 ceph-mon[111939]: mgrmap e19: smithi049.rqlvwo(active, since 95s), standbys: smithi133.wbiduk 2023-12-16T07:36:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:40 smithi049 ceph-mon[111939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T07:36:40.616 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125898]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-16T07:36:40.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125898]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:40.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125898]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:40.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125898]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125909]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-16T07:36:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125909]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-16T07:36:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125909]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-16T07:36:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:40 smithi133 sudo[125909]: pam_unix(sudo:session): session closed for user root 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: pgmap v58: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T07:36:41.364 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:41 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: pgmap v58: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-16T07:36:41.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:41 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:42.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:42 smithi133 ceph-mon[120445]: pgmap v59: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T07:36:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:42 smithi049 ceph-mon[111939]: pgmap v59: 1 pgs: 1 active+clean; 449 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-16T07:36:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:43 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T07:36:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:43 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:43 smithi133 ceph-mon[120445]: Deploying daemon osd.3 on smithi133 2023-12-16T07:36:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:43 smithi133 ceph-mon[120445]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-12-16T07:36:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:43 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T07:36:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:43 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:43 smithi049 ceph-mon[111939]: Deploying daemon osd.3 on smithi133 2023-12-16T07:36:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:43 smithi049 ceph-mon[111939]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-12-16T07:36:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:46 smithi133 ceph-mon[120445]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-12-16T07:36:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:46.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:46 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:46.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:46 smithi049 ceph-mon[111939]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-12-16T07:36:46.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:46.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:46.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:46 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:48.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:48 smithi133 ceph-mon[120445]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-12-16T07:36:48.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:48.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:48.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:48.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:48.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:48.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:48.581 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 3 on host 'smithi133' 2023-12-16T07:36:48.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.580+0000 7f3d8b7fe700 1 -- 172.21.15.133:0/3190430601 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3da410e490 con 0x7f3d8c068ed0 2023-12-16T07:36:48.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.582+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3d8c068ed0 msgr2=0x7f3d8c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:48.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.582+0000 7f3da978e700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3d8c068ed0 0x7f3d8c06b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3da40fcb60 tx=0x7f3d9800b040 comp rx=0 tx=0).stop 2023-12-16T07:36:48.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.582+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 msgr2=0x7f3da410c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:48.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.582+0000 7f3da978e700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da410c9b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009fd0 tx=0x7f3d94009e30 comp rx=0 tx=0).stop 2023-12-16T07:36:48.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.582+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 shutdown_connections 2023-12-16T07:36:48.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.582+0000 7f3da978e700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3d8c068ed0 0x7f3d8c06b380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:48.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.583+0000 7f3da978e700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3da40fbaf0 0x7f3da410c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:48.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.583+0000 7f3da978e700 1 --2- 172.21.15.133:0/3190430601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da40fcd00 0x7f3da410c9b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:48.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.583+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 >> 172.21.15.133:0/3190430601 conn(0x7f3da40f7190 msgr2=0x7f3da40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:36:48.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.583+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 shutdown_connections 2023-12-16T07:36:48.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:48.583+0000 7f3da978e700 1 -- 172.21.15.133:0/3190430601 wait complete. 2023-12-16T07:36:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:48 smithi049 ceph-mon[111939]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-12-16T07:36:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:36:48.970 DEBUG:teuthology.orchestra.run.smithi133:osd.3> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.3.service 2023-12-16T07:36:48.972 INFO:tasks.cephadm:Deploying osd.4 on smithi133 with /dev/vg_nvme/lv_3... 2023-12-16T07:36:48.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-16T07:36:49.005 INFO:journalctl@ceph.osd.3.smithi133.stdout:-- Logs begin at Sat 2023-12-16 07:19:48 UTC. -- 2023-12-16T07:36:49.372 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:36:49.599 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:49.599 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:49.599 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:49 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:49.599 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:49 smithi133 ceph-mon[120445]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.3 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-12-16T07:36:49.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:49.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:49.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:49 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:36:49.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:49 smithi049 ceph-mon[111939]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.3 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-12-16T07:36:50.118 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:36:50 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[126802]: 2023-12-16T07:36:50.051+0000 7f1112c60540 -1 osd.3 0 log_to_monitors true 2023-12-16T07:36:50.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:50 smithi133 ceph-mon[120445]: from='osd.3 [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:36:50.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:50 smithi133 ceph-mon[120445]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:36:50.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:50 smithi049 ceph-mon[111939]: from='osd.3 [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:36:50.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:50 smithi049 ceph-mon[111939]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:36:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-16T07:36:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-16T07:36:51.027 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2023-12-16T07:36:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2023-12-16T07:36:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111063 s, 944 MB/s 2023-12-16T07:36:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2023-12-16T07:36:51.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi133:vg_nvme/lv_3 2023-12-16T07:36:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:36:51.867 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[126802]: 2023-12-16T07:36:51.564+0000 7f1109445700 -1 osd.3 0 waiting for initial osdmap 2023-12-16T07:36:51.867 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[126802]: 2023-12-16T07:36:51.569+0000 7f1104240700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='osd.3 [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi133 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi133 to 15970M 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:51.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:51.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:51.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:51 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:51.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T07:36:51.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: osdmap e23: 4 total, 3 up, 4 in 2023-12-16T07:36:51.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:51.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='osd.3 [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: Detected new or changed devices on smithi133 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi133 to 15970M 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:36:51.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:51 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:36:52.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 -- 172.21.15.133:0/2060827490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 msgr2=0x7f82881021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:52.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 --2- 172.21.15.133:0/2060827490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f82881021d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8278004940 tx=0x7f8278009e30 comp rx=0 tx=0).stop 2023-12-16T07:36:52.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 -- 172.21.15.133:0/2060827490 shutdown_connections 2023-12-16T07:36:52.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 --2- 172.21.15.133:0/2060827490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f82881021d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:52.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 --2- 172.21.15.133:0/2060827490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8288066920 0x7f82880ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 -- 172.21.15.133:0/2060827490 >> 172.21.15.133:0/2060827490 conn(0x7f82880f71b0 msgr2=0x7f82880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 -- 172.21.15.133:0/2060827490 shutdown_connections 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 -- 172.21.15.133:0/2060827490 wait complete. 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 Processor -- start 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.812+0000 7f828db4c700 1 -- start start 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f828db4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8288066920 0x7f828810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f828db4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f828810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f828db4c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828810e130 con 0x7f8288066920 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f828db4c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828810e970 con 0x7f82880ffd70 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f828810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f828810daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46402/0 (socket says 172.21.15.133:46402) 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f8286ffd700 1 -- 172.21.15.133:0/3078957618 learned_addr learned my addr 172.21.15.133:0/3078957618 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f8286ffd700 1 -- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8288066920 msgr2=0x7f828810d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:36:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f8286ffd700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8288066920 0x7f828810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:36:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f8286ffd700 1 -- 172.21.15.133:0/3078957618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278005040 con 0x7f82880ffd70 2023-12-16T07:36:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f8286ffd700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f828810daa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8278004f90 tx=0x7f8278009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:36:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f826ffff700 1 -- 172.21.15.133:0/3078957618 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827800e040 con 0x7f82880ffd70 2023-12-16T07:36:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f826ffff700 1 -- 172.21.15.133:0/3078957618 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f827800bcd0 con 0x7f82880ffd70 2023-12-16T07:36:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828810ebf0 con 0x7f82880ffd70 2023-12-16T07:36:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f826ffff700 1 -- 172.21.15.133:0/3078957618 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827801c630 con 0x7f82880ffd70 2023-12-16T07:36:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.813+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828810f130 con 0x7f82880ffd70 2023-12-16T07:36:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.814+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828804bb80 con 0x7f82880ffd70 2023-12-16T07:36:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.815+0000 7f826ffff700 1 -- 172.21.15.133:0/3078957618 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8278013960 con 0x7f82880ffd70 2023-12-16T07:36:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.815+0000 7f826ffff700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8270068f60 0x7f827006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:36:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.815+0000 7f826ffff700 1 -- 172.21.15.133:0/3078957618 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3803+0+0 (secure 0 0 0) 0x7f8278087ae0 con 0x7f82880ffd70 2023-12-16T07:36:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.815+0000 7f82877fe700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8270068f60 0x7f827006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:36:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.816+0000 7f82877fe700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8270068f60 0x7f827006b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:36:52.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:52.820+0000 7f826ffff700 1 -- 172.21.15.133:0/3078957618 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8278058160 con 0x7f82880ffd70 2023-12-16T07:36:52.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:52 smithi133 ceph-mon[120445]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-12-16T07:36:52.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:52 smithi133 ceph-mon[120445]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T07:36:52.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:52.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:52.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:52 smithi133 ceph-mon[120445]: osd.3 [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] boot 2023-12-16T07:36:52.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:52 smithi133 ceph-mon[120445]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T07:36:52.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:52 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:52.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:52 smithi049 ceph-mon[111939]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-12-16T07:36:52.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:52 smithi049 ceph-mon[111939]: osdmap e24: 4 total, 3 up, 4 in 2023-12-16T07:36:52.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:52.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:52.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:52 smithi049 ceph-mon[111939]: osd.3 [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] boot 2023-12-16T07:36:52.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:52 smithi049 ceph-mon[111939]: osdmap e25: 4 total, 4 up, 4 in 2023-12-16T07:36:52.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:52 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:36:53.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:36:53.014+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8288100a10 con 0x7f8270068f60 2023-12-16T07:36:53.739 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: purged_snaps scrub starts 2023-12-16T07:36:53.739 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: purged_snaps scrub ok 2023-12-16T07:36:53.739 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:36:53.739 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:36:53.740 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:36:53.740 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:53.740 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:36:53.740 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:53 smithi133 ceph-mon[120445]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: purged_snaps scrub starts 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: purged_snaps scrub ok 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:36:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:53 smithi049 ceph-mon[111939]: osdmap e26: 4 total, 4 up, 4 in 2023-12-16T07:36:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: osdmap e27: 4 total, 4 up, 4 in 2023-12-16T07:36:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/2693381041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78584567-3240-4b79-b085-ea1b83fa1868"}]: dispatch 2023-12-16T07:36:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78584567-3240-4b79-b085-ea1b83fa1868"}]: dispatch 2023-12-16T07:36:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78584567-3240-4b79-b085-ea1b83fa1868"}]': finished 2023-12-16T07:36:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T07:36:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:36:55.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:36:55.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:55 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/166845516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: osdmap e27: 4 total, 4 up, 4 in 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/2693381041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78584567-3240-4b79-b085-ea1b83fa1868"}]: dispatch 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78584567-3240-4b79-b085-ea1b83fa1868"}]: dispatch 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78584567-3240-4b79-b085-ea1b83fa1868"}]': finished 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: osdmap e28: 5 total, 4 up, 5 in 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:36:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:55 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/166845516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:36:56.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:56 smithi049 ceph-mon[111939]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T07:36:56.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:56 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:36:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:56 smithi133 ceph-mon[120445]: osdmap e29: 5 total, 4 up, 5 in 2023-12-16T07:36:57.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:56 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:36:58.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:36:57 smithi133 ceph-mon[120445]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-16T07:36:58.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:36:57 smithi049 ceph-mon[111939]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-16T07:37:00.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:00 smithi133 ceph-mon[120445]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-12-16T07:37:00.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:00 smithi049 ceph-mon[111939]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-12-16T07:37:01.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:01 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T07:37:01.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:01 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:01 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T07:37:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:01 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:02.587 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:02 smithi133 ceph-mon[120445]: Deploying daemon osd.4 on smithi133 2023-12-16T07:37:02.587 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:02 smithi133 ceph-mon[120445]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-12-16T07:37:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:02 smithi049 ceph-mon[111939]: Deploying daemon osd.4 on smithi133 2023-12-16T07:37:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:02 smithi049 ceph-mon[111939]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-12-16T07:37:03.843 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:03 smithi133 ceph-mon[120445]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-12-16T07:37:03.844 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:03 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:03 smithi049 ceph-mon[111939]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-12-16T07:37:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:05.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:05.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:05.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:05.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:05.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:05.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:06.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.374+0000 7f826ffff700 1 -- 172.21.15.133:0/3078957618 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8288100a10 con 0x7f8270068f60 2023-12-16T07:37:06.375 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 4 on host 'smithi133' 2023-12-16T07:37:06.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8270068f60 msgr2=0x7f827006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8270068f60 0x7f827006b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c006db0 comp rx=0 tx=0).stop 2023-12-16T07:37:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 msgr2=0x7f828810daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f828810daa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8278004f90 tx=0x7f8278009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 shutdown_connections 2023-12-16T07:37:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8270068f60 0x7f827006b410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:06.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8288066920 0x7f828810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:06.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 --2- 172.21.15.133:0/3078957618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82880ffd70 0x7f828810daa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:06.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 >> 172.21.15.133:0/3078957618 conn(0x7f82880f71b0 msgr2=0x7f82880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:06.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 shutdown_connections 2023-12-16T07:37:06.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:06.376+0000 7f828db4c700 1 -- 172.21.15.133:0/3078957618 wait complete. 2023-12-16T07:37:06.567 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.568 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:06 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:06.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:06 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:06.730 DEBUG:teuthology.orchestra.run.smithi133:osd.4> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.4.service 2023-12-16T07:37:06.733 INFO:tasks.cephadm:Deploying osd.5 on smithi133 with /dev/vg_nvme/lv_2... 2023-12-16T07:37:06.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-16T07:37:06.763 INFO:journalctl@ceph.osd.4.smithi133.stdout:-- Logs begin at Sat 2023-12-16 07:19:48 UTC. -- 2023-12-16T07:37:07.226 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:37:08.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:08 smithi133 ceph-mon[120445]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-12-16T07:37:08.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:08 smithi133 ceph-mon[120445]: from='osd.4 [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:37:08.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:08 smithi133 ceph-mon[120445]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:37:08.618 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:37:08 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[135518]: 2023-12-16T07:37:08.315+0000 7f2ecd851540 -1 osd.4 0 log_to_monitors true 2023-12-16T07:37:08.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:08 smithi049 ceph-mon[111939]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-12-16T07:37:08.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:08 smithi049 ceph-mon[111939]: from='osd.4 [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:37:08.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:08 smithi049 ceph-mon[111939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:37:08.750 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-16T07:37:08.750 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-16T07:37:08.750 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2023-12-16T07:37:08.750 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2023-12-16T07:37:08.750 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.01199 s, 875 MB/s 2023-12-16T07:37:08.750 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2023-12-16T07:37:09.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi133:vg_nvme/lv_2 2023-12-16T07:37:09.518 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T07:37:09.518 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T07:37:09.518 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:09.518 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='osd.4 [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:09.518 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:09.518 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:37:09.518 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi133 2023-12-16T07:37:09.519 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:09.519 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:09.519 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:09.519 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:09.519 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi133 to 7985M 2023-12-16T07:37:09.519 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:09.520 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:09.520 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:09.520 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:09.564 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:37:09.856 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[135518]: 2023-12-16T07:37:09.519+0000 7f2ec4036700 -1 osd.4 0 waiting for initial osdmap 2023-12-16T07:37:09.856 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:37:09 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[135518]: 2023-12-16T07:37:09.527+0000 7f2ebee31700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: osdmap e30: 5 total, 4 up, 5 in 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='osd.4 [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: Detected new or changed devices on smithi133 2023-12-16T07:37:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi133 to 7985M 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:09 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 -- 172.21.15.133:0/2046659783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 msgr2=0x7f984c0fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 --2- 172.21.15.133:0/2046659783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c0fb6a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9840004940 tx=0x7f9840009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 -- 172.21.15.133:0/2046659783 shutdown_connections 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 --2- 172.21.15.133:0/2046659783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0fc4a0 0x7f984c0fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 --2- 172.21.15.133:0/2046659783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c0fb6a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 -- 172.21.15.133:0/2046659783 >> 172.21.15.133:0/2046659783 conn(0x7f984c0f6950 msgr2=0x7f984c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 -- 172.21.15.133:0/2046659783 shutdown_connections 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 -- 172.21.15.133:0/2046659783 wait complete. 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.493+0000 7f9852379700 1 Processor -- start 2023-12-16T07:37:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9852379700 1 -- start start 2023-12-16T07:37:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9852379700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c10d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9852379700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0fc4a0 0x7f984c10db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9852379700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c10e1d0 con 0x7f984c0fc4a0 2023-12-16T07:37:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9852379700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c10ea10 con 0x7f984c0fb290 2023-12-16T07:37:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c10d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c10d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34296/0 (socket says 172.21.15.133:34296) 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984bfff700 1 -- 172.21.15.133:0/957076014 learned_addr learned my addr 172.21.15.133:0/957076014 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984b7fe700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0fc4a0 0x7f984c10db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984bfff700 1 -- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0fc4a0 msgr2=0x7f984c10db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984bfff700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0fc4a0 0x7f984c10db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984bfff700 1 -- 172.21.15.133:0/957076014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840005040 con 0x7f984c0fb290 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f984bfff700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c10d600 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9840009180 tx=0x7f9840009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9848ff9700 1 -- 172.21.15.133:0/957076014 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984000e040 con 0x7f984c0fb290 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c10ec90 con 0x7f984c0fb290 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9848ff9700 1 -- 172.21.15.133:0/957076014 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9840004290 con 0x7f984c0fb290 2023-12-16T07:37:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.494+0000 7f9848ff9700 1 -- 172.21.15.133:0/957076014 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984001c630 con 0x7f984c0fb290 2023-12-16T07:37:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.495+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c10f1d0 con 0x7f984c0fb290 2023-12-16T07:37:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.495+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c04bb80 con 0x7f984c0fb290 2023-12-16T07:37:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.496+0000 7f9848ff9700 1 -- 172.21.15.133:0/957076014 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f984000bc50 con 0x7f984c0fb290 2023-12-16T07:37:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.496+0000 7f9848ff9700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9834068fc0 0x7f983406b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.496+0000 7f9848ff9700 1 -- 172.21.15.133:0/957076014 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f9840087c40 con 0x7f984c0fb290 2023-12-16T07:37:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.497+0000 7f984b7fe700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9834068fc0 0x7f983406b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.497+0000 7f984b7fe700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9834068fc0 0x7f983406b470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f983c006fd0 tx=0x7f983c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.500+0000 7f9848ff9700 1 -- 172.21.15.133:0/957076014 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9840058100 con 0x7f984c0fb290 2023-12-16T07:37:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:10.696+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f984c10f620 con 0x7f9834068fc0 2023-12-16T07:37:10.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:10 smithi133 ceph-mon[120445]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-12-16T07:37:10.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:10 smithi133 ceph-mon[120445]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T07:37:10.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:10 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:10.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:10 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:10.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:10 smithi049 ceph-mon[111939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-12-16T07:37:10.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:10 smithi049 ceph-mon[111939]: osdmap e31: 5 total, 4 up, 5 in 2023-12-16T07:37:10.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:10.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:10 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:11.757 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: purged_snaps scrub starts 2023-12-16T07:37:11.757 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: purged_snaps scrub ok 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: osd.4 [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] boot 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:11.758 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:11 smithi133 ceph-mon[120445]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: purged_snaps scrub starts 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: purged_snaps scrub ok 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: osd.4 [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] boot 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: osdmap e32: 5 total, 5 up, 5 in 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-16T07:37:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-16T07:37:11.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:11.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:11 smithi049 ceph-mon[111939]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-16T07:37:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:12 smithi133 ceph-mon[120445]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T07:37:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:12 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/2116605076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba3d6fef-d56a-4a09-808e-84bb8c5b1b90"}]: dispatch 2023-12-16T07:37:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:12 smithi133 ceph-mon[120445]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba3d6fef-d56a-4a09-808e-84bb8c5b1b90"}]: dispatch 2023-12-16T07:37:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:12 smithi133 ceph-mon[120445]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba3d6fef-d56a-4a09-808e-84bb8c5b1b90"}]': finished 2023-12-16T07:37:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:12 smithi133 ceph-mon[120445]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T07:37:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:12 smithi049 ceph-mon[111939]: osdmap e33: 5 total, 5 up, 5 in 2023-12-16T07:37:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:12 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/2116605076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba3d6fef-d56a-4a09-808e-84bb8c5b1b90"}]: dispatch 2023-12-16T07:37:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:12 smithi049 ceph-mon[111939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba3d6fef-d56a-4a09-808e-84bb8c5b1b90"}]: dispatch 2023-12-16T07:37:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:12 smithi049 ceph-mon[111939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba3d6fef-d56a-4a09-808e-84bb8c5b1b90"}]': finished 2023-12-16T07:37:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:12 smithi049 ceph-mon[111939]: osdmap e34: 6 total, 5 up, 6 in 2023-12-16T07:37:12.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:13 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/3368688385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:37:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:13 smithi133 ceph-mon[120445]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:13 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/3368688385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-16T07:37:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:13 smithi049 ceph-mon[111939]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:16.533 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:16 smithi133 ceph-mon[120445]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:16.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:16 smithi049 ceph-mon[111939]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:18.511 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:18 smithi133 ceph-mon[120445]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:18.511 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:18 smithi049 ceph-mon[111939]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:19.536 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T07:37:19.536 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:19 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:19.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:19 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T07:37:19.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:19 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:20.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:20 smithi133 ceph-mon[120445]: Deploying daemon osd.5 on smithi133 2023-12-16T07:37:20.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:20 smithi133 ceph-mon[120445]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:20.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:20 smithi049 ceph-mon[111939]: Deploying daemon osd.5 on smithi133 2023-12-16T07:37:20.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:20 smithi049 ceph-mon[111939]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:22.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:22 smithi133 ceph-mon[120445]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:22.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:22.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:22.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:22.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:22 smithi049 ceph-mon[111939]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:22.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:22.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:22.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:23.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:23 smithi133 ceph-mon[120445]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:23.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:23 smithi049 ceph-mon[111939]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:24.308 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 5 on host 'smithi133' 2023-12-16T07:37:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.307+0000 7f9848ff9700 1 -- 172.21.15.133:0/957076014 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f984c10f620 con 0x7f9834068fc0 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9834068fc0 msgr2=0x7f983406b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9834068fc0 0x7f983406b470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f983c006fd0 tx=0x7f983c008040 comp rx=0 tx=0).stop 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 msgr2=0x7f984c10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c10d600 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9840009180 tx=0x7f9840009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 shutdown_connections 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9834068fc0 0x7f983406b470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f984c0fb290 0x7f984c10d600 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 --2- 172.21.15.133:0/957076014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0fc4a0 0x7f984c10db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 >> 172.21.15.133:0/957076014 conn(0x7f984c0f6950 msgr2=0x7f984c1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:24.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 shutdown_connections 2023-12-16T07:37:24.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:24.310+0000 7f9852379700 1 -- 172.21.15.133:0/957076014 wait complete. 2023-12-16T07:37:24.719 DEBUG:teuthology.orchestra.run.smithi133:osd.5> sudo journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.5.service 2023-12-16T07:37:24.721 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-16T07:37:24.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T07:37:24.752 INFO:journalctl@ceph.osd.5.smithi133.stdout:-- Logs begin at Sat 2023-12-16 07:19:48 UTC. -- 2023-12-16T07:37:25.006 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:25.270 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:25.270 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:25.271 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:25.271 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:25.323 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:25.323 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:25.323 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:25.323 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 -- 172.21.15.49:0/185515495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c066070 msgr2=0x7f434c101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 --2- 172.21.15.49:0/185515495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c066070 0x7f434c101bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4340004940 tx=0x7f4340009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 -- 172.21.15.49:0/185515495 shutdown_connections 2023-12-16T07:37:26.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 --2- 172.21.15.49:0/185515495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f434c102100 0x7f434c1044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 --2- 172.21.15.49:0/185515495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c066070 0x7f434c101bc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 -- 172.21.15.49:0/185515495 >> 172.21.15.49:0/185515495 conn(0x7f434c0f7190 msgr2=0x7f434c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 -- 172.21.15.49:0/185515495 shutdown_connections 2023-12-16T07:37:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.006+0000 7f435317f700 1 -- 172.21.15.49:0/185515495 wait complete. 2023-12-16T07:37:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f435317f700 1 Processor -- start 2023-12-16T07:37:26.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f435317f700 1 -- start start 2023-12-16T07:37:26.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f435317f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f434c066070 0x7f434c10f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:26.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f435317f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c102100 0x7f434c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:26.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f435317f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c110230 con 0x7f434c102100 2023-12-16T07:37:26.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f435317f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c110ad0 con 0x7f434c066070 2023-12-16T07:37:26.010 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f434bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c102100 0x7f434c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f434bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c102100 0x7f434c10fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56518/0 (socket says 172.21.15.49:56518) 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f4350f1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f434c066070 0x7f434c10f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.007+0000 7f434bfff700 1 -- 172.21.15.49:0/3470421103 learned_addr learned my addr 172.21.15.49:0/3470421103 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f434bfff700 1 -- 172.21.15.49:0/3470421103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f434c066070 msgr2=0x7f434c10f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f434bfff700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f434c066070 0x7f434c10f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f434bfff700 1 -- 172.21.15.49:0/3470421103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340005040 con 0x7f434c102100 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f434bfff700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c102100 0x7f434c10fc30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f433800eb40 tx=0x7f433800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f43497fa700 1 -- 172.21.15.49:0/3470421103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4338007cc0 con 0x7f434c102100 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f43497fa700 1 -- 172.21.15.49:0/3470421103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f433800f040 con 0x7f434c102100 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c110d50 con 0x7f434c102100 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f43497fa700 1 -- 172.21.15.49:0/3470421103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433800c8f0 con 0x7f434c102100 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.008+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c111290 con 0x7f434c102100 2023-12-16T07:37:26.011 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.009+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c04bb80 con 0x7f434c102100 2023-12-16T07:37:26.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.009+0000 7f43497fa700 1 -- 172.21.15.49:0/3470421103 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f43380090d0 con 0x7f434c102100 2023-12-16T07:37:26.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.010+0000 7f43497fa700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f433c068f60 0x7f433c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:26.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.010+0000 7f4350f1b700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f433c068f60 0x7f433c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:26.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.010+0000 7f43497fa700 1 -- 172.21.15.49:0/3470421103 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4317+0+0 (secure 0 0 0) 0x7f4338086290 con 0x7f434c102100 2023-12-16T07:37:26.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.010+0000 7f4350f1b700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f433c068f60 0x7f433c06b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4340000c00 tx=0x7f4340009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:26.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.015+0000 7f43497fa700 1 -- 172.21.15.49:0/3470421103 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f433804da00 con 0x7f434c102100 2023-12-16T07:37:26.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.212+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f434c1077b0 con 0x7f434c102100 2023-12-16T07:37:26.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.212+0000 7f43497fa700 1 -- 172.21.15.49:0/3470421103 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4338056720 con 0x7f434c102100 2023-12-16T07:37:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f433c068f60 msgr2=0x7f433c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f433c068f60 0x7f433c06b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4340000c00 tx=0x7f4340009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c102100 msgr2=0x7f434c10fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c102100 0x7f434c10fc30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f433800eb40 tx=0x7f433800b040 comp rx=0 tx=0).stop 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 shutdown_connections 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f433c068f60 0x7f433c06b410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f434c066070 0x7f434c10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 --2- 172.21.15.49:0/3470421103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f434c102100 0x7f434c10fc30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 >> 172.21.15.49:0/3470421103 conn(0x7f434c0f7190 msgr2=0x7f434c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 shutdown_connections 2023-12-16T07:37:26.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:26.214+0000 7f435317f700 1 -- 172.21.15.49:0/3470421103 wait complete. 2023-12-16T07:37:26.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:26 smithi133 ceph-mon[120445]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:26.368 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:37:26 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[144071]: 2023-12-16T07:37:26.146+0000 7f38ab7d7540 -1 osd.5 0 log_to_monitors true 2023-12-16T07:37:26.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:26 smithi049 ceph-mon[111939]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:26.592 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1702712230,"num_in_osds":6,"osd_in_since":1702712232,"num_remapped_pgs":0} 2023-12-16T07:37:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='osd.5 [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:37:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:37:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3470421103' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T07:37:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:27.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='osd.5 [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:37:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:37:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3470421103' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T07:37:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:37:27.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:37:27.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T07:37:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: Detected new or changed devices on smithi133 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi133 to 5323M 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: from='osd.5 [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:28.330 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:28 smithi049 ceph-mon[111939]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:28.367 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[144071]: 2023-12-16T07:37:28.060+0000 7f38a1fbc700 -1 osd.5 0 waiting for initial osdmap 2023-12-16T07:37:28.367 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[144071]: 2023-12-16T07:37:28.069+0000 7f389edbb700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:37:28.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi133 2023-12-16T07:37:28.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi133 to 5323M 2023-12-16T07:37:28.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T07:37:28.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: osdmap e35: 6 total, 5 up, 6 in 2023-12-16T07:37:28.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:28.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: from='osd.5 [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:28.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:37:28.369 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:28 smithi133 ceph-mon[120445]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 -- 172.21.15.49:0/355354451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 msgr2=0x7f34d00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 --2- 172.21.15.49:0/355354451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d00fd000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34cc004940 tx=0x7f34cc009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 -- 172.21.15.49:0/355354451 shutdown_connections 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 --2- 172.21.15.49:0/355354451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d00fde00 0x7f34d00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 --2- 172.21.15.49:0/355354451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d00fd000 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 -- 172.21.15.49:0/355354451 >> 172.21.15.49:0/355354451 conn(0x7f34d00f82d0 msgr2=0x7f34d00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 -- 172.21.15.49:0/355354451 shutdown_connections 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 -- 172.21.15.49:0/355354451 wait complete. 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 Processor -- start 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.822+0000 7f34d78dd700 1 -- start start 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d78dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:28.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d78dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d00fde00 0x7f34d010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d78dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d010e010 con 0x7f34d00fcbf0 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d78dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d010e8b0 con 0x7f34d00fde00 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d5679700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d5679700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33980/0 (socket says 172.21.15.49:33980) 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d5679700 1 -- 172.21.15.49:0/3571839847 learned_addr learned my addr 172.21.15.49:0/3571839847 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d4e78700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d00fde00 0x7f34d010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d5679700 1 -- 172.21.15.49:0/3571839847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d00fde00 msgr2=0x7f34d010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d5679700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d00fde00 0x7f34d010da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d5679700 1 -- 172.21.15.49:0/3571839847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc005040 con 0x7f34d00fcbf0 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d5679700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d010d4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34cc000c00 tx=0x7f34cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34c5ffb700 1 -- 172.21.15.49:0/3571839847 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34cc00e040 con 0x7f34d00fcbf0 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34c5ffb700 1 -- 172.21.15.49:0/3571839847 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34cc009af0 con 0x7f34d00fcbf0 2023-12-16T07:37:28.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d010eb30 con 0x7f34d00fcbf0 2023-12-16T07:37:28.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.823+0000 7f34c5ffb700 1 -- 172.21.15.49:0/3571839847 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34cc01c630 con 0x7f34d00fcbf0 2023-12-16T07:37:28.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.824+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d010f070 con 0x7f34d00fcbf0 2023-12-16T07:37:28.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.825+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d004bb80 con 0x7f34d00fcbf0 2023-12-16T07:37:28.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.825+0000 7f34c5ffb700 1 -- 172.21.15.49:0/3571839847 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f34cc00bc50 con 0x7f34d00fcbf0 2023-12-16T07:37:28.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.826+0000 7f34c5ffb700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f34bc068f60 0x7f34bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:28.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.826+0000 7f34c5ffb700 1 -- 172.21.15.49:0/3571839847 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f34cc087ca0 con 0x7f34d00fcbf0 2023-12-16T07:37:28.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.826+0000 7f34d4e78700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f34bc068f60 0x7f34bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:28.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.826+0000 7f34d4e78700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f34bc068f60 0x7f34bc06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009fd0 tx=0x7f34c000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:28.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:28.830+0000 7f34c5ffb700 1 -- 172.21.15.49:0/3571839847 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f34cc08c070 con 0x7f34d00fcbf0 2023-12-16T07:37:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.025+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f34d0105590 con 0x7f34d00fcbf0 2023-12-16T07:37:29.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.025+0000 7f34c5ffb700 1 -- 172.21.15.49:0/3571839847 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f34cc058050 con 0x7f34d00fcbf0 2023-12-16T07:37:29.026 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f34bc068f60 msgr2=0x7f34bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:29.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f34bc068f60 0x7f34bc06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009fd0 tx=0x7f34c000b040 comp rx=0 tx=0).stop 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 msgr2=0x7f34d010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d010d4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34cc000c00 tx=0x7f34cc009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 shutdown_connections 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f34bc068f60 0x7f34bc06b410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34d00fcbf0 0x7f34d010d4d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 --2- 172.21.15.49:0/3571839847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d00fde00 0x7f34d010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 >> 172.21.15.49:0/3571839847 conn(0x7f34d00f82d0 msgr2=0x7f34d0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 shutdown_connections 2023-12-16T07:37:29.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:29.027+0000 7f34d78dd700 1 -- 172.21.15.49:0/3571839847 wait complete. 2023-12-16T07:37:29.316 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:29 smithi049 ceph-mon[111939]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-12-16T07:37:29.316 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:29 smithi049 ceph-mon[111939]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T07:37:29.316 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:29.316 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:29.316 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:29 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3571839847' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T07:37:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:29 smithi133 ceph-mon[120445]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-12-16T07:37:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:29 smithi133 ceph-mon[120445]: osdmap e36: 6 total, 5 up, 6 in 2023-12-16T07:37:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:29 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3571839847' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T07:37:29.384 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1702712230,"num_in_osds":6,"osd_in_since":1702712232,"num_remapped_pgs":0} 2023-12-16T07:37:30.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:30 smithi133 ceph-mon[120445]: purged_snaps scrub starts 2023-12-16T07:37:30.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:30 smithi133 ceph-mon[120445]: purged_snaps scrub ok 2023-12-16T07:37:30.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:30 smithi133 ceph-mon[120445]: osd.5 [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] boot 2023-12-16T07:37:30.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:30 smithi133 ceph-mon[120445]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T07:37:30.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:30 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:30.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:30 smithi133 ceph-mon[120445]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:30.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-16T07:37:30.420 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:30 smithi049 ceph-mon[111939]: purged_snaps scrub starts 2023-12-16T07:37:30.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:30 smithi049 ceph-mon[111939]: purged_snaps scrub ok 2023-12-16T07:37:30.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:30 smithi049 ceph-mon[111939]: osd.5 [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] boot 2023-12-16T07:37:30.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:30 smithi049 ceph-mon[111939]: osdmap e37: 6 total, 6 up, 6 in 2023-12-16T07:37:30.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:30 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:37:30.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:30 smithi049 ceph-mon[111939]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:31.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:31 smithi133 ceph-mon[120445]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T07:37:31.453 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:31 smithi049 ceph-mon[111939]: osdmap e38: 6 total, 6 up, 6 in 2023-12-16T07:37:31.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.630+0000 7f27fca4a700 1 -- 172.21.15.49:0/3411081980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 msgr2=0x7f27f80fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.630+0000 7f27fca4a700 1 --2- 172.21.15.49:0/3411081980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f80fbf10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f27e8004940 tx=0x7f27e8009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.630+0000 7f27fca4a700 1 -- 172.21.15.49:0/3411081980 shutdown_connections 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.630+0000 7f27fca4a700 1 --2- 172.21.15.49:0/3411081980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80fcd10 0x7f27f80fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.630+0000 7f27fca4a700 1 --2- 172.21.15.49:0/3411081980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f80fbf10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.630+0000 7f27fca4a700 1 -- 172.21.15.49:0/3411081980 >> 172.21.15.49:0/3411081980 conn(0x7f27f80f71c0 msgr2=0x7f27f80f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 -- 172.21.15.49:0/3411081980 shutdown_connections 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 -- 172.21.15.49:0/3411081980 wait complete. 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 Processor -- start 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 -- start start 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f8110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80fcd10 0x7f27f81127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:31.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80669a0 con 0x7f27f80fbb00 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27fca4a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8066ae0 con 0x7f27f80fcd10 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27f659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f8110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27f659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f8110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33996/0 (socket says 172.21.15.49:33996) 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27f659c700 1 -- 172.21.15.49:0/2378893624 learned_addr learned my addr 172.21.15.49:0/2378893624 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.631+0000 7f27f5d9b700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80fcd10 0x7f27f81127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27f659c700 1 -- 172.21.15.49:0/2378893624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80fcd10 msgr2=0x7f27f81127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27f659c700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80fcd10 0x7f27f81127e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27f659c700 1 -- 172.21.15.49:0/2378893624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e8005040 con 0x7f27f80fbb00 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27f659c700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f8110290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27e8004f90 tx=0x7f27e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27e6ffd700 1 -- 172.21.15.49:0/2378893624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e800e040 con 0x7f27f80fbb00 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27e6ffd700 1 -- 172.21.15.49:0/2378893624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27e800bc50 con 0x7f27f80fbb00 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f8112de0 con 0x7f27f80fbb00 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27e6ffd700 1 -- 172.21.15.49:0/2378893624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e801c630 con 0x7f27f80fbb00 2023-12-16T07:37:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.632+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f8113240 con 0x7f27f80fbb00 2023-12-16T07:37:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.633+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f81064e0 con 0x7f27f80fbb00 2023-12-16T07:37:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.634+0000 7f27e6ffd700 1 -- 172.21.15.49:0/2378893624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f27e8013420 con 0x7f27f80fbb00 2023-12-16T07:37:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.634+0000 7f27e6ffd700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f27e0068f60 0x7f27e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.634+0000 7f27e6ffd700 1 -- 172.21.15.49:0/2378893624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f27e8087e10 con 0x7f27f80fbb00 2023-12-16T07:37:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.634+0000 7f27f5d9b700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f27e0068f60 0x7f27e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.634+0000 7f27f5d9b700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f27e0068f60 0x7f27e006b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27ec004f40 tx=0x7f27ec00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:31.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.638+0000 7f27e6ffd700 1 -- 172.21.15.49:0/2378893624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f27e8054620 con 0x7f27f80fbb00 2023-12-16T07:37:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.832+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f27f804bbd0 con 0x7f27f80fbb00 2023-12-16T07:37:31.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.832+0000 7f27e6ffd700 1 -- 172.21.15.49:0/2378893624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f27e8057c40 con 0x7f27f80fbb00 2023-12-16T07:37:31.833 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f27e0068f60 msgr2=0x7f27e006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f27e0068f60 0x7f27e006b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27ec004f40 tx=0x7f27ec00b040 comp rx=0 tx=0).stop 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 msgr2=0x7f27f8110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f8110290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27e8004f90 tx=0x7f27e8009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 shutdown_connections 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f27e0068f60 0x7f27e006b410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f80fbb00 0x7f27f8110290 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 --2- 172.21.15.49:0/2378893624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f80fcd10 0x7f27f81127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.834+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 >> 172.21.15.49:0/2378893624 conn(0x7f27f80f71c0 msgr2=0x7f27f80f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:31.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.835+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 shutdown_connections 2023-12-16T07:37:31.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:31.835+0000 7f27fca4a700 1 -- 172.21.15.49:0/2378893624 wait complete. 2023-12-16T07:37:32.132 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:32 smithi049 ceph-mon[111939]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:32.132 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:32 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2378893624' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T07:37:32.200 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1702712249,"num_in_osds":6,"osd_in_since":1702712232,"num_remapped_pgs":0} 2023-12-16T07:37:32.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T07:37:32.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:32 smithi133 ceph-mon[120445]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:32.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:32 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2378893624' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-16T07:37:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:33.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 -- 172.21.15.49:0/1527383504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd94006ff80 msgr2=0x7fd940070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:33.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 --2- 172.21.15.49:0/1527383504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd94006ff80 0x7fd940070350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd930004970 tx=0x7fd930009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:33.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 -- 172.21.15.49:0/1527383504 shutdown_connections 2023-12-16T07:37:33.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 --2- 172.21.15.49:0/1527383504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd940070890 0x7fd940108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 --2- 172.21.15.49:0/1527383504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd94006ff80 0x7fd940070350 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 -- 172.21.15.49:0/1527383504 >> 172.21.15.49:0/1527383504 conn(0x7fd9400f8790 msgr2=0x7fd9400faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 -- 172.21.15.49:0/1527383504 shutdown_connections 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.505+0000 7fd9462d2700 1 -- 172.21.15.49:0/1527383504 wait complete. 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd9462d2700 1 Processor -- start 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd9462d2700 1 -- start start 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd9462d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd94006ff80 0x7fd9401157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd9462d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd940070890 0x7fd940115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd9462d2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd940116370 con 0x7fd940070890 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd9462d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94010f6a0 con 0x7fd94006ff80 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd937fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd940070890 0x7fd940115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd937fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd940070890 0x7fd940115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34014/0 (socket says 172.21.15.49:34014) 2023-12-16T07:37:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd937fff700 1 -- 172.21.15.49:0/689812527 learned_addr learned my addr 172.21.15.49:0/689812527 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd93ffff700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd94006ff80 0x7fd9401157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd937fff700 1 -- 172.21.15.49:0/689812527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd94006ff80 msgr2=0x7fd9401157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd937fff700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd94006ff80 0x7fd9401157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.506+0000 7fd937fff700 1 -- 172.21.15.49:0/689812527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd930005040 con 0x7fd940070890 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.507+0000 7fd937fff700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd940070890 0x7fd940115d20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd928002a50 tx=0x7fd9280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.507+0000 7fd93d7fa700 1 -- 172.21.15.49:0/689812527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd928007cc0 con 0x7fd940070890 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.507+0000 7fd93d7fa700 1 -- 172.21.15.49:0/689812527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd92800f040 con 0x7fd940070890 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.507+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94010f980 con 0x7fd940070890 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.507+0000 7fd93d7fa700 1 -- 172.21.15.49:0/689812527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd928009540 con 0x7fd940070890 2023-12-16T07:37:33.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.507+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94010fec0 con 0x7fd940070890 2023-12-16T07:37:33.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.508+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd940106630 con 0x7fd940070890 2023-12-16T07:37:33.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.508+0000 7fd93d7fa700 1 -- 172.21.15.49:0/689812527 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd9280096a0 con 0x7fd940070890 2023-12-16T07:37:33.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.509+0000 7fd93d7fa700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd92c068f60 0x7fd92c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:33.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.509+0000 7fd93d7fa700 1 -- 172.21.15.49:0/689812527 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd928086780 con 0x7fd940070890 2023-12-16T07:37:33.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.509+0000 7fd93ffff700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd92c068f60 0x7fd92c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:33.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.509+0000 7fd93ffff700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd92c068f60 0x7fd92c06b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd930004560 tx=0x7fd930009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:33.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.513+0000 7fd93d7fa700 1 -- 172.21.15.49:0/689812527 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd928056a20 con 0x7fd940070890 2023-12-16T07:37:33.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:33 smithi049 ceph-mon[111939]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:33.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:33 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.714+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd94010bdb0 con 0x7fd940070890 2023-12-16T07:37:33.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.715+0000 7fd93d7fa700 1 -- 172.21.15.49:0/689812527 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11060 (secure 0 0 0) 0x7fd9280565b0 con 0x7fd940070890 2023-12-16T07:37:33.715 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:33.715 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","created":"2023-12-16T07:33:24.032146+0000","modified":"2023-12-16T07:37:30.056440+0000","last_up_change":"2023-12-16T07:37:29.048482+0000","last_in_change":"2023-12-16T07:37:12.459978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T07:36:35.661056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4530d745-4857-47b4-b774-3b7a5ec0b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6803","nonce":3714029642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6805","nonce":3714029642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6809","nonce":3714029642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6807","nonce":3714029642}]},"public_addr":"172.21.15.49:6803/3714029642","cluster_addr":"172.21.15.49:6805/3714029642","heartbeat_back_addr":"172.21.15.49:6809/3714029642","heartbeat_front_addr":"172.21.15.49:6807/3714029642","state":["exists","up"]},{"osd":1,"uuid":"6f6c48cb-df63-42f1-9637-038a97b80255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3249432879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3249432879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3249432879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3249432879}]},"public_addr":"172.21.15.49:6811/3249432879","cluster_addr":"172.21.15.49:6813/3249432879","heartbeat_back_addr":"172.21.15.49:6817/3249432879","heartbeat_front_addr":"172.21.15.49:6815/3249432879","state":["exists","up"]},{"osd":2,"uuid":"fc0f86d1-e690-4394-9f3b-45dc882e8df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6819","nonce":338711156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6821","nonce":338711156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6825","nonce":338711156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6823","nonce":338711156}]},"public_addr":"172.21.15.49:6819/338711156","cluster_addr":"172.21.15.49:6821/338711156","heartbeat_back_addr":"172.21.15.49:6825/338711156","heartbeat_front_addr":"172.21.15.49:6823/338711156","state":["exists","up"]},{"osd":3,"uuid":"d48037c4-bb53-46d8-ba71-0c726cd8ae95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6801","nonce":31606206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6803","nonce":31606206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6807","nonce":31606206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6805","nonce":31606206}]},"public_addr":"172.21.15.133:6801/31606206","cluster_addr":"172.21.15.133:6803/31606206","heartbeat_back_addr":"172.21.15.133:6807/31606206","heartbeat_front_addr":"172.21.15.133:6805/31606206","state":["exists","up"]},{"osd":4,"uuid":"78584567-3240-4b79-b085-ea1b83fa1868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6809","nonce":3300498409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6811","nonce":3300498409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6815","nonce":3300498409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6813","nonce":3300498409}]},"public_addr":"172.21.15.133:6809/3300498409","cluster_addr":"172.21.15.133:6811/3300498409","heartbeat_back_addr":"172.21.15.133:6815/3300498409","heartbeat_front_addr":"172.21.15.133:6813/3300498409","state":["exists","up"]},{"osd":5,"uuid":"ba3d6fef-d56a-4a09-808e-84bb8c5b1b90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6817","nonce":3892328217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6819","nonce":3892328217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6823","nonce":3892328217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6821","nonce":3892328217}]},"public_addr":"172.21.15.133:6817/3892328217","cluster_addr":"172.21.15.133:6819/3892328217","heartbeat_back_addr":"172.21.15.133:6823/3892328217","heartbeat_front_addr":"172.21.15.133:6821/3892328217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:35:54.616062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:13.940774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:33.140071+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:51.066041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:09.306146+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:27.119927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4193621983":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1284982982":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1476740054":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/1954956906":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3505892537":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6800/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6800/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6800/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/2648683047":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/3034826394":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/3838333790":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/226482574":"2023-12-17T07:33:48.311036+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T07:37:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd92c068f60 msgr2=0x7fd92c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd92c068f60 0x7fd92c06b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd930004560 tx=0x7fd930009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd940070890 msgr2=0x7fd940115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd940070890 0x7fd940115d20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd928002a50 tx=0x7fd9280046b0 comp rx=0 tx=0).stop 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 shutdown_connections 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd92c068f60 0x7fd92c06b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd94006ff80 0x7fd9401157e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 --2- 172.21.15.49:0/689812527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd940070890 0x7fd940115d20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 >> 172.21.15.49:0/689812527 conn(0x7fd9400f8790 msgr2=0x7fd9401037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 shutdown_connections 2023-12-16T07:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:33.717+0000 7fd9462d2700 1 -- 172.21.15.49:0/689812527 wait complete. 2023-12-16T07:37:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:33 smithi133 ceph-mon[120445]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:33 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:34.150 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T07:36:35.661056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-16T07:37:34.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-16T07:37:34.420 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:34.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:34 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/689812527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:37:34.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:34 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/689812527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:37:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 -- 172.21.15.49:0/3999682244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198102c20 msgr2=0x7f6198102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:35.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 --2- 172.21.15.49:0/3999682244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198102c20 0x7f6198102ff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6188004940 tx=0x7f6188009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 -- 172.21.15.49:0/3999682244 shutdown_connections 2023-12-16T07:37:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 --2- 172.21.15.49:0/3999682244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6198065390 0x7f6198065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 --2- 172.21.15.49:0/3999682244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198102c20 0x7f6198102ff0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 -- 172.21.15.49:0/3999682244 >> 172.21.15.49:0/3999682244 conn(0x7f61980719b0 msgr2=0x7f6198071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 -- 172.21.15.49:0/3999682244 shutdown_connections 2023-12-16T07:37:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.408+0000 7f619f5b6700 1 -- 172.21.15.49:0/3999682244 wait complete. 2023-12-16T07:37:35.411 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619f5b6700 1 Processor -- start 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619f5b6700 1 -- start start 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619f5b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198065390 0x7f61981136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619f5b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6198102c20 0x7f6198113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619f5b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6198114240 con 0x7f6198065390 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619f5b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619810d590 con 0x7f6198102c20 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619d352700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198065390 0x7f61981136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619d352700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198065390 0x7f61981136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34028/0 (socket says 172.21.15.49:34028) 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619d352700 1 -- 172.21.15.49:0/2885605909 learned_addr learned my addr 172.21.15.49:0/2885605909 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619d352700 1 -- 172.21.15.49:0/2885605909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6198102c20 msgr2=0x7f6198113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:35.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619d352700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6198102c20 0x7f6198113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619d352700 1 -- 172.21.15.49:0/2885605909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188005040 con 0x7f6198065390 2023-12-16T07:37:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619d352700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198065390 0x7f61981136b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f618800b3b0 tx=0x7f6188009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f618dffb700 1 -- 172.21.15.49:0/2885605909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f618800e040 con 0x7f6198065390 2023-12-16T07:37:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.409+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619810d810 con 0x7f6198065390 2023-12-16T07:37:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.410+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619810dd50 con 0x7f6198065390 2023-12-16T07:37:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.410+0000 7f618dffb700 1 -- 172.21.15.49:0/2885605909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f618800bc50 con 0x7f6198065390 2023-12-16T07:37:35.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.410+0000 7f618dffb700 1 -- 172.21.15.49:0/2885605909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f618801ce20 con 0x7f6198065390 2023-12-16T07:37:35.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.411+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c0052b0 con 0x7f6198065390 2023-12-16T07:37:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.411+0000 7f618dffb700 1 -- 172.21.15.49:0/2885605909 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f618801c430 con 0x7f6198065390 2023-12-16T07:37:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.412+0000 7f618dffb700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6184068f60 0x7f618406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.412+0000 7f618dffb700 1 -- 172.21.15.49:0/2885605909 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f61880878a0 con 0x7f6198065390 2023-12-16T07:37:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.412+0000 7f619cb51700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6184068f60 0x7f618406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.412+0000 7f619cb51700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6184068f60 0x7f618406b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f619810ef90 tx=0x7f6194009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.416+0000 7f618dffb700 1 -- 172.21.15.49:0/2885605909 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6188057bf0 con 0x7f6198065390 2023-12-16T07:37:35.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.614+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f617c005ae0 con 0x7f6198065390 2023-12-16T07:37:35.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.614+0000 7f618dffb700 1 -- 172.21.15.49:0/2885605909 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6188057780 con 0x7f6198065390 2023-12-16T07:37:35.615 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-16T07:37:35.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6184068f60 msgr2=0x7f618406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:35.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6184068f60 0x7f618406b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f619810ef90 tx=0x7f6194009ce0 comp rx=0 tx=0).stop 2023-12-16T07:37:35.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198065390 msgr2=0x7f61981136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:35.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198065390 0x7f61981136b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f618800b3b0 tx=0x7f6188009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:35.617 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 shutdown_connections 2023-12-16T07:37:35.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6184068f60 0x7f618406b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:35.618 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6198065390 0x7f61981136b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:35.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 --2- 172.21.15.49:0/2885605909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6198102c20 0x7f6198113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:35.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 >> 172.21.15.49:0/2885605909 conn(0x7f61980719b0 msgr2=0x7f61980fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:35.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 shutdown_connections 2023-12-16T07:37:35.622 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:35.616+0000 7f619f5b6700 1 -- 172.21.15.49:0/2885605909 wait complete. 2023-12-16T07:37:35.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:35 smithi049 ceph-mon[111939]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:35.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:35 smithi133 ceph-mon[120445]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:35.982 INFO:tasks.cephadm:Setting up client nodes... 2023-12-16T07:37:35.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T07:37:36.253 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:36.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:36 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2885605909' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:37:36.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:36 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2885605909' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:37:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 -- 172.21.15.49:0/1381594871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe40ffd70 msgr2=0x7fcfe41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:37.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1381594871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe40ffd70 0x7fcfe41021d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0004940 tx=0x7fcfd0009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 -- 172.21.15.49:0/1381594871 shutdown_connections 2023-12-16T07:37:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1381594871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe40ffd70 0x7fcfe41021d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1381594871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe4066920 0x7fcfe40ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 -- 172.21.15.49:0/1381594871 >> 172.21.15.49:0/1381594871 conn(0x7fcfe40f71b0 msgr2=0x7fcfe40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 -- 172.21.15.49:0/1381594871 shutdown_connections 2023-12-16T07:37:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 -- 172.21.15.49:0/1381594871 wait complete. 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.226+0000 7fcfeb218700 1 Processor -- start 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfeb218700 1 -- start start 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfeb218700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe4066920 0x7fcfe410d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfeb218700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe40ffd70 0x7fcfe410da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfeb218700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410e050 con 0x7fcfe4066920 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfeb218700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410e8f0 con 0x7fcfe40ffd70 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfe8fb4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe4066920 0x7fcfe410d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfe8fb4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe4066920 0x7fcfe410d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34034/0 (socket says 172.21.15.49:34034) 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfe8fb4700 1 -- 172.21.15.49:0/1909875425 learned_addr learned my addr 172.21.15.49:0/1909875425 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfe3fff700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe40ffd70 0x7fcfe410da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfe8fb4700 1 -- 172.21.15.49:0/1909875425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe40ffd70 msgr2=0x7fcfe410da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfe8fb4700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe40ffd70 0x7fcfe410da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.227+0000 7fcfe8fb4700 1 -- 172.21.15.49:0/1909875425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0005040 con 0x7fcfe4066920 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.228+0000 7fcfe8fb4700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe4066920 0x7fcfe410d510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8002a50 tx=0x7fcfd80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.228+0000 7fcfe17fa700 1 -- 172.21.15.49:0/1909875425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd8007cc0 con 0x7fcfe4066920 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.228+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe410ebd0 con 0x7fcfe4066920 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.228+0000 7fcfe17fa700 1 -- 172.21.15.49:0/1909875425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfd800f040 con 0x7fcfe4066920 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.228+0000 7fcfe17fa700 1 -- 172.21.15.49:0/1909875425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd8009540 con 0x7fcfe4066920 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.228+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe410f110 con 0x7fcfe4066920 2023-12-16T07:37:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.229+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe41075c0 con 0x7fcfe4066920 2023-12-16T07:37:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.229+0000 7fcfe17fa700 1 -- 172.21.15.49:0/1909875425 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcfd80096a0 con 0x7fcfe4066920 2023-12-16T07:37:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.230+0000 7fcfe17fa700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fcfd4068f60 0x7fcfd406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.230+0000 7fcfe17fa700 1 -- 172.21.15.49:0/1909875425 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcfd8086890 con 0x7fcfe4066920 2023-12-16T07:37:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.230+0000 7fcfe3fff700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fcfd4068f60 0x7fcfd406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.230+0000 7fcfe3fff700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fcfd4068f60 0x7fcfd406b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b3b0 tx=0x7fcfd0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.234+0000 7fcfe17fa700 1 -- 172.21.15.49:0/1909875425 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcfd8056ab0 con 0x7fcfe4066920 2023-12-16T07:37:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.505+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fcfe404bb80 con 0x7fcfe4066920 2023-12-16T07:37:37.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.509+0000 7fcfe17fa700 1 -- 172.21.15.49:0/1909875425 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcfd8056640 con 0x7fcfe4066920 2023-12-16T07:37:37.509 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2023-12-16T07:37:37.509 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQDBU31lZFY5HhAAY+MSPldz4DrKcz0WMliX/g== 2023-12-16T07:37:37.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fcfd4068f60 msgr2=0x7fcfd406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fcfd4068f60 0x7fcfd406b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b3b0 tx=0x7fcfd0009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe4066920 msgr2=0x7fcfe410d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe4066920 0x7fcfe410d510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8002a50 tx=0x7fcfd80046b0 comp rx=0 tx=0).stop 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 shutdown_connections 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fcfd4068f60 0x7fcfd406b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcfe4066920 0x7fcfe410d510 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 --2- 172.21.15.49:0/1909875425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe40ffd70 0x7fcfe410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 >> 172.21.15.49:0/1909875425 conn(0x7fcfe40f71b0 msgr2=0x7fcfe40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 shutdown_connections 2023-12-16T07:37:37.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:37.511+0000 7fcfeb218700 1 -- 172.21.15.49:0/1909875425 wait complete. 2023-12-16T07:37:37.827 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:37 smithi049 ceph-mon[111939]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:37.828 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:37 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1909875425' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T07:37:37.828 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:37 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1909875425' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T07:37:37.829 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:37:37.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-16T07:37:37.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T07:37:37.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:37 smithi133 ceph-mon[120445]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:37.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:37 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1909875425' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T07:37:37.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:37 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1909875425' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T07:37:37.869 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-16T07:37:38.146 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi133/config 2023-12-16T07:37:39.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2377749008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 msgr2=0x7f189c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2377749008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c0fd150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1890004940 tx=0x7f1890009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2377749008 shutdown_connections 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2377749008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c0fd150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2377749008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c0fbaf0 0x7f189c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2377749008 >> 172.21.15.133:0/2377749008 conn(0x7f189c0f7190 msgr2=0x7f189c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2377749008 shutdown_connections 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2377749008 wait complete. 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 Processor -- start 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 -- start start 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.027+0000 7f18a0cf0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c0fbaf0 0x7f189c1101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:39.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f18a0cf0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f18a0cf0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c066110 con 0x7f189c0fbaf0 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f18a0cf0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c066250 con 0x7f189c0fcd00 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f1899d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f1899d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c112740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36638/0 (socket says 172.21.15.133:36638) 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f1899d9b700 1 -- 172.21.15.133:0/2623144349 learned_addr learned my addr 172.21.15.133:0/2623144349 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f189a59c700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c0fbaf0 0x7f189c1101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f1899d9b700 1 -- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c0fbaf0 msgr2=0x7f189c1101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f1899d9b700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c0fbaf0 0x7f189c1101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f1899d9b700 1 -- 172.21.15.133:0/2623144349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890005040 con 0x7f189c0fcd00 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f1899d9b700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c112740 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1890000c00 tx=0x7f1890009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f188affd700 1 -- 172.21.15.133:0/2623144349 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1890021070 con 0x7f189c0fcd00 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c112ce0 con 0x7f189c0fcd00 2023-12-16T07:37:39.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f188affd700 1 -- 172.21.15.133:0/2623144349 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f189001c400 con 0x7f189c0fcd00 2023-12-16T07:37:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f188affd700 1 -- 172.21.15.133:0/2623144349 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189000e070 con 0x7f189c0fcd00 2023-12-16T07:37:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.028+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c1131c0 con 0x7f189c0fcd00 2023-12-16T07:37:39.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.029+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c04bb80 con 0x7f189c0fcd00 2023-12-16T07:37:39.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.030+0000 7f188affd700 1 -- 172.21.15.133:0/2623144349 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f189001c570 con 0x7f189c0fcd00 2023-12-16T07:37:39.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.030+0000 7f188affd700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1884068f60 0x7f188406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:39.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.030+0000 7f188affd700 1 -- 172.21.15.133:0/2623144349 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1890087d30 con 0x7f189c0fcd00 2023-12-16T07:37:39.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.030+0000 7f189a59c700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1884068f60 0x7f188406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:39.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.031+0000 7f189a59c700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1884068f60 0x7f188406b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f188c004600 tx=0x7f188c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:39.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.034+0000 7f188affd700 1 -- 172.21.15.133:0/2623144349 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1890054540 con 0x7f189c0fcd00 2023-12-16T07:37:39.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.293+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f189c104490 con 0x7f189c0fcd00 2023-12-16T07:37:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.300+0000 7f188affd700 1 -- 172.21.15.133:0/2623144349 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1890057b60 con 0x7f189c0fcd00 2023-12-16T07:37:39.301 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-16T07:37:39.301 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDDU31lCrqoERAAqIrKo+3M2AR/Dcl/tgVnKQ== 2023-12-16T07:37:39.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1884068f60 msgr2=0x7f188406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:39.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1884068f60 0x7f188406b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f188c004600 tx=0x7f188c00b040 comp rx=0 tx=0).stop 2023-12-16T07:37:39.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 msgr2=0x7f189c112740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:39.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c112740 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1890000c00 tx=0x7f1890009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:39.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 shutdown_connections 2023-12-16T07:37:39.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1884068f60 0x7f188406b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f189c0fbaf0 0x7f189c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 --2- 172.21.15.133:0/2623144349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f189c0fcd00 0x7f189c112740 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 >> 172.21.15.133:0/2623144349 conn(0x7f189c0f7190 msgr2=0x7f189c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 shutdown_connections 2023-12-16T07:37:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-16T07:37:39.302+0000 7f18a0cf0700 1 -- 172.21.15.133:0/2623144349 wait complete. 2023-12-16T07:37:39.674 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:37:39.674 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-16T07:37:39.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-16T07:37:39.715 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T07:37:39.715 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-16T07:37:39.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph mgr dump --format=json 2023-12-16T07:37:39.998 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:40 smithi049 ceph-mon[111939]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:40 smithi049 ceph-mon[111939]: from='client.? 172.21.15.133:0/2623144349' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T07:37:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:40 smithi049 ceph-mon[111939]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T07:37:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:40 smithi049 ceph-mon[111939]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T07:37:40.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:40 smithi133 ceph-mon[120445]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:40.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:40 smithi133 ceph-mon[120445]: from='client.? 172.21.15.133:0/2623144349' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T07:37:40.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:40 smithi133 ceph-mon[120445]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-16T07:37:40.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:40 smithi133 ceph-mon[120445]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-16T07:37:40.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 -- 172.21.15.49:0/2490448900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 msgr2=0x7f32300fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:40.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 --2- 172.21.15.49:0/2490448900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f32300fcc10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3224004940 tx=0x7f3224009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:40.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 -- 172.21.15.49:0/2490448900 shutdown_connections 2023-12-16T07:37:40.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 --2- 172.21.15.49:0/2490448900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f32300fcc10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:40.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 --2- 172.21.15.49:0/2490448900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3230102c00 0x7f3230102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:40.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 -- 172.21.15.49:0/2490448900 >> 172.21.15.49:0/2490448900 conn(0x7f32300f8790 msgr2=0x7f32300faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:40.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 -- 172.21.15.49:0/2490448900 shutdown_connections 2023-12-16T07:37:40.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.970+0000 7f3235379700 1 -- 172.21.15.49:0/2490448900 wait complete. 2023-12-16T07:37:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f3235379700 1 Processor -- start 2023-12-16T07:37:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f3235379700 1 -- start start 2023-12-16T07:37:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f3235379700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3230102c00 0x7f3230113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:40.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f3235379700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f3230113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f3235379700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301141e0 con 0x7f32301035a0 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f3235379700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323010d4d0 con 0x7f3230102c00 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f3230113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f3230113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41824/0 (socket says 172.21.15.49:41824) 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322e7fc700 1 -- 172.21.15.49:0/1373970828 learned_addr learned my addr 172.21.15.49:0/1373970828 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322effd700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3230102c00 0x7f3230113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322e7fc700 1 -- 172.21.15.49:0/1373970828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3230102c00 msgr2=0x7f3230113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322e7fc700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3230102c00 0x7f3230113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322e7fc700 1 -- 172.21.15.49:0/1373970828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224005040 con 0x7f32301035a0 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.971+0000 7f322e7fc700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f3230113b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3224009fd0 tx=0x7f3224009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.972+0000 7f32177fe700 1 -- 172.21.15.49:0/1373970828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322400e040 con 0x7f32301035a0 2023-12-16T07:37:40.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.972+0000 7f32177fe700 1 -- 172.21.15.49:0/1373970828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3224013420 con 0x7f32301035a0 2023-12-16T07:37:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.972+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323010d700 con 0x7f32301035a0 2023-12-16T07:37:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.972+0000 7f32177fe700 1 -- 172.21.15.49:0/1373970828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322401c630 con 0x7f32301035a0 2023-12-16T07:37:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.972+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323010dc40 con 0x7f32301035a0 2023-12-16T07:37:40.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.973+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32301050d0 con 0x7f32301035a0 2023-12-16T07:37:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.973+0000 7f32177fe700 1 -- 172.21.15.49:0/1373970828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f322400bb80 con 0x7f32301035a0 2023-12-16T07:37:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.973+0000 7f32177fe700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3218068f60 0x7f321806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.974+0000 7f32177fe700 1 -- 172.21.15.49:0/1373970828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3224087ba0 con 0x7f32301035a0 2023-12-16T07:37:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.974+0000 7f322effd700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3218068f60 0x7f321806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:40.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.974+0000 7f322effd700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3218068f60 0x7f321806b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32300f9a10 tx=0x7f322000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:40.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:40.978+0000 7f32177fe700 1 -- 172.21.15.49:0/1373970828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3224057ee0 con 0x7f32301035a0 2023-12-16T07:37:41.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.240+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f32301050d0 con 0x7f32301035a0 2023-12-16T07:37:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.243+0000 7f32177fe700 1 -- 172.21.15.49:0/1373970828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166776 (secure 0 0 0) 0x7f3224057a70 con 0x7f32301035a0 2023-12-16T07:37:41.246 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3218068f60 msgr2=0x7f321806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3218068f60 0x7f321806b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32300f9a10 tx=0x7f322000b040 comp rx=0 tx=0).stop 2023-12-16T07:37:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 msgr2=0x7f3230113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f3230113b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3224009fd0 tx=0x7f3224009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:41.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 shutdown_connections 2023-12-16T07:37:41.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3218068f60 0x7f321806b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:41.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3230102c00 0x7f3230113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:41.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 --2- 172.21.15.49:0/1373970828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32301035a0 0x7f3230113b90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:41.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 >> 172.21.15.49:0/1373970828 conn(0x7f32300f8790 msgr2=0x7f32300fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:41.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 shutdown_connections 2023-12-16T07:37:41.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:41.246+0000 7f3235379700 1 -- 172.21.15.49:0/1373970828 wait complete. 2023-12-16T07:37:41.565 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:41 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1373970828' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T07:37:41.614 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi049.rqlvwo","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2346374523},{"type":"v1","addr":"172.21.15.49:6801","nonce":2346374523}]},"active_addr":"172.21.15.49:6801/2346374523","active_change":"2023-12-16T07:35:03.164822+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi133.wbiduk","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.49:8443/","prometheus":"http://172.21.15.49:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":4037451623}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1859081974}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":598785895}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2149050593}]}]} 2023-12-16T07:37:41.618 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-16T07:37:41.618 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-16T07:37:41.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T07:37:41.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:41 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1373970828' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-16T07:37:41.889 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:42.369 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:42 smithi049 ceph-mon[111939]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:42.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:42 smithi133 ceph-mon[120445]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 -- 172.21.15.49:0/1021637847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8065390 msgr2=0x7f44c8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/1021637847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8065390 0x7f44c8065800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f44b4004940 tx=0x7f44b4009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 -- 172.21.15.49:0/1021637847 shutdown_connections 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/1021637847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8065390 0x7f44c8065800 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/1021637847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44c8102c20 0x7f44c8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 -- 172.21.15.49:0/1021637847 >> 172.21.15.49:0/1021637847 conn(0x7f44c80719b0 msgr2=0x7f44c8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 -- 172.21.15.49:0/1021637847 shutdown_connections 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.853+0000 7f44cf1d6700 1 -- 172.21.15.49:0/1021637847 wait complete. 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44cf1d6700 1 Processor -- start 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44cf1d6700 1 -- start start 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44cf1d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44c8065390 0x7f44c8113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:42.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44cf1d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8102c20 0x7f44c8113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44cf1d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c81142e0 con 0x7f44c8102c20 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44cf1d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c810d610 con 0x7f44c8065390 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44c7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8102c20 0x7f44c8113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44ccf72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44c8065390 0x7f44c8113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44ccf72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44c8065390 0x7f44c8113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.49:52436/0 (socket says 172.21.15.49:52436) 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44c7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8102c20 0x7f44c8113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41844/0 (socket says 172.21.15.49:41844) 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.854+0000 7f44ccf72700 1 -- 172.21.15.49:0/4279981810 learned_addr learned my addr 172.21.15.49:0/4279981810 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44c7fff700 1 -- 172.21.15.49:0/4279981810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44c8065390 msgr2=0x7f44c8113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44c7fff700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44c8065390 0x7f44c8113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44c7fff700 1 -- 172.21.15.49:0/4279981810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4005040 con 0x7f44c8102c20 2023-12-16T07:37:42.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44c7fff700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8102c20 0x7f44c8113c90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009fd0 tx=0x7f44b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:42.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44c57fa700 1 -- 172.21.15.49:0/4279981810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b400e040 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44c57fa700 1 -- 172.21.15.49:0/4279981810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f44b4013420 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c810d890 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44c57fa700 1 -- 172.21.15.49:0/4279981810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b401c630 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.855+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c810ddd0 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.856+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c80fff40 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.856+0000 7f44c57fa700 1 -- 172.21.15.49:0/4279981810 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f44b4013a20 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.857+0000 7f44c57fa700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f44b8068f60 0x7f44b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.857+0000 7f44c57fa700 1 -- 172.21.15.49:0/4279981810 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f44b40874b0 con 0x7f44c8102c20 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.857+0000 7f44ccf72700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f44b8068f60 0x7f44b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:42.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.857+0000 7f44ccf72700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f44b8068f60 0x7f44b806b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0041d0 tx=0x7f44bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:42.861 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:42.861+0000 7f44c57fa700 1 -- 172.21.15.49:0/4279981810 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f44b40577f0 con 0x7f44c8102c20 2023-12-16T07:37:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.057+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44c80734d0 con 0x7f44c8102c20 2023-12-16T07:37:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.058+0000 7f44c57fa700 1 -- 172.21.15.49:0/4279981810 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11060 (secure 0 0 0) 0x7f44b4057380 con 0x7f44c8102c20 2023-12-16T07:37:43.058 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:43.058 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","created":"2023-12-16T07:33:24.032146+0000","modified":"2023-12-16T07:37:30.056440+0000","last_up_change":"2023-12-16T07:37:29.048482+0000","last_in_change":"2023-12-16T07:37:12.459978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T07:36:35.661056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4530d745-4857-47b4-b774-3b7a5ec0b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6803","nonce":3714029642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6805","nonce":3714029642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6809","nonce":3714029642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6807","nonce":3714029642}]},"public_addr":"172.21.15.49:6803/3714029642","cluster_addr":"172.21.15.49:6805/3714029642","heartbeat_back_addr":"172.21.15.49:6809/3714029642","heartbeat_front_addr":"172.21.15.49:6807/3714029642","state":["exists","up"]},{"osd":1,"uuid":"6f6c48cb-df63-42f1-9637-038a97b80255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3249432879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3249432879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3249432879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3249432879}]},"public_addr":"172.21.15.49:6811/3249432879","cluster_addr":"172.21.15.49:6813/3249432879","heartbeat_back_addr":"172.21.15.49:6817/3249432879","heartbeat_front_addr":"172.21.15.49:6815/3249432879","state":["exists","up"]},{"osd":2,"uuid":"fc0f86d1-e690-4394-9f3b-45dc882e8df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6819","nonce":338711156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6821","nonce":338711156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6825","nonce":338711156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6823","nonce":338711156}]},"public_addr":"172.21.15.49:6819/338711156","cluster_addr":"172.21.15.49:6821/338711156","heartbeat_back_addr":"172.21.15.49:6825/338711156","heartbeat_front_addr":"172.21.15.49:6823/338711156","state":["exists","up"]},{"osd":3,"uuid":"d48037c4-bb53-46d8-ba71-0c726cd8ae95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6801","nonce":31606206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6803","nonce":31606206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6807","nonce":31606206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6805","nonce":31606206}]},"public_addr":"172.21.15.133:6801/31606206","cluster_addr":"172.21.15.133:6803/31606206","heartbeat_back_addr":"172.21.15.133:6807/31606206","heartbeat_front_addr":"172.21.15.133:6805/31606206","state":["exists","up"]},{"osd":4,"uuid":"78584567-3240-4b79-b085-ea1b83fa1868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6809","nonce":3300498409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6811","nonce":3300498409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6815","nonce":3300498409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6813","nonce":3300498409}]},"public_addr":"172.21.15.133:6809/3300498409","cluster_addr":"172.21.15.133:6811/3300498409","heartbeat_back_addr":"172.21.15.133:6815/3300498409","heartbeat_front_addr":"172.21.15.133:6813/3300498409","state":["exists","up"]},{"osd":5,"uuid":"ba3d6fef-d56a-4a09-808e-84bb8c5b1b90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6817","nonce":3892328217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6819","nonce":3892328217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6823","nonce":3892328217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6821","nonce":3892328217}]},"public_addr":"172.21.15.133:6817/3892328217","cluster_addr":"172.21.15.133:6819/3892328217","heartbeat_back_addr":"172.21.15.133:6823/3892328217","heartbeat_front_addr":"172.21.15.133:6821/3892328217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:35:54.616062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:13.940774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:33.140071+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:51.066041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:09.306146+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:27.119927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4193621983":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1284982982":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1476740054":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/1954956906":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3505892537":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6800/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6800/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6800/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/2648683047":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/3034826394":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/3838333790":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/226482574":"2023-12-17T07:33:48.311036+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T07:37:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f44b8068f60 msgr2=0x7f44b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f44b8068f60 0x7f44b806b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0041d0 tx=0x7f44bc00b040 comp rx=0 tx=0).stop 2023-12-16T07:37:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8102c20 msgr2=0x7f44c8113c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8102c20 0x7f44c8113c90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009fd0 tx=0x7f44b4009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:43.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 shutdown_connections 2023-12-16T07:37:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f44b8068f60 0x7f44b806b410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44c8065390 0x7f44c8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 --2- 172.21.15.49:0/4279981810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44c8102c20 0x7f44c8113c90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 >> 172.21.15.49:0/4279981810 conn(0x7f44c80719b0 msgr2=0x7f44c80face0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 shutdown_connections 2023-12-16T07:37:43.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:43.060+0000 7f44cf1d6700 1 -- 172.21.15.49:0/4279981810 wait complete. 2023-12-16T07:37:43.431 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-16T07:37:43.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-16T07:37:43.702 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:43.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:43 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/4279981810' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:37:43.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:43 smithi049 ceph-mon[111939]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:43.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:43 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/4279981810' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:37:43.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:43 smithi133 ceph-mon[120445]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 -- 172.21.15.49:0/367667006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 msgr2=0x7fd084101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 --2- 172.21.15.49:0/367667006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084101ed0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd080004940 tx=0x7fd080009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 -- 172.21.15.49:0/367667006 shutdown_connections 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 --2- 172.21.15.49:0/367667006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0840fbb40 0x7fd0840fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 --2- 172.21.15.49:0/367667006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084101ed0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 -- 172.21.15.49:0/367667006 >> 172.21.15.49:0/367667006 conn(0x7fd0840719b0 msgr2=0x7fd084071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 -- 172.21.15.49:0/367667006 shutdown_connections 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 -- 172.21.15.49:0/367667006 wait complete. 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 Processor -- start 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.690+0000 7fd08c625700 1 -- start start 2023-12-16T07:37:44.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd08c625700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0840fbb40 0x7fd084112550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd08c625700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd08c625700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841130e0 con 0x7fd084101b00 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd08c625700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08410c410 con 0x7fd0840fbb40 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd089bc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd089bc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084112a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41870/0 (socket says 172.21.15.49:41870) 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd089bc0700 1 -- 172.21.15.49:0/2137779775 learned_addr learned my addr 172.21.15.49:0/2137779775 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd08a3c1700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0840fbb40 0x7fd084112550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd089bc0700 1 -- 172.21.15.49:0/2137779775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0840fbb40 msgr2=0x7fd084112550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd089bc0700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0840fbb40 0x7fd084112550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd089bc0700 1 -- 172.21.15.49:0/2137779775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080005040 con 0x7fd084101b00 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd08a3c1700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0840fbb40 0x7fd084112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd089bc0700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084112a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd074002a50 tx=0x7fd0740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd07affd700 1 -- 172.21.15.49:0/2137779775 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd074007cc0 con 0x7fd084101b00 2023-12-16T07:37:44.693 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08410c690 con 0x7fd084101b00 2023-12-16T07:37:44.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd07affd700 1 -- 172.21.15.49:0/2137779775 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd07400f040 con 0x7fd084101b00 2023-12-16T07:37:44.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.691+0000 7fd07affd700 1 -- 172.21.15.49:0/2137779775 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd074009540 con 0x7fd084101b00 2023-12-16T07:37:44.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.692+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08410cbd0 con 0x7fd084101b00 2023-12-16T07:37:44.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.692+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0840734d0 con 0x7fd084101b00 2023-12-16T07:37:44.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.693+0000 7fd07affd700 1 -- 172.21.15.49:0/2137779775 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd0740096a0 con 0x7fd084101b00 2023-12-16T07:37:44.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.693+0000 7fd07affd700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd070068fb0 0x7fd07006b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:44.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.693+0000 7fd07affd700 1 -- 172.21.15.49:0/2137779775 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd074086930 con 0x7fd084101b00 2023-12-16T07:37:44.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.693+0000 7fd08a3c1700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd070068fb0 0x7fd07006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:44.695 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.694+0000 7fd08a3c1700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd070068fb0 0x7fd07006b460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd080004560 tx=0x7fd080009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:44.698 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.698+0000 7fd07affd700 1 -- 172.21.15.49:0/2137779775 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd074056ab0 con 0x7fd084101b00 2023-12-16T07:37:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.893+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd08410db30 con 0x7fd084101b00 2023-12-16T07:37:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.893+0000 7fd07affd700 1 -- 172.21.15.49:0/2137779775 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11060 (secure 0 0 0) 0x7fd074056640 con 0x7fd084101b00 2023-12-16T07:37:44.894 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:44.894 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","created":"2023-12-16T07:33:24.032146+0000","modified":"2023-12-16T07:37:30.056440+0000","last_up_change":"2023-12-16T07:37:29.048482+0000","last_in_change":"2023-12-16T07:37:12.459978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T07:36:35.661056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4530d745-4857-47b4-b774-3b7a5ec0b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6803","nonce":3714029642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6805","nonce":3714029642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6809","nonce":3714029642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6807","nonce":3714029642}]},"public_addr":"172.21.15.49:6803/3714029642","cluster_addr":"172.21.15.49:6805/3714029642","heartbeat_back_addr":"172.21.15.49:6809/3714029642","heartbeat_front_addr":"172.21.15.49:6807/3714029642","state":["exists","up"]},{"osd":1,"uuid":"6f6c48cb-df63-42f1-9637-038a97b80255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3249432879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3249432879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3249432879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3249432879}]},"public_addr":"172.21.15.49:6811/3249432879","cluster_addr":"172.21.15.49:6813/3249432879","heartbeat_back_addr":"172.21.15.49:6817/3249432879","heartbeat_front_addr":"172.21.15.49:6815/3249432879","state":["exists","up"]},{"osd":2,"uuid":"fc0f86d1-e690-4394-9f3b-45dc882e8df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6819","nonce":338711156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6821","nonce":338711156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6825","nonce":338711156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6823","nonce":338711156}]},"public_addr":"172.21.15.49:6819/338711156","cluster_addr":"172.21.15.49:6821/338711156","heartbeat_back_addr":"172.21.15.49:6825/338711156","heartbeat_front_addr":"172.21.15.49:6823/338711156","state":["exists","up"]},{"osd":3,"uuid":"d48037c4-bb53-46d8-ba71-0c726cd8ae95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6801","nonce":31606206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6803","nonce":31606206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6807","nonce":31606206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6805","nonce":31606206}]},"public_addr":"172.21.15.133:6801/31606206","cluster_addr":"172.21.15.133:6803/31606206","heartbeat_back_addr":"172.21.15.133:6807/31606206","heartbeat_front_addr":"172.21.15.133:6805/31606206","state":["exists","up"]},{"osd":4,"uuid":"78584567-3240-4b79-b085-ea1b83fa1868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6809","nonce":3300498409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6811","nonce":3300498409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6815","nonce":3300498409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6813","nonce":3300498409}]},"public_addr":"172.21.15.133:6809/3300498409","cluster_addr":"172.21.15.133:6811/3300498409","heartbeat_back_addr":"172.21.15.133:6815/3300498409","heartbeat_front_addr":"172.21.15.133:6813/3300498409","state":["exists","up"]},{"osd":5,"uuid":"ba3d6fef-d56a-4a09-808e-84bb8c5b1b90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6817","nonce":3892328217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6819","nonce":3892328217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6823","nonce":3892328217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6821","nonce":3892328217}]},"public_addr":"172.21.15.133:6817/3892328217","cluster_addr":"172.21.15.133:6819/3892328217","heartbeat_back_addr":"172.21.15.133:6823/3892328217","heartbeat_front_addr":"172.21.15.133:6821/3892328217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:35:54.616062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:13.940774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:33.140071+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:51.066041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:09.306146+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:27.119927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4193621983":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1284982982":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1476740054":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/1954956906":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3505892537":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6800/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6800/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6800/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/2648683047":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/3034826394":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/3838333790":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/226482574":"2023-12-17T07:33:48.311036+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T07:37:44.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd070068fb0 msgr2=0x7fd07006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd070068fb0 0x7fd07006b460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd080004560 tx=0x7fd080009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 msgr2=0x7fd084112a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084112a90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd074002a50 tx=0x7fd0740046b0 comp rx=0 tx=0).stop 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 shutdown_connections 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd070068fb0 0x7fd07006b460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0840fbb40 0x7fd084112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 --2- 172.21.15.49:0/2137779775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd084101b00 0x7fd084112a90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 >> 172.21.15.49:0/2137779775 conn(0x7fd0840719b0 msgr2=0x7fd0840fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 shutdown_connections 2023-12-16T07:37:44.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:44.895+0000 7fd08c625700 1 -- 172.21.15.49:0/2137779775 wait complete. 2023-12-16T07:37:45.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:44 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2137779775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:37:45.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-16T07:37:45.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-16T07:37:45.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-16T07:37:45.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-16T07:37:45.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-16T07:37:45.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-16T07:37:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:44 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2137779775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:37:45.704 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:45.705 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:46.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:45 smithi049 ceph-mon[111939]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:46.344 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:45 smithi133 ceph-mon[120445]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.929+0000 7f2b03498700 1 -- 172.21.15.49:0/2932769103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc0708f0 msgr2=0x7f2afc108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.929+0000 7f2b03498700 1 --2- 172.21.15.49:0/2932769103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc0708f0 0x7f2afc108f10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2aec004970 tx=0x7f2aec009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.929+0000 7f2b03498700 1 -- 172.21.15.49:0/2932769103 shutdown_connections 2023-12-16T07:37:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.929+0000 7f2b03498700 1 --2- 172.21.15.49:0/2932769103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc0708f0 0x7f2afc108f10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.929+0000 7f2b03498700 1 --2- 172.21.15.49:0/2932769103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2afc06ffe0 0x7f2afc0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.929+0000 7f2b03498700 1 -- 172.21.15.49:0/2932769103 >> 172.21.15.49:0/2932769103 conn(0x7f2afc0f8790 msgr2=0x7f2afc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:47.932 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.930+0000 7f2b03498700 1 -- 172.21.15.49:0/2932769103 shutdown_connections 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.930+0000 7f2b03498700 1 -- 172.21.15.49:0/2932769103 wait complete. 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.930+0000 7f2b03498700 1 Processor -- start 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.930+0000 7f2b03498700 1 -- start start 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b03498700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc06ffe0 0x7f2afc115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b03498700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2afc0708f0 0x7f2afc115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b03498700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc1163a0 con 0x7f2afc06ffe0 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b03498700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc10f6d0 con 0x7f2afc0708f0 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b01234700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc06ffe0 0x7f2afc115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b01234700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc06ffe0 0x7f2afc115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53310/0 (socket says 172.21.15.49:53310) 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b01234700 1 -- 172.21.15.49:0/4141829643 learned_addr learned my addr 172.21.15.49:0/4141829643 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b00a33700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2afc0708f0 0x7f2afc115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b01234700 1 -- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2afc0708f0 msgr2=0x7f2afc115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b01234700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2afc0708f0 0x7f2afc115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.933 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b01234700 1 -- 172.21.15.49:0/4141829643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec005040 con 0x7f2afc06ffe0 2023-12-16T07:37:47.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b01234700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc06ffe0 0x7f2afc115810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2af800ec30 tx=0x7f2af800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af8007b30 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2af800f040 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc10f9b0 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.931+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af800cc80 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.932+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc10fec0 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.932+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2afc1103b0 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.933+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2af8007c90 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.933+0000 7f2af1ffb700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2ae8068f60 0x7f2ae806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.933+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2af8086ee0 con 0x7f2afc06ffe0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.933+0000 7f2b00a33700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2ae8068f60 0x7f2ae806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:47.935 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.933+0000 7f2af1ffb700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] conn(0x7f2ae806ec30 0x7f2ae8071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:47.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.933+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 --> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ae80716f0 con 0x7f2ae806ec30 2023-12-16T07:37:47.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.933+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2af8089530 con 0x7f2afc06ffe0 2023-12-16T07:37:47.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.934+0000 7f2b00a33700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2ae8068f60 0x7f2ae806b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2afc110a00 tx=0x7f2aec009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:47.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.934+0000 7f2b01a35700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] conn(0x7f2ae806ec30 0x7f2ae8071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:47.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.934+0000 7f2b01a35700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] conn(0x7f2ae806ec30 0x7f2ae8071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:47.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.935+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== osd.3 v2:172.21.15.133:6800/31606206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2ae80716f0 con 0x7f2ae806ec30 2023-12-16T07:37:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.950+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 --> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2afc110520 con 0x7f2ae806ec30 2023-12-16T07:37:47.951 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2af1ffb700 1 -- 172.21.15.49:0/4141829643 <== osd.3 v2:172.21.15.133:6800/31606206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2afc110520 con 0x7f2ae806ec30 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] conn(0x7f2ae806ec30 msgr2=0x7f2ae8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] conn(0x7f2ae806ec30 0x7f2ae8071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2ae8068f60 msgr2=0x7f2ae806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2ae8068f60 0x7f2ae806b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2afc110a00 tx=0x7f2aec009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc06ffe0 msgr2=0x7f2afc115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc06ffe0 0x7f2afc115810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2af800ec30 tx=0x7f2af800b040 comp rx=0 tx=0).stop 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 shutdown_connections 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:6800/31606206,v1:172.21.15.133:6801/31606206] conn(0x7f2ae806ec30 0x7f2ae8071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2ae8068f60 0x7f2ae806b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2afc06ffe0 0x7f2afc115810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.952 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 --2- 172.21.15.49:0/4141829643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2afc0708f0 0x7f2afc115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:47.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 >> 172.21.15.49:0/4141829643 conn(0x7f2afc0f8790 msgr2=0x7f2afc103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:47.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 shutdown_connections 2023-12-16T07:37:47.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:47.951+0000 7f2b03498700 1 -- 172.21.15.49:0/4141829643 wait complete. 2023-12-16T07:37:48.591 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:48 smithi049 ceph-mon[111939]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:48.591 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:48.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:48 smithi133 ceph-mon[120445]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:48.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:37:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 -- 172.21.15.49:0/223861118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f0101b00 msgr2=0x7fb5f0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/223861118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f0101b00 0x7fb5f0101ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009ce0 tx=0x7fb5e0004d10 comp rx=0 tx=0).stop 2023-12-16T07:37:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 -- 172.21.15.49:0/223861118 shutdown_connections 2023-12-16T07:37:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/223861118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00fbb40 0x7fb5f00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/223861118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f0101b00 0x7fb5f0101ed0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 -- 172.21.15.49:0/223861118 >> 172.21.15.49:0/223861118 conn(0x7fb5f00719b0 msgr2=0x7fb5f0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 -- 172.21.15.49:0/223861118 shutdown_connections 2023-12-16T07:37:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.632+0000 7fb5f53d6700 1 -- 172.21.15.49:0/223861118 wait complete. 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5f53d6700 1 Processor -- start 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5f53d6700 1 -- start start 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5f53d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f00fbb40 0x7fb5f010e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5f53d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0101b00 0x7fb5f010eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5f53d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f010f3c0 con 0x7fb5f00fbb40 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5f53d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f010f500 con 0x7fb5f0101b00 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f00fbb40 0x7fb5f010e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f00fbb40 0x7fb5f010e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53340/0 (socket says 172.21.15.49:53340) 2023-12-16T07:37:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.633+0000 7fb5eeffd700 1 -- 172.21.15.49:0/940007358 learned_addr learned my addr 172.21.15.49:0/940007358 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5ee7fc700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0101b00 0x7fb5f010eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5eeffd700 1 -- 172.21.15.49:0/940007358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0101b00 msgr2=0x7fb5f010eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5eeffd700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0101b00 0x7fb5f010eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5eeffd700 1 -- 172.21.15.49:0/940007358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0009940 con 0x7fb5f00fbb40 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5eeffd700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f00fbb40 0x7fb5f010e860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000bf10 tx=0x7fb5e0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e000e040 con 0x7fb5f00fbb40 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f01177d0 con 0x7fb5f00fbb40 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5e0008ea0 con 0x7fb5f00fbb40 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e001c750 con 0x7fb5f00fbb40 2023-12-16T07:37:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.634+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f0117d10 con 0x7fb5f00fbb40 2023-12-16T07:37:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.635+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5f005e380 con 0x7fb5f00fbb40 2023-12-16T07:37:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb5e0012b30 con 0x7fb5f00fbb40 2023-12-16T07:37:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5e77fe700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb5dc068f60 0x7fb5dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb5e00886c0 con 0x7fb5f00fbb40 2023-12-16T07:37:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5ee7fc700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb5dc068f60 0x7fb5dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5e77fe700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] conn(0x7fb5dc06ec30 0x7fb5dc071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 --> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5dc0716f0 con 0x7fb5dc06ec30 2023-12-16T07:37:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5e008ad10 con 0x7fb5f00fbb40 2023-12-16T07:37:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.636+0000 7fb5ef7fe700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] conn(0x7fb5dc06ec30 0x7fb5dc071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.637+0000 7fb5ee7fc700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb5dc068f60 0x7fb5dc06b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0065e30 tx=0x7fb5d80091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.637+0000 7fb5ef7fe700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] conn(0x7fb5dc06ec30 0x7fb5dc071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.638+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== osd.0 v2:172.21.15.49:6802/3714029642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb5dc0716f0 con 0x7fb5dc06ec30 2023-12-16T07:37:48.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 --> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5f005e7b0 con 0x7fb5dc06ec30 2023-12-16T07:37:48.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5e77fe700 1 -- 172.21.15.49:0/940007358 <== osd.0 v2:172.21.15.49:6802/3714029642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5f005e7b0 con 0x7fb5dc06ec30 2023-12-16T07:37:48.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] conn(0x7fb5dc06ec30 msgr2=0x7fb5dc071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:48.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] conn(0x7fb5dc06ec30 0x7fb5dc071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb5dc068f60 msgr2=0x7fb5dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:48.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb5dc068f60 0x7fb5dc06b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0065e30 tx=0x7fb5d80091a0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f00fbb40 msgr2=0x7fb5f010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f00fbb40 0x7fb5f010e860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000bf10 tx=0x7fb5e0004d10 comp rx=0 tx=0).stop 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 shutdown_connections 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6802/3714029642,v1:172.21.15.49:6803/3714029642] conn(0x7fb5dc06ec30 0x7fb5dc071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb5dc068f60 0x7fb5dc06b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f00fbb40 0x7fb5f010e860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 --2- 172.21.15.49:0/940007358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f0101b00 0x7fb5f010eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.653+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 >> 172.21.15.49:0/940007358 conn(0x7fb5f00719b0 msgr2=0x7fb5f00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.654+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 shutdown_connections 2023-12-16T07:37:48.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:48.654+0000 7fb5f53d6700 1 -- 172.21.15.49:0/940007358 wait complete. 2023-12-16T07:37:49.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.094+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3424404065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d00fbb40 msgr2=0x7f85d00fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.094+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3424404065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d00fbb40 0x7f85d00fbfb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f85c4004940 tx=0x7f85c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3424404065 shutdown_connections 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3424404065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d00fbb40 0x7f85d00fbfb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3424404065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d0101b00 0x7f85d0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3424404065 >> 172.21.15.49:0/3424404065 conn(0x7f85d00719b0 msgr2=0x7f85d0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3424404065 shutdown_connections 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3424404065 wait complete. 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 Processor -- start 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 -- start start 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d00fbb40 0x7f85d010e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:49.097 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0101b00 0x7f85d010ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d010f290 con 0x7f85d0101b00 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.095+0000 7f85d4ffe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d010f400 con 0x7f85d00fbb40 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85cdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0101b00 0x7f85d010ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85cdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0101b00 0x7f85d010ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53360/0 (socket says 172.21.15.49:53360) 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85cdd9b700 1 -- 172.21.15.49:0/3277546833 learned_addr learned my addr 172.21.15.49:0/3277546833 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85ce59c700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d00fbb40 0x7f85d010e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85cdd9b700 1 -- 172.21.15.49:0/3277546833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d00fbb40 msgr2=0x7f85d010e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85cdd9b700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d00fbb40 0x7f85d010e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85cdd9b700 1 -- 172.21.15.49:0/3277546833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4005040 con 0x7f85d0101b00 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85cdd9b700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0101b00 0x7f85d010ece0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009180 tx=0x7f85c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c400e040 con 0x7f85d0101b00 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d0117710 con 0x7f85d0101b00 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85c4004290 con 0x7f85d0101b00 2023-12-16T07:37:49.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c401c3f0 con 0x7f85d0101b00 2023-12-16T07:37:49.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.096+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d0117c20 con 0x7f85d0101b00 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f85c4013420 con 0x7f85d0101b00 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85d005e300 con 0x7f85d0101b00 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85beffd700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f85b8068f60 0x7f85b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f85c4087d40 con 0x7f85d0101b00 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85ce59c700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f85b8068f60 0x7f85b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85beffd700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] conn(0x7f85b806ec30 0x7f85b8071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 --> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85b80716f0 con 0x7f85b806ec30 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85c408d3a0 con 0x7f85d0101b00 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85ced9d700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] conn(0x7f85b806ec30 0x7f85b8071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.098+0000 7f85ce59c700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f85b8068f60 0x7f85b806b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85c0007fd0 tx=0x7f85c0009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.099+0000 7f85ced9d700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] conn(0x7f85b806ec30 0x7f85b8071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:49.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.099+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== osd.1 v2:172.21.15.49:6810/3249432879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f85b80716f0 con 0x7f85b806ec30 2023-12-16T07:37:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.115+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 --> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85d005e6b0 con 0x7f85b806ec30 2023-12-16T07:37:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.115+0000 7f85beffd700 1 -- 172.21.15.49:0/3277546833 <== osd.1 v2:172.21.15.49:6810/3249432879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85d005e6b0 con 0x7f85b806ec30 2023-12-16T07:37:49.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.115+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] conn(0x7f85b806ec30 msgr2=0x7f85b8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.115+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] conn(0x7f85b806ec30 0x7f85b8071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.115+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f85b8068f60 msgr2=0x7f85b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.115+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f85b8068f60 0x7f85b806b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85c0007fd0 tx=0x7f85c0009040 comp rx=0 tx=0).stop 2023-12-16T07:37:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0101b00 msgr2=0x7f85d010ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0101b00 0x7f85d010ece0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009180 tx=0x7f85c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:49.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 shutdown_connections 2023-12-16T07:37:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6810/3249432879,v1:172.21.15.49:6811/3249432879] conn(0x7f85b806ec30 0x7f85b8071040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f85b8068f60 0x7f85b806b410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d00fbb40 0x7f85d010e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 --2- 172.21.15.49:0/3277546833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85d0101b00 0x7f85d010ece0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 >> 172.21.15.49:0/3277546833 conn(0x7f85d00719b0 msgr2=0x7f85d00fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 shutdown_connections 2023-12-16T07:37:49.119 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:49.116+0000 7f85d4ffe700 1 -- 172.21.15.49:0/3277546833 wait complete. 2023-12-16T07:37:49.240 INFO:teuthology.orchestra.run.smithi049.stdout:38654705689 2023-12-16T07:37:49.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-16T07:37:49.706 INFO:teuthology.orchestra.run.smithi049.stdout:60129542166 2023-12-16T07:37:49.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-16T07:37:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:107374182414 2023-12-16T07:37:49.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.223+0000 7fc66b28c700 1 -- 172.21.15.49:0/2019857806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664102c00 msgr2=0x7fc664102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.223+0000 7fc66b28c700 1 --2- 172.21.15.49:0/2019857806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664102c00 0x7fc664102fd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc658004940 tx=0x7fc658009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.223+0000 7fc66b28c700 1 -- 172.21.15.49:0/2019857806 shutdown_connections 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.223+0000 7fc66b28c700 1 --2- 172.21.15.49:0/2019857806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6641035a0 0x7fc6640fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 --2- 172.21.15.49:0/2019857806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664102c00 0x7fc664102fd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 -- 172.21.15.49:0/2019857806 >> 172.21.15.49:0/2019857806 conn(0x7fc6640f8790 msgr2=0x7fc6640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 -- 172.21.15.49:0/2019857806 shutdown_connections 2023-12-16T07:37:50.224 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 -- 172.21.15.49:0/2019857806 wait complete. 2023-12-16T07:37:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 Processor -- start 2023-12-16T07:37:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 -- start start 2023-12-16T07:37:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc664102c00 0x7fc664113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6641035a0 0x7fc664113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641141e0 con 0x7fc6641035a0 2023-12-16T07:37:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc66b28c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66410d4d0 con 0x7fc664102c00 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.224+0000 7fc668827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6641035a0 0x7fc664113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc668827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6641035a0 0x7fc664113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53368/0 (socket says 172.21.15.49:53368) 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc668827700 1 -- 172.21.15.49:0/3773453009 learned_addr learned my addr 172.21.15.49:0/3773453009 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc669028700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc664102c00 0x7fc664113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc668827700 1 -- 172.21.15.49:0/3773453009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc664102c00 msgr2=0x7fc664113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc668827700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc664102c00 0x7fc664113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc668827700 1 -- 172.21.15.49:0/3773453009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc658005040 con 0x7fc6641035a0 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc668827700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6641035a0 0x7fc664113b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c890 tx=0x7fc6600044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc66000a700 con 0x7fc6641035a0 2023-12-16T07:37:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc66000ad10 con 0x7fc6641035a0 2023-12-16T07:37:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66410d760 con 0x7fc6641035a0 2023-12-16T07:37:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc660012e70 con 0x7fc6641035a0 2023-12-16T07:37:50.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.225+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66410dca0 con 0x7fc6641035a0 2023-12-16T07:37:50.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.226+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc66410e1a0 con 0x7fc6641035a0 2023-12-16T07:37:50.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc66000a860 con 0x7fc6641035a0 2023-12-16T07:37:50.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc655ffb700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc650068f60 0x7fc65006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc660086a00 con 0x7fc6641035a0 2023-12-16T07:37:50.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc669028700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc650068f60 0x7fc65006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc655ffb700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] conn(0x7fc65006ec30 0x7fc650071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 --> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6500716f0 con 0x7fc65006ec30 2023-12-16T07:37:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc66008b220 con 0x7fc6641035a0 2023-12-16T07:37:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc669829700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] conn(0x7fc65006ec30 0x7fc650071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.227+0000 7fc669028700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc650068f60 0x7fc65006b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc658004f90 tx=0x7fc658009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.228+0000 7fc669829700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] conn(0x7fc65006ec30 0x7fc650071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.228+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== osd.2 v2:172.21.15.49:6818/338711156 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc6500716f0 con 0x7fc65006ec30 2023-12-16T07:37:50.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.243+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 --> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6640fc390 con 0x7fc65006ec30 2023-12-16T07:37:50.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.243+0000 7fc655ffb700 1 -- 172.21.15.49:0/3773453009 <== osd.2 v2:172.21.15.49:6818/338711156 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc6640fc390 con 0x7fc65006ec30 2023-12-16T07:37:50.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] conn(0x7fc65006ec30 msgr2=0x7fc650071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] conn(0x7fc65006ec30 0x7fc650071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc650068f60 msgr2=0x7fc65006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc650068f60 0x7fc65006b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc658004f90 tx=0x7fc658009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6641035a0 msgr2=0x7fc664113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6641035a0 0x7fc664113b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c890 tx=0x7fc6600044c0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 shutdown_connections 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6818/338711156,v1:172.21.15.49:6819/338711156] conn(0x7fc65006ec30 0x7fc650071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc650068f60 0x7fc65006b410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc664102c00 0x7fc664113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 --2- 172.21.15.49:0/3773453009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6641035a0 0x7fc664113b90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 >> 172.21.15.49:0/3773453009 conn(0x7fc6640f8790 msgr2=0x7fc6640fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 shutdown_connections 2023-12-16T07:37:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.244+0000 7fc66b28c700 1 -- 172.21.15.49:0/3773453009 wait complete. 2023-12-16T07:37:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 -- 172.21.15.49:0/344533782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa80fbb40 msgr2=0x7f2aa80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/344533782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa80fbb40 0x7f2aa80fbfb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4004940 tx=0x7f2aa4009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 -- 172.21.15.49:0/344533782 shutdown_connections 2023-12-16T07:37:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/344533782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa80fbb40 0x7f2aa80fbfb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/344533782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa8101b00 0x7f2aa8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 -- 172.21.15.49:0/344533782 >> 172.21.15.49:0/344533782 conn(0x7f2aa80719b0 msgr2=0x7f2aa8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 -- 172.21.15.49:0/344533782 shutdown_connections 2023-12-16T07:37:50.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.457+0000 7f2ab03e6700 1 -- 172.21.15.49:0/344533782 wait complete. 2023-12-16T07:37:50.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2ab03e6700 1 Processor -- start 2023-12-16T07:37:50.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2ab03e6700 1 -- start start 2023-12-16T07:37:50.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2ab03e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa80fbb40 0x7f2aa810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2ab03e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8101b00 0x7f2aa810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2ab03e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa810f290 con 0x7f2aa8101b00 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2ab03e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa810f400 con 0x7f2aa80fbb40 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aad981700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8101b00 0x7f2aa810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aad981700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8101b00 0x7f2aa810ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53386/0 (socket says 172.21.15.49:53386) 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aad981700 1 -- 172.21.15.49:0/3911751871 learned_addr learned my addr 172.21.15.49:0/3911751871 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aae182700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa80fbb40 0x7f2aa810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aad981700 1 -- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa80fbb40 msgr2=0x7f2aa810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aad981700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa80fbb40 0x7f2aa810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aad981700 1 -- 172.21.15.49:0/3911751871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4005040 con 0x7f2aa8101b00 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.458+0000 7f2aad981700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8101b00 0x7f2aa810ece0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400b3b0 tx=0x7f2aa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.459+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa400e040 con 0x7f2aa8101b00 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.459+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2aa4004290 con 0x7f2aa8101b00 2023-12-16T07:37:50.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.459+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa8117710 con 0x7f2aa8101b00 2023-12-16T07:37:50.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.459+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa401c3f0 con 0x7f2aa8101b00 2023-12-16T07:37:50.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.459+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa8117c20 con 0x7f2aa8101b00 2023-12-16T07:37:50.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.459+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2aa805e300 con 0x7f2aa8101b00 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.460+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2aa4013790 con 0x7f2aa8101b00 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.460+0000 7f2a9effd700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2a94068f60 0x7f2a9406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2aa4087c40 con 0x7f2aa8101b00 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2aae182700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2a94068f60 0x7f2a9406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2a9effd700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] conn(0x7f2a9406ec30 0x7f2a94071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 --> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a940716f0 con 0x7f2a9406ec30 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aa408a250 con 0x7f2aa8101b00 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2aae983700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] conn(0x7f2a9406ec30 0x7f2a94071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2aae182700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2a94068f60 0x7f2a9406b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a98004f40 tx=0x7f2a9800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:50.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.461+0000 7f2aae983700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] conn(0x7f2a9406ec30 0x7f2a94071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:50.463 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.462+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== osd.5 v2:172.21.15.133:6816/3892328217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2a940716f0 con 0x7f2a9406ec30 2023-12-16T07:37:50.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.478+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 --> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2aa805e700 con 0x7f2a9406ec30 2023-12-16T07:37:50.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.478+0000 7f2a9effd700 1 -- 172.21.15.49:0/3911751871 <== osd.5 v2:172.21.15.133:6816/3892328217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2aa805e700 con 0x7f2a9406ec30 2023-12-16T07:37:50.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] conn(0x7f2a9406ec30 msgr2=0x7f2a94071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] conn(0x7f2a9406ec30 0x7f2a94071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2a94068f60 msgr2=0x7f2a9406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2a94068f60 0x7f2a9406b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a98004f40 tx=0x7f2a9800b040 comp rx=0 tx=0).stop 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8101b00 msgr2=0x7f2aa810ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8101b00 0x7f2aa810ece0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400b3b0 tx=0x7f2aa4009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 shutdown_connections 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f2a94068f60 0x7f2a9406b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa80fbb40 0x7f2aa810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.133:6816/3892328217,v1:172.21.15.133:6817/3892328217] conn(0x7f2a9406ec30 0x7f2a94071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 --2- 172.21.15.49:0/3911751871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8101b00 0x7f2aa810ece0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 >> 172.21.15.49:0/3911751871 conn(0x7f2aa80719b0 msgr2=0x7f2aa80fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 shutdown_connections 2023-12-16T07:37:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:50.479+0000 7f2ab03e6700 1 -- 172.21.15.49:0/3911751871 wait complete. 2023-12-16T07:37:50.503 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:50 smithi049 ceph-mon[111939]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:50 smithi133 ceph-mon[120445]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:51.042 INFO:teuthology.orchestra.run.smithi049.stdout:158913789959 2023-12-16T07:37:51.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-16T07:37:51.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 -- 172.21.15.49:0/3697885076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 msgr2=0x7f8640101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 --2- 172.21.15.49:0/3697885076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f8640101ec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8630009ce0 tx=0x7f8630004d10 comp rx=0 tx=0).stop 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 -- 172.21.15.49:0/3697885076 shutdown_connections 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 --2- 172.21.15.49:0/3697885076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86400fbb30 0x7f86400fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 --2- 172.21.15.49:0/3697885076 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f8640101ec0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 -- 172.21.15.49:0/3697885076 >> 172.21.15.49:0/3697885076 conn(0x7f86400f7690 msgr2=0x7f86400f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 -- 172.21.15.49:0/3697885076 shutdown_connections 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.058+0000 7f8645be5700 1 -- 172.21.15.49:0/3697885076 wait complete. 2023-12-16T07:37:51.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f8645be5700 1 Processor -- start 2023-12-16T07:37:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f8645be5700 1 -- start start 2023-12-16T07:37:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f8645be5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86400fbb30 0x7f864010e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f8645be5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f864010ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f8645be5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864010f1e0 con 0x7f8640101af0 2023-12-16T07:37:51.060 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f8645be5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864010f350 con 0x7f86400fbb30 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f863effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f864010ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f863effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f864010ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53398/0 (socket says 172.21.15.49:53398) 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f863effd700 1 -- 172.21.15.49:0/2151666257 learned_addr learned my addr 172.21.15.49:0/2151666257 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f863f7fe700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86400fbb30 0x7f864010e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f863effd700 1 -- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86400fbb30 msgr2=0x7f864010e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.059+0000 7f863effd700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86400fbb30 0x7f864010e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.060+0000 7f863effd700 1 -- 172.21.15.49:0/2151666257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630009940 con 0x7f8640101af0 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.060+0000 7f863effd700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f864010ec30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f863400eb40 tx=0x7f863400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.060+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8634007cc0 con 0x7f8640101af0 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.060+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8640117660 con 0x7f8640101af0 2023-12-16T07:37:51.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.060+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8640117b70 con 0x7f8640101af0 2023-12-16T07:37:51.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.060+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f863400f040 con 0x7f8640101af0 2023-12-16T07:37:51.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.061+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f863400c990 con 0x7f8640101af0 2023-12-16T07:37:51.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.061+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f862c000fd0 con 0x7f8640101af0 2023-12-16T07:37:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.063+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f863400cc00 con 0x7f8640101af0 2023-12-16T07:37:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.063+0000 7f8627fff700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8628068f60 0x7f862806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.063+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f86340866e0 con 0x7f8640101af0 2023-12-16T07:37:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.064+0000 7f8627fff700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] conn(0x7f862806ec30 0x7f8628071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.064+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 --> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86280716f0 con 0x7f862806ec30 2023-12-16T07:37:51.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.064+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8634086a20 con 0x7f8640101af0 2023-12-16T07:37:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.064+0000 7f863f7fe700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8628068f60 0x7f862806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:51.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.064+0000 7f863f7fe700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8628068f60 0x7f862806b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8630004f50 tx=0x7f8630004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.066+0000 7f863ffff700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] conn(0x7f862806ec30 0x7f8628071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:51.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.066+0000 7f863ffff700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] conn(0x7f862806ec30 0x7f8628071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:51.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.067+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== osd.4 v2:172.21.15.133:6808/3300498409 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f86280716f0 con 0x7f862806ec30 2023-12-16T07:37:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.083+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 --> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f862c002d30 con 0x7f862806ec30 2023-12-16T07:37:51.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8627fff700 1 -- 172.21.15.49:0/2151666257 <== osd.4 v2:172.21.15.133:6808/3300498409 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f862c002d30 con 0x7f862806ec30 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] conn(0x7f862806ec30 msgr2=0x7f8628071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] conn(0x7f862806ec30 0x7f8628071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8628068f60 msgr2=0x7f862806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8628068f60 0x7f862806b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8630004f50 tx=0x7f8630004d10 comp rx=0 tx=0).stop 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 msgr2=0x7f864010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f864010ec30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f863400eb40 tx=0x7f863400b040 comp rx=0 tx=0).stop 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 shutdown_connections 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:6808/3300498409,v1:172.21.15.133:6809/3300498409] conn(0x7f862806ec30 0x7f8628071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8628068f60 0x7f862806b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86400fbb30 0x7f864010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 --2- 172.21.15.49:0/2151666257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101af0 0x7f864010ec30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 >> 172.21.15.49:0/2151666257 conn(0x7f86400f7690 msgr2=0x7f86400f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 shutdown_connections 2023-12-16T07:37:51.086 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:51.084+0000 7f8645be5700 1 -- 172.21.15.49:0/2151666257 wait complete. 2023-12-16T07:37:51.545 INFO:teuthology.orchestra.run.smithi049.stdout:81604378642 2023-12-16T07:37:51.545 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-16T07:37:51.682 INFO:teuthology.orchestra.run.smithi049.stdout:137438953483 2023-12-16T07:37:51.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-16T07:37:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:52.543 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:52 smithi049 ceph-mon[111939]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:52.552 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:52.621 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:52 smithi133 ceph-mon[120445]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:52.803 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:53.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.108+0000 7f5e9c441700 1 -- 172.21.15.49:0/2775276928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e940fbb30 msgr2=0x7f5e940fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:53.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.108+0000 7f5e9c441700 1 --2- 172.21.15.49:0/2775276928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e940fbb30 0x7f5e940fbfa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e84004940 tx=0x7f5e84009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.108+0000 7f5e9c441700 1 -- 172.21.15.49:0/2775276928 shutdown_connections 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.109+0000 7f5e9c441700 1 --2- 172.21.15.49:0/2775276928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e940fbb30 0x7f5e940fbfa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.109+0000 7f5e9c441700 1 --2- 172.21.15.49:0/2775276928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e94101af0 0x7f5e94101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.109+0000 7f5e9c441700 1 -- 172.21.15.49:0/2775276928 >> 172.21.15.49:0/2775276928 conn(0x7f5e940f7690 msgr2=0x7f5e940f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.109+0000 7f5e9c441700 1 -- 172.21.15.49:0/2775276928 shutdown_connections 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.109+0000 7f5e9c441700 1 -- 172.21.15.49:0/2775276928 wait complete. 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.109+0000 7f5e9c441700 1 Processor -- start 2023-12-16T07:37:53.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.109+0000 7f5e9c441700 1 -- start start 2023-12-16T07:37:53.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e9c441700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e940fbb30 0x7f5e941125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:53.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e9c441700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e94101af0 0x7f5e94112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:53.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e9c441700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9410c4b0 con 0x7f5e94101af0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e9c441700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9410c620 con 0x7f5e940fbb30 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e999dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e94101af0 0x7f5e94112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e999dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e94101af0 0x7f5e94112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53408/0 (socket says 172.21.15.49:53408) 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e999dc700 1 -- 172.21.15.49:0/1826802908 learned_addr learned my addr 172.21.15.49:0/1826802908 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e9a1dd700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e940fbb30 0x7f5e941125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e999dc700 1 -- 172.21.15.49:0/1826802908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e940fbb30 msgr2=0x7f5e941125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e999dc700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e940fbb30 0x7f5e941125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e999dc700 1 -- 172.21.15.49:0/1826802908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84005040 con 0x7f5e94101af0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e999dc700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e94101af0 0x7f5e94112b70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009360 tx=0x7f5e84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.110+0000 7f5e8affd700 1 -- 172.21.15.49:0/1826802908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e8400e040 con 0x7f5e94101af0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.111+0000 7f5e8affd700 1 -- 172.21.15.49:0/1826802908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e84013420 con 0x7f5e94101af0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.111+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9410c8a0 con 0x7f5e94101af0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.111+0000 7f5e8affd700 1 -- 172.21.15.49:0/1826802908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e8401c610 con 0x7f5e94101af0 2023-12-16T07:37:53.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.111+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9410cde0 con 0x7f5e94101af0 2023-12-16T07:37:53.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.112+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e94103fa0 con 0x7f5e94101af0 2023-12-16T07:37:53.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.112+0000 7f5e8affd700 1 -- 172.21.15.49:0/1826802908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5e8400bb80 con 0x7f5e94101af0 2023-12-16T07:37:53.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.112+0000 7f5e8affd700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5e80068f70 0x7f5e8006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:53.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.113+0000 7f5e8affd700 1 -- 172.21.15.49:0/1826802908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5e84087c20 con 0x7f5e94101af0 2023-12-16T07:37:53.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.113+0000 7f5e9a1dd700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5e80068f70 0x7f5e8006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:53.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.113+0000 7f5e9a1dd700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5e80068f70 0x7f5e8006b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e940f8d40 tx=0x7f5e900091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:53.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.117+0000 7f5e8affd700 1 -- 172.21.15.49:0/1826802908 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5e84057ec0 con 0x7f5e94101af0 2023-12-16T07:37:53.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.318+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e940fb290 con 0x7f5e94101af0 2023-12-16T07:37:53.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.318+0000 7f5e8affd700 1 -- 172.21.15.49:0/1826802908 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e940fb290 con 0x7f5e94101af0 2023-12-16T07:37:53.319 INFO:teuthology.orchestra.run.smithi049.stdout:38654705689 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5e80068f70 msgr2=0x7f5e8006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5e80068f70 0x7f5e8006b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e940f8d40 tx=0x7f5e900091a0 comp rx=0 tx=0).stop 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e94101af0 msgr2=0x7f5e94112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e94101af0 0x7f5e94112b70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009360 tx=0x7f5e84009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 shutdown_connections 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5e80068f70 0x7f5e8006b420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e940fbb30 0x7f5e941125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 --2- 172.21.15.49:0/1826802908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e94101af0 0x7f5e94112b70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 >> 172.21.15.49:0/1826802908 conn(0x7f5e940f7690 msgr2=0x7f5e940f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 shutdown_connections 2023-12-16T07:37:53.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:53.320+0000 7f5e9c441700 1 -- 172.21.15.49:0/1826802908 wait complete. 2023-12-16T07:37:53.579 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:53 smithi049 ceph-mon[111939]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:53.579 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:53 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1826802908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T07:37:53.830 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:53.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:53 smithi133 ceph-mon[120445]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:53.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:53 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1826802908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-16T07:37:53.914 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705689 got 38654705689 for osd.0 2023-12-16T07:37:53.914 DEBUG:teuthology.parallel:result is None 2023-12-16T07:37:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/915718669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f980fbb40 msgr2=0x7f8f980fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/915718669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f980fbb40 0x7f8f980fbfb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f80004940 tx=0x7f8f80009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:54.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/915718669 shutdown_connections 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/915718669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f980fbb40 0x7f8f980fbfb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/915718669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f98101b00 0x7f8f98101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/915718669 >> 172.21.15.49:0/915718669 conn(0x7f8f980719b0 msgr2=0x7f8f98071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/915718669 shutdown_connections 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.940+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/915718669 wait complete. 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f9dd6c700 1 Processor -- start 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f9dd6c700 1 -- start start 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f9dd6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f980fbb40 0x7f8f9810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f9dd6c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98101b00 0x7f8f9810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f9dd6c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9810f290 con 0x7f8f98101b00 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f9dd6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9810f400 con 0x7f8f980fbb40 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f96ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98101b00 0x7f8f9810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f96ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98101b00 0x7f8f9810ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53424/0 (socket says 172.21.15.49:53424) 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f96ffd700 1 -- 172.21.15.49:0/802511992 learned_addr learned my addr 172.21.15.49:0/802511992 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f977fe700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f980fbb40 0x7f8f9810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f96ffd700 1 -- 172.21.15.49:0/802511992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f980fbb40 msgr2=0x7f8f9810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f96ffd700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f980fbb40 0x7f8f9810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f96ffd700 1 -- 172.21.15.49:0/802511992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80005040 con 0x7f8f98101b00 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.941+0000 7f8f977fe700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f980fbb40 0x7f8f9810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.942+0000 7f8f96ffd700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98101b00 0x7f8f9810ece0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000b3b0 tx=0x7f8f80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.942+0000 7f8f8ffff700 1 -- 172.21.15.49:0/802511992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8000e040 con 0x7f8f98101b00 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.942+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f98117710 con 0x7f8f98101b00 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.942+0000 7f8f8ffff700 1 -- 172.21.15.49:0/802511992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f8000bc50 con 0x7f8f98101b00 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.942+0000 7f8f8ffff700 1 -- 172.21.15.49:0/802511992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f80013420 con 0x7f8f98101b00 2023-12-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.942+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98117c20 con 0x7f8f98101b00 2023-12-16T07:37:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.943+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f98103fb0 con 0x7f8f98101b00 2023-12-16T07:37:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.943+0000 7f8f8ffff700 1 -- 172.21.15.49:0/802511992 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8f8001c430 con 0x7f8f98101b00 2023-12-16T07:37:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.944+0000 7f8f8ffff700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8f84068f60 0x7f8f8406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.944+0000 7f8f8ffff700 1 -- 172.21.15.49:0/802511992 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8f80087830 con 0x7f8f98101b00 2023-12-16T07:37:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.944+0000 7f8f977fe700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8f84068f60 0x7f8f8406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:54.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.944+0000 7f8f977fe700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8f84068f60 0x7f8f8406b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f90004550 tx=0x7f8f90009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:54.948 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:54.948+0000 7f8f8ffff700 1 -- 172.21.15.49:0/802511992 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8f800540f0 con 0x7f8f98101b00 2023-12-16T07:37:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.147+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8f9804bb80 con 0x7f8f98101b00 2023-12-16T07:37:55.148 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.148+0000 7f8f8ffff700 1 -- 172.21.15.49:0/802511992 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f80057710 con 0x7f8f98101b00 2023-12-16T07:37:55.148 INFO:teuthology.orchestra.run.smithi049.stdout:158913789959 2023-12-16T07:37:55.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8f84068f60 msgr2=0x7f8f8406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8f84068f60 0x7f8f8406b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f90004550 tx=0x7f8f90009040 comp rx=0 tx=0).stop 2023-12-16T07:37:55.151 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98101b00 msgr2=0x7f8f9810ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98101b00 0x7f8f9810ece0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000b3b0 tx=0x7f8f80009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 shutdown_connections 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f8f84068f60 0x7f8f8406b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f980fbb40 0x7f8f9810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 --2- 172.21.15.49:0/802511992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f98101b00 0x7f8f9810ece0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 >> 172.21.15.49:0/802511992 conn(0x7f8f980719b0 msgr2=0x7f8f980fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 shutdown_connections 2023-12-16T07:37:55.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.151+0000 7f8f9dd6c700 1 -- 172.21.15.49:0/802511992 wait complete. 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 -- 172.21.15.49:0/3309590964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 msgr2=0x7fdd70102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 --2- 172.21.15.49:0/3309590964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd70102fd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd60004940 tx=0x7fdd60009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 -- 172.21.15.49:0/3309590964 shutdown_connections 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 --2- 172.21.15.49:0/3309590964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd701035a0 0x7fdd700fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 --2- 172.21.15.49:0/3309590964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd70102fd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 -- 172.21.15.49:0/3309590964 >> 172.21.15.49:0/3309590964 conn(0x7fdd700f8790 msgr2=0x7fdd700faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 -- 172.21.15.49:0/3309590964 shutdown_connections 2023-12-16T07:37:55.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.456+0000 7fdd7565c700 1 -- 172.21.15.49:0/3309590964 wait complete. 2023-12-16T07:37:55.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd7565c700 1 Processor -- start 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd7565c700 1 -- start start 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd7565c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd7006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd7565c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd701035a0 0x7fdd70070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd7565c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70070a80 con 0x7fdd70102c00 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd7565c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70070bf0 con 0x7fdd701035a0 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd7006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd7006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53436/0 (socket says 172.21.15.49:53436) 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.457+0000 7fdd6effd700 1 -- 172.21.15.49:0/2476818909 learned_addr learned my addr 172.21.15.49:0/2476818909 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd6e7fc700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd701035a0 0x7fdd70070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd6effd700 1 -- 172.21.15.49:0/2476818909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd701035a0 msgr2=0x7fdd70070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd6effd700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd701035a0 0x7fdd70070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd6effd700 1 -- 172.21.15.49:0/2476818909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60005040 con 0x7fdd70102c00 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd6effd700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd7006ff40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000b3b0 tx=0x7fdd60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:55.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd577fe700 1 -- 172.21.15.49:0/2476818909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd6000e040 con 0x7fdd70102c00 2023-12-16T07:37:55.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd577fe700 1 -- 172.21.15.49:0/2476818909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd6001c430 con 0x7fdd70102c00 2023-12-16T07:37:55.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd70119850 con 0x7fdd70102c00 2023-12-16T07:37:55.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:55 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/802511992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T07:37:55.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd577fe700 1 -- 172.21.15.49:0/2476818909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd60013640 con 0x7fdd70102c00 2023-12-16T07:37:55.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.458+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd70119cb0 con 0x7fdd70102c00 2023-12-16T07:37:55.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.459+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd700fff10 con 0x7fdd70102c00 2023-12-16T07:37:55.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.460+0000 7fdd577fe700 1 -- 172.21.15.49:0/2476818909 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdd6001c5a0 con 0x7fdd70102c00 2023-12-16T07:37:55.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.461+0000 7fdd577fe700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdd58068f60 0x7fdd5806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:55.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.461+0000 7fdd577fe700 1 -- 172.21.15.49:0/2476818909 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdd60087450 con 0x7fdd70102c00 2023-12-16T07:37:55.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.461+0000 7fdd6e7fc700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdd58068f60 0x7fdd5806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:55.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.461+0000 7fdd6e7fc700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdd58068f60 0x7fdd5806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd70071940 tx=0x7fdd6400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:55.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.465+0000 7fdd577fe700 1 -- 172.21.15.49:0/2476818909 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdd60053db0 con 0x7fdd70102c00 2023-12-16T07:37:55.547 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 -- 172.21.15.49:0/4280623784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 msgr2=0x7f7828065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 --2- 172.21.15.49:0/4280623784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828065800 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f781c004940 tx=0x7f781c009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 -- 172.21.15.49:0/4280623784 shutdown_connections 2023-12-16T07:37:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 --2- 172.21.15.49:0/4280623784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828065800 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 --2- 172.21.15.49:0/4280623784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828102c20 0x7f7828102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 -- 172.21.15.49:0/4280623784 >> 172.21.15.49:0/4280623784 conn(0x7f78280719b0 msgr2=0x7f7828071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 -- 172.21.15.49:0/4280623784 shutdown_connections 2023-12-16T07:37:55.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.547+0000 7f782d690700 1 -- 172.21.15.49:0/4280623784 wait complete. 2023-12-16T07:37:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f782d690700 1 Processor -- start 2023-12-16T07:37:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f782d690700 1 -- start start 2023-12-16T07:37:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f782d690700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:55.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f782d690700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828102c20 0x7f7828113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f782d690700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78281142c0 con 0x7f7828065390 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f782d690700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782810d5f0 con 0x7f7828102c20 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f7826ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f7826ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53450/0 (socket says 172.21.15.49:53450) 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f7826ffd700 1 -- 172.21.15.49:0/463437847 learned_addr learned my addr 172.21.15.49:0/463437847 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.548+0000 7f78267fc700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828102c20 0x7f7828113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f7826ffd700 1 -- 172.21.15.49:0/463437847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828102c20 msgr2=0x7f7828113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f7826ffd700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828102c20 0x7f7828113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f7826ffd700 1 -- 172.21.15.49:0/463437847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c005040 con 0x7f7828065390 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f7826ffd700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828113730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7818002a50 tx=0x7f78180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f780f7fe700 1 -- 172.21.15.49:0/463437847 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7818007cc0 con 0x7f7828065390 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f780f7fe700 1 -- 172.21.15.49:0/463437847 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f781800f040 con 0x7f7828065390 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782810d8d0 con 0x7f7828065390 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f780f7fe700 1 -- 172.21.15.49:0/463437847 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f781800d9c0 con 0x7f7828065390 2023-12-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.549+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782810dde0 con 0x7f7828065390 2023-12-16T07:37:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.550+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78280fff40 con 0x7f7828065390 2023-12-16T07:37:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.551+0000 7f780f7fe700 1 -- 172.21.15.49:0/463437847 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f781800db20 con 0x7f7828065390 2023-12-16T07:37:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.551+0000 7f780f7fe700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7810068f60 0x7f781006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.551+0000 7f780f7fe700 1 -- 172.21.15.49:0/463437847 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7818086790 con 0x7f7828065390 2023-12-16T07:37:55.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.551+0000 7f78267fc700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7810068f60 0x7f781006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:55.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.551+0000 7f78267fc700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7810068f60 0x7f781006b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f782810e920 tx=0x7f781c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:55.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.556+0000 7f780f7fe700 1 -- 172.21.15.49:0/463437847 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f78180569b0 con 0x7f7828065390 2023-12-16T07:37:55.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:55 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/802511992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-16T07:37:55.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.668+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd70071680 con 0x7fdd70102c00 2023-12-16T07:37:55.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.668+0000 7fdd577fe700 1 -- 172.21.15.49:0/2476818909 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd600573d0 con 0x7fdd70102c00 2023-12-16T07:37:55.669 INFO:teuthology.orchestra.run.smithi049.stdout:60129542167 2023-12-16T07:37:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdd58068f60 msgr2=0x7fdd5806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdd58068f60 0x7fdd5806b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd70071940 tx=0x7fdd6400b040 comp rx=0 tx=0).stop 2023-12-16T07:37:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 msgr2=0x7fdd7006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd7006ff40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000b3b0 tx=0x7fdd60009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 shutdown_connections 2023-12-16T07:37:55.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdd58068f60 0x7fdd5806b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd70102c00 0x7fdd7006ff40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 --2- 172.21.15.49:0/2476818909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd701035a0 0x7fdd70070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.670+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 >> 172.21.15.49:0/2476818909 conn(0x7fdd700f8790 msgr2=0x7fdd700fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.671+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 shutdown_connections 2023-12-16T07:37:55.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.671+0000 7fdd7565c700 1 -- 172.21.15.49:0/2476818909 wait complete. 2023-12-16T07:37:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.754+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f782804bb80 con 0x7f7828065390 2023-12-16T07:37:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.754+0000 7f780f7fe700 1 -- 172.21.15.49:0/463437847 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7818056540 con 0x7f7828065390 2023-12-16T07:37:55.755 INFO:teuthology.orchestra.run.smithi049.stdout:137438953484 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7810068f60 msgr2=0x7f781006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7810068f60 0x7f781006b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f782810e920 tx=0x7f781c009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 msgr2=0x7f7828113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828113730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7818002a50 tx=0x7f78180046b0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 shutdown_connections 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7810068f60 0x7f781006b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7828065390 0x7f7828113730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 --2- 172.21.15.49:0/463437847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7828102c20 0x7f7828113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.756+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 >> 172.21.15.49:0/463437847 conn(0x7f78280719b0 msgr2=0x7f78280fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:55.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.757+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 shutdown_connections 2023-12-16T07:37:55.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:55.757+0000 7f782d690700 1 -- 172.21.15.49:0/463437847 wait complete. 2023-12-16T07:37:56.141 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789959 got 158913789959 for osd.5 2023-12-16T07:37:56.141 DEBUG:teuthology.parallel:result is None 2023-12-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.297+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2413392672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f0101b00 msgr2=0x7f24f0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.297+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2413392672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f0101b00 0x7f24f0101ed0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f24e0004940 tx=0x7f24e0009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.297+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2413392672 shutdown_connections 2023-12-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.297+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2413392672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f00fbb40 0x7f24f00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.297+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2413392672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f0101b00 0x7f24f0101ed0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.297+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2413392672 >> 172.21.15.49:0/2413392672 conn(0x7f24f00719b0 msgr2=0x7f24f0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:56.298 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.298+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2413392672 shutdown_connections 2023-12-16T07:37:56.299 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.298+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2413392672 wait complete. 2023-12-16T07:37:56.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.298+0000 7f24f5bcc700 1 Processor -- start 2023-12-16T07:37:56.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.298+0000 7f24f5bcc700 1 -- start start 2023-12-16T07:37:56.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24f5bcc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f00fbb40 0x7f24f01124a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:56.300 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24f5bcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f0101b00 0x7f24f01129e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24f5bcc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0113030 con 0x7f24f00fbb40 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24f5bcc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f010c360 con 0x7f24f0101b00 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24ef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f00fbb40 0x7f24f01124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24ef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f00fbb40 0x7f24f01124a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53468/0 (socket says 172.21.15.49:53468) 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24ef7fe700 1 -- 172.21.15.49:0/2844430294 learned_addr learned my addr 172.21.15.49:0/2844430294 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24eeffd700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f0101b00 0x7f24f01129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24ef7fe700 1 -- 172.21.15.49:0/2844430294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f0101b00 msgr2=0x7f24f01129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24ef7fe700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f0101b00 0x7f24f01129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24ef7fe700 1 -- 172.21.15.49:0/2844430294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e0005040 con 0x7f24f00fbb40 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.299+0000 7f24ef7fe700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f00fbb40 0x7f24f01124a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24e000b3b0 tx=0x7f24e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:56.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.300+0000 7f24e7fff700 1 -- 172.21.15.49:0/2844430294 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e000e040 con 0x7f24f00fbb40 2023-12-16T07:37:56.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.300+0000 7f24e7fff700 1 -- 172.21.15.49:0/2844430294 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24e0009af0 con 0x7f24f00fbb40 2023-12-16T07:37:56.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.300+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f010c5e0 con 0x7f24f00fbb40 2023-12-16T07:37:56.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.300+0000 7f24e7fff700 1 -- 172.21.15.49:0/2844430294 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e0013660 con 0x7f24f00fbb40 2023-12-16T07:37:56.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.300+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f010cb20 con 0x7f24f00fbb40 2023-12-16T07:37:56.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.301+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f00734d0 con 0x7f24f00fbb40 2023-12-16T07:37:56.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.301+0000 7f24e7fff700 1 -- 172.21.15.49:0/2844430294 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f24e00138e0 con 0x7f24f00fbb40 2023-12-16T07:37:56.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.302+0000 7f24e7fff700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f24dc068f60 0x7f24dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:56.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.302+0000 7f24e7fff700 1 -- 172.21.15.49:0/2844430294 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f24e008a760 con 0x7f24f00fbb40 2023-12-16T07:37:56.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.302+0000 7f24eeffd700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f24dc068f60 0x7f24dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:56.303 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.302+0000 7f24eeffd700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f24dc068f60 0x7f24dc06b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24f010dd40 tx=0x7f24d800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:56.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.306+0000 7f24e7fff700 1 -- 172.21.15.49:0/2844430294 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f24e005aa00 con 0x7f24f00fbb40 2023-12-16T07:37:56.325 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:56 smithi049 ceph-mon[111939]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:56.325 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:56 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2476818909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T07:37:56.325 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:56 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/463437847' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T07:37:56.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.506+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24f0108ab0 con 0x7f24f00fbb40 2023-12-16T07:37:56.506 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.506+0000 7f24e7fff700 1 -- 172.21.15.49:0/2844430294 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24e005a590 con 0x7f24f00fbb40 2023-12-16T07:37:56.506 INFO:teuthology.orchestra.run.smithi049.stdout:107374182415 2023-12-16T07:37:56.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f24dc068f60 msgr2=0x7f24dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f24dc068f60 0x7f24dc06b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24f010dd40 tx=0x7f24d800b040 comp rx=0 tx=0).stop 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f00fbb40 msgr2=0x7f24f01124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f00fbb40 0x7f24f01124a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24e000b3b0 tx=0x7f24e0009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 shutdown_connections 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f24dc068f60 0x7f24dc06b410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24f00fbb40 0x7f24f01124a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 --2- 172.21.15.49:0/2844430294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24f0101b00 0x7f24f01129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 >> 172.21.15.49:0/2844430294 conn(0x7f24f00719b0 msgr2=0x7f24f00faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 shutdown_connections 2023-12-16T07:37:56.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.508+0000 7f24f5bcc700 1 -- 172.21.15.49:0/2844430294 wait complete. 2023-12-16T07:37:56.574 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542166 got 60129542167 for osd.1 2023-12-16T07:37:56.574 DEBUG:teuthology.parallel:result is None 2023-12-16T07:37:56.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:56 smithi133 ceph-mon[120445]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:56.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:56 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2476818909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-16T07:37:56.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:56 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/463437847' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-16T07:37:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/2438648096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 msgr2=0x7f5f24101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/2438648096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f24101ed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004940 tx=0x7f5f18009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/2438648096 shutdown_connections 2023-12-16T07:37:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/2438648096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f240fbb40 0x7f5f240fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/2438648096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f24101ed0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/2438648096 >> 172.21.15.49:0/2438648096 conn(0x7f5f240719b0 msgr2=0x7f5f24071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/2438648096 shutdown_connections 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/2438648096 wait complete. 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 Processor -- start 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.751+0000 7f5f2b2f3700 1 -- start start 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2b2f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f240fbb40 0x7f5f2410e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2b2f3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f2410ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2b2f3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2410f1e0 con 0x7f5f24101b00 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2b2f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2410f320 con 0x7f5f240fbb40 2023-12-16T07:37:56.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2888e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f2410ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2888e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f2410ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53490/0 (socket says 172.21.15.49:53490) 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2888e700 1 -- 172.21.15.49:0/852541948 learned_addr learned my addr 172.21.15.49:0/852541948 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2908f700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f240fbb40 0x7f5f2410e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2888e700 1 -- 172.21.15.49:0/852541948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f240fbb40 msgr2=0x7f5f2410e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2888e700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f240fbb40 0x7f5f2410e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2888e700 1 -- 172.21.15.49:0/852541948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f18005040 con 0x7f5f24101b00 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2908f700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f240fbb40 0x7f5f2410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2888e700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f2410ec50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f20002a50 tx=0x7f5f200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f15ffb700 1 -- 172.21.15.49:0/852541948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f20007cc0 con 0x7f5f24101b00 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f15ffb700 1 -- 172.21.15.49:0/852541948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f2000f040 con 0x7f5f24101b00 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f15ffb700 1 -- 172.21.15.49:0/852541948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2000da70 con 0x7f5f24101b00 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.752+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f24117680 con 0x7f5f24101b00 2023-12-16T07:37:56.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.753+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f24117b40 con 0x7f5f24101b00 2023-12-16T07:37:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.754+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f24103fb0 con 0x7f5f24101b00 2023-12-16T07:37:56.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.754+0000 7f5f15ffb700 1 -- 172.21.15.49:0/852541948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5f2000dc10 con 0x7f5f24101b00 2023-12-16T07:37:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.754+0000 7f5f15ffb700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5f10068f60 0x7f5f1006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.754+0000 7f5f15ffb700 1 -- 172.21.15.49:0/852541948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5f20086190 con 0x7f5f24101b00 2023-12-16T07:37:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.754+0000 7f5f2908f700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5f10068f60 0x7f5f1006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.755+0000 7f5f2908f700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5f10068f60 0x7f5f1006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004f90 tx=0x7f5f18009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:56.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.759+0000 7f5f15ffb700 1 -- 172.21.15.49:0/852541948 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f2004ca00 con 0x7f5f24101b00 2023-12-16T07:37:56.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953483 got 137438953484 for osd.4 2023-12-16T07:37:56.830 DEBUG:teuthology.parallel:result is None 2023-12-16T07:37:56.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.963+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f240734d0 con 0x7f5f24101b00 2023-12-16T07:37:56.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.963+0000 7f5f15ffb700 1 -- 172.21.15.49:0/852541948 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f20052920 con 0x7f5f24101b00 2023-12-16T07:37:56.964 INFO:teuthology.orchestra.run.smithi049.stdout:81604378643 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.965+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5f10068f60 msgr2=0x7f5f1006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.965+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5f10068f60 0x7f5f1006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004f90 tx=0x7f5f18009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.965+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 msgr2=0x7f5f2410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.965+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f2410ec50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f20002a50 tx=0x7f5f200046b0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.966+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 shutdown_connections 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.966+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f5f10068f60 0x7f5f1006b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.966+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f240fbb40 0x7f5f2410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.966+0000 7f5f2b2f3700 1 --2- 172.21.15.49:0/852541948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f24101b00 0x7f5f2410ec50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.966+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 >> 172.21.15.49:0/852541948 conn(0x7f5f240719b0 msgr2=0x7f5f240fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.966+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 shutdown_connections 2023-12-16T07:37:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:56.966+0000 7f5f2b2f3700 1 -- 172.21.15.49:0/852541948 wait complete. 2023-12-16T07:37:57.066 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182414 got 107374182415 for osd.3 2023-12-16T07:37:57.067 DEBUG:teuthology.parallel:result is None 2023-12-16T07:37:57.387 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:57 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2844430294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T07:37:57.387 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:57 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/852541948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T07:37:57.388 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378642 got 81604378643 for osd.2 2023-12-16T07:37:57.389 DEBUG:teuthology.parallel:result is None 2023-12-16T07:37:57.389 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-16T07:37:57.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T07:37:57.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:57 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2844430294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-16T07:37:57.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:57 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/852541948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-16T07:37:57.660 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:37:58.449 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:37:58 smithi049 ceph-mon[111939]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:58.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:37:58 smithi133 ceph-mon[120445]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:37:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 -- 172.21.15.49:0/3227401689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe40fb1e0 msgr2=0x7fdfe40fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 --2- 172.21.15.49:0/3227401689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe40fb1e0 0x7fdfe40fb630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8004940 tx=0x7fdfd8009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 -- 172.21.15.49:0/3227401689 shutdown_connections 2023-12-16T07:37:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 --2- 172.21.15.49:0/3227401689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe40fb1e0 0x7fdfe40fb630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 --2- 172.21.15.49:0/3227401689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe4102c70 0x7fdfe4103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 -- 172.21.15.49:0/3227401689 >> 172.21.15.49:0/3227401689 conn(0x7fdfe40711a0 msgr2=0x7fdfe40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 -- 172.21.15.49:0/3227401689 shutdown_connections 2023-12-16T07:37:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.651+0000 7fdfea011700 1 -- 172.21.15.49:0/3227401689 wait complete. 2023-12-16T07:37:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfea011700 1 Processor -- start 2023-12-16T07:37:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfea011700 1 -- start start 2023-12-16T07:37:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfea011700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe40fb1e0 0x7fdfe4113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfea011700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe4102c70 0x7fdfe4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfea011700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe4114200 con 0x7fdfe4102c70 2023-12-16T07:37:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfea011700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe410d4f0 con 0x7fdfe40fb1e0 2023-12-16T07:37:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfe2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe4102c70 0x7fdfe4113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfe2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe4102c70 0x7fdfe4113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50082/0 (socket says 172.21.15.49:50082) 2023-12-16T07:37:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfe2ffd700 1 -- 172.21.15.49:0/3823384548 learned_addr learned my addr 172.21.15.49:0/3823384548 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:37:58.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.652+0000 7fdfe37fe700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe40fb1e0 0x7fdfe4113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfe2ffd700 1 -- 172.21.15.49:0/3823384548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe40fb1e0 msgr2=0x7fdfe4113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfe2ffd700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe40fb1e0 0x7fdfe4113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfe2ffd700 1 -- 172.21.15.49:0/3823384548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8005040 con 0x7fdfe4102c70 2023-12-16T07:37:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfe2ffd700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe4102c70 0x7fdfe4113bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800b3b0 tx=0x7fdfd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfcbfff700 1 -- 172.21.15.49:0/3823384548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd800e040 con 0x7fdfe4102c70 2023-12-16T07:37:58.657 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfcbfff700 1 -- 172.21.15.49:0/3823384548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfd801c430 con 0x7fdfe4102c70 2023-12-16T07:37:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe410d720 con 0x7fdfe4102c70 2023-12-16T07:37:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfcbfff700 1 -- 172.21.15.49:0/3823384548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd8013640 con 0x7fdfe4102c70 2023-12-16T07:37:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.653+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe410dc60 con 0x7fdfe4102c70 2023-12-16T07:37:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.654+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe4105050 con 0x7fdfe4102c70 2023-12-16T07:37:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.654+0000 7fdfcbfff700 1 -- 172.21.15.49:0/3823384548 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdfd801c5a0 con 0x7fdfe4102c70 2023-12-16T07:37:58.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.655+0000 7fdfcbfff700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdfcc068f60 0x7fdfcc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:37:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.655+0000 7fdfcbfff700 1 -- 172.21.15.49:0/3823384548 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdfd8087450 con 0x7fdfe4102c70 2023-12-16T07:37:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.655+0000 7fdfe37fe700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdfcc068f60 0x7fdfcc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:37:58.659 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.655+0000 7fdfe37fe700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdfcc068f60 0x7fdfcc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40f9a10 tx=0x7fdfd400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:37:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.659+0000 7fdfcbfff700 1 -- 172.21.15.49:0/3823384548 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdfd8057840 con 0x7fdfe4102c70 2023-12-16T07:37:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.853+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfe410ec10 con 0x7fdfcc068f60 2023-12-16T07:37:58.855 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.854+0000 7fdfcbfff700 1 -- 172.21.15.49:0/3823384548 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+23135 (secure 0 0 0) 0x7fdfe410ec10 con 0x7fdfcc068f60 2023-12-16T07:37:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdfcc068f60 msgr2=0x7fdfcc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdfcc068f60 0x7fdfcc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40f9a10 tx=0x7fdfd400b040 comp rx=0 tx=0).stop 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe4102c70 msgr2=0x7fdfe4113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe4102c70 0x7fdfe4113bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800b3b0 tx=0x7fdfd8009e30 comp rx=0 tx=0).stop 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 shutdown_connections 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fdfcc068f60 0x7fdfcc06b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe40fb1e0 0x7fdfe4113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 --2- 172.21.15.49:0/3823384548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfe4102c70 0x7fdfe4113bb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.856+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 >> 172.21.15.49:0/3823384548 conn(0x7fdfe40711a0 msgr2=0x7fdfe40fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.857+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 shutdown_connections 2023-12-16T07:37:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:37:58.857+0000 7fdfea011700 1 -- 172.21.15.49:0/3823384548 wait complete. 2023-12-16T07:37:58.858 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-16T07:37:59.221 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-12-16T07:37:57.199525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787508,"kb_used_data":3780,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683404,"statfs":{"total":575970213888,"available":574139805696,"internally_reserved":0,"allocated":3870720,"data_stored":2563350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001882"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-16T07:37:30.021017+0000","last_change":"2023-12-16T07:37:10.523189+0000","last_active":"2023-12-16T07:37:30.021017+0000","last_peered":"2023-12-16T07:37:30.021017+0000","last_clean":"2023-12-16T07:37:30.021017+0000","last_became_active":"2023-12-16T07:37:10.522722+0000","last_became_peered":"2023-12-16T07:37:10.522722+0000","last_unstale":"2023-12-16T07:37:30.021017+0000","last_undegraded":"2023-12-16T07:37:30.021017+0000","last_fullsized":"2023-12-16T07:37:30.021017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T07:36:35.759553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T07:36:35.759553+0000","last_clean_scrub_stamp":"2023-12-16T07:36:35.759553+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:08:12.038686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":4,"up_from":32,"seq":137438953485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":3,"up_from":25,"seq":107374182415,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 07:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Dec 16 07:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Dec 16 07:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 07:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Dec 16 07:37:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Dec 16 07:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 07:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Dec 16 07:37:37 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Dec 16 07:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T07:37:59.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-16T07:37:59.496 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 -- 172.21.15.49:0/819501207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c102c20 msgr2=0x7fa21c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 --2- 172.21.15.49:0/819501207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c102c20 0x7fa21c102ff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa20c004940 tx=0x7fa20c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 -- 172.21.15.49:0/819501207 shutdown_connections 2023-12-16T07:38:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 --2- 172.21.15.49:0/819501207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa21c065390 0x7fa21c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 --2- 172.21.15.49:0/819501207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c102c20 0x7fa21c102ff0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 -- 172.21.15.49:0/819501207 >> 172.21.15.49:0/819501207 conn(0x7fa21c0719b0 msgr2=0x7fa21c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:00.469 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 -- 172.21.15.49:0/819501207 shutdown_connections 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 -- 172.21.15.49:0/819501207 wait complete. 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 Processor -- start 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.467+0000 7fa22210e700 1 -- start start 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa22210e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c065390 0x7fa21c0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa22210e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa21c102c20 0x7fa21c0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa22210e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0fc730 con 0x7fa21c065390 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa22210e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0fc8a0 con 0x7fa21c102c20 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c065390 0x7fa21c0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c065390 0x7fa21c0fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50102/0 (socket says 172.21.15.49:50102) 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21b7fe700 1 -- 172.21.15.49:0/4291532185 learned_addr learned my addr 172.21.15.49:0/4291532185 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21affd700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa21c102c20 0x7fa21c0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21b7fe700 1 -- 172.21.15.49:0/4291532185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa21c102c20 msgr2=0x7fa21c0fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21b7fe700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa21c102c20 0x7fa21c0fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21b7fe700 1 -- 172.21.15.49:0/4291532185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c005040 con 0x7fa21c065390 2023-12-16T07:38:00.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21affd700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa21c102c20 0x7fa21c0fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:38:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa21b7fe700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c065390 0x7fa21c0fbbf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b3b0 tx=0x7fa20c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa203fff700 1 -- 172.21.15.49:0/4291532185 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa20c00e040 con 0x7fa21c065390 2023-12-16T07:38:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa203fff700 1 -- 172.21.15.49:0/4291532185 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa20c00bc50 con 0x7fa21c065390 2023-12-16T07:38:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c119910 con 0x7fa21c065390 2023-12-16T07:38:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa203fff700 1 -- 172.21.15.49:0/4291532185 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa20c013420 con 0x7fa21c065390 2023-12-16T07:38:00.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.468+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c119d70 con 0x7fa21c065390 2023-12-16T07:38:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.470+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c0fff40 con 0x7fa21c065390 2023-12-16T07:38:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.470+0000 7fa203fff700 1 -- 172.21.15.49:0/4291532185 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa20c01c430 con 0x7fa21c065390 2023-12-16T07:38:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.470+0000 7fa203fff700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa204068f60 0x7fa20406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.470+0000 7fa203fff700 1 -- 172.21.15.49:0/4291532185 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa20c087850 con 0x7fa21c065390 2023-12-16T07:38:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.470+0000 7fa21affd700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa204068f60 0x7fa20406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:00.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.471+0000 7fa21affd700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa204068f60 0x7fa20406b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa210009fd0 tx=0x7fa210009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:00.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.475+0000 7fa203fff700 1 -- 172.21.15.49:0/4291532185 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa20c054110 con 0x7fa21c065390 2023-12-16T07:38:00.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:00 smithi133 ceph-mon[120445]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T07:38:00.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:00 smithi133 ceph-mon[120445]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:00.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.663+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa21c0fd330 con 0x7fa204068f60 2023-12-16T07:38:00.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.664+0000 7fa203fff700 1 -- 172.21.15.49:0/4291532185 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24573 (secure 0 0 0) 0x7fa21c0fd330 con 0x7fa204068f60 2023-12-16T07:38:00.665 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa204068f60 msgr2=0x7fa20406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa204068f60 0x7fa20406b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa210009fd0 tx=0x7fa210009ee0 comp rx=0 tx=0).stop 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c065390 msgr2=0x7fa21c0fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c065390 0x7fa21c0fbbf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b3b0 tx=0x7fa20c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 shutdown_connections 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa204068f60 0x7fa20406b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa21c065390 0x7fa21c0fbbf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 --2- 172.21.15.49:0/4291532185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa21c102c20 0x7fa21c0fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:00.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 >> 172.21.15.49:0/4291532185 conn(0x7fa21c0719b0 msgr2=0x7fa21c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:00.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 shutdown_connections 2023-12-16T07:38:00.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:00.667+0000 7fa22210e700 1 -- 172.21.15.49:0/4291532185 wait complete. 2023-12-16T07:38:00.668 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2023-12-16T07:38:00.691 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:00 smithi049 ceph-mon[111939]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T07:38:00.691 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:00 smithi049 ceph-mon[111939]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:01.061 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-12-16T07:37:59.199880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787508,"kb_used_data":3780,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683404,"statfs":{"total":575970213888,"available":574139805696,"internally_reserved":0,"allocated":3870720,"data_stored":2563350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001907"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-16T07:37:30.021017+0000","last_change":"2023-12-16T07:37:10.523189+0000","last_active":"2023-12-16T07:37:30.021017+0000","last_peered":"2023-12-16T07:37:30.021017+0000","last_clean":"2023-12-16T07:37:30.021017+0000","last_became_active":"2023-12-16T07:37:10.522722+0000","last_became_peered":"2023-12-16T07:37:10.522722+0000","last_unstale":"2023-12-16T07:37:30.021017+0000","last_undegraded":"2023-12-16T07:37:30.021017+0000","last_fullsized":"2023-12-16T07:37:30.021017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T07:36:35.759553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T07:36:35.759553+0000","last_clean_scrub_stamp":"2023-12-16T07:36:35.759553+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:08:12.038686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":3,"up_from":25,"seq":107374182416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 07:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40899999999999997}]},{"osd":1,"last update":"Sat Dec 16 07:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Dec 16 07:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 07:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Dec 16 07:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27700000000000002}]},{"osd":3,"last update":"Sat Dec 16 07:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 07:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Dec 16 07:37:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Dec 16 07:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 07:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Dec 16 07:37:37 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Dec 16 07:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T07:38:01.062 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-16T07:38:01.062 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T07:38:01.063 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-16T07:38:01.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph health --format=json 2023-12-16T07:38:01.332 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:02.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 -- 172.21.15.49:0/3418433136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 msgr2=0x7ff18c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:02.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 --2- 172.21.15.49:0/3418433136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c101ed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff188004940 tx=0x7ff188009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 -- 172.21.15.49:0/3418433136 shutdown_connections 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 --2- 172.21.15.49:0/3418433136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c102410 0x7ff18c0fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 --2- 172.21.15.49:0/3418433136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c101ed0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 -- 172.21.15.49:0/3418433136 >> 172.21.15.49:0/3418433136 conn(0x7ff18c0711a0 msgr2=0x7ff18c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 -- 172.21.15.49:0/3418433136 shutdown_connections 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.282+0000 7ff193853700 1 -- 172.21.15.49:0/3418433136 wait complete. 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff193853700 1 Processor -- start 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff193853700 1 -- start start 2023-12-16T07:38:02.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff193853700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff193853700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c102410 0x7ff18c10ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff193853700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c10f230 con 0x7ff18c101b00 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff193853700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c10f370 con 0x7ff18c102410 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff1915ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff1915ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50116/0 (socket says 172.21.15.49:50116) 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff1915ef700 1 -- 172.21.15.49:0/2758439616 learned_addr learned my addr 172.21.15.49:0/2758439616 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff190dee700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c102410 0x7ff18c10ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff1915ef700 1 -- 172.21.15.49:0/2758439616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c102410 msgr2=0x7ff18c10ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff1915ef700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c102410 0x7ff18c10ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff1915ef700 1 -- 172.21.15.49:0/2758439616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff188005040 con 0x7ff18c101b00 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff190dee700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c102410 0x7ff18c10ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.283+0000 7ff1915ef700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c10e6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff188009380 tx=0x7ff188009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:02.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.284+0000 7ff17dffb700 1 -- 172.21.15.49:0/2758439616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18800e040 con 0x7ff18c101b00 2023-12-16T07:38:02.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.284+0000 7ff17dffb700 1 -- 172.21.15.49:0/2758439616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff18800bd20 con 0x7ff18c101b00 2023-12-16T07:38:02.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.284+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c117640 con 0x7ff18c101b00 2023-12-16T07:38:02.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.284+0000 7ff17dffb700 1 -- 172.21.15.49:0/2758439616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff188013660 con 0x7ff18c101b00 2023-12-16T07:38:02.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.284+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c117b80 con 0x7ff18c101b00 2023-12-16T07:38:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.285+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0fee60 con 0x7ff18c101b00 2023-12-16T07:38:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.285+0000 7ff17dffb700 1 -- 172.21.15.49:0/2758439616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff18801c970 con 0x7ff18c101b00 2023-12-16T07:38:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.286+0000 7ff17dffb700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff178068f60 0x7ff17806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.286+0000 7ff17dffb700 1 -- 172.21.15.49:0/2758439616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff188087890 con 0x7ff18c101b00 2023-12-16T07:38:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.286+0000 7ff190dee700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff178068f60 0x7ff17806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:02.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.286+0000 7ff190dee700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff178068f60 0x7ff17806b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff180006fd0 tx=0x7ff180008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:02.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.291+0000 7ff17dffb700 1 -- 172.21.15.49:0/2758439616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff188054140 con 0x7ff18c101b00 2023-12-16T07:38:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:02 smithi049 ceph-mon[111939]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T07:38:02.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:02 smithi049 ceph-mon[111939]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.533+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff18c072cc0 con 0x7ff18c101b00 2023-12-16T07:38:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.533+0000 7ff17dffb700 1 -- 172.21.15.49:0/2758439616 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff188057760 con 0x7ff18c101b00 2023-12-16T07:38:02.534 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:02.534 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T07:38:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff178068f60 msgr2=0x7ff17806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff178068f60 0x7ff17806b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff180006fd0 tx=0x7ff180008040 comp rx=0 tx=0).stop 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 msgr2=0x7ff18c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c10e6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff188009380 tx=0x7ff188009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 shutdown_connections 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ff178068f60 0x7ff17806b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff18c101b00 0x7ff18c10e6d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 --2- 172.21.15.49:0/2758439616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff18c102410 0x7ff18c10ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 >> 172.21.15.49:0/2758439616 conn(0x7ff18c0711a0 msgr2=0x7ff18c0fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 shutdown_connections 2023-12-16T07:38:02.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:02.536+0000 7ff193853700 1 -- 172.21.15.49:0/2758439616 wait complete. 2023-12-16T07:38:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:02 smithi133 ceph-mon[120445]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-16T07:38:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:02 smithi133 ceph-mon[120445]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:02.894 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-16T07:38:02.894 INFO:tasks.cephadm:Setup complete, yielding 2023-12-16T07:38:02.895 INFO:teuthology.run_tasks:Running task print... 2023-12-16T07:38:02.904 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-16T07:38:02.904 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T07:38:02.944 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:02.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-16T07:38:03.216 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:03.649 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:03 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2758439616' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T07:38:03.649 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:03 smithi049 ceph-mon[111939]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:03.649 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:03 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2758439616' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-16T07:38:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:03 smithi133 ceph-mon[120445]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:03 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2569603712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 msgr2=0x7fb1f00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2569603712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f00fd000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4004940 tx=0x7fb1e4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2569603712 shutdown_connections 2023-12-16T07:38:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2569603712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1f00fde00 0x7fb1f00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2569603712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f00fd000 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2569603712 >> 172.21.15.49:0/2569603712 conn(0x7fb1f00f82d0 msgr2=0x7fb1f00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:04.172 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2569603712 shutdown_connections 2023-12-16T07:38:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.171+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2569603712 wait complete. 2023-12-16T07:38:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f71cd700 1 Processor -- start 2023-12-16T07:38:04.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f71cd700 1 -- start start 2023-12-16T07:38:04.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f71cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:04.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f71cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1f00fde00 0x7fb1f006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f71cd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f0070590 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f71cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f0070700 con 0x7fb1f00fde00 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f4f69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f4f69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50132/0 (socket says 172.21.15.49:50132) 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f4f69700 1 -- 172.21.15.49:0/2498082145 learned_addr learned my addr 172.21.15.49:0/2498082145 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1effff700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1f00fde00 0x7fb1f006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f4f69700 1 -- 172.21.15.49:0/2498082145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1f00fde00 msgr2=0x7fb1f006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f4f69700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1f00fde00 0x7fb1f006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1f4f69700 1 -- 172.21.15.49:0/2498082145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4005040 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.172+0000 7fb1effff700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1f00fde00 0x7fb1f006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:38:04.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.173+0000 7fb1f4f69700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f0071b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4004f90 tx=0x7fb1e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.173+0000 7fb1ed7fa700 1 -- 172.21.15.49:0/2498082145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e400e040 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.173+0000 7fb1ed7fa700 1 -- 172.21.15.49:0/2498082145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1e400bcd0 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.173+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f0070980 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.173+0000 7fb1ed7fa700 1 -- 172.21.15.49:0/2498082145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e401c630 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.173+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f0115590 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.174+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f004bb80 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.174+0000 7fb1ed7fa700 1 -- 172.21.15.49:0/2498082145 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb1e4013960 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.175+0000 7fb1ed7fa700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb1e0068f60 0x7fb1e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:04.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.175+0000 7fb1ed7fa700 1 -- 172.21.15.49:0/2498082145 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb1e4087ef0 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.175+0000 7fb1effff700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb1e0068f60 0x7fb1e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:04.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.175+0000 7fb1effff700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb1e0068f60 0x7fb1e006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009fd0 tx=0x7fb1dc009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:04.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.179+0000 7fb1ed7fa700 1 -- 172.21.15.49:0/2498082145 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb1e4058190 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.375 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.375+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fb1f0105590 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.379 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.379+0000 7fb1ed7fa700 1 -- 172.21.15.49:0/2498082145 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fb1e4057d20 con 0x7fb1f00fcbf0 2023-12-16T07:38:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb1e0068f60 msgr2=0x7fb1e006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb1e0068f60 0x7fb1e006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009fd0 tx=0x7fb1dc009ee0 comp rx=0 tx=0).stop 2023-12-16T07:38:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 msgr2=0x7fb1f0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f0071b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4004f90 tx=0x7fb1e4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 shutdown_connections 2023-12-16T07:38:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb1e0068f60 0x7fb1e006b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1f00fcbf0 0x7fb1f0071b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:04.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 --2- 172.21.15.49:0/2498082145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1f00fde00 0x7fb1f006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:04.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.381+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 >> 172.21.15.49:0/2498082145 conn(0x7fb1f00f82d0 msgr2=0x7fb1f0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:04.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.382+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 shutdown_connections 2023-12-16T07:38:04.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:04.382+0000 7fb1f71cd700 1 -- 172.21.15.49:0/2498082145 wait complete. 2023-12-16T07:38:04.769 INFO:teuthology.run_tasks:Running task print... 2023-12-16T07:38:04.778 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-16T07:38:04.779 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T07:38:04.802 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:04.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph orch status' 2023-12-16T07:38:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:05.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:05 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2498082145' entity='client.admin' 2023-12-16T07:38:05.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:05.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:05.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:05.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:05 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2498082145' entity='client.admin' 2023-12-16T07:38:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:05.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:05.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:05.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 -- 172.21.15.49:0/1602979342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440faed0 msgr2=0x7f12440fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 --2- 172.21.15.49:0/1602979342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440faed0 0x7f12440fb2e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1240004940 tx=0x7f1240009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 -- 172.21.15.49:0/1602979342 shutdown_connections 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 --2- 172.21.15.49:0/1602979342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12440fdf60 0x7f12440fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 --2- 172.21.15.49:0/1602979342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440faed0 0x7f12440fb2e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 -- 172.21.15.49:0/1602979342 >> 172.21.15.49:0/1602979342 conn(0x7f12440f6950 msgr2=0x7f12440f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 -- 172.21.15.49:0/1602979342 shutdown_connections 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 -- 172.21.15.49:0/1602979342 wait complete. 2023-12-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.096+0000 7f124bddd700 1 Processor -- start 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f124bddd700 1 -- start start 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f124bddd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12440faed0 0x7f12440fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f124bddd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440fdf60 0x7f12440fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f124bddd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440fc470 con 0x7f12440fdf60 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f124bddd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440fc5e0 con 0x7f12440faed0 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249378700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440fdf60 0x7f12440fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249378700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440fdf60 0x7f12440fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50142/0 (socket says 172.21.15.49:50142) 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249378700 1 -- 172.21.15.49:0/3592056634 learned_addr learned my addr 172.21.15.49:0/3592056634 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249b79700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12440faed0 0x7f12440fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249378700 1 -- 172.21.15.49:0/3592056634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12440faed0 msgr2=0x7f12440fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249378700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12440faed0 0x7f12440fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249378700 1 -- 172.21.15.49:0/3592056634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240005040 con 0x7f12440fdf60 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f1249378700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440fdf60 0x7f12440fbe70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1234002a50 tx=0x7f12340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f123a7fc700 1 -- 172.21.15.49:0/3592056634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1234007cc0 con 0x7f12440fdf60 2023-12-16T07:38:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f123a7fc700 1 -- 172.21.15.49:0/3592056634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f123400f040 con 0x7f12440fdf60 2023-12-16T07:38:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f123a7fc700 1 -- 172.21.15.49:0/3592056634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123400d9c0 con 0x7f12440fdf60 2023-12-16T07:38:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.097+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12440fc8c0 con 0x7f12440fdf60 2023-12-16T07:38:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.098+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1244115610 con 0x7f12440fdf60 2023-12-16T07:38:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.098+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12441075f0 con 0x7f12440fdf60 2023-12-16T07:38:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.099+0000 7f123a7fc700 1 -- 172.21.15.49:0/3592056634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f123400db20 con 0x7f12440fdf60 2023-12-16T07:38:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.099+0000 7f123a7fc700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1230069030 0x7f123006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.099+0000 7f123a7fc700 1 -- 172.21.15.49:0/3592056634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1234086740 con 0x7f12440fdf60 2023-12-16T07:38:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.099+0000 7f1249b79700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1230069030 0x7f123006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.100+0000 7f1249b79700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1230069030 0x7f123006b4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1240004890 tx=0x7f1240009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.104+0000 7f123a7fc700 1 -- 172.21.15.49:0/3592056634 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1234056940 con 0x7f12440fdf60 2023-12-16T07:38:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.315+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f124402b1f0 con 0x7f1230069030 2023-12-16T07:38:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.316+0000 7f123a7fc700 1 -- 172.21.15.49:0/3592056634 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f124402b1f0 con 0x7f1230069030 2023-12-16T07:38:06.316 INFO:teuthology.orchestra.run.smithi049.stdout:Backend: cephadm 2023-12-16T07:38:06.316 INFO:teuthology.orchestra.run.smithi049.stdout:Available: Yes 2023-12-16T07:38:06.316 INFO:teuthology.orchestra.run.smithi049.stdout:Paused: No 2023-12-16T07:38:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1230069030 msgr2=0x7f123006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1230069030 0x7f123006b4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1240004890 tx=0x7f1240009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440fdf60 msgr2=0x7f12440fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440fdf60 0x7f12440fbe70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1234002a50 tx=0x7f12340046b0 comp rx=0 tx=0).stop 2023-12-16T07:38:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 shutdown_connections 2023-12-16T07:38:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1230069030 0x7f123006b4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12440faed0 0x7f12440fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 --2- 172.21.15.49:0/3592056634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12440fdf60 0x7f12440fbe70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 >> 172.21.15.49:0/3592056634 conn(0x7f12440f6950 msgr2=0x7f12440f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 shutdown_connections 2023-12-16T07:38:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:06.318+0000 7f124bddd700 1 -- 172.21.15.49:0/3592056634 wait complete. 2023-12-16T07:38:06.610 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:06 smithi049 ceph-mon[111939]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:06.686 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-16T07:38:06.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:06 smithi133 ceph-mon[120445]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:07.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:07 smithi049 ceph-mon[111939]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:07.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:07 smithi133 ceph-mon[120445]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 -- 172.21.15.49:0/17922862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fcbf0 msgr2=0x7feff00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 --2- 172.21.15.49:0/17922862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fcbf0 0x7feff00fd000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fefe0004940 tx=0x7fefe0009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 -- 172.21.15.49:0/17922862 shutdown_connections 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 --2- 172.21.15.49:0/17922862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feff00fde00 0x7feff00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 --2- 172.21.15.49:0/17922862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fcbf0 0x7feff00fd000 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 -- 172.21.15.49:0/17922862 >> 172.21.15.49:0/17922862 conn(0x7feff00f82d0 msgr2=0x7feff00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 -- 172.21.15.49:0/17922862 shutdown_connections 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.892+0000 7feff8181700 1 -- 172.21.15.49:0/17922862 wait complete. 2023-12-16T07:38:07.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff8181700 1 Processor -- start 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff8181700 1 -- start start 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff8181700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feff00fcbf0 0x7feff0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff8181700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fde00 0x7feff006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff8181700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff0070590 con 0x7feff00fde00 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff8181700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff0070700 con 0x7feff00fcbf0 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff571c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fde00 0x7feff006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff571c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fde00 0x7feff006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43724/0 (socket says 172.21.15.49:43724) 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff571c700 1 -- 172.21.15.49:0/2395988785 learned_addr learned my addr 172.21.15.49:0/2395988785 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff5f1d700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feff00fcbf0 0x7feff0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff571c700 1 -- 172.21.15.49:0/2395988785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feff00fcbf0 msgr2=0x7feff0071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff571c700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feff00fcbf0 0x7feff0071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:07.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff571c700 1 -- 172.21.15.49:0/2395988785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0005040 con 0x7feff00fde00 2023-12-16T07:38:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff5f1d700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feff00fcbf0 0x7feff0071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:38:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7feff571c700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fde00 0x7feff006ff90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefec00eb40 tx=0x7fefec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.893+0000 7fefe67fc700 1 -- 172.21.15.49:0/2395988785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefec007cc0 con 0x7feff00fde00 2023-12-16T07:38:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.894+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff0070980 con 0x7feff00fde00 2023-12-16T07:38:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.894+0000 7fefe67fc700 1 -- 172.21.15.49:0/2395988785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fefec00f040 con 0x7feff00fde00 2023-12-16T07:38:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.894+0000 7fefe67fc700 1 -- 172.21.15.49:0/2395988785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefec009570 con 0x7feff00fde00 2023-12-16T07:38:07.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.894+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff0115500 con 0x7feff00fde00 2023-12-16T07:38:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.895+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff004bb80 con 0x7feff00fde00 2023-12-16T07:38:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.895+0000 7fefe67fc700 1 -- 172.21.15.49:0/2395988785 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fefec0096d0 con 0x7feff00fde00 2023-12-16T07:38:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.895+0000 7fefe67fc700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fefdc068f60 0x7fefdc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.896+0000 7fefe67fc700 1 -- 172.21.15.49:0/2395988785 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fefec0866f0 con 0x7feff00fde00 2023-12-16T07:38:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.896+0000 7feff5f1d700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fefdc068f60 0x7fefdc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:07.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.896+0000 7feff5f1d700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fefdc068f60 0x7fefdc06b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fefe000b0d0 tx=0x7fefe0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:07.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:07.900+0000 7fefe67fc700 1 -- 172.21.15.49:0/2395988785 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fefec04da00 con 0x7feff00fde00 2023-12-16T07:38:08.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.105+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feff0102750 con 0x7fefdc068f60 2023-12-16T07:38:08.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.113+0000 7fefe67fc700 1 -- 172.21.15.49:0/2395988785 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7feff0102750 con 0x7fefdc068f60 2023-12-16T07:38:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:38:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (2m) 96s ago 3m 27.0M - 0.25.0 c8568f914cd2 ac0238c966a8 2023-12-16T07:38:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (3m) 96s ago 3m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:38:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (2m) 44s ago 2m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:38:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (2m) 96s ago 3m 79.4M - 9.4.7 954c08fa6188 f8fc00abbcaf 2023-12-16T07:38:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:9283 running (4m) 96s ago 4m 484M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ecfbb356bee1 2023-12-16T07:38:08.114 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283 running (2m) 44s ago 2m 438M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 29adbb1c71a5 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (4m) 96s ago 4m 58.0M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (2m) 44s ago 2m 50.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (3m) 96s ago 3m 15.6M - 1.5.0 0da6a335fe13 82ed4cc88c41 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (2m) 44s ago 2m 18.6M - 1.5.0 0da6a335fe13 ecd5d6b45738 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (2m) 96s ago 2m 40.7M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (119s) 96s ago 119s 40.7M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (100s) 96s ago 100s 11.5M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (82s) 44s ago 82s 45.3M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (63s) 44s ago 63s 39.9M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (46s) 44s ago 45s 11.4M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:38:08.115 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (2m) 96s ago 3m 37.6M - 2.43.0 a07b618ecd1d d2e8b8e4a383 2023-12-16T07:38:08.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fefdc068f60 msgr2=0x7fefdc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:08.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fefdc068f60 0x7fefdc06b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fefe000b0d0 tx=0x7fefe0009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:08.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fde00 msgr2=0x7feff006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fde00 0x7feff006ff90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefec00eb40 tx=0x7fefec00b040 comp rx=0 tx=0).stop 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 shutdown_connections 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fefdc068f60 0x7fefdc06b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feff00fcbf0 0x7feff0071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 --2- 172.21.15.49:0/2395988785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff00fde00 0x7feff006ff90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 >> 172.21.15.49:0/2395988785 conn(0x7feff00f82d0 msgr2=0x7feff0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 shutdown_connections 2023-12-16T07:38:08.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:08.115+0000 7feff8181700 1 -- 172.21.15.49:0/2395988785 wait complete. 2023-12-16T07:38:08.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-16T07:38:08.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:08 smithi133 ceph-mon[120445]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:08.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:08 smithi049 ceph-mon[111939]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:08.747 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:09.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:09 smithi049 ceph-mon[111939]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:09.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 -- 172.21.15.49:0/4184735399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 msgr2=0x7f68340ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 --2- 172.21.15.49:0/4184735399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f68340ff210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6830004940 tx=0x7f6830009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 -- 172.21.15.49:0/4184735399 shutdown_connections 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 --2- 172.21.15.49:0/4184735399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68340fff70 0x7f68341003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 --2- 172.21.15.49:0/4184735399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f68340ff210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 -- 172.21.15.49:0/4184735399 >> 172.21.15.49:0/4184735399 conn(0x7f68340fa5d0 msgr2=0x7f68340fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 -- 172.21.15.49:0/4184735399 shutdown_connections 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 -- 172.21.15.49:0/4184735399 wait complete. 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 Processor -- start 2023-12-16T07:38:09.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.720+0000 7f683c12e700 1 -- start start 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f683c12e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f683410f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f683c12e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68340fff70 0x7f683410fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f683c12e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68341102f0 con 0x7f68340fee00 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f683c12e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834110b90 con 0x7f68340fff70 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f6839eca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f683410f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f6839eca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f683410f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43742/0 (socket says 172.21.15.49:43742) 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f6839eca700 1 -- 172.21.15.49:0/896603107 learned_addr learned my addr 172.21.15.49:0/896603107 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f68396c9700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68340fff70 0x7f683410fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f6839eca700 1 -- 172.21.15.49:0/896603107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68340fff70 msgr2=0x7f683410fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f6839eca700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68340fff70 0x7f683410fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f6839eca700 1 -- 172.21.15.49:0/896603107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830005040 con 0x7f68340fee00 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f6839eca700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f683410f7b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f683000b3b0 tx=0x7f6830009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:09.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f682a7fc700 1 -- 172.21.15.49:0/896603107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683000e040 con 0x7f68340fee00 2023-12-16T07:38:09.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6834110e10 con 0x7f68340fee00 2023-12-16T07:38:09.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f682a7fc700 1 -- 172.21.15.49:0/896603107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f683000bc50 con 0x7f68340fee00 2023-12-16T07:38:09.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f682a7fc700 1 -- 172.21.15.49:0/896603107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6830013660 con 0x7f68340fee00 2023-12-16T07:38:09.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.721+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6834111350 con 0x7f68340fee00 2023-12-16T07:38:09.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.722+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68341097f0 con 0x7f68340fee00 2023-12-16T07:38:09.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.723+0000 7f682a7fc700 1 -- 172.21.15.49:0/896603107 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f68300138d0 con 0x7f68340fee00 2023-12-16T07:38:09.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.724+0000 7f682a7fc700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6820068f60 0x7f682006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:09.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.724+0000 7f68396c9700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6820068f60 0x7f682006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:09.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.724+0000 7f682a7fc700 1 -- 172.21.15.49:0/896603107 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f683001ce40 con 0x7f68340fee00 2023-12-16T07:38:09.725 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.724+0000 7f68396c9700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6820068f60 0x7f682006b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6824004990 tx=0x7f6824009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:09.728 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.728+0000 7f682a7fc700 1 -- 172.21.15.49:0/896603107 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6830058240 con 0x7f68340fee00 2023-12-16T07:38:09.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:09 smithi133 ceph-mon[120445]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:09.934 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.934+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f683402b1f0 con 0x7f6820068f60 2023-12-16T07:38:09.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.938+0000 7f682a7fc700 1 -- 172.21.15.49:0/896603107 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f683402b1f0 con 0x7f6820068f60 2023-12-16T07:38:09.938 INFO:teuthology.orchestra.run.smithi049.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-16T07:38:09.938 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager ?:9093,9094 1/1 98s ago 4m count:1 2023-12-16T07:38:09.939 INFO:teuthology.orchestra.run.smithi049.stdout:crash 2/2 98s ago 4m * 2023-12-16T07:38:09.939 INFO:teuthology.orchestra.run.smithi049.stdout:grafana ?:3000 1/1 98s ago 4m count:1 2023-12-16T07:38:09.939 INFO:teuthology.orchestra.run.smithi049.stdout:mgr 2/2 98s ago 4m count:2 2023-12-16T07:38:09.939 INFO:teuthology.orchestra.run.smithi049.stdout:mon 2/2 98s ago 3m smithi049:172.21.15.49=smithi049;smithi133:172.21.15.133=smithi133;count:2 2023-12-16T07:38:09.939 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter ?:9100 2/2 98s ago 4m * 2023-12-16T07:38:09.939 INFO:teuthology.orchestra.run.smithi049.stdout:osd 6 98s ago - 2023-12-16T07:38:09.939 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus ?:9095 1/1 98s ago 4m count:1 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6820068f60 msgr2=0x7f682006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6820068f60 0x7f682006b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6824004990 tx=0x7f6824009ee0 comp rx=0 tx=0).stop 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 msgr2=0x7f683410f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f683410f7b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f683000b3b0 tx=0x7f6830009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 shutdown_connections 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6820068f60 0x7f682006b410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68340fee00 0x7f683410f7b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 --2- 172.21.15.49:0/896603107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68340fff70 0x7f683410fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:09.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 >> 172.21.15.49:0/896603107 conn(0x7f68340fa5d0 msgr2=0x7f68340fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.940+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 shutdown_connections 2023-12-16T07:38:09.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:09.941+0000 7f683c12e700 1 -- 172.21.15.49:0/896603107 wait complete. 2023-12-16T07:38:10.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-16T07:38:10.589 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:10.687 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:10 smithi049 ceph-mon[111939]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:10.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:10 smithi133 ceph-mon[120445]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:11 smithi049 ceph-mon[111939]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:11.702 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.700+0000 7f153031e700 1 -- 172.21.15.49:0/4146331006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fcd00 msgr2=0x7f15280fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.700+0000 7f153031e700 1 --2- 172.21.15.49:0/4146331006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fcd00 0x7f15280fd150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f151c004940 tx=0x7f151c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 -- 172.21.15.49:0/4146331006 shutdown_connections 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 --2- 172.21.15.49:0/4146331006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fcd00 0x7f15280fd150 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 --2- 172.21.15.49:0/4146331006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15280fbaf0 0x7f15280fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 -- 172.21.15.49:0/4146331006 >> 172.21.15.49:0/4146331006 conn(0x7f15280f7190 msgr2=0x7f15280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 -- 172.21.15.49:0/4146331006 shutdown_connections 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 -- 172.21.15.49:0/4146331006 wait complete. 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 Processor -- start 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 -- start start 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fbaf0 0x7f152810c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15280fcd00 0x7f152810c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:11.703 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152810d040 con 0x7f15280fbaf0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f153031e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152810d880 con 0x7f15280fcd00 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f152e0ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fbaf0 0x7f152810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f152e0ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fbaf0 0x7f152810c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43754/0 (socket says 172.21.15.49:43754) 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.701+0000 7f152e0ba700 1 -- 172.21.15.49:0/3492240272 learned_addr learned my addr 172.21.15.49:0/3492240272 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f152d8b9700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15280fcd00 0x7f152810c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f152e0ba700 1 -- 172.21.15.49:0/3492240272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15280fcd00 msgr2=0x7f152810c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f152e0ba700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15280fcd00 0x7f152810c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f152e0ba700 1 -- 172.21.15.49:0/3492240272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c005040 con 0x7f15280fbaf0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f152e0ba700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fbaf0 0x7f152810c470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f152400b790 tx=0x7f1524009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f151affd700 1 -- 172.21.15.49:0/3492240272 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152400f6f0 con 0x7f15280fbaf0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f151affd700 1 -- 172.21.15.49:0/3492240272 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f152400fd00 con 0x7f15280fbaf0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f151affd700 1 -- 172.21.15.49:0/3492240272 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1524011e90 con 0x7f15280fbaf0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152810db60 con 0x7f15280fbaf0 2023-12-16T07:38:11.704 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.702+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152810e0a0 con 0x7f15280fbaf0 2023-12-16T07:38:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.703+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152804bb80 con 0x7f15280fbaf0 2023-12-16T07:38:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.704+0000 7f151affd700 1 -- 172.21.15.49:0/3492240272 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f152400f850 con 0x7f15280fbaf0 2023-12-16T07:38:11.705 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.704+0000 7f151affd700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1514068f60 0x7f151406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.704+0000 7f151affd700 1 -- 172.21.15.49:0/3492240272 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f15240867c0 con 0x7f15280fbaf0 2023-12-16T07:38:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.704+0000 7f152d8b9700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1514068f60 0x7f151406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:11.706 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.705+0000 7f152d8b9700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1514068f60 0x7f151406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f151c00b3b0 tx=0x7f151c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:11.709 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.709+0000 7f151affd700 1 -- 172.21.15.49:0/3492240272 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1524056b00 con 0x7f15280fbaf0 2023-12-16T07:38:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:11 smithi133 ceph-mon[120445]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.909+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f152810e520 con 0x7f1514068f60 2023-12-16T07:38:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.910+0000 7f151affd700 1 -- 172.21.15.49:0/3492240272 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f152810e520 con 0x7f1514068f60 2023-12-16T07:38:11.910 INFO:teuthology.orchestra.run.smithi049.stdout:HOST ADDR LABELS STATUS 2023-12-16T07:38:11.911 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 172.21.15.49 2023-12-16T07:38:11.911 INFO:teuthology.orchestra.run.smithi049.stdout:smithi133 172.21.15.133 2023-12-16T07:38:11.911 INFO:teuthology.orchestra.run.smithi049.stdout:2 hosts in cluster 2023-12-16T07:38:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1514068f60 msgr2=0x7f151406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1514068f60 0x7f151406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f151c00b3b0 tx=0x7f151c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fbaf0 msgr2=0x7f152810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fbaf0 0x7f152810c470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f152400b790 tx=0x7f1524009220 comp rx=0 tx=0).stop 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 shutdown_connections 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1514068f60 0x7f151406b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15280fbaf0 0x7f152810c470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 --2- 172.21.15.49:0/3492240272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15280fcd00 0x7f152810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 >> 172.21.15.49:0/3492240272 conn(0x7f15280f7190 msgr2=0x7f15280fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 shutdown_connections 2023-12-16T07:38:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:11.912+0000 7f153031e700 1 -- 172.21.15.49:0/3492240272 wait complete. 2023-12-16T07:38:12.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-16T07:38:12.556 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:12.646 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:12 smithi049 ceph-mon[111939]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:12 smithi133 ceph-mon[120445]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 -- 172.21.15.49:0/1225034193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fbb00 msgr2=0x7fecc40fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 --2- 172.21.15.49:0/1225034193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fbb00 0x7fecc40fbf10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fecb4004940 tx=0x7fecb4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 -- 172.21.15.49:0/1225034193 shutdown_connections 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 --2- 172.21.15.49:0/1225034193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecc40fcd10 0x7fecc40fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 --2- 172.21.15.49:0/1225034193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fbb00 0x7fecc40fbf10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 -- 172.21.15.49:0/1225034193 >> 172.21.15.49:0/1225034193 conn(0x7fecc40f71c0 msgr2=0x7fecc40f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 -- 172.21.15.49:0/1225034193 shutdown_connections 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 -- 172.21.15.49:0/1225034193 wait complete. 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.467+0000 7fecca7f9700 1 Processor -- start 2023-12-16T07:38:13.468 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecca7f9700 1 -- start start 2023-12-16T07:38:13.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecca7f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecc40fbb00 0x7fecc410c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:13.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecca7f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fcd10 0x7fecc410c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:13.470 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecca7f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc410cf20 con 0x7fecc40fcd10 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecca7f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc410d7c0 con 0x7fecc40fbb00 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fcd10 0x7fecc410c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fcd10 0x7fecc410c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43768/0 (socket says 172.21.15.49:43768) 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc37fe700 1 -- 172.21.15.49:0/3367395212 learned_addr learned my addr 172.21.15.49:0/3367395212 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc3fff700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecc40fbb00 0x7fecc410c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc37fe700 1 -- 172.21.15.49:0/3367395212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecc40fbb00 msgr2=0x7fecc410c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc37fe700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecc40fbb00 0x7fecc410c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc37fe700 1 -- 172.21.15.49:0/3367395212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4005040 con 0x7fecc40fcd10 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.468+0000 7fecc3fff700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecc40fbb00 0x7fecc410c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.469+0000 7fecc37fe700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fcd10 0x7fecc410c920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fecb800eb40 tx=0x7fecb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.469+0000 7fecc0ff9700 1 -- 172.21.15.49:0/3367395212 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb8007cc0 con 0x7fecc40fcd10 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.469+0000 7fecc0ff9700 1 -- 172.21.15.49:0/3367395212 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fecb800f040 con 0x7fecc40fcd10 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.469+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc410da40 con 0x7fecc40fcd10 2023-12-16T07:38:13.471 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.469+0000 7fecc0ff9700 1 -- 172.21.15.49:0/3367395212 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb8009570 con 0x7fecc40fcd10 2023-12-16T07:38:13.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.469+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc410df80 con 0x7fecc40fcd10 2023-12-16T07:38:13.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.470+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc404bb80 con 0x7fecc40fcd10 2023-12-16T07:38:13.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.471+0000 7fecc0ff9700 1 -- 172.21.15.49:0/3367395212 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fecb80096d0 con 0x7fecc40fcd10 2023-12-16T07:38:13.472 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.471+0000 7fecc0ff9700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fecac068f60 0x7fecac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:13.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.471+0000 7fecc0ff9700 1 -- 172.21.15.49:0/3367395212 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fecb80868f0 con 0x7fecc40fcd10 2023-12-16T07:38:13.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.471+0000 7fecc3fff700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fecac068f60 0x7fecac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:13.473 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.472+0000 7fecc3fff700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fecac068f60 0x7fecac06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fecb4000c00 tx=0x7fecb4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:13.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.475+0000 7fecc0ff9700 1 -- 172.21.15.49:0/3367395212 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fecb8056c40 con 0x7fecc40fcd10 2023-12-16T07:38:13.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.680+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fecc410e450 con 0x7fecac068f60 2023-12-16T07:38:13.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.682+0000 7fecc0ff9700 1 -- 172.21.15.49:0/3367395212 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fecc410e450 con 0x7fecac068f60 2023-12-16T07:38:13.682 INFO:teuthology.orchestra.run.smithi049.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-16T07:38:13.682 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500D2480DGN 447G No 99s ago Has a FileSystem, LVM detected 2023-12-16T07:38:13.682 INFO:teuthology.orchestra.run.smithi049.stdout:smithi133 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN 372G No 46s ago Has a FileSystem, LVM detected 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fecac068f60 msgr2=0x7fecac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fecac068f60 0x7fecac06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fecb4000c00 tx=0x7fecb4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fcd10 msgr2=0x7fecc410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fcd10 0x7fecc410c920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fecb800eb40 tx=0x7fecb800b040 comp rx=0 tx=0).stop 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 shutdown_connections 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fecac068f60 0x7fecac06b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecc40fbb00 0x7fecc410c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 --2- 172.21.15.49:0/3367395212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fecc40fcd10 0x7fecc410c920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 >> 172.21.15.49:0/3367395212 conn(0x7fecc40f71c0 msgr2=0x7fecc40fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 shutdown_connections 2023-12-16T07:38:13.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:13.684+0000 7fecca7f9700 1 -- 172.21.15.49:0/3367395212 wait complete. 2023-12-16T07:38:13.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:13 smithi049 ceph-mon[111939]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:13 smithi133 ceph-mon[120445]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:14.014 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T07:38:14.026 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:14.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-16T07:38:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:14.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:14 smithi049 ceph-mon[111939]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:14 smithi133 ceph-mon[120445]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.277+0000 7f777cab2700 1 -- 172.21.15.49:0/1496503134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fcd00 msgr2=0x7f77780fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.277+0000 7f777cab2700 1 --2- 172.21.15.49:0/1496503134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fcd00 0x7f77780fd150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f776c004940 tx=0x7f776c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 -- 172.21.15.49:0/1496503134 shutdown_connections 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 --2- 172.21.15.49:0/1496503134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fcd00 0x7f77780fd150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 --2- 172.21.15.49:0/1496503134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77780fbaf0 0x7f77780fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 -- 172.21.15.49:0/1496503134 >> 172.21.15.49:0/1496503134 conn(0x7f77780f7190 msgr2=0x7f77780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 -- 172.21.15.49:0/1496503134 shutdown_connections 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 -- 172.21.15.49:0/1496503134 wait complete. 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 Processor -- start 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 -- start start 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fbaf0 0x7f777810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77780fcd00 0x7f777810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777810e130 con 0x7f77780fbaf0 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777cab2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777810e970 con 0x7f77780fcd00 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fbaf0 0x7f777810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fbaf0 0x7f777810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43780/0 (socket says 172.21.15.49:43780) 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.278+0000 7f777659c700 1 -- 172.21.15.49:0/3001896850 learned_addr learned my addr 172.21.15.49:0/3001896850 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f7775d9b700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77780fcd00 0x7f777810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f777659c700 1 -- 172.21.15.49:0/3001896850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77780fcd00 msgr2=0x7f777810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f777659c700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77780fcd00 0x7f777810daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f777659c700 1 -- 172.21.15.49:0/3001896850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c005040 con 0x7f77780fbaf0 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f777659c700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fbaf0 0x7f777810d560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f776800b790 tx=0x7f7768009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f7766ffd700 1 -- 172.21.15.49:0/3001896850 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776800f6f0 con 0x7f77780fbaf0 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f7766ffd700 1 -- 172.21.15.49:0/3001896850 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f776800fd00 con 0x7f77780fbaf0 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777810ec50 con 0x7f77780fbaf0 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f7766ffd700 1 -- 172.21.15.49:0/3001896850 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77680103a0 con 0x7f77780fbaf0 2023-12-16T07:38:15.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.279+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777810f190 con 0x7f77780fbaf0 2023-12-16T07:38:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.280+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777804bb80 con 0x7f77780fbaf0 2023-12-16T07:38:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.281+0000 7f7766ffd700 1 -- 172.21.15.49:0/3001896850 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f776800f850 con 0x7f77780fbaf0 2023-12-16T07:38:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.281+0000 7f7766ffd700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7760068f60 0x7f776006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.281+0000 7f7766ffd700 1 -- 172.21.15.49:0/3001896850 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f77680867e0 con 0x7f77780fbaf0 2023-12-16T07:38:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.281+0000 7f7775d9b700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7760068f60 0x7f776006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.281+0000 7f7775d9b700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7760068f60 0x7f776006b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f776c00b3b0 tx=0x7f776c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.285+0000 7f7766ffd700 1 -- 172.21.15.49:0/3001896850 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7768056a80 con 0x7f77780fbaf0 2023-12-16T07:38:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:15.509+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f777810f690 con 0x7f7760068f60 2023-12-16T07:38:15.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:15 smithi049 ceph-mon[111939]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:15 smithi133 ceph-mon[120445]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:16.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:16 smithi049 ceph-mon[111939]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:16.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:16 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T07:38:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:16 smithi133 ceph-mon[120445]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:16 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-16T07:38:17.475 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.474+0000 7f7766ffd700 1 -- 172.21.15.49:0/3001896850 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f777810f690 con 0x7f7760068f60 2023-12-16T07:38:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7760068f60 msgr2=0x7f776006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7760068f60 0x7f776006b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f776c00b3b0 tx=0x7f776c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fbaf0 msgr2=0x7f777810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fbaf0 0x7f777810d560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f776800b790 tx=0x7f7768009220 comp rx=0 tx=0).stop 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 shutdown_connections 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f7760068f60 0x7f776006b410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77780fbaf0 0x7f777810d560 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 --2- 172.21.15.49:0/3001896850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77780fcd00 0x7f777810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 >> 172.21.15.49:0/3001896850 conn(0x7f77780f7190 msgr2=0x7f7778065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 shutdown_connections 2023-12-16T07:38:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:17.477+0000 7f777cab2700 1 -- 172.21.15.49:0/3001896850 wait complete. 2023-12-16T07:38:17.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:17 smithi049 ceph-mon[111939]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:17.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T07:38:17.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:17 smithi049 ceph-mon[111939]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T07:38:17.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:17 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T07:38:17.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:17 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[111916]: 2023-12-16T07:38:17.448+0000 7f41811f5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T07:38:17.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T07:38:17.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:17 smithi133 ceph-mon[120445]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:17.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:17 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-16T07:38:17.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:17 smithi133 ceph-mon[120445]: osdmap e39: 6 total, 6 up, 6 in 2023-12-16T07:38:17.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:17 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-16T07:38:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:18.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: pgmap v124: 33 pgs: 13 creating+peering, 1 active+clean, 19 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:18.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-16T07:38:18.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T07:38:18.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T07:38:18.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T07:38:18.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T07:38:18.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: fsmap cephfs:0 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: Saving service mds.cephfs spec with placement count:4 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ekquzl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:18.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ekquzl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:18.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:18.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:18.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: pgmap v124: 33 pgs: 13 creating+peering, 1 active+clean, 19 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-16T07:38:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-16T07:38:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: osdmap e40: 6 total, 6 up, 6 in 2023-12-16T07:38:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-16T07:38:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: osdmap e41: 6 total, 6 up, 6 in 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: fsmap cephfs:0 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: Saving service mds.cephfs spec with placement count:4 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ekquzl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ekquzl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:18.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:18.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 -- 172.21.15.49:0/3356485250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 msgr2=0x7fb8240fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 --2- 172.21.15.49:0/3356485250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fd150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb818004940 tx=0x7fb818009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 -- 172.21.15.49:0/3356485250 shutdown_connections 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 --2- 172.21.15.49:0/3356485250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fd150 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 --2- 172.21.15.49:0/3356485250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240fbaf0 0x7fb8240fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 -- 172.21.15.49:0/3356485250 >> 172.21.15.49:0/3356485250 conn(0x7fb8240f7190 msgr2=0x7fb8240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 -- 172.21.15.49:0/3356485250 shutdown_connections 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.534+0000 7fb829704700 1 -- 172.21.15.49:0/3356485250 wait complete. 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb829704700 1 Processor -- start 2023-12-16T07:38:19.535 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb829704700 1 -- start start 2023-12-16T07:38:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb829704700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240fbaf0 0x7fb8240ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb829704700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb829704700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240fe640 con 0x7fb8240fcd00 2023-12-16T07:38:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb829704700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240fe7b0 con 0x7fb8240fbaf0 2023-12-16T07:38:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb8227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb8227fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36444/0 (socket says 172.21.15.49:36444) 2023-12-16T07:38:19.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb8227fc700 1 -- 172.21.15.49:0/982405291 learned_addr learned my addr 172.21.15.49:0/982405291 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb822ffd700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240fbaf0 0x7fb8240ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb8227fc700 1 -- 172.21.15.49:0/982405291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240fbaf0 msgr2=0x7fb8240ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb8227fc700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240fbaf0 0x7fb8240ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.535+0000 7fb8227fc700 1 -- 172.21.15.49:0/982405291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818005040 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.536+0000 7fb8227fc700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fe040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb818000c00 tx=0x7fb818009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.536+0000 7fb80b7fe700 1 -- 172.21.15.49:0/982405291 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb818021070 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.536+0000 7fb80b7fe700 1 -- 172.21.15.49:0/982405291 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb81801c400 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.536+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240fea30 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.536+0000 7fb80b7fe700 1 -- 172.21.15.49:0/982405291 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81800e070 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.536+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb824115500 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.537+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82404bb80 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.537+0000 7fb80b7fe700 1 -- 172.21.15.49:0/982405291 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb81801c9c0 con 0x7fb8240fcd00 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.538+0000 7fb80b7fe700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb80c068f60 0x7fb80c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.538+0000 7fb822ffd700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb80c068f60 0x7fb80c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:19.539 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.538+0000 7fb80b7fe700 1 -- 172.21.15.49:0/982405291 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb818087eb0 con 0x7fb8240fcd00 2023-12-16T07:38:19.540 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.538+0000 7fb822ffd700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb80c068f60 0x7fb80c06b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ff950 tx=0x7fb81400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:19.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.543+0000 7fb80b7fe700 1 -- 172.21.15.49:0/982405291 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb818057eb0 con 0x7fb8240fcd00 2023-12-16T07:38:19.780 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:19 smithi049 ceph-mon[111939]: Deploying daemon mds.cephfs.smithi049.ekquzl on smithi049 2023-12-16T07:38:19.780 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:19 smithi049 ceph-mon[111939]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T07:38:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.791+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb824104490 con 0x7fb8240fcd00 2023-12-16T07:38:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.792+0000 7fb80b7fe700 1 -- 172.21.15.49:0/982405291 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fb818057a40 con 0x7fb8240fcd00 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:e2 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 2 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:17.449131+0000 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:38:19.793 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:in 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:38:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2023-12-16T07:38:19.795 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:38:19.795 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 0 2023-12-16T07:38:19.795 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:19.795 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb80c068f60 msgr2=0x7fb80c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb80c068f60 0x7fb80c06b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ff950 tx=0x7fb81400b040 comp rx=0 tx=0).stop 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 msgr2=0x7fb8240fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fe040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb818000c00 tx=0x7fb818009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 shutdown_connections 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fb80c068f60 0x7fb80c06b410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240fbaf0 0x7fb8240ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 --2- 172.21.15.49:0/982405291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8240fcd00 0x7fb8240fe040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 >> 172.21.15.49:0/982405291 conn(0x7fb8240f7190 msgr2=0x7fb824065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 shutdown_connections 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:19.794+0000 7fb829704700 1 -- 172.21.15.49:0/982405291 wait complete. 2023-12-16T07:38:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2023-12-16T07:38:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:19 smithi133 ceph-mon[120445]: Deploying daemon mds.cephfs.smithi049.ekquzl on smithi049 2023-12-16T07:38:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:19 smithi133 ceph-mon[120445]: osdmap e42: 6 total, 6 up, 6 in 2023-12-16T07:38:20.167 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T07:38:20.178 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:20.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2023-12-16T07:38:20.457 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:20.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: pgmap v128: 65 pgs: 23 active+clean, 19 creating+peering, 23 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:20.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-16T07:38:20.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T07:38:20.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/982405291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:38:20.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:20.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:20.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:20.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.takfuo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:20.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.takfuo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:20.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:20 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: pgmap v128: 65 pgs: 23 active+clean, 19 creating+peering, 23 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: osdmap e43: 6 total, 6 up, 6 in 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/982405291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:20.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.takfuo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:20.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.takfuo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:20.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:20 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 -- 172.21.15.49:0/756950251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c100050 msgr2=0x7f3c9c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/756950251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c100050 0x7f3c9c102430 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c90004940 tx=0x7f3c90009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 -- 172.21.15.49:0/756950251 shutdown_connections 2023-12-16T07:38:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/756950251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c100050 0x7f3c9c102430 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/756950251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c0fd730 0x7f3c9c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 -- 172.21.15.49:0/756950251 >> 172.21.15.49:0/756950251 conn(0x7f3c9c0f7190 msgr2=0x7f3c9c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 -- 172.21.15.49:0/756950251 shutdown_connections 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.440+0000 7f3ca0c66700 1 -- 172.21.15.49:0/756950251 wait complete. 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3ca0c66700 1 Processor -- start 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3ca0c66700 1 -- start start 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3ca0c66700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c0fd730 0x7f3c9c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3ca0c66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c100050 0x7f3c9c0fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3ca0c66700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0fbc40 con 0x7f3c9c0fd730 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3ca0c66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0fbdb0 con 0x7f3c9c100050 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c9a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c0fd730 0x7f3c9c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c9a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c0fd730 0x7f3c9c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36494/0 (socket says 172.21.15.49:36494) 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c99d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c100050 0x7f3c9c0fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c9a59c700 1 -- 172.21.15.49:0/1152900121 learned_addr learned my addr 172.21.15.49:0/1152900121 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c9a59c700 1 -- 172.21.15.49:0/1152900121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c100050 msgr2=0x7f3c9c0fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c9a59c700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c100050 0x7f3c9c0fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c9a59c700 1 -- 172.21.15.49:0/1152900121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c90005040 con 0x7f3c9c0fd730 2023-12-16T07:38:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.441+0000 7f3c99d9b700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c100050 0x7f3c9c0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T07:38:21.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.442+0000 7f3c9a59c700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c0fd730 0x7f3c9c0fd1c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c002a50 tx=0x7f3c8c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:21.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.444+0000 7f3c8affd700 1 -- 172.21.15.49:0/1152900121 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c8c007cc0 con 0x7f3c9c0fd730 2023-12-16T07:38:21.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.444+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c0fc090 con 0x7f3c9c0fd730 2023-12-16T07:38:21.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.444+0000 7f3c8affd700 1 -- 172.21.15.49:0/1152900121 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3c8c00f040 con 0x7f3c9c0fd730 2023-12-16T07:38:21.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.444+0000 7f3c8affd700 1 -- 172.21.15.49:0/1152900121 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c8c00d9c0 con 0x7f3c9c0fd730 2023-12-16T07:38:21.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.444+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c115560 con 0x7f3c9c0fd730 2023-12-16T07:38:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.445+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c1075c0 con 0x7f3c9c0fd730 2023-12-16T07:38:21.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.445+0000 7f3c8affd700 1 -- 172.21.15.49:0/1152900121 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3c8c00db20 con 0x7f3c9c0fd730 2023-12-16T07:38:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.446+0000 7f3c8affd700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3c84068f60 0x7f3c8406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.446+0000 7f3c8affd700 1 -- 172.21.15.49:0/1152900121 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3c8c086ad0 con 0x7f3c9c0fd730 2023-12-16T07:38:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.446+0000 7f3c99d9b700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3c84068f60 0x7f3c8406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:21.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.446+0000 7f3c99d9b700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3c84068f60 0x7f3c8406b410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000b3b0 tx=0x7f3c90009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.450+0000 7f3c8affd700 1 -- 172.21.15.49:0/1152900121 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3c8c0569b0 con 0x7f3c9c0fd730 2023-12-16T07:38:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:21.695+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f3c9c105580 con 0x7f3c9c0fd730 2023-12-16T07:38:21.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: Deploying daemon mds.cephfs.smithi133.takfuo on smithi133 2023-12-16T07:38:21.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.49:6826/1458998795,v1:172.21.15.49:6827/1458998795] up:boot 2023-12-16T07:38:21.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: daemon mds.cephfs.smithi049.ekquzl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T07:38:21.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T07:38:21.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T07:38:21.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: Cluster is now healthy 2023-12-16T07:38:21.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: fsmap cephfs:0 1 up:standby 2023-12-16T07:38:21.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:38:21.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:creating} 2023-12-16T07:38:21.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: daemon mds.cephfs.smithi049.ekquzl is now active in filesystem cephfs as rank 0 2023-12-16T07:38:21.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:21.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:21 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:21.901 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: Deploying daemon mds.cephfs.smithi133.takfuo on smithi133 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.49:6826/1458998795,v1:172.21.15.49:6827/1458998795] up:boot 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: daemon mds.cephfs.smithi049.ekquzl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: Cluster is now healthy 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: fsmap cephfs:0 1 up:standby 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:creating} 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: daemon mds.cephfs.smithi049.ekquzl is now active in filesystem cephfs as rank 0 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:21.902 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:21 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.495+0000 7f3c8affd700 1 -- 172.21.15.49:0/1152900121 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3c8c056540 con 0x7f3c9c0fd730 2023-12-16T07:38:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3c84068f60 msgr2=0x7f3c8406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3c84068f60 0x7f3c8406b410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000b3b0 tx=0x7f3c90009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c0fd730 msgr2=0x7f3c9c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c0fd730 0x7f3c9c0fd1c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c002a50 tx=0x7f3c8c0046b0 comp rx=0 tx=0).stop 2023-12-16T07:38:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 shutdown_connections 2023-12-16T07:38:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3c84068f60 0x7f3c8406b410 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c9c0fd730 0x7f3c9c0fd1c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 --2- 172.21.15.49:0/1152900121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c100050 0x7f3c9c0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 >> 172.21.15.49:0/1152900121 conn(0x7f3c9c0f7190 msgr2=0x7f3c9c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 shutdown_connections 2023-12-16T07:38:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:22.498+0000 7f3ca0c66700 1 -- 172.21.15.49:0/1152900121 wait complete. 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: pgmap v130: 65 pgs: 32 active+clean, 19 creating+peering, 14 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 3 op/s 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.49:6826/1458998795,v1:172.21.15.49:6827/1458998795] up:active 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:boot 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 1 up:standby 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 1 up:standby 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:22.598 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.eyimyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:22.599 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.eyimyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:22.599 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:22.599 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:22 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1152900121' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-16T07:38:22.814 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T07:38:22.823 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:22.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-16T07:38:22.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: pgmap v130: 65 pgs: 32 active+clean, 19 creating+peering, 14 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 3 op/s 2023-12-16T07:38:22.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.49:6826/1458998795,v1:172.21.15.49:6827/1458998795] up:active 2023-12-16T07:38:22.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:boot 2023-12-16T07:38:22.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 1 up:standby 2023-12-16T07:38:22.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:38:22.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 1 up:standby 2023-12-16T07:38:22.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:22.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.eyimyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:22.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.eyimyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:22.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:22.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:22 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1152900121' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-16T07:38:23.272 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: Deploying daemon mds.cephfs.smithi049.eyimyr on smithi049 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1152900121' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 1 up:standby 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.uedvhy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.uedvhy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:23.737 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:23 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: Deploying daemon mds.cephfs.smithi049.eyimyr on smithi049 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1152900121' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 1 up:standby 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.uedvhy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.uedvhy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-16T07:38:23.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:23 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 -- 172.21.15.49:0/2437628915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 msgr2=0x7f56d40ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 --2- 172.21.15.49:0/2437628915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40ff7c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56c4004940 tx=0x7f56c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 -- 172.21.15.49:0/2437628915 shutdown_connections 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 --2- 172.21.15.49:0/2437628915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56d40ffd90 0x7f56d41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 --2- 172.21.15.49:0/2437628915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40ff7c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 -- 172.21.15.49:0/2437628915 >> 172.21.15.49:0/2437628915 conn(0x7f56d40f7190 msgr2=0x7f56d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 -- 172.21.15.49:0/2437628915 shutdown_connections 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.277+0000 7f56d9830700 1 -- 172.21.15.49:0/2437628915 wait complete. 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d9830700 1 Processor -- start 2023-12-16T07:38:24.278 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d9830700 1 -- start start 2023-12-16T07:38:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d9830700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d9830700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56d40ffd90 0x7f56d40fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d9830700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40fbcc0 con 0x7f56d4066070 2023-12-16T07:38:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d9830700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40fbe30 con 0x7f56d40ffd90 2023-12-16T07:38:24.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36528/0 (socket says 172.21.15.49:36528) 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d2ffd700 1 -- 172.21.15.49:0/3052147670 learned_addr learned my addr 172.21.15.49:0/3052147670 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d27fc700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56d40ffd90 0x7f56d40fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d2ffd700 1 -- 172.21.15.49:0/3052147670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56d40ffd90 msgr2=0x7f56d40fb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d2ffd700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56d40ffd90 0x7f56d40fb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.278+0000 7f56d2ffd700 1 -- 172.21.15.49:0/3052147670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4005040 con 0x7f56d4066070 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.279+0000 7f56d2ffd700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40fd240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56c400b3b0 tx=0x7f56c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.279+0000 7f56bb7fe700 1 -- 172.21.15.49:0/3052147670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c400e040 con 0x7f56d4066070 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.279+0000 7f56bb7fe700 1 -- 172.21.15.49:0/3052147670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56c4009b10 con 0x7f56d4066070 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.279+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d40fc0b0 con 0x7f56d4066070 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.279+0000 7f56bb7fe700 1 -- 172.21.15.49:0/3052147670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c401c630 con 0x7f56d4066070 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.279+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d4115560 con 0x7f56d4066070 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.280+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d41075f0 con 0x7f56d4066070 2023-12-16T07:38:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.280+0000 7f56bb7fe700 1 -- 172.21.15.49:0/3052147670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f56c400bc50 con 0x7f56d4066070 2023-12-16T07:38:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.281+0000 7f56bb7fe700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f56bc068f60 0x7f56bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.281+0000 7f56bb7fe700 1 -- 172.21.15.49:0/3052147670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f56c4088130 con 0x7f56d4066070 2023-12-16T07:38:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.281+0000 7f56d27fc700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f56bc068f60 0x7f56bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.281+0000 7f56d27fc700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f56bc068f60 0x7f56bc06b410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56d4065db0 tx=0x7f56c800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.285+0000 7f56bb7fe700 1 -- 172.21.15.49:0/3052147670 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f56c4058090 con 0x7f56d4066070 2023-12-16T07:38:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:24.529+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f56d41055b0 con 0x7f56d4066070 2023-12-16T07:38:24.770 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:24 smithi133 ceph-mon[120445]: pgmap v131: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2023-12-16T07:38:24.771 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:24 smithi133 ceph-mon[120445]: Deploying daemon mds.cephfs.smithi133.uedvhy on smithi133 2023-12-16T07:38:24.771 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:24 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] up:boot 2023-12-16T07:38:24.771 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:24 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 2 up:standby 2023-12-16T07:38:24.771 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:38:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:24 smithi049 ceph-mon[111939]: pgmap v131: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2023-12-16T07:38:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:24 smithi049 ceph-mon[111939]: Deploying daemon mds.cephfs.smithi133.uedvhy on smithi133 2023-12-16T07:38:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:24 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] up:boot 2023-12-16T07:38:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:24 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 2 up:standby 2023-12-16T07:38:24.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:38:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.482+0000 7f56bb7fe700 1 -- 172.21.15.49:0/3052147670 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f56c4013e60 con 0x7f56d4066070 2023-12-16T07:38:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f56bc068f60 msgr2=0x7f56bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f56bc068f60 0x7f56bc06b410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56d4065db0 tx=0x7f56c800b040 comp rx=0 tx=0).stop 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 msgr2=0x7f56d40fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40fd240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f56c400b3b0 tx=0x7f56c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 shutdown_connections 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f56bc068f60 0x7f56bc06b410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56d4066070 0x7f56d40fd240 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 --2- 172.21.15.49:0/3052147670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56d40ffd90 0x7f56d40fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 >> 172.21.15.49:0/3052147670 conn(0x7f56d40f7190 msgr2=0x7f56d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 shutdown_connections 2023-12-16T07:38:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:25.485+0000 7f56d9830700 1 -- 172.21.15.49:0/3052147670 wait complete. 2023-12-16T07:38:25.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:25 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3052147670' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-16T07:38:25.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:25 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:25.793 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:25 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3052147670' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-16T07:38:25.793 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.793 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.793 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.793 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.793 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:25.794 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:25 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:26.213 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T07:38:26.223 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:26.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2023-12-16T07:38:26.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: pgmap v132: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2023-12-16T07:38:26.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3052147670' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-16T07:38:26.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] up:boot 2023-12-16T07:38:26.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:standby 2023-12-16T07:38:26.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: Dropping low affinity active daemon mds.cephfs.smithi049.ekquzl in favor of higher affinity standby. 2023-12-16T07:38:26.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: Replacing daemon mds.cephfs.smithi049.ekquzl as rank 0 with standby daemon mds.cephfs.smithi133.takfuo 2023-12-16T07:38:26.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-16T07:38:26.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 3 up:standby 2023-12-16T07:38:26.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:38:26.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T07:38:26.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:26 smithi049 ceph-mon[111939]: fsmap cephfs:1/1 {0=cephfs.smithi133.takfuo=up:replay} 2 up:standby 2023-12-16T07:38:26.710 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: pgmap v132: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3052147670' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] up:boot 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:standby 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: Dropping low affinity active daemon mds.cephfs.smithi049.ekquzl in favor of higher affinity standby. 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: Replacing daemon mds.cephfs.smithi049.ekquzl as rank 0 with standby daemon mds.cephfs.smithi133.takfuo 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-16T07:38:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi049.ekquzl=up:active} 3 up:standby 2023-12-16T07:38:26.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:38:26.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: osdmap e44: 6 total, 6 up, 6 in 2023-12-16T07:38:26.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:26 smithi133 ceph-mon[120445]: fsmap cephfs:1/1 {0=cephfs.smithi133.takfuo=up:replay} 2 up:standby 2023-12-16T07:38:27.653 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:27 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:reconnect 2023-12-16T07:38:27.653 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:27 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] up:boot 2023-12-16T07:38:27.653 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:27 smithi049 ceph-mon[111939]: fsmap cephfs:1/1 {0=cephfs.smithi133.takfuo=up:reconnect} 3 up:standby 2023-12-16T07:38:27.653 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:38:27.653 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:27.653 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:27.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:27 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:reconnect 2023-12-16T07:38:27.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:27 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] up:boot 2023-12-16T07:38:27.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:27 smithi133 ceph-mon[120445]: fsmap cephfs:1/1 {0=cephfs.smithi133.takfuo=up:reconnect} 3 up:standby 2023-12-16T07:38:27.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:38:27.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:27.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.940+0000 7f9a4cf45700 1 -- 172.21.15.49:0/3873687260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48076970 msgr2=0x7f9a48076d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.940+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/3873687260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48076970 0x7f9a48076d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009ce0 tx=0x7f9a40004d10 comp rx=0 tx=0).stop 2023-12-16T07:38:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 -- 172.21.15.49:0/3873687260 shutdown_connections 2023-12-16T07:38:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/3873687260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a48077bd0 0x7f9a48078040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/3873687260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48076970 0x7f9a48076d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 -- 172.21.15.49:0/3873687260 >> 172.21.15.49:0/3873687260 conn(0x7f9a48072480 msgr2=0x7f9a480748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:27.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 -- 172.21.15.49:0/3873687260 shutdown_connections 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 -- 172.21.15.49:0/3873687260 wait complete. 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 Processor -- start 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 -- start start 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a48076970 0x7f9a4811c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48077bd0 0x7f9a4811c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4811d080 con 0x7f9a48077bd0 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.941+0000 7f9a4cf45700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4811d8c0 con 0x7f9a48076970 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a45d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48077bd0 0x7f9a4811c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a45d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48077bd0 0x7f9a4811c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49544/0 (socket says 172.21.15.49:49544) 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a45d9b700 1 -- 172.21.15.49:0/533597445 learned_addr learned my addr 172.21.15.49:0/533597445 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a4659c700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a48076970 0x7f9a4811c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a45d9b700 1 -- 172.21.15.49:0/533597445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a48076970 msgr2=0x7f9a4811c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a45d9b700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a48076970 0x7f9a4811c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a45d9b700 1 -- 172.21.15.49:0/533597445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40009940 con 0x7f9a48077bd0 2023-12-16T07:38:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a45d9b700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48077bd0 0x7f9a4811c9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00b790 tx=0x7f9a3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a36ffd700 1 -- 172.21.15.49:0/533597445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3c00f6f0 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a36ffd700 1 -- 172.21.15.49:0/533597445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a3c00fd00 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4811dba0 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a36ffd700 1 -- 172.21.15.49:0/533597445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3c0103a0 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.942+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4811e0e0 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.944+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4804bb80 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.944+0000 7f9a36ffd700 1 -- 172.21.15.49:0/533597445 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9a3c00f850 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.944+0000 7f9a36ffd700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9a30068f60 0x7f9a3006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.944+0000 7f9a36ffd700 1 -- 172.21.15.49:0/533597445 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9a3c086b10 con 0x7f9a48077bd0 2023-12-16T07:38:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.944+0000 7f9a4659c700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9a30068f60 0x7f9a3006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.945+0000 7f9a4659c700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9a30068f60 0x7f9a3006b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009400 tx=0x7f9a40004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:27.949+0000 7f9a36ffd700 1 -- 172.21.15.49:0/533597445 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9a3c056ac0 con 0x7f9a48077bd0 2023-12-16T07:38:28.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.196+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a48114400 con 0x7f9a48077bd0 2023-12-16T07:38:28.493 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.493+0000 7f9a36ffd700 1 -- 172.21.15.49:0/533597445 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v13) v1 ==== 168+0+0 (secure 0 0 0) 0x7f9a3c056650 con 0x7f9a48077bd0 2023-12-16T07:38:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9a30068f60 msgr2=0x7f9a3006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9a30068f60 0x7f9a3006b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009400 tx=0x7f9a40004d10 comp rx=0 tx=0).stop 2023-12-16T07:38:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48077bd0 msgr2=0x7f9a4811c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48077bd0 0x7f9a4811c9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00b790 tx=0x7f9a3c009250 comp rx=0 tx=0).stop 2023-12-16T07:38:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 shutdown_connections 2023-12-16T07:38:28.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9a30068f60 0x7f9a3006b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:28.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a48076970 0x7f9a4811c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:28.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 --2- 172.21.15.49:0/533597445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a48077bd0 0x7f9a4811c9f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:28.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 >> 172.21.15.49:0/533597445 conn(0x7f9a48072480 msgr2=0x7f9a4807ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:28.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 shutdown_connections 2023-12-16T07:38:28.496 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:28.495+0000 7f9a4cf45700 1 -- 172.21.15.49:0/533597445 wait complete. 2023-12-16T07:38:28.496 INFO:teuthology.orchestra.run.smithi049.stderr:inline data enabled 2023-12-16T07:38:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:28 smithi133 ceph-mon[120445]: pgmap v134: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1.6 KiB/s wr, 6 op/s 2023-12-16T07:38:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:28 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:rejoin 2023-12-16T07:38:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:28 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] up:standby 2023-12-16T07:38:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:28 smithi133 ceph-mon[120445]: fsmap cephfs:1/1 {0=cephfs.smithi133.takfuo=up:rejoin} 3 up:standby 2023-12-16T07:38:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:28 smithi133 ceph-mon[120445]: daemon mds.cephfs.smithi133.takfuo is now active in filesystem cephfs as rank 0 2023-12-16T07:38:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:28 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/533597445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-16T07:38:28.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:28 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:28 smithi049 ceph-mon[111939]: pgmap v134: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1.6 KiB/s wr, 6 op/s 2023-12-16T07:38:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:28 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:rejoin 2023-12-16T07:38:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:28 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] up:standby 2023-12-16T07:38:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:28 smithi049 ceph-mon[111939]: fsmap cephfs:1/1 {0=cephfs.smithi133.takfuo=up:rejoin} 3 up:standby 2023-12-16T07:38:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:28 smithi049 ceph-mon[111939]: daemon mds.cephfs.smithi133.takfuo is now active in filesystem cephfs as rank 0 2023-12-16T07:38:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:28 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/533597445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-16T07:38:28.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:28 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:29.031 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-16T07:38:29.041 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:29.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-16T07:38:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:29.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:29 smithi049 ceph-mon[111939]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-16T07:38:29.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:29 smithi049 ceph-mon[111939]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-16T07:38:29.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:29 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:active 2023-12-16T07:38:29.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:29 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/533597445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-16T07:38:29.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:29 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:38:29.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:29.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:29 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:29.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:29 smithi133 ceph-mon[120445]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-16T07:38:29.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:29 smithi133 ceph-mon[120445]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-16T07:38:29.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:29 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] up:active 2023-12-16T07:38:29.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:29 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/533597445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-16T07:38:29.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:29 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:38:29.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:29.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:29 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 -- 172.21.15.49:0/439306962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9478066920 msgr2=0x7f9478101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 --2- 172.21.15.49:0/439306962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9478066920 0x7f9478101ba0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9474004940 tx=0x7f9474009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 -- 172.21.15.49:0/439306962 shutdown_connections 2023-12-16T07:38:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 --2- 172.21.15.49:0/439306962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94781020e0 0x7f94781044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 --2- 172.21.15.49:0/439306962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9478066920 0x7f9478101ba0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 -- 172.21.15.49:0/439306962 >> 172.21.15.49:0/439306962 conn(0x7f94780f71b0 msgr2=0x7f94780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 -- 172.21.15.49:0/439306962 shutdown_connections 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.404+0000 7f94801e3700 1 -- 172.21.15.49:0/439306962 wait complete. 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f94801e3700 1 Processor -- start 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f94801e3700 1 -- start start 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f94801e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9478066920 0x7f947810b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f94801e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94781020e0 0x7f947810b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f94801e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947810beb0 con 0x7f94781020e0 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f94801e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947810f9a0 con 0x7f9478066920 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f947d77e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94781020e0 0x7f947810b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f947d77e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94781020e0 0x7f947810b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49572/0 (socket says 172.21.15.49:49572) 2023-12-16T07:38:30.407 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f947d77e700 1 -- 172.21.15.49:0/2213839367 learned_addr learned my addr 172.21.15.49:0/2213839367 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:30.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f947df7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9478066920 0x7f947810b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:30.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f947d77e700 1 -- 172.21.15.49:0/2213839367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9478066920 msgr2=0x7f947810b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:30.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f947d77e700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9478066920 0x7f947810b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:30.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.405+0000 7f947d77e700 1 -- 172.21.15.49:0/2213839367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474005040 con 0x7f94781020e0 2023-12-16T07:38:30.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.406+0000 7f947d77e700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94781020e0 0x7f947810b860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9468002a50 tx=0x7f9468004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.406+0000 7f946e7fc700 1 -- 172.21.15.49:0/2213839367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9468007cc0 con 0x7f94781020e0 2023-12-16T07:38:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.406+0000 7f946e7fc700 1 -- 172.21.15.49:0/2213839367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f946800f040 con 0x7f94781020e0 2023-12-16T07:38:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.406+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947810fc80 con 0x7f94781020e0 2023-12-16T07:38:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.406+0000 7f946e7fc700 1 -- 172.21.15.49:0/2213839367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f946800d920 con 0x7f94781020e0 2023-12-16T07:38:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.406+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94781101c0 con 0x7f94781020e0 2023-12-16T07:38:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.407+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947804bb80 con 0x7f94781020e0 2023-12-16T07:38:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.408+0000 7f946e7fc700 1 -- 172.21.15.49:0/2213839367 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9468009680 con 0x7f94781020e0 2023-12-16T07:38:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.408+0000 7f946e7fc700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9464068fb0 0x7f946406b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.408+0000 7f946e7fc700 1 -- 172.21.15.49:0/2213839367 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9468086c20 con 0x7f94781020e0 2023-12-16T07:38:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.408+0000 7f947df7f700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9464068fb0 0x7f946406b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.409+0000 7f947df7f700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9464068fb0 0x7f946406b460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9474004890 tx=0x7f9474009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.413+0000 7f946e7fc700 1 -- 172.21.15.49:0/2213839367 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9468052f80 con 0x7f94781020e0 2023-12-16T07:38:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.669+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94781077a0 con 0x7f94781020e0 2023-12-16T07:38:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.669+0000 7f946e7fc700 1 -- 172.21.15.49:0/2213839367 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f94680565a0 con 0x7f94781020e0 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:38:30.670 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:38:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:38:30.672 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:38:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9464068fb0 msgr2=0x7f946406b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9464068fb0 0x7f946406b460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9474004890 tx=0x7f9474009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94781020e0 msgr2=0x7f947810b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94781020e0 0x7f947810b860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9468002a50 tx=0x7f9468004600 comp rx=0 tx=0).stop 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 shutdown_connections 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f9464068fb0 0x7f946406b460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9478066920 0x7f947810b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 --2- 172.21.15.49:0/2213839367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94781020e0 0x7f947810b860 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 >> 172.21.15.49:0/2213839367 conn(0x7f94780f71b0 msgr2=0x7f94780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 shutdown_connections 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:30.671+0000 7f94801e3700 1 -- 172.21.15.49:0/2213839367 wait complete. 2023-12-16T07:38:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:38:30.713 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:30 smithi133 ceph-mon[120445]: pgmap v135: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-12-16T07:38:30.714 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:30 smithi133 ceph-mon[120445]: mds.? [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] up:standby 2023-12-16T07:38:30.714 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:30 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:38:30.714 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:30 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:30.714 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:30 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:30.714 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:30 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:30.714 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:30 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:30.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:30 smithi049 ceph-mon[111939]: pgmap v135: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-12-16T07:38:30.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:30 smithi049 ceph-mon[111939]: mds.? [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] up:standby 2023-12-16T07:38:30.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:30 smithi049 ceph-mon[111939]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:38:30.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:30 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:30.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:30 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:30.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:30 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:30.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:30 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:38:31.120 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-16T07:38:31.560 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:31.756 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:31 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2213839367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:38:31.756 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:31 smithi049 ceph-mon[111939]: pgmap v136: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-12-16T07:38:31.756 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:31 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:31.756 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:31 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:31.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:31 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2213839367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:38:31.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:31 smithi133 ceph-mon[120445]: pgmap v136: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-12-16T07:38:31.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:31 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:31.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:31 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 -- 172.21.15.49:0/1941743199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 msgr2=0x7febfc0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 --2- 172.21.15.49:0/1941743199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc0ffb10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7febec004940 tx=0x7febec009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 -- 172.21.15.49:0/1941743199 shutdown_connections 2023-12-16T07:38:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 --2- 172.21.15.49:0/1941743199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc100050 0x7febfc102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 --2- 172.21.15.49:0/1941743199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc0ffb10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 -- 172.21.15.49:0/1941743199 >> 172.21.15.49:0/1941743199 conn(0x7febfc0f71b0 msgr2=0x7febfc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 -- 172.21.15.49:0/1941743199 shutdown_connections 2023-12-16T07:38:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.781+0000 7fec02571700 1 -- 172.21.15.49:0/1941743199 wait complete. 2023-12-16T07:38:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7fec02571700 1 Processor -- start 2023-12-16T07:38:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7fec02571700 1 -- start start 2023-12-16T07:38:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7fec02571700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc10d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7fec02571700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc100050 0x7febfc10da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7fec02571700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc10e020 con 0x7febfc0fd730 2023-12-16T07:38:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7fec02571700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc10e8c0 con 0x7febfc100050 2023-12-16T07:38:32.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7febfbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc10d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7febfbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc10d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49596/0 (socket says 172.21.15.49:49596) 2023-12-16T07:38:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7febfbfff700 1 -- 172.21.15.49:0/4271772068 learned_addr learned my addr 172.21.15.49:0/4271772068 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.782+0000 7febfb7fe700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc100050 0x7febfc10da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7febfbfff700 1 -- 172.21.15.49:0/4271772068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc100050 msgr2=0x7febfc10da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7febfbfff700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc100050 0x7febfc10da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7febfbfff700 1 -- 172.21.15.49:0/4271772068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec005040 con 0x7febfc0fd730 2023-12-16T07:38:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7febfbfff700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc10d4e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7febec009360 tx=0x7febec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7febf8ff9700 1 -- 172.21.15.49:0/4271772068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febec00e040 con 0x7febfc0fd730 2023-12-16T07:38:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc10eb40 con 0x7febfc0fd730 2023-12-16T07:38:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7febf8ff9700 1 -- 172.21.15.49:0/4271772068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febec00bc50 con 0x7febfc0fd730 2023-12-16T07:38:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc10f080 con 0x7febfc0fd730 2023-12-16T07:38:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.783+0000 7febf8ff9700 1 -- 172.21.15.49:0/4271772068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febec025400 con 0x7febfc0fd730 2023-12-16T07:38:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.784+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc04bb80 con 0x7febfc0fd730 2023-12-16T07:38:32.805 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.785+0000 7febf8ff9700 1 -- 172.21.15.49:0/4271772068 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7febec013420 con 0x7febfc0fd730 2023-12-16T07:38:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.785+0000 7febf8ff9700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7febe4068f60 0x7febe406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.785+0000 7febf8ff9700 1 -- 172.21.15.49:0/4271772068 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7febec0881c0 con 0x7febfc0fd730 2023-12-16T07:38:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.786+0000 7febfb7fe700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7febe4068f60 0x7febe406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.786+0000 7febfb7fe700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7febe4068f60 0x7febe406b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febf0004f40 tx=0x7febf000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:32.793+0000 7febf8ff9700 1 -- 172.21.15.49:0/4271772068 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7febec058050 con 0x7febfc0fd730 2023-12-16T07:38:33.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.053+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febfc105580 con 0x7febfc0fd730 2023-12-16T07:38:33.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.054+0000 7febf8ff9700 1 -- 172.21.15.49:0/4271772068 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4691 (secure 0 0 0) 0x7febec057be0 con 0x7febfc0fd730 2023-12-16T07:38:33.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7febe4068f60 msgr2=0x7febe406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:33.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7febe4068f60 0x7febe406b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febf0004f40 tx=0x7febf000b040 comp rx=0 tx=0).stop 2023-12-16T07:38:33.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 msgr2=0x7febfc10d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:33.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc10d4e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7febec009360 tx=0x7febec009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:33.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 shutdown_connections 2023-12-16T07:38:33.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7febe4068f60 0x7febe406b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:33.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febfc0fd730 0x7febfc10d4e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:33.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 --2- 172.21.15.49:0/4271772068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc100050 0x7febfc10da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:33.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 >> 172.21.15.49:0/4271772068 conn(0x7febfc0f71b0 msgr2=0x7febfc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:33.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 shutdown_connections 2023-12-16T07:38:33.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:33.057+0000 7fec02571700 1 -- 172.21.15.49:0/4271772068 wait complete. 2023-12-16T07:38:33.059 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:38:33.073 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:38:33.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-16T07:38:33.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:33 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/4271772068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T07:38:33.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:33 smithi049 ceph-mon[111939]: pgmap v137: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-16T07:38:33.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:33 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:33.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:33 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:33.798 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:33 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/4271772068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T07:38:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:33 smithi133 ceph-mon[120445]: pgmap v137: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-16T07:38:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:33 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:33 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.821+0000 7fd5c7014700 1 -- 172.21.15.49:0/3835041290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00fdf60 msgr2=0x7fd5c00fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.821+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3835041290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00fdf60 0x7fd5c00fe3b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac004940 tx=0x7fd5ac009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.821+0000 7fd5c7014700 1 -- 172.21.15.49:0/3835041290 shutdown_connections 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.821+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3835041290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00fdf60 0x7fd5c00fe3b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.821+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3835041290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5c00faed0 0x7fd5c00fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.821+0000 7fd5c7014700 1 -- 172.21.15.49:0/3835041290 >> 172.21.15.49:0/3835041290 conn(0x7fd5c00f6950 msgr2=0x7fd5c00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 -- 172.21.15.49:0/3835041290 shutdown_connections 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 -- 172.21.15.49:0/3835041290 wait complete. 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 Processor -- start 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 -- start start 2023-12-16T07:38:34.824 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00faed0 0x7fd5c010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5c00fdf60 0x7fd5c010db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c010e190 con 0x7fd5c00faed0 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.822+0000 7fd5c7014700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c010ea30 con 0x7fd5c00fdf60 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c4db0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00faed0 0x7fd5c010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c4db0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00faed0 0x7fd5c010d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49604/0 (socket says 172.21.15.49:49604) 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c4db0700 1 -- 172.21.15.49:0/3381131615 learned_addr learned my addr 172.21.15.49:0/3381131615 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5bffff700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5c00fdf60 0x7fd5c010db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c4db0700 1 -- 172.21.15.49:0/3381131615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5c00fdf60 msgr2=0x7fd5c010db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c4db0700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5c00fdf60 0x7fd5c010db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c4db0700 1 -- 172.21.15.49:0/3381131615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac005040 con 0x7fd5c00faed0 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c4db0700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00faed0 0x7fd5c010d650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4002a80 tx=0x7fd5b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5bd7fa700 1 -- 172.21.15.49:0/3381131615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b4007cc0 con 0x7fd5c00faed0 2023-12-16T07:38:34.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5bd7fa700 1 -- 172.21.15.49:0/3381131615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5b400f040 con 0x7fd5c00faed0 2023-12-16T07:38:34.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c010ed10 con 0x7fd5c00faed0 2023-12-16T07:38:34.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5bd7fa700 1 -- 172.21.15.49:0/3381131615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b400d9c0 con 0x7fd5c00faed0 2023-12-16T07:38:34.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.823+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c010f250 con 0x7fd5c00faed0 2023-12-16T07:38:34.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.824+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c01075f0 con 0x7fd5c00faed0 2023-12-16T07:38:34.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.825+0000 7fd5bd7fa700 1 -- 172.21.15.49:0/3381131615 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd5b400db20 con 0x7fd5c00faed0 2023-12-16T07:38:34.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.825+0000 7fd5bd7fa700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd5b0068f60 0x7fd5b006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:34.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.825+0000 7fd5bd7fa700 1 -- 172.21.15.49:0/3381131615 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd5b4086b10 con 0x7fd5c00faed0 2023-12-16T07:38:34.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.825+0000 7fd5bffff700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd5b0068f60 0x7fd5b006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:34.827 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.826+0000 7fd5bffff700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd5b0068f60 0x7fd5b006b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac004f90 tx=0x7fd5ac009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:34.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:34.830+0000 7fd5bd7fa700 1 -- 172.21.15.49:0/3381131615 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd5b40569a0 con 0x7fd5c00faed0 2023-12-16T07:38:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:34 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:35.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.108+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fd5c004bb80 con 0x7fd5c00faed0 2023-12-16T07:38:35.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.108+0000 7fd5bd7fa700 1 -- 172.21.15.49:0/3381131615 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7fd5b4056530 con 0x7fd5c00faed0 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.110+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd5b0068f60 msgr2=0x7fd5b006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.110+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd5b0068f60 0x7fd5b006b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac004f90 tx=0x7fd5ac009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.110+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00faed0 msgr2=0x7fd5c010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.110+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00faed0 0x7fd5c010d650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4002a80 tx=0x7fd5b4004600 comp rx=0 tx=0).stop 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.111+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 shutdown_connections 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.111+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fd5b0068f60 0x7fd5b006b410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.111+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00faed0 0x7fd5c010d650 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.111+0000 7fd5c7014700 1 --2- 172.21.15.49:0/3381131615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5c00fdf60 0x7fd5c010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.111+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 >> 172.21.15.49:0/3381131615 conn(0x7fd5c00f6950 msgr2=0x7fd5c00f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.111+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 shutdown_connections 2023-12-16T07:38:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.111+0000 7fd5c7014700 1 -- 172.21.15.49:0/3381131615 wait complete. 2023-12-16T07:38:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:38:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:38:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:34 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:38:35.121 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:38:35.473 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-16T07:38:35.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T07:38:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- 172.21.15.49:0/2506206442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 msgr2=0x7fa4800fb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 --2- 172.21.15.49:0/2506206442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa4800fb140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa47c004940 tx=0x7fa47c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- 172.21.15.49:0/2506206442 shutdown_connections 2023-12-16T07:38:35.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 --2- 172.21.15.49:0/2506206442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4800fddc0 0x7fa4800fe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 --2- 172.21.15.49:0/2506206442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa4800fb140 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- 172.21.15.49:0/2506206442 >> 172.21.15.49:0/2506206442 conn(0x7fa4800f67b0 msgr2=0x7fa4800f8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- 172.21.15.49:0/2506206442 shutdown_connections 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- 172.21.15.49:0/2506206442 wait complete. 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 Processor -- start 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- start start 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa48010d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4800fddc0 0x7fa48010d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48010de30 con 0x7fa4800fad30 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.624+0000 7fa4882a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48010dfa0 con 0x7fa4800fddc0 2023-12-16T07:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa486042700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa48010d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa486042700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa48010d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49636/0 (socket says 172.21.15.49:49636) 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa486042700 1 -- 172.21.15.49:0/3925303520 learned_addr learned my addr 172.21.15.49:0/3925303520 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa485841700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4800fddc0 0x7fa48010d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa486042700 1 -- 172.21.15.49:0/3925303520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4800fddc0 msgr2=0x7fa48010d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa486042700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4800fddc0 0x7fa48010d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa486042700 1 -- 172.21.15.49:0/3925303520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c005040 con 0x7fa4800fad30 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa486042700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa48010d2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa47c004f90 tx=0x7fa47c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa476ffd700 1 -- 172.21.15.49:0/3925303520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c00e040 con 0x7fa4800fad30 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4801129f0 con 0x7fa4800fad30 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa476ffd700 1 -- 172.21.15.49:0/3925303520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa47c00bcd0 con 0x7fa4800fad30 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa476ffd700 1 -- 172.21.15.49:0/3925303520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c01c630 con 0x7fa4800fad30 2023-12-16T07:38:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.625+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa480112fb0 con 0x7fa4800fad30 2023-12-16T07:38:35.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.626+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa480105430 con 0x7fa4800fad30 2023-12-16T07:38:35.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.627+0000 7fa476ffd700 1 -- 172.21.15.49:0/3925303520 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa47c013960 con 0x7fa4800fad30 2023-12-16T07:38:35.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.627+0000 7fa476ffd700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa46c068f60 0x7fa46c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.627+0000 7fa476ffd700 1 -- 172.21.15.49:0/3925303520 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa47c088280 con 0x7fa4800fad30 2023-12-16T07:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.627+0000 7fa485841700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa46c068f60 0x7fa46c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.627+0000 7fa485841700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa46c068f60 0x7fa46c06b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa470009fd0 tx=0x7fa470009f20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:35.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.631+0000 7fa476ffd700 1 -- 172.21.15.49:0/3925303520 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa47c058190 con 0x7fa4800fad30 2023-12-16T07:38:35.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.828+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa480113200 con 0x7fa4800fad30 2023-12-16T07:38:35.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.829+0000 7fa476ffd700 1 -- 172.21.15.49:0/3925303520 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14375 (secure 0 0 0) 0x7fa47c057d20 con 0x7fa4800fad30 2023-12-16T07:38:35.829 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:35.829 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","created":"2023-12-16T07:33:24.032146+0000","modified":"2023-12-16T07:38:25.483307+0000","last_up_change":"2023-12-16T07:37:29.048482+0000","last_in_change":"2023-12-16T07:37:12.459978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T07:36:35.661056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T07:38:15.937834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T07:38:16.870070+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4530d745-4857-47b4-b774-3b7a5ec0b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6803","nonce":3714029642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6805","nonce":3714029642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6809","nonce":3714029642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3714029642},{"type":"v1","addr":"172.21.15.49:6807","nonce":3714029642}]},"public_addr":"172.21.15.49:6803/3714029642","cluster_addr":"172.21.15.49:6805/3714029642","heartbeat_back_addr":"172.21.15.49:6809/3714029642","heartbeat_front_addr":"172.21.15.49:6807/3714029642","state":["exists","up"]},{"osd":1,"uuid":"6f6c48cb-df63-42f1-9637-038a97b80255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6811","nonce":3249432879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6813","nonce":3249432879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6817","nonce":3249432879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3249432879},{"type":"v1","addr":"172.21.15.49:6815","nonce":3249432879}]},"public_addr":"172.21.15.49:6811/3249432879","cluster_addr":"172.21.15.49:6813/3249432879","heartbeat_back_addr":"172.21.15.49:6817/3249432879","heartbeat_front_addr":"172.21.15.49:6815/3249432879","state":["exists","up"]},{"osd":2,"uuid":"fc0f86d1-e690-4394-9f3b-45dc882e8df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6819","nonce":338711156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6821","nonce":338711156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6825","nonce":338711156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":338711156},{"type":"v1","addr":"172.21.15.49:6823","nonce":338711156}]},"public_addr":"172.21.15.49:6819/338711156","cluster_addr":"172.21.15.49:6821/338711156","heartbeat_back_addr":"172.21.15.49:6825/338711156","heartbeat_front_addr":"172.21.15.49:6823/338711156","state":["exists","up"]},{"osd":3,"uuid":"d48037c4-bb53-46d8-ba71-0c726cd8ae95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6801","nonce":31606206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6803","nonce":31606206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6807","nonce":31606206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":31606206},{"type":"v1","addr":"172.21.15.133:6805","nonce":31606206}]},"public_addr":"172.21.15.133:6801/31606206","cluster_addr":"172.21.15.133:6803/31606206","heartbeat_back_addr":"172.21.15.133:6807/31606206","heartbeat_front_addr":"172.21.15.133:6805/31606206","state":["exists","up"]},{"osd":4,"uuid":"78584567-3240-4b79-b085-ea1b83fa1868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6809","nonce":3300498409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6811","nonce":3300498409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6815","nonce":3300498409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":3300498409},{"type":"v1","addr":"172.21.15.133:6813","nonce":3300498409}]},"public_addr":"172.21.15.133:6809/3300498409","cluster_addr":"172.21.15.133:6811/3300498409","heartbeat_back_addr":"172.21.15.133:6815/3300498409","heartbeat_front_addr":"172.21.15.133:6813/3300498409","state":["exists","up"]},{"osd":5,"uuid":"ba3d6fef-d56a-4a09-808e-84bb8c5b1b90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6817","nonce":3892328217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6819","nonce":3892328217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6823","nonce":3892328217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3892328217},{"type":"v1","addr":"172.21.15.133:6821","nonce":3892328217}]},"public_addr":"172.21.15.133:6817/3892328217","cluster_addr":"172.21.15.133:6819/3892328217","heartbeat_back_addr":"172.21.15.133:6823/3892328217","heartbeat_front_addr":"172.21.15.133:6821/3892328217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:35:54.616062+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:13.940774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:33.140071+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:51.066041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:09.306146+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:27.119927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6827/1458998795":"2023-12-17T07:38:25.483273+0000","172.21.15.49:0/226482574":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3034826394":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/2648683047":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6800/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6801/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6800/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6801/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3505892537":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1476740054":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6801/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1284982982":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/1954956906":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/4193621983":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/3838333790":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6800/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6826/1458998795":"2023-12-17T07:38:25.483273+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T07:38:35.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa46c068f60 msgr2=0x7fa46c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa46c068f60 0x7fa46c06b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa470009fd0 tx=0x7fa470009f20 comp rx=0 tx=0).stop 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 msgr2=0x7fa48010d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa48010d2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa47c004f90 tx=0x7fa47c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 shutdown_connections 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa46c068f60 0x7fa46c06b410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4800fad30 0x7fa48010d2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 --2- 172.21.15.49:0/3925303520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4800fddc0 0x7fa48010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 >> 172.21.15.49:0/3925303520 conn(0x7fa4800f67b0 msgr2=0x7fa480100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 shutdown_connections 2023-12-16T07:38:35.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.831+0000 7fa4882a6700 1 -- 172.21.15.49:0/3925303520 wait complete. 2023-12-16T07:38:35.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T07:36:35.661056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T07:38:15.937834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T07:38:16.870070+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-16T07:38:35.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T07:38:35.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 -- 172.21.15.49:0/3879386150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fb920 msgr2=0x7f09b80fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3879386150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fb920 0x7f09b80fbd30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f09a8004940 tx=0x7f09a8009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 -- 172.21.15.49:0/3879386150 shutdown_connections 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3879386150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b80fc270 0x7f09b80fcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3879386150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fb920 0x7f09b80fbd30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 -- 172.21.15.49:0/3879386150 >> 172.21.15.49:0/3879386150 conn(0x7f09b80f70c0 msgr2=0x7f09b80f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 -- 172.21.15.49:0/3879386150 shutdown_connections 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.969+0000 7f09bd41d700 1 -- 172.21.15.49:0/3879386150 wait complete. 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09bd41d700 1 Processor -- start 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09bd41d700 1 -- start start 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09bd41d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b80fb920 0x7f09b80ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09bd41d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fc270 0x7f09b80fdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09bd41d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80ffef0 con 0x7f09b80fc270 2023-12-16T07:38:35.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09bd41d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80fe4c0 con 0x7f09b80fb920 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09b67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fc270 0x7f09b80fdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09b67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fc270 0x7f09b80fdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49660/0 (socket says 172.21.15.49:49660) 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09b67fc700 1 -- 172.21.15.49:0/3698902372 learned_addr learned my addr 172.21.15.49:0/3698902372 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.970+0000 7f09b6ffd700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b80fb920 0x7f09b80ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f09b67fc700 1 -- 172.21.15.49:0/3698902372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b80fb920 msgr2=0x7f09b80ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f09b67fc700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b80fb920 0x7f09b80ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f09b67fc700 1 -- 172.21.15.49:0/3698902372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8005040 con 0x7f09b80fc270 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f09b67fc700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fc270 0x7f09b80fdf50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09ac002a50 tx=0x7f09ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f099f7fe700 1 -- 172.21.15.49:0/3698902372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ac007cc0 con 0x7f09b80fc270 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f099f7fe700 1 -- 172.21.15.49:0/3698902372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f09ac00f040 con 0x7f09b80fc270 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f099f7fe700 1 -- 172.21.15.49:0/3698902372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ac00d9c0 con 0x7f09b80fc270 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b80fe7a0 con 0x7f09b80fc270 2023-12-16T07:38:35.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.971+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b80fed60 con 0x7f09b80fc270 2023-12-16T07:38:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.972+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b8104300 con 0x7f09b80fc270 2023-12-16T07:38:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.972+0000 7f099f7fe700 1 -- 172.21.15.49:0/3698902372 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f09ac00db20 con 0x7f09b80fc270 2023-12-16T07:38:35.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.973+0000 7f099f7fe700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f09a0068f60 0x7f09a006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.973+0000 7f099f7fe700 1 -- 172.21.15.49:0/3698902372 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f09ac086a30 con 0x7f09b80fc270 2023-12-16T07:38:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.973+0000 7f09b6ffd700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f09a0068f60 0x7f09a006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:35.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.973+0000 7f09b6ffd700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f09a0068f60 0x7f09a006b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09a8004890 tx=0x7f09a8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:35.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:35.977+0000 7f099f7fe700 1 -- 172.21.15.49:0/3698902372 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f09ac056940 con 0x7f09b80fc270 2023-12-16T07:38:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:35 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3381131615' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T07:38:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:35 smithi133 ceph-mon[120445]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-16T07:38:36.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.168+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09b8115450 con 0x7f09b80fc270 2023-12-16T07:38:36.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.168+0000 7f099f7fe700 1 -- 172.21.15.49:0/3698902372 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09ac0564d0 con 0x7f09b80fc270 2023-12-16T07:38:36.168 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-16T07:38:36.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f09a0068f60 msgr2=0x7f09a006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f09a0068f60 0x7f09a006b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09a8004890 tx=0x7f09a8009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fc270 msgr2=0x7f09b80fdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fc270 0x7f09b80fdf50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09ac002a50 tx=0x7f09ac0046b0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 shutdown_connections 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f09a0068f60 0x7f09a006b410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09b80fb920 0x7f09b80ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 --2- 172.21.15.49:0/3698902372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09b80fc270 0x7f09b80fdf50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 >> 172.21.15.49:0/3698902372 conn(0x7f09b80f70c0 msgr2=0x7f09b8065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 shutdown_connections 2023-12-16T07:38:36.171 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.170+0000 7f09bd41d700 1 -- 172.21.15.49:0/3698902372 wait complete. 2023-12-16T07:38:36.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:35 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3381131615' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-16T07:38:36.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:35 smithi049 ceph-mon[111939]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-16T07:38:36.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T07:38:36.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 -- 172.21.15.49:0/945699095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 msgr2=0x7fc7040fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/945699095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc7040fbd80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc700004940 tx=0x7fc700009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 -- 172.21.15.49:0/945699095 shutdown_connections 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/945699095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040fcb80 0x7fc7040fcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/945699095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc7040fbd80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 -- 172.21.15.49:0/945699095 >> 172.21.15.49:0/945699095 conn(0x7fc7040f7010 msgr2=0x7fc7040f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 -- 172.21.15.49:0/945699095 shutdown_connections 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.307+0000 7fc70b2c5700 1 -- 172.21.15.49:0/945699095 wait complete. 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc70b2c5700 1 Processor -- start 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc70b2c5700 1 -- start start 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc70b2c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc70410d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc70b2c5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040fcb80 0x7fc70410d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc70b2c5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70410de00 con 0x7fc7040fb970 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc70b2c5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70410df70 con 0x7fc7040fcb80 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc709061700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc70410d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc709061700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc70410d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49670/0 (socket says 172.21.15.49:49670) 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc709061700 1 -- 172.21.15.49:0/140376275 learned_addr learned my addr 172.21.15.49:0/140376275 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc708860700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040fcb80 0x7fc70410d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc709061700 1 -- 172.21.15.49:0/140376275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040fcb80 msgr2=0x7fc70410d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc709061700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040fcb80 0x7fc70410d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc709061700 1 -- 172.21.15.49:0/140376275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700005040 con 0x7fc7040fb970 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.308+0000 7fc708860700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040fcb80 0x7fc70410d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.309+0000 7fc709061700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc70410d2c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc700004f90 tx=0x7fc700009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.309+0000 7fc6f9ffb700 1 -- 172.21.15.49:0/140376275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70000e040 con 0x7fc7040fb970 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.309+0000 7fc6f9ffb700 1 -- 172.21.15.49:0/140376275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc70000bcd0 con 0x7fc7040fb970 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.309+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7041129c0 con 0x7fc7040fb970 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.309+0000 7fc6f9ffb700 1 -- 172.21.15.49:0/140376275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70001c630 con 0x7fc7040fb970 2023-12-16T07:38:36.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.309+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc704112f80 con 0x7fc7040fb970 2023-12-16T07:38:36.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.310+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc704104310 con 0x7fc7040fb970 2023-12-16T07:38:36.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.310+0000 7fc6f9ffb700 1 -- 172.21.15.49:0/140376275 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc700013960 con 0x7fc7040fb970 2023-12-16T07:38:36.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.311+0000 7fc6f9ffb700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc6f0068f60 0x7fc6f006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.311+0000 7fc6f9ffb700 1 -- 172.21.15.49:0/140376275 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc700088280 con 0x7fc7040fb970 2023-12-16T07:38:36.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.311+0000 7fc708860700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc6f0068f60 0x7fc6f006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.311+0000 7fc708860700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc6f0068f60 0x7fc6f006b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f4009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:36.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.315+0000 7fc6f9ffb700 1 -- 172.21.15.49:0/140376275 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc700058190 con 0x7fc7040fb970 2023-12-16T07:38:36.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.510+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc7041135c0 con 0x7fc7040fb970 2023-12-16T07:38:36.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.511+0000 7fc6f9ffb700 1 -- 172.21.15.49:0/140376275 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc700057d20 con 0x7fc7040fb970 2023-12-16T07:38:36.511 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-16T07:38:36.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc6f0068f60 msgr2=0x7fc6f006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc6f0068f60 0x7fc6f006b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f4009ee0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 msgr2=0x7fc70410d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc70410d2c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc700004f90 tx=0x7fc700009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 shutdown_connections 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fc6f0068f60 0x7fc6f006b410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7040fb970 0x7fc70410d2c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 --2- 172.21.15.49:0/140376275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040fcb80 0x7fc70410d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 >> 172.21.15.49:0/140376275 conn(0x7fc7040f7010 msgr2=0x7fc704064b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 shutdown_connections 2023-12-16T07:38:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.513+0000 7fc70b2c5700 1 -- 172.21.15.49:0/140376275 wait complete. 2023-12-16T07:38:36.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T07:38:36.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.650+0000 7fa4dc227700 1 -- 172.21.15.49:0/954524282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 msgr2=0x7fa4d40fe1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.650+0000 7fa4dc227700 1 --2- 172.21.15.49:0/954524282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d40fe1a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4004940 tx=0x7fa4c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 -- 172.21.15.49:0/954524282 shutdown_connections 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 --2- 172.21.15.49:0/954524282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d40fe1a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 --2- 172.21.15.49:0/954524282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d40fca80 0x7fa4d40fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 -- 172.21.15.49:0/954524282 >> 172.21.15.49:0/954524282 conn(0x7fa4d40f81c0 msgr2=0x7fa4d40fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 -- 172.21.15.49:0/954524282 shutdown_connections 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 -- 172.21.15.49:0/954524282 wait complete. 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 Processor -- start 2023-12-16T07:38:36.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 -- start start 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d40fca80 0x7fa4d410f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d410f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d410ffc0 con 0x7fa4d40fdd30 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4dc227700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4110130 con 0x7fa4d40fca80 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4d97c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d410f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4d97c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d410f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49694/0 (socket says 172.21.15.49:49694) 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.651+0000 7fa4d97c2700 1 -- 172.21.15.49:0/187989730 learned_addr learned my addr 172.21.15.49:0/187989730 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4d9fc3700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d40fca80 0x7fa4d410f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4d97c2700 1 -- 172.21.15.49:0/187989730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d40fca80 msgr2=0x7fa4d410f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4d97c2700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d40fca80 0x7fa4d410f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4d97c2700 1 -- 172.21.15.49:0/187989730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4005040 con 0x7fa4d40fdd30 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4d9fc3700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d40fca80 0x7fa4d410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4d97c2700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d410f9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b3b0 tx=0x7fa4c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:36.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4ca7fc700 1 -- 172.21.15.49:0/187989730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c400e040 con 0x7fa4d40fdd30 2023-12-16T07:38:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4ca7fc700 1 -- 172.21.15.49:0/187989730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa4c4009b10 con 0x7fa4d40fdd30 2023-12-16T07:38:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d4114b80 con 0x7fa4d40fdd30 2023-12-16T07:38:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4ca7fc700 1 -- 172.21.15.49:0/187989730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c401c630 con 0x7fa4d40fdd30 2023-12-16T07:38:36.655 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.652+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d4115140 con 0x7fa4d40fdd30 2023-12-16T07:38:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.653+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d4101dd0 con 0x7fa4d40fdd30 2023-12-16T07:38:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.654+0000 7fa4ca7fc700 1 -- 172.21.15.49:0/187989730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa4c4013960 con 0x7fa4d40fdd30 2023-12-16T07:38:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.654+0000 7fa4ca7fc700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa4c0068f60 0x7fa4c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.654+0000 7fa4ca7fc700 1 -- 172.21.15.49:0/187989730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa4c4088c60 con 0x7fa4d40fdd30 2023-12-16T07:38:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.654+0000 7fa4d9fc3700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa4c0068f60 0x7fa4c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.655+0000 7fa4d9fc3700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa4c0068f60 0x7fa4c006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:36.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.658+0000 7fa4ca7fc700 1 -- 172.21.15.49:0/187989730 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa4c4058c10 con 0x7fa4d40fdd30 2023-12-16T07:38:36.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.853+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa4d402b320 con 0x7fa4d40fdd30 2023-12-16T07:38:36.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.853+0000 7fa4ca7fc700 1 -- 172.21.15.49:0/187989730 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa4c40587a0 con 0x7fa4d40fdd30 2023-12-16T07:38:36.854 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa4c0068f60 msgr2=0x7fa4c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa4c0068f60 0x7fa4c006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d000b040 comp rx=0 tx=0).stop 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 msgr2=0x7fa4d410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d410f9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b3b0 tx=0x7fa4c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 shutdown_connections 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa4c0068f60 0x7fa4c006b410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d40fca80 0x7fa4d410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 --2- 172.21.15.49:0/187989730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d40fdd30 0x7fa4d410f9c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.856 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 >> 172.21.15.49:0/187989730 conn(0x7fa4d40f81c0 msgr2=0x7fa4d40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:36.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 shutdown_connections 2023-12-16T07:38:36.857 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.855+0000 7fa4dc227700 1 -- 172.21.15.49:0/187989730 wait complete. 2023-12-16T07:38:36.867 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:36 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3925303520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:38:36.867 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:36 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3698902372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:38:36.867 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:36 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/140376275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T07:38:36.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 -- 172.21.15.49:0/288964709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 msgr2=0x7fe9480fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 --2- 172.21.15.49:0/288964709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe9480fcea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe930004940 tx=0x7fe930009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 -- 172.21.15.49:0/288964709 shutdown_connections 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 --2- 172.21.15.49:0/288964709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9480fdca0 0x7fe9480fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 --2- 172.21.15.49:0/288964709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe9480fcea0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 -- 172.21.15.49:0/288964709 >> 172.21.15.49:0/288964709 conn(0x7fe9480f8150 msgr2=0x7fe9480fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 -- 172.21.15.49:0/288964709 shutdown_connections 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 -- 172.21.15.49:0/288964709 wait complete. 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 Processor -- start 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.990+0000 7fe94e143700 1 -- start start 2023-12-16T07:38:36.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe94e143700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe948071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe94e143700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9480fdca0 0x7fe94806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe94e143700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948071f30 con 0x7fe9480fca90 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe94e143700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948070500 con 0x7fe9480fdca0 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe9477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe948071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe9477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe948071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49716/0 (socket says 172.21.15.49:49716) 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe9477fe700 1 -- 172.21.15.49:0/3153503517 learned_addr learned my addr 172.21.15.49:0/3153503517 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe946ffd700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9480fdca0 0x7fe94806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe9477fe700 1 -- 172.21.15.49:0/3153503517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9480fdca0 msgr2=0x7fe94806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe9477fe700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9480fdca0 0x7fe94806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe9477fe700 1 -- 172.21.15.49:0/3153503517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe930005040 con 0x7fe9480fca90 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe9477fe700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe948071930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe93ffff700 1 -- 172.21.15.49:0/3153503517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe930021070 con 0x7fe9480fca90 2023-12-16T07:38:36.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe93ffff700 1 -- 172.21.15.49:0/3153503517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe93001c400 con 0x7fe9480fca90 2023-12-16T07:38:36.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe948070780 con 0x7fe9480fca90 2023-12-16T07:38:36.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe93ffff700 1 -- 172.21.15.49:0/3153503517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93000e070 con 0x7fe9480fca90 2023-12-16T07:38:36.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.991+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe948070ce0 con 0x7fe9480fca90 2023-12-16T07:38:36.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.992+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe948105430 con 0x7fe9480fca90 2023-12-16T07:38:36.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.993+0000 7fe93ffff700 1 -- 172.21.15.49:0/3153503517 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe93001ca00 con 0x7fe9480fca90 2023-12-16T07:38:36.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.993+0000 7fe93ffff700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe934068f60 0x7fe93406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:36.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.993+0000 7fe93ffff700 1 -- 172.21.15.49:0/3153503517 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe930087fa0 con 0x7fe9480fca90 2023-12-16T07:38:36.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.993+0000 7fe946ffd700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe934068f60 0x7fe93406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:36.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.994+0000 7fe946ffd700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe934068f60 0x7fe93406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe938009b80 tx=0x7fe93800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:36.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:36.998+0000 7fe93ffff700 1 -- 172.21.15.49:0/3153503517 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe930057eb0 con 0x7fe9480fca90 2023-12-16T07:38:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:36 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3925303520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:38:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:36 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3698902372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:38:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:36 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/140376275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T07:38:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.239+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe948115380 con 0x7fe9480fca90 2023-12-16T07:38:37.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.240+0000 7fe93ffff700 1 -- 172.21.15.49:0/3153503517 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4691 (secure 0 0 0) 0x7fe930057a40 con 0x7fe9480fca90 2023-12-16T07:38:37.240 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:38:37.240 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14478,"name":"cephfs.smithi049.eyimyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.49:6829/186303549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":186303549},{"type":"v1","addr":"172.21.15.49:6829","nonce":186303549}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14490,"name":"cephfs.smithi049.ekquzl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3806583046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3806583046},{"type":"v1","addr":"172.21.15.49:6827","nonce":3806583046}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24321,"name":"cephfs.smithi133.uedvhy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/1973165985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1973165985},{"type":"v1","addr":"172.21.15.133:6827","nonce":1973165985}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T07:38:17.449056+0000","modified":"2023-12-16T07:38:28.491615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24305":{"gid":24305,"name":"cephfs.smithi133.takfuo","rank":0,"incarnation":10,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6825/1044825502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1044825502},{"type":"v1","addr":"172.21.15.133:6825","nonce":1044825502}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe934068f60 msgr2=0x7fe93406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe934068f60 0x7fe93406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe938009b80 tx=0x7fe93800b040 comp rx=0 tx=0).stop 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 msgr2=0x7fe948071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe948071930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 shutdown_connections 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe934068f60 0x7fe93406b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9480fca90 0x7fe948071930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 --2- 172.21.15.49:0/3153503517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9480fdca0 0x7fe94806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 >> 172.21.15.49:0/3153503517 conn(0x7fe9480f8150 msgr2=0x7fe948100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:37.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 shutdown_connections 2023-12-16T07:38:37.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:37.242+0000 7fe94e143700 1 -- 172.21.15.49:0/3153503517 wait complete. 2023-12-16T07:38:37.244 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:38:37.254 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2023-12-16T07:38:37.255 INFO:teuthology.run_tasks:Running task kclient... 2023-12-16T07:38:37.281 INFO:tasks.kclient:Mounting kernel clients... 2023-12-16T07:38:37.281 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-16T07:38:37.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:37.281 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-16T07:38:37.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:37.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-12-16T07:38:37.371 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2023-12-16T07:38:37.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:38:37.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:37.372 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-16T07:38:37.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:37.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-16T07:38:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-12-16T07:38:37.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:38:37.477 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-16T07:38:37.477 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T07:38:37.477 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:37.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T07:38:37.750 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:38.035 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:37 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/187989730' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T07:38:38.035 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:37 smithi049 ceph-mon[111939]: pgmap v139: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-16T07:38:38.035 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:37 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3153503517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T07:38:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:37 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/187989730' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T07:38:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:37 smithi133 ceph-mon[120445]: pgmap v139: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-16T07:38:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:37 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3153503517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 -- 172.21.15.49:0/3722049725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 msgr2=0x7fef1c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 --2- 172.21.15.49:0/3722049725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c102ff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fef18004940 tx=0x7fef18009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 -- 172.21.15.49:0/3722049725 shutdown_connections 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 --2- 172.21.15.49:0/3722049725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef1c065390 0x7fef1c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 --2- 172.21.15.49:0/3722049725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c102ff0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 -- 172.21.15.49:0/3722049725 >> 172.21.15.49:0/3722049725 conn(0x7fef1c0719b0 msgr2=0x7fef1c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 -- 172.21.15.49:0/3722049725 shutdown_connections 2023-12-16T07:38:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.723+0000 7fef2433e700 1 -- 172.21.15.49:0/3722049725 wait complete. 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef2433e700 1 Processor -- start 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef2433e700 1 -- start start 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef2433e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef1c065390 0x7fef1c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef2433e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef2433e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c114220 con 0x7fef1c102c20 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef2433e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c10d570 con 0x7fef1c065390 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef218d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef218d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45650/0 (socket says 172.21.15.49:45650) 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.724+0000 7fef218d9700 1 -- 172.21.15.49:0/3800194583 learned_addr learned my addr 172.21.15.49:0/3800194583 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef220da700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef1c065390 0x7fef1c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef218d9700 1 -- 172.21.15.49:0/3800194583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef1c065390 msgr2=0x7fef1c113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef218d9700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef1c065390 0x7fef1c113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef218d9700 1 -- 172.21.15.49:0/3800194583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef18005040 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef218d9700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c113bd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fef10002a50 tx=0x7fef100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef0effd700 1 -- 172.21.15.49:0/3800194583 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef10007cc0 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef0effd700 1 -- 172.21.15.49:0/3800194583 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef1000f040 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c10d850 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef0effd700 1 -- 172.21.15.49:0/3800194583 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1000d9c0 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.725+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c10dd90 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.726+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c0fff40 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.726+0000 7fef0effd700 1 -- 172.21.15.49:0/3800194583 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fef1000db20 con 0x7fef1c102c20 2023-12-16T07:38:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.727+0000 7fef0effd700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fef08068f60 0x7fef0806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.727+0000 7fef0effd700 1 -- 172.21.15.49:0/3800194583 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fef10086a30 con 0x7fef1c102c20 2023-12-16T07:38:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.727+0000 7fef220da700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fef08068f60 0x7fef0806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.727+0000 7fef220da700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fef08068f60 0x7fef0806b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef18004f90 tx=0x7fef18009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:38.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.732+0000 7fef0effd700 1 -- 172.21.15.49:0/3800194583 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fef10056940 con 0x7fef1c102c20 2023-12-16T07:38:38.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.971+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef1c0734d0 con 0x7fef1c102c20 2023-12-16T07:38:38.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.971+0000 7fef0effd700 1 -- 172.21.15.49:0/3800194583 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fef100564d0 con 0x7fef1c102c20 2023-12-16T07:38:38.971 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T07:38:38.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fef08068f60 msgr2=0x7fef0806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:38.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fef08068f60 0x7fef0806b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef18004f90 tx=0x7fef18009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 msgr2=0x7fef1c113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c113bd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fef10002a50 tx=0x7fef100046b0 comp rx=0 tx=0).stop 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 shutdown_connections 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fef08068f60 0x7fef0806b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef1c065390 0x7fef1c113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 --2- 172.21.15.49:0/3800194583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef1c102c20 0x7fef1c113bd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 >> 172.21.15.49:0/3800194583 conn(0x7fef1c0719b0 msgr2=0x7fef1c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 shutdown_connections 2023-12-16T07:38:38.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:38.973+0000 7fef2433e700 1 -- 172.21.15.49:0/3800194583 wait complete. 2023-12-16T07:38:39.321 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:39 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3800194583' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T07:38:39.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:39 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3800194583' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T07:38:39.373 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T07:38:39.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:39.374 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T07:38:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42113sec preferred_lft 42113sec 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2023-12-16T07:38:39.395 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T07:38:39.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:39.395 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-16T07:38:39.395 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-16T07:38:39.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2023-12-16T07:38:39.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2023-12-16T07:38:39.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2023-12-16T07:38:39.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T07:38:39.396 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-16T07:38:39.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:39.582 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T07:38:39.612 INFO:teuthology.orchestra.run.smithi049.stdout:1 2023-12-16T07:38:39.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:39.613 DEBUG:teuthology.orchestra.run.smithi049:> route 2023-12-16T07:38:39.710 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2023-12-16T07:38:39.710 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T07:38:39.710 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-16T07:38:39.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-16T07:38:39.710 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T07:38:39.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:39.711 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-16T07:38:39.711 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-16T07:38:39.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T07:38:39.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T07:38:39.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T07:38:39.711 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-16T07:38:39.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:39.971 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-16T07:38:39.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:39.990 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2023-12-16T07:38:40.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:40.049 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-16T07:38:40.049 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-16T07:38:40.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T07:38:40.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-16T07:38:40.049 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-16T07:38:40.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:40 smithi049 ceph-mon[111939]: pgmap v140: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T07:38:40.146 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-16T07:38:40.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-16T07:38:40.147 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-16T07:38:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:40 smithi133 ceph-mon[120445]: pgmap v140: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T07:38:40.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:40.414 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2023-12-16T07:38:40.414 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2023-12-16T07:38:40.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2023-12-16T07:38:40.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T07:38:40.414 DEBUG:teuthology.orchestra.run.smithi049:> ') 2023-12-16T07:38:40.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T07:38:40.512 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:40.531 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T07:38:40.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T07:38:40.532 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:40.589 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T07:38:40.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:40.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T07:38:40.696 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T07:38:40.697 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T07:38:40.697 INFO:teuthology.orchestra.run.smithi049.stdout:invalid new device string format 2023-12-16T07:38:40.791 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T07:38:40.791 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T07:38:40.791 INFO:teuthology.orchestra.run.smithi049.stdout:invalid new device string format 2023-12-16T07:38:40.791 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.133:3300" 2023-12-16T07:38:40.791 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T07:38:40.810 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-16T07:38:40.810 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-16T07:38:40.810 INFO:teuthology.orchestra.run.smithi049.stdout:invalid new device string format 2023-12-16T07:38:40.811 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.133:3300" 2023-12-16T07:38:40.811 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T07:38:40.811 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:6789,172.21.15.133:6789" 2023-12-16T07:38:40.811 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.49:6789,172.21.15.133:6789:/ 2023-12-16T07:38:40.811 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4ed9995e-9be5-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T07:38:40.813 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T07:38:40.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:40.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:40.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:40.842 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T07:38:40.934 INFO:teuthology.orchestra.run.smithi049.stdout:client14532 2023-12-16T07:38:40.935 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:38:40.935 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T07:38:40.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:40.956 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T07:38:41.045 INFO:teuthology.orchestra.run.smithi049.stdout:client14532 2023-12-16T07:38:41.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:41.045 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T07:38:41.095 INFO:teuthology.orchestra.run.smithi049.stdout:client14532 2023-12-16T07:38:41.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:41.096 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715.client14532/status') 2023-12-16T07:38:41.152 INFO:teuthology.orchestra.run.smithi049.stdout:instance: client.14532 (3)192.168.0.1:0/2118922654 2023-12-16T07:38:41.152 INFO:teuthology.orchestra.run.smithi049.stdout:blocklisted: false 2023-12-16T07:38:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records in 2023-12-16T07:38:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records out 2023-12-16T07:38:41.153 INFO:teuthology.orchestra.run.smithi049.stderr:70 bytes copied, 2.4606e-05 s, 2.8 MB/s 2023-12-16T07:38:41.154 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-16T07:38:41.154 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T07:38:41.154 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:41.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-16T07:38:41.429 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:42 smithi049 ceph-mon[111939]: pgmap v141: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T07:38:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/3349936741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 msgr2=0x7f1e080fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/3349936741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e080fbf70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1df4004940 tx=0x7f1df4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/3349936741 shutdown_connections 2023-12-16T07:38:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/3349936741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e080fbf70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/3349936741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e08101b60 0x7f1e08101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/3349936741 >> 172.21.15.49:0/3349936741 conn(0x7f1e080f7680 msgr2=0x7f1e080f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:42.596 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/3349936741 shutdown_connections 2023-12-16T07:38:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.595+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/3349936741 wait complete. 2023-12-16T07:38:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0f0ba700 1 Processor -- start 2023-12-16T07:38:42.597 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0f0ba700 1 -- start start 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0f0ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e0810e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0f0ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e08101b60 0x7f1e0810ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0f0ba700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0810f1b0 con 0x7f1e080fbb00 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0f0ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0810f2f0 con 0x7f1e08101b60 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0ce56700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e0810e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0ce56700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e0810e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45674/0 (socket says 172.21.15.49:45674) 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e0ce56700 1 -- 172.21.15.49:0/2538765359 learned_addr learned my addr 172.21.15.49:0/2538765359 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.596+0000 7f1e07fff700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e08101b60 0x7f1e0810ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e0ce56700 1 -- 172.21.15.49:0/2538765359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e08101b60 msgr2=0x7f1e0810ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:42.598 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e0ce56700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e08101b60 0x7f1e0810ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e0ce56700 1 -- 172.21.15.49:0/2538765359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df4005040 con 0x7f1e080fbb00 2023-12-16T07:38:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e0ce56700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e0810e6e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc002a50 tx=0x7f1dfc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e057fa700 1 -- 172.21.15.49:0/2538765359 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dfc007cc0 con 0x7f1e080fbb00 2023-12-16T07:38:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e08117650 con 0x7f1e080fbb00 2023-12-16T07:38:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e057fa700 1 -- 172.21.15.49:0/2538765359 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1dfc00f040 con 0x7f1e080fbb00 2023-12-16T07:38:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e057fa700 1 -- 172.21.15.49:0/2538765359 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dfc00d9c0 con 0x7f1e080fbb00 2023-12-16T07:38:42.599 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.597+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e08117b60 con 0x7f1e080fbb00 2023-12-16T07:38:42.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.598+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e08103f40 con 0x7f1e080fbb00 2023-12-16T07:38:42.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.598+0000 7f1e057fa700 1 -- 172.21.15.49:0/2538765359 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1dfc00db20 con 0x7f1e080fbb00 2023-12-16T07:38:42.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.599+0000 7f1e057fa700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1df8068f60 0x7f1df806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:42.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.599+0000 7f1e057fa700 1 -- 172.21.15.49:0/2538765359 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1dfc086b20 con 0x7f1e080fbb00 2023-12-16T07:38:42.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.599+0000 7f1e07fff700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1df8068f60 0x7f1df806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:42.600 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.599+0000 7f1e07fff700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1df8068f60 0x7f1df806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1e080666c0 tx=0x7f1df4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:42.604 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.604+0000 7f1e057fa700 1 -- 172.21.15.49:0/2538765359 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1dfc052f20 con 0x7f1e080fbb00 2023-12-16T07:38:42.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:42 smithi133 ceph-mon[120445]: pgmap v141: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-16T07:38:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.845+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e08066400 con 0x7f1e080fbb00 2023-12-16T07:38:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.846+0000 7f1e057fa700 1 -- 172.21.15.49:0/2538765359 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f1dfc056540 con 0x7f1e080fbb00 2023-12-16T07:38:42.846 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.847+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1df8068f60 msgr2=0x7f1df806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.847+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1df8068f60 0x7f1df806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1e080666c0 tx=0x7f1df4009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.847+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 msgr2=0x7f1e0810e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.847+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e0810e6e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc002a50 tx=0x7f1dfc0046b0 comp rx=0 tx=0).stop 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.848+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 shutdown_connections 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.848+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1df8068f60 0x7f1df806b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.848+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e080fbb00 0x7f1e0810e6e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:42.848 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.848+0000 7f1e0f0ba700 1 --2- 172.21.15.49:0/2538765359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e08101b60 0x7f1e0810ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.848+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 >> 172.21.15.49:0/2538765359 conn(0x7f1e080f7680 msgr2=0x7f1e080f8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.848+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 shutdown_connections 2023-12-16T07:38:42.849 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:42.848+0000 7f1e0f0ba700 1 -- 172.21.15.49:0/2538765359 wait complete. 2023-12-16T07:38:43.204 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T07:38:43.204 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T07:38:43.204 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-16T07:38:43.204 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T07:38:43.205 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:43.205 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T07:38:43.205 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T07:38:43.205 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T07:38:43.205 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T07:38:43.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.205 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-16T07:38:43.230 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T07:38:43.230 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T07:38:43.230 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T07:38:43.230 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-16T07:38:43.230 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-16T07:38:43.230 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42079sec preferred_lft 42079sec 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-16T07:38:43.231 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-16T07:38:43.232 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T07:38:43.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.232 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-16T07:38:43.232 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-16T07:38:43.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2023-12-16T07:38:43.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2023-12-16T07:38:43.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2023-12-16T07:38:43.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T07:38:43.232 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-16T07:38:43.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.406 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T07:38:43.435 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-16T07:38:43.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.436 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-16T07:38:43.518 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-16T07:38:43.519 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T07:38:43.519 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T07:38:43.519 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T07:38:43.519 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T07:38:43.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.519 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-16T07:38:43.519 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-16T07:38:43.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T07:38:43.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T07:38:43.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T07:38:43.520 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-16T07:38:43.598 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:43 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2538765359' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T07:38:43.598 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:43 smithi133 ceph-mon[120445]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2023-12-16T07:38:43.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.775 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-16T07:38:43.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.834 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-12-16T07:38:43.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.892 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-16T07:38:43.892 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-16T07:38:43.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T07:38:43.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-16T07:38:43.892 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-16T07:38:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:43 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2538765359' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-16T07:38:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:43 smithi049 ceph-mon[111939]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2023-12-16T07:38:43.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-16T07:38:43.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-16T07:38:43.988 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-16T07:38:44.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:44.199 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-16T07:38:44.200 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-16T07:38:44.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-16T07:38:44.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T07:38:44.200 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-16T07:38:44.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T07:38:44.297 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:44.315 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T07:38:44.315 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T07:38:44.315 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:44.372 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-16T07:38:44.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:44.372 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T07:38:44.473 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T07:38:44.473 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T07:38:44.473 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2023-12-16T07:38:44.544 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T07:38:44.545 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T07:38:44.545 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2023-12-16T07:38:44.545 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.133:3300" 2023-12-16T07:38:44.545 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.133:3300" 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.49:6789,172.21.15.133:6789" 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.49:6789,172.21.15.133:6789:/ 2023-12-16T07:38:44.562 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=4ed9995e-9be5-11ee-95a5-87774f69a715" will pass to kernel 2023-12-16T07:38:44.565 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T07:38:44.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:44.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:44.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:44.592 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T07:38:44.666 INFO:teuthology.orchestra.run.smithi133.stdout:client24367 2023-12-16T07:38:44.666 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:38:44.666 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T07:38:44.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:44.726 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T07:38:44.798 INFO:teuthology.orchestra.run.smithi133.stdout:client24367 2023-12-16T07:38:44.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:44.799 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T07:38:44.872 INFO:teuthology.orchestra.run.smithi133.stdout:client24367 2023-12-16T07:38:44.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:38:44.872 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715.client24367/status') 2023-12-16T07:38:44.953 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.24367 (3)192.168.0.1:0/1895192105 2023-12-16T07:38:44.953 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2023-12-16T07:38:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2023-12-16T07:38:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2023-12-16T07:38:44.954 INFO:teuthology.orchestra.run.smithi133.stderr:70 bytes copied, 2.2836e-05 s, 3.1 MB/s 2023-12-16T07:38:44.954 INFO:teuthology.run_tasks:Running task print... 2023-12-16T07:38:44.967 INFO:teuthology.task.print:**** done client 2023-12-16T07:38:44.967 INFO:teuthology.run_tasks:Running task parallel... 2023-12-16T07:38:45.007 INFO:teuthology.task.parallel:starting parallel... 2023-12-16T07:38:45.007 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T07:38:45.008 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T07:38:45.009 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:38:45.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T07:38:45.010 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-16T07:38:45.010 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-16T07:38:45.013 INFO:tasks.workunit:Pulling workunits from ref 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:38:45.014 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-16T07:38:45.014 INFO:tasks.workunit:timeout=3h 2023-12-16T07:38:45.014 INFO:tasks.workunit:cleanup=True 2023-12-16T07:38:45.014 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:45.039 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 99h/153d Inode: 1 Links: 2 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2023-12-16 07:38:20.473374119 +0000 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2023-12-16 07:38:40.839543808 +0000 2023-12-16T07:38:45.040 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2023-12-16 07:38:20.473374119 +0000 2023-12-16T07:38:45.040 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-16T07:38:45.040 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-16T07:38:45.117 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:45.137 INFO:teuthology.orchestra.run.smithi133.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:45.137 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-16T07:38:45.137 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-16T07:38:45.138 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T07:38:45.138 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-16T07:38:45.138 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-16T07:38:45.138 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-16 07:38:45.111425551 +0000 2023-12-16T07:38:45.138 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-16 07:38:45.111425551 +0000 2023-12-16T07:38:45.139 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-16 07:38:20.473374119 +0000 2023-12-16T07:38:45.139 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-16T07:38:45.139 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-16T07:38:45.210 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:38:45.210 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:38:45.231 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-16T07:38:45.268 INFO:tasks.workunit.client.1.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-16T07:38:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 -- 172.21.15.49:0/3275102283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 msgr2=0x7f60641044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 --2- 172.21.15.49:0/3275102283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f60641044e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f604c004940 tx=0x7f604c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 -- 172.21.15.49:0/3275102283 shutdown_connections 2023-12-16T07:38:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 --2- 172.21.15.49:0/3275102283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f60641044e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 --2- 172.21.15.49:0/3275102283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064066070 0x7f6064101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 -- 172.21.15.49:0/3275102283 >> 172.21.15.49:0/3275102283 conn(0x7f60640f7190 msgr2=0x7f60640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 -- 172.21.15.49:0/3275102283 shutdown_connections 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.306+0000 7f6069c3e700 1 -- 172.21.15.49:0/3275102283 wait complete. 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6069c3e700 1 Processor -- start 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6069c3e700 1 -- start start 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6069c3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064066070 0x7f606410f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6069c3e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f606410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6069c3e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60641103a0 con 0x7f6064102100 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6069c3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6064110c40 con 0x7f6064066070 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6062ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f606410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6062ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f606410fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45692/0 (socket says 172.21.15.49:45692) 2023-12-16T07:38:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6062ffd700 1 -- 172.21.15.49:0/1076078135 learned_addr learned my addr 172.21.15.49:0/1076078135 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f60637fe700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064066070 0x7f606410f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6062ffd700 1 -- 172.21.15.49:0/1076078135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064066070 msgr2=0x7f606410f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6062ffd700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064066070 0x7f606410f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f6062ffd700 1 -- 172.21.15.49:0/1076078135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c005040 con 0x7f6064102100 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.307+0000 7f60637fe700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064066070 0x7f606410f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.308+0000 7f6062ffd700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f606410fda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f604c000c00 tx=0x7f604c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.308+0000 7f605bfff700 1 -- 172.21.15.49:0/1076078135 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604c00e040 con 0x7f6064102100 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.308+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6064110ec0 con 0x7f6064102100 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.308+0000 7f605bfff700 1 -- 172.21.15.49:0/1076078135 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f604c00bcd0 con 0x7f6064102100 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.308+0000 7f605bfff700 1 -- 172.21.15.49:0/1076078135 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604c01c630 con 0x7f6064102100 2023-12-16T07:38:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.308+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6064111400 con 0x7f6064102100 2023-12-16T07:38:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.309+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6064109700 con 0x7f6064102100 2023-12-16T07:38:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.309+0000 7f605bfff700 1 -- 172.21.15.49:0/1076078135 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f604c0139d0 con 0x7f6064102100 2023-12-16T07:38:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.310+0000 7f605bfff700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6050068f60 0x7f605006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.310+0000 7f605bfff700 1 -- 172.21.15.49:0/1076078135 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f604c0882f0 con 0x7f6064102100 2023-12-16T07:38:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.310+0000 7f60637fe700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6050068f60 0x7f605006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.310+0000 7f60637fe700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6050068f60 0x7f605006b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6054009fd0 tx=0x7f6054009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:46.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.314+0000 7f605bfff700 1 -- 172.21.15.49:0/1076078135 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f604c058200 con 0x7f6064102100 2023-12-16T07:38:46.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:46 smithi049 ceph-mon[111939]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:38:46.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.511+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f6064109120 con 0x7f6064102100 2023-12-16T07:38:46.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.511+0000 7f605bfff700 1 -- 172.21.15.49:0/1076078135 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f604c057d90 con 0x7f6064102100 2023-12-16T07:38:46.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6050068f60 msgr2=0x7f605006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6050068f60 0x7f605006b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6054009fd0 tx=0x7f6054009ee0 comp rx=0 tx=0).stop 2023-12-16T07:38:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 msgr2=0x7f606410fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f606410fda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f604c000c00 tx=0x7f604c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 shutdown_connections 2023-12-16T07:38:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6050068f60 0x7f605006b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064066070 0x7f606410f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:46.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 --2- 172.21.15.49:0/1076078135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6064102100 0x7f606410fda0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:46.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 >> 172.21.15.49:0/1076078135 conn(0x7f60640f7190 msgr2=0x7f60640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:46.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 shutdown_connections 2023-12-16T07:38:46.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:46.513+0000 7f6069c3e700 1 -- 172.21.15.49:0/1076078135 wait complete. 2023-12-16T07:38:46.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:46 smithi133 ceph-mon[120445]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:38:46.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T07:38:47.205 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:48.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 -- 172.21.15.49:0/1802469564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fcd00 msgr2=0x7fbd240fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:48.209 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 --2- 172.21.15.49:0/1802469564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fcd00 0x7fbd240fd150 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c004940 tx=0x7fbd0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:48.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 -- 172.21.15.49:0/1802469564 shutdown_connections 2023-12-16T07:38:48.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 --2- 172.21.15.49:0/1802469564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fcd00 0x7fbd240fd150 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:48.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 --2- 172.21.15.49:0/1802469564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd240fbaf0 0x7fbd240fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:48.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 -- 172.21.15.49:0/1802469564 >> 172.21.15.49:0/1802469564 conn(0x7fbd240f71d0 msgr2=0x7fbd240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:48.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 -- 172.21.15.49:0/1802469564 shutdown_connections 2023-12-16T07:38:48.210 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.209+0000 7fbd29993700 1 -- 172.21.15.49:0/1802469564 wait complete. 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd29993700 1 Processor -- start 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd29993700 1 -- start start 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd29993700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fbaf0 0x7fbd2410c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd29993700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd240fcd00 0x7fbd2410c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd29993700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2410d010 con 0x7fbd240fbaf0 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd29993700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2410d850 con 0x7fbd240fcd00 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fbaf0 0x7fbd2410c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fbaf0 0x7fbd2410c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56588/0 (socket says 172.21.15.49:56588) 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd22ffd700 1 -- 172.21.15.49:0/684792234 learned_addr learned my addr 172.21.15.49:0/684792234 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.210+0000 7fbd227fc700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd240fcd00 0x7fbd2410c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd22ffd700 1 -- 172.21.15.49:0/684792234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd240fcd00 msgr2=0x7fbd2410c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd22ffd700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd240fcd00 0x7fbd2410c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd22ffd700 1 -- 172.21.15.49:0/684792234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c005040 con 0x7fbd240fbaf0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd227fc700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd240fcd00 0x7fbd2410c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd22ffd700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fbaf0 0x7fbd2410c440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400b790 tx=0x7fbd14009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd1b7fe700 1 -- 172.21.15.49:0/684792234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd1400f6f0 con 0x7fbd240fbaf0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd1b7fe700 1 -- 172.21.15.49:0/684792234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd1400fd00 con 0x7fbd240fbaf0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2410db30 con 0x7fbd240fbaf0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd1b7fe700 1 -- 172.21.15.49:0/684792234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd140103a0 con 0x7fbd240fbaf0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.211+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2410e070 con 0x7fbd240fbaf0 2023-12-16T07:38:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.212+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2404bb80 con 0x7fbd240fbaf0 2023-12-16T07:38:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.212+0000 7fbd1b7fe700 1 -- 172.21.15.49:0/684792234 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbd1400f850 con 0x7fbd240fbaf0 2023-12-16T07:38:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.213+0000 7fbd1b7fe700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fbd10068f60 0x7fbd1006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.213+0000 7fbd1b7fe700 1 -- 172.21.15.49:0/684792234 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbd14086c20 con 0x7fbd240fbaf0 2023-12-16T07:38:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.213+0000 7fbd227fc700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fbd10068f60 0x7fbd1006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.213+0000 7fbd227fc700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fbd10068f60 0x7fbd1006b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c004560 tx=0x7fbd0c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.217+0000 7fbd1b7fe700 1 -- 172.21.15.49:0/684792234 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbd14056ab0 con 0x7fbd240fbaf0 2023-12-16T07:38:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.413+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fbd24104530 con 0x7fbd240fbaf0 2023-12-16T07:38:48.414 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.414+0000 7fbd1b7fe700 1 -- 172.21.15.49:0/684792234 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fbd14056640 con 0x7fbd240fbaf0 2023-12-16T07:38:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fbd10068f60 msgr2=0x7fbd1006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fbd10068f60 0x7fbd1006b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c004560 tx=0x7fbd0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fbaf0 msgr2=0x7fbd2410c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fbaf0 0x7fbd2410c440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400b790 tx=0x7fbd14009220 comp rx=0 tx=0).stop 2023-12-16T07:38:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 shutdown_connections 2023-12-16T07:38:48.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fbd10068f60 0x7fbd1006b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:48.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd240fbaf0 0x7fbd2410c440 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:48.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 --2- 172.21.15.49:0/684792234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd240fcd00 0x7fbd2410c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:48.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 >> 172.21.15.49:0/684792234 conn(0x7fbd240f71d0 msgr2=0x7fbd240fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:48.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 shutdown_connections 2023-12-16T07:38:48.417 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:48.416+0000 7fbd29993700 1 -- 172.21.15.49:0/684792234 wait complete. 2023-12-16T07:38:48.575 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:48 smithi049 ceph-mon[111939]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T07:38:48.575 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:48.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:48 smithi133 ceph-mon[120445]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T07:38:48.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:38:48.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T07:38:49.076 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 -- 172.21.15.49:0/730368870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fbaf0 msgr2=0x7f39480fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 --2- 172.21.15.49:0/730368870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fbaf0 0x7f39480fbf00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3938004940 tx=0x7f3938009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 -- 172.21.15.49:0/730368870 shutdown_connections 2023-12-16T07:38:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 --2- 172.21.15.49:0/730368870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480fcd00 0x7f39480fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 --2- 172.21.15.49:0/730368870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fbaf0 0x7f39480fbf00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 -- 172.21.15.49:0/730368870 >> 172.21.15.49:0/730368870 conn(0x7f39480f7190 msgr2=0x7f39480f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:50.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 -- 172.21.15.49:0/730368870 shutdown_connections 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.074+0000 7f394d5ad700 1 -- 172.21.15.49:0/730368870 wait complete. 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f394d5ad700 1 Processor -- start 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f394d5ad700 1 -- start start 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f394d5ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480fbaf0 0x7f39480ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f394d5ad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fcd00 0x7f39480fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f394d5ad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39480fe640 con 0x7f39480fcd00 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f394d5ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39480fe7b0 con 0x7f39480fbaf0 2023-12-16T07:38:50.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f39467fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fcd00 0x7f39480fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f39467fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fcd00 0x7f39480fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56600/0 (socket says 172.21.15.49:56600) 2023-12-16T07:38:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f39467fc700 1 -- 172.21.15.49:0/3922081873 learned_addr learned my addr 172.21.15.49:0/3922081873 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.075+0000 7f3946ffd700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480fbaf0 0x7f39480ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f39467fc700 1 -- 172.21.15.49:0/3922081873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480fbaf0 msgr2=0x7f39480ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f39467fc700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480fbaf0 0x7f39480ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f39467fc700 1 -- 172.21.15.49:0/3922081873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938005040 con 0x7f39480fcd00 2023-12-16T07:38:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f39467fc700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fcd00 0x7f39480fe040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f393c00c8c0 tx=0x7f393c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f392f7fe700 1 -- 172.21.15.49:0/3922081873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f393c00a760 con 0x7f39480fcd00 2023-12-16T07:38:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f392f7fe700 1 -- 172.21.15.49:0/3922081873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f393c00ad70 con 0x7f39480fcd00 2023-12-16T07:38:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39480fea90 con 0x7f39480fcd00 2023-12-16T07:38:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f392f7fe700 1 -- 172.21.15.49:0/3922081873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f393c0113a0 con 0x7f39480fcd00 2023-12-16T07:38:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.076+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39481155b0 con 0x7f39480fcd00 2023-12-16T07:38:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.077+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394804bb80 con 0x7f39480fcd00 2023-12-16T07:38:50.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.077+0000 7f392f7fe700 1 -- 172.21.15.49:0/3922081873 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f393c012400 con 0x7f39480fcd00 2023-12-16T07:38:50.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.078+0000 7f392f7fe700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3930068f60 0x7f393006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:50.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.078+0000 7f392f7fe700 1 -- 172.21.15.49:0/3922081873 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f393c086e80 con 0x7f39480fcd00 2023-12-16T07:38:50.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.078+0000 7f3946ffd700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3930068f60 0x7f393006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:50.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.078+0000 7f3946ffd700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3930068f60 0x7f393006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f393800b7d0 tx=0x7f3938009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:50.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.082+0000 7f392f7fe700 1 -- 172.21.15.49:0/3922081873 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f393c056d90 con 0x7f39480fcd00 2023-12-16T07:38:50.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.292+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f3948104490 con 0x7f39480fcd00 2023-12-16T07:38:50.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.292+0000 7f392f7fe700 1 -- 172.21.15.49:0/3922081873 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f393c056920 con 0x7f39480fcd00 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3930068f60 msgr2=0x7f393006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3930068f60 0x7f393006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f393800b7d0 tx=0x7f3938009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fcd00 msgr2=0x7f39480fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fcd00 0x7f39480fe040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f393c00c8c0 tx=0x7f393c0044c0 comp rx=0 tx=0).stop 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 shutdown_connections 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3930068f60 0x7f393006b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480fbaf0 0x7f39480ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 --2- 172.21.15.49:0/3922081873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39480fcd00 0x7f39480fe040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 >> 172.21.15.49:0/3922081873 conn(0x7f39480f7190 msgr2=0x7f3948065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:50.295 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 shutdown_connections 2023-12-16T07:38:50.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:50.294+0000 7f394d5ad700 1 -- 172.21.15.49:0/3922081873 wait complete. 2023-12-16T07:38:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:50 smithi133 ceph-mon[120445]: pgmap v145: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T07:38:50.636 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:50 smithi049 ceph-mon[111939]: pgmap v145: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T07:38:50.672 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-16T07:38:50.955 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:38:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.034+0000 7fa029e23700 1 -- 172.21.15.49:0/969044956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0240ffd90 msgr2=0x7fa0241021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.034+0000 7fa029e23700 1 --2- 172.21.15.49:0/969044956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0240ffd90 0x7fa0241021d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa00c004940 tx=0x7fa00c009e30 comp rx=0 tx=0).stop 2023-12-16T07:38:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 -- 172.21.15.49:0/969044956 shutdown_connections 2023-12-16T07:38:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 --2- 172.21.15.49:0/969044956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0240ffd90 0x7fa0241021d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 --2- 172.21.15.49:0/969044956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa024066070 0x7fa0240ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 -- 172.21.15.49:0/969044956 >> 172.21.15.49:0/969044956 conn(0x7fa0240f7190 msgr2=0x7fa0240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 -- 172.21.15.49:0/969044956 shutdown_connections 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 -- 172.21.15.49:0/969044956 wait complete. 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 Processor -- start 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 -- start start 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa024066070 0x7fa0240fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240ffd90 0x7fa0240fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240fbcc0 con 0x7fa024066070 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa029e23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240fbe30 con 0x7fa0240ffd90 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa0237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa024066070 0x7fa0240fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa0237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa024066070 0x7fa0240fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56610/0 (socket says 172.21.15.49:56610) 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.035+0000 7fa0237fe700 1 -- 172.21.15.49:0/3626329276 learned_addr learned my addr 172.21.15.49:0/3626329276 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:38:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa01bfff700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240ffd90 0x7fa0240fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa0237fe700 1 -- 172.21.15.49:0/3626329276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240ffd90 msgr2=0x7fa0240fb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:38:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa0237fe700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240ffd90 0x7fa0240fb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:38:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa0237fe700 1 -- 172.21.15.49:0/3626329276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c005040 con 0x7fa024066070 2023-12-16T07:38:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa0237fe700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa024066070 0x7fa0240fd240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa01400eb40 tx=0x7fa01400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa020ff9700 1 -- 172.21.15.49:0/3626329276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa014007cc0 con 0x7fa024066070 2023-12-16T07:38:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0240fc0b0 con 0x7fa024066070 2023-12-16T07:38:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa020ff9700 1 -- 172.21.15.49:0/3626329276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa01400f040 con 0x7fa024066070 2023-12-16T07:38:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa020ff9700 1 -- 172.21.15.49:0/3626329276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa01400c990 con 0x7fa024066070 2023-12-16T07:38:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.036+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa024115540 con 0x7fa024066070 2023-12-16T07:38:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.037+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0241075c0 con 0x7fa024066070 2023-12-16T07:38:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.038+0000 7fa020ff9700 1 -- 172.21.15.49:0/3626329276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa01400cc00 con 0x7fa024066070 2023-12-16T07:38:52.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.038+0000 7fa020ff9700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa010068f60 0x7fa01006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:38:52.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.038+0000 7fa020ff9700 1 -- 172.21.15.49:0/3626329276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa0140869e0 con 0x7fa024066070 2023-12-16T07:38:52.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.038+0000 7fa01bfff700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa010068f60 0x7fa01006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:38:52.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.039+0000 7fa01bfff700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa010068f60 0x7fa01006b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa00c013680 tx=0x7fa00c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:38:52.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.045+0000 7fa020ff9700 1 -- 172.21.15.49:0/3626329276 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa01404da00 con 0x7fa024066070 2023-12-16T07:38:52.257 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:38:52.257+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fa02402b300 con 0x7fa010068f60 2023-12-16T07:38:52.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:52 smithi133 ceph-mon[120445]: pgmap v146: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T07:38:52.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:52 smithi049 ceph-mon[111939]: pgmap v146: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T07:38:53.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:53 smithi133 ceph-mon[120445]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:53.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:53 smithi049 ceph-mon[111939]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:38:54.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:54 smithi133 ceph-mon[120445]: pgmap v147: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T07:38:54.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:54 smithi049 ceph-mon[111939]: pgmap v147: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-16T07:38:56.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:56 smithi049 ceph-mon[111939]: pgmap v148: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:38:56.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:56 smithi133 ceph-mon[120445]: pgmap v148: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:38:58.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:38:58 smithi133 ceph-mon[120445]: pgmap v149: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:38:58.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:38:58 smithi049 ceph-mon[111939]: pgmap v149: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:39:00.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:00 smithi133 ceph-mon[120445]: pgmap v150: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-16T07:39:00.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:00 smithi049 ceph-mon[111939]: pgmap v150: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-16T07:39:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:02 smithi133 ceph-mon[120445]: pgmap v151: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:02 smithi049 ceph-mon[111939]: pgmap v151: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:03 smithi133 ceph-mon[120445]: pgmap v152: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:03 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:03 smithi049 ceph-mon[111939]: pgmap v152: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:06.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:06 smithi049 ceph-mon[111939]: pgmap v153: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:06.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:06 smithi133 ceph-mon[120445]: pgmap v153: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:08.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:08 smithi133 ceph-mon[120445]: pgmap v154: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:08.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:08 smithi049 ceph-mon[111939]: pgmap v154: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:10 smithi133 ceph-mon[120445]: pgmap v155: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:10.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:10 smithi049 ceph-mon[111939]: pgmap v155: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:12.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:12 smithi133 ceph-mon[120445]: pgmap v156: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:12.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:12 smithi049 ceph-mon[111939]: pgmap v156: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:13 smithi133 ceph-mon[120445]: pgmap v157: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:13.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:13 smithi049 ceph-mon[111939]: pgmap v157: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:16.566 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:16 smithi049 ceph-mon[111939]: pgmap v158: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:16.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:16 smithi133 ceph-mon[120445]: pgmap v158: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:18.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:18 smithi133 ceph-mon[120445]: pgmap v159: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:18.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:18 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:18 smithi049 ceph-mon[111939]: pgmap v159: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:39:18.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:18 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:20.626 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:20 smithi133 ceph-mon[120445]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:39:20.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:20 smithi049 ceph-mon[111939]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:39:22.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:22 smithi133 ceph-mon[120445]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:39:22.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:22 smithi049 ceph-mon[111939]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:39:23.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:23 smithi133 ceph-mon[120445]: pgmap v162: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:39:23.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:23 smithi049 ceph-mon[111939]: pgmap v162: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:39:23.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:23.997+0000 7fa020ff9700 1 -- 172.21.15.49:0/3626329276 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fa02402b300 con 0x7fa010068f60 2023-12-16T07:39:23.998 INFO:teuthology.orchestra.run.smithi049.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:39:24.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa010068f60 msgr2=0x7fa01006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:24.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa010068f60 0x7fa01006b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa00c013680 tx=0x7fa00c009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:24.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa024066070 msgr2=0x7fa0240fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:24.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa024066070 0x7fa0240fd240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa01400eb40 tx=0x7fa01400b040 comp rx=0 tx=0).stop 2023-12-16T07:39:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 shutdown_connections 2023-12-16T07:39:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa010068f60 0x7fa01006b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa024066070 0x7fa0240fd240 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 --2- 172.21.15.49:0/3626329276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240ffd90 0x7fa0240fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 >> 172.21.15.49:0/3626329276 conn(0x7fa0240f7190 msgr2=0x7fa0240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 shutdown_connections 2023-12-16T07:39:24.003 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:24.000+0000 7fa029e23700 1 -- 172.21.15.49:0/3626329276 wait complete. 2023-12-16T07:39:24.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-16T07:39:24.913 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:39:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:24 smithi133 ceph-mon[120445]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:39:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:39:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:39:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:39:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:24 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:25.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:24 smithi133 ceph-mon[120445]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:39:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:24 smithi049 ceph-mon[111939]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:39:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:39:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:39:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:39:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:24 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:24 smithi049 ceph-mon[111939]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:39:26.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:26 smithi049 ceph-mon[111939]: pgmap v163: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:39:26.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 -- 172.21.15.49:0/2767900027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 msgr2=0x7f590c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 --2- 172.21.15.49:0/2767900027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 0x7f590c0fd150 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0049c0 tx=0x7f58fc009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 -- 172.21.15.49:0/2767900027 shutdown_connections 2023-12-16T07:39:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 --2- 172.21.15.49:0/2767900027 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 0x7f590c0fd150 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 --2- 172.21.15.49:0/2767900027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f590c0fbaf0 0x7f590c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 -- 172.21.15.49:0/2767900027 >> 172.21.15.49:0/2767900027 conn(0x7f590c0f7190 msgr2=0x7f590c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:26.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 -- 172.21.15.49:0/2767900027 shutdown_connections 2023-12-16T07:39:26.285 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.283+0000 7f591463b700 1 -- 172.21.15.49:0/2767900027 wait complete. 2023-12-16T07:39:26.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f591463b700 1 Processor -- start 2023-12-16T07:39:26.286 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f591463b700 1 -- start start 2023-12-16T07:39:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f591463b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f590c0fbaf0 0x7f590c10f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f591463b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 0x7f590c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f591463b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c110240 con 0x7f590c0fcd00 2023-12-16T07:39:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f591463b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c110ae0 con 0x7f590c0fbaf0 2023-12-16T07:39:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f59123d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f590c0fbaf0 0x7f590c10f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:26.287 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f5911bd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 0x7f590c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f59123d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f590c0fbaf0 0x7f590c10f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.49:33736/0 (socket says 172.21.15.49:33736) 2023-12-16T07:39:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f59123d7700 1 -- 172.21.15.49:0/3088425523 learned_addr learned my addr 172.21.15.49:0/3088425523 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f5911bd6700 1 -- 172.21.15.49:0/3088425523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f590c0fbaf0 msgr2=0x7f590c10f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f5911bd6700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f590c0fbaf0 0x7f590c10f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.284+0000 7f5911bd6700 1 -- 172.21.15.49:0/3088425523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc005040 con 0x7f590c0fcd00 2023-12-16T07:39:26.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.285+0000 7f5911bd6700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 0x7f590c10fc40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00b870 tx=0x7f58fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:26.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.285+0000 7f5902ffd700 1 -- 172.21.15.49:0/3088425523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58fc00e070 con 0x7f590c0fcd00 2023-12-16T07:39:26.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.285+0000 7f5902ffd700 1 -- 172.21.15.49:0/3088425523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58fc011480 con 0x7f590c0fcd00 2023-12-16T07:39:26.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.285+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c110d60 con 0x7f590c0fcd00 2023-12-16T07:39:26.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.285+0000 7f5902ffd700 1 -- 172.21.15.49:0/3088425523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58fc022640 con 0x7f590c0fcd00 2023-12-16T07:39:26.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.285+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c1112a0 con 0x7f590c0fcd00 2023-12-16T07:39:26.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.286+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f00052e0 con 0x7f590c0fcd00 2023-12-16T07:39:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.287+0000 7f5902ffd700 1 -- 172.21.15.49:0/3088425523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f58fc00ba40 con 0x7f590c0fcd00 2023-12-16T07:39:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.288+0000 7f5902ffd700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f58f8068f60 0x7f58f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.288+0000 7f5902ffd700 1 -- 172.21.15.49:0/3088425523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f58fc0883e0 con 0x7f590c0fcd00 2023-12-16T07:39:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.288+0000 7f59123d7700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f58f8068f60 0x7f58f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.289+0000 7f59123d7700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f58f8068f60 0x7f58f806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5908004f80 tx=0x7f590800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:26.293 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.293+0000 7f5902ffd700 1 -- 172.21.15.49:0/3088425523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f58fc0582d0 con 0x7f590c0fcd00 2023-12-16T07:39:26.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:26 smithi133 ceph-mon[120445]: pgmap v163: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:39:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.510+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58f0000bf0 con 0x7f58f8068f60 2023-12-16T07:39:26.511 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.511+0000 7f5902ffd700 1 -- 172.21.15.49:0/3088425523 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f58f0000bf0 con 0x7f58f8068f60 2023-12-16T07:39:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.513+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f58f8068f60 msgr2=0x7f58f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f58f8068f60 0x7f58f806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5908004f80 tx=0x7f590800b040 comp rx=0 tx=0).stop 2023-12-16T07:39:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 msgr2=0x7f590c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 0x7f590c10fc40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00b870 tx=0x7f58fc009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:26.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 shutdown_connections 2023-12-16T07:39:26.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f58f8068f60 0x7f58f806b410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f590c0fbaf0 0x7f590c10f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 --2- 172.21.15.49:0/3088425523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f590c0fcd00 0x7f590c10fc40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 >> 172.21.15.49:0/3088425523 conn(0x7f590c0f7190 msgr2=0x7f590c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:26.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 shutdown_connections 2023-12-16T07:39:26.515 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.514+0000 7f591463b700 1 -- 172.21.15.49:0/3088425523 wait complete. 2023-12-16T07:39:26.530 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:39:26.661 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.659+0000 7fa3df0bb700 1 -- 172.21.15.49:0/1423459044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fcd00 msgr2=0x7fa3d80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.659+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/1423459044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fcd00 0x7fa3d80fd150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4004940 tx=0x7fa3c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:26.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 -- 172.21.15.49:0/1423459044 shutdown_connections 2023-12-16T07:39:26.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/1423459044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fcd00 0x7fa3d80fd150 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/1423459044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80fbaf0 0x7fa3d80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 -- 172.21.15.49:0/1423459044 >> 172.21.15.49:0/1423459044 conn(0x7fa3d80f71b0 msgr2=0x7fa3d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:26.662 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 -- 172.21.15.49:0/1423459044 shutdown_connections 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 -- 172.21.15.49:0/1423459044 wait complete. 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 Processor -- start 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.660+0000 7fa3df0bb700 1 -- start start 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3df0bb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fbaf0 0x7fa3d810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3df0bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80fcd00 0x7fa3d810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3df0bb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d810dfd0 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3df0bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d810e870 con 0x7fa3d80fcd00 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3dce57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fbaf0 0x7fa3d810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3dce57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fbaf0 0x7fa3d810d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34640/0 (socket says 172.21.15.49:34640) 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3dce57700 1 -- 172.21.15.49:0/2280291203 learned_addr learned my addr 172.21.15.49:0/2280291203 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3d7fff700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80fcd00 0x7fa3d810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3dce57700 1 -- 172.21.15.49:0/2280291203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80fcd00 msgr2=0x7fa3d810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3dce57700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80fcd00 0x7fa3d810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3dce57700 1 -- 172.21.15.49:0/2280291203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4005040 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.661+0000 7fa3dce57700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fbaf0 0x7fa3d810d490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc002a80 tx=0x7fa3cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.662+0000 7fa3d57fa700 1 -- 172.21.15.49:0/2280291203 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3cc007cc0 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.662+0000 7fa3d57fa700 1 -- 172.21.15.49:0/2280291203 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3cc00f040 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.662+0000 7fa3d57fa700 1 -- 172.21.15.49:0/2280291203 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3cc00d9e0 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.662+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d810eaf0 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.662+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d810f030 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.663+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d804bb80 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.664+0000 7fa3d57fa700 1 -- 172.21.15.49:0/2280291203 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa3cc00db40 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.664+0000 7fa3d57fa700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa3c806d430 0x7fa3c806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:26.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.665+0000 7fa3d57fa700 1 -- 172.21.15.49:0/2280291203 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa3cc086510 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.665+0000 7fa3d7fff700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa3c806d430 0x7fa3c806f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:26.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.666+0000 7fa3d7fff700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa3c806d430 0x7fa3c806f8e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40043d0 tx=0x7fa3c4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:26.672 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.672+0000 7fa3d57fa700 1 -- 172.21.15.49:0/2280291203 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa3cc04ca00 con 0x7fa3d80fbaf0 2023-12-16T07:39:26.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.988+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3d8066310 con 0x7fa3c806d430 2023-12-16T07:39:26.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.989+0000 7fa3d57fa700 1 -- 172.21.15.49:0/2280291203 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa3d8066310 con 0x7fa3c806d430 2023-12-16T07:39:26.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa3c806d430 msgr2=0x7fa3c806f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa3c806d430 0x7fa3c806f8e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40043d0 tx=0x7fa3c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:26.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fbaf0 msgr2=0x7fa3d810d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:26.992 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fbaf0 0x7fa3d810d490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc002a80 tx=0x7fa3cc0046b0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 shutdown_connections 2023-12-16T07:39:26.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fa3c806d430 0x7fa3c806f8e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d80fbaf0 0x7fa3d810d490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 --2- 172.21.15.49:0/2280291203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80fcd00 0x7fa3d810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:26.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 >> 172.21.15.49:0/2280291203 conn(0x7fa3d80f71b0 msgr2=0x7fa3d8065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:26.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 shutdown_connections 2023-12-16T07:39:26.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:26.991+0000 7fa3df0bb700 1 -- 172.21.15.49:0/2280291203 wait complete. 2023-12-16T07:39:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.108+0000 7f3aa4c32700 1 -- 172.21.15.49:0/4239992089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa0100050 msgr2=0x7f3aa0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.108+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/4239992089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa0100050 0x7f3aa0102430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3a94004940 tx=0x7f3a94009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.108+0000 7f3aa4c32700 1 -- 172.21.15.49:0/4239992089 shutdown_connections 2023-12-16T07:39:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.108+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/4239992089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa0100050 0x7f3aa0102430 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.108+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/4239992089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00fd730 0x7f3aa00ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.108+0000 7f3aa4c32700 1 -- 172.21.15.49:0/4239992089 >> 172.21.15.49:0/4239992089 conn(0x7f3aa00f71d0 msgr2=0x7f3aa00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 -- 172.21.15.49:0/4239992089 shutdown_connections 2023-12-16T07:39:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 -- 172.21.15.49:0/4239992089 wait complete. 2023-12-16T07:39:27.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 Processor -- start 2023-12-16T07:39:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 -- start start 2023-12-16T07:39:27.113 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa00fd730 0x7f3aa00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa0100050 0x7f3aa00fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01111f0 con 0x7f3aa00fd730 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.112+0000 7f3aa4c32700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0111360 con 0x7f3aa0100050 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa0100050 0x7f3aa00fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa0100050 0x7f3aa00fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.49:33770/0 (socket says 172.21.15.49:33770) 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9dd9b700 1 -- 172.21.15.49:0/1054018716 learned_addr learned my addr 172.21.15.49:0/1054018716 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9e59c700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa00fd730 0x7f3aa00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9e59c700 1 -- 172.21.15.49:0/1054018716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa0100050 msgr2=0x7f3aa00fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9e59c700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa0100050 0x7f3aa00fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9e59c700 1 -- 172.21.15.49:0/1054018716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a94005040 con 0x7f3aa00fd730 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9dd9b700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa0100050 0x7f3aa00fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T07:39:27.114 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a9e59c700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa00fd730 0x7f3aa00fd1c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3a90002820 tx=0x7f3a90004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3a8effd700 1 -- 172.21.15.49:0/1054018716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a90007cc0 con 0x7f3aa00fd730 2023-12-16T07:39:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.113+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0111640 con 0x7f3aa00fd730 2023-12-16T07:39:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.114+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa0111b80 con 0x7f3aa00fd730 2023-12-16T07:39:27.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.114+0000 7f3a8effd700 1 -- 172.21.15.49:0/1054018716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3a9000f040 con 0x7f3aa00fd730 2023-12-16T07:39:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.114+0000 7f3a8effd700 1 -- 172.21.15.49:0/1054018716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a900137d0 con 0x7f3aa00fd730 2023-12-16T07:39:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.115+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a800052e0 con 0x7f3aa00fd730 2023-12-16T07:39:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.115+0000 7f3a8effd700 1 -- 172.21.15.49:0/1054018716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3a90013a80 con 0x7f3aa00fd730 2023-12-16T07:39:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.116+0000 7f3a8effd700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3a88068f60 0x7f3a8806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:27.116 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.116+0000 7f3a8effd700 1 -- 172.21.15.49:0/1054018716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3a90086a40 con 0x7f3aa00fd730 2023-12-16T07:39:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.116+0000 7f3a9dd9b700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3a88068f60 0x7f3a8806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:27.117 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.116+0000 7f3a9dd9b700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3a88068f60 0x7f3a8806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b3b0 tx=0x7f3a94009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:27.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.123+0000 7f3a8effd700 1 -- 172.21.15.49:0/1054018716 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3a90056950 con 0x7f3aa00fd730 2023-12-16T07:39:27.412 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.411+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a80000bf0 con 0x7f3a88068f60 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.421+0000 7f3a8effd700 1 -- 172.21.15.49:0/1054018716 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f3a80000bf0 con 0x7f3a88068f60 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (3m) 53s ago 4m 27.1M - 0.25.0 c8568f914cd2 ac0238c966a8 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (5m) 53s ago 5m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (4m) 56s ago 4m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (3m) 53s ago 4m 88.4M - 9.4.7 954c08fa6188 f8fc00abbcaf 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (67s) 53s ago 67s 12.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (64s) 53s ago 64s 13.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (66s) 56s ago 66s 17.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:39:27.422 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (62s) 56s ago 62s 15.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:9283 running (5m) 53s ago 5m 496M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ecfbb356bee1 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283 running (4m) 56s ago 4m 438M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 29adbb1c71a5 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 53s ago 6m 75.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (4m) 56s ago 4m 57.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (4m) 53s ago 4m 15.9M - 1.5.0 0da6a335fe13 82ed4cc88c41 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (4m) 56s ago 4m 19.1M - 1.5.0 0da6a335fe13 ecd5d6b45738 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 53s ago 3m 56.8M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (3m) 53s ago 3m 60.1M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 53s ago 2m 54.3M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (2m) 56s ago 2m 54.7M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (2m) 56s ago 2m 48.4M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (2m) 56s ago 2m 48.8M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:39:27.423 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (3m) 53s ago 4m 49.2M - 2.43.0 a07b618ecd1d d2e8b8e4a383 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3a88068f60 msgr2=0x7f3a8806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3a88068f60 0x7f3a8806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b3b0 tx=0x7f3a94009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa00fd730 msgr2=0x7f3aa00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa00fd730 0x7f3aa00fd1c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3a90002820 tx=0x7f3a90004570 comp rx=0 tx=0).stop 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 shutdown_connections 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f3a88068f60 0x7f3a8806b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3aa00fd730 0x7f3aa00fd1c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 --2- 172.21.15.49:0/1054018716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa0100050 0x7f3aa00fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 >> 172.21.15.49:0/1054018716 conn(0x7f3aa00f71d0 msgr2=0x7f3aa00f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:27.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 shutdown_connections 2023-12-16T07:39:27.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.424+0000 7f3aa4c32700 1 -- 172.21.15.49:0/1054018716 wait complete. 2023-12-16T07:39:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:27 smithi049 ceph-mon[111939]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T07:39:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:27 smithi049 ceph-mon[111939]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T07:39:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:39:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:27 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:27 smithi049 ceph-mon[111939]: Upgrade: Need to upgrade myself (mgr.smithi049.rqlvwo) 2023-12-16T07:39:27.572 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 -- 172.21.15.49:0/699509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 msgr2=0x7f4280101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 --2- 172.21.15.49:0/699509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 0x7f4280101ba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4270004940 tx=0x7f4270009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:27.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 -- 172.21.15.49:0/699509314 shutdown_connections 2023-12-16T07:39:27.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 --2- 172.21.15.49:0/699509314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42801020e0 0x7f42801044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 --2- 172.21.15.49:0/699509314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 0x7f4280101ba0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 -- 172.21.15.49:0/699509314 >> 172.21.15.49:0/699509314 conn(0x7f42800f7190 msgr2=0x7f42800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:27.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 -- 172.21.15.49:0/699509314 shutdown_connections 2023-12-16T07:39:27.573 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.572+0000 7f428518e700 1 -- 172.21.15.49:0/699509314 wait complete. 2023-12-16T07:39:27.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.573+0000 7f428518e700 1 Processor -- start 2023-12-16T07:39:27.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.573+0000 7f428518e700 1 -- start start 2023-12-16T07:39:27.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.573+0000 7f428518e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 0x7f428010f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:27.574 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.573+0000 7f428518e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42801020e0 0x7f428010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f428518e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280110210 con 0x7f4280066090 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f428518e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280110ab0 con 0x7f42801020e0 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42801020e0 0x7f428010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 0x7f428010f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 0x7f428010f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57018/0 (socket says 172.21.15.49:57018) 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427ed9d700 1 -- 172.21.15.49:0/2362286650 learned_addr learned my addr 172.21.15.49:0/2362286650 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427e59c700 1 -- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 msgr2=0x7f428010f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427e59c700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 0x7f428010f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.575 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427e59c700 1 -- 172.21.15.49:0/2362286650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270005040 con 0x7f42801020e0 2023-12-16T07:39:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.574+0000 7f427e59c700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42801020e0 0x7f428010fc10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4280065dd0 tx=0x7f427400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.575+0000 7f42677fe700 1 -- 172.21.15.49:0/2362286650 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4274004e90 con 0x7f42801020e0 2023-12-16T07:39:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.575+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280110d30 con 0x7f42801020e0 2023-12-16T07:39:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.575+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4280111270 con 0x7f42801020e0 2023-12-16T07:39:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.575+0000 7f42677fe700 1 -- 172.21.15.49:0/2362286650 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f427400f040 con 0x7f42801020e0 2023-12-16T07:39:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.575+0000 7f42677fe700 1 -- 172.21.15.49:0/2362286650 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f427400c980 con 0x7f42801020e0 2023-12-16T07:39:27.576 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.576+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c0052e0 con 0x7f42801020e0 2023-12-16T07:39:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.576+0000 7f42677fe700 1 -- 172.21.15.49:0/2362286650 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4274007cc0 con 0x7f42801020e0 2023-12-16T07:39:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.577+0000 7f42677fe700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f4268068f70 0x7f426806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:27.577 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.577+0000 7f42677fe700 1 -- 172.21.15.49:0/2362286650 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f42740866f0 con 0x7f42801020e0 2023-12-16T07:39:27.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.577+0000 7f427ed9d700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f4268068f70 0x7f426806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:27.578 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.578+0000 7f427ed9d700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f4268068f70 0x7f426806b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f427000b0d0 tx=0x7f4270009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.585+0000 7f42677fe700 1 -- 172.21.15.49:0/2362286650 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f427404da00 con 0x7f42801020e0 2023-12-16T07:39:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:27 smithi133 ceph-mon[120445]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T07:39:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:27 smithi133 ceph-mon[120445]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T07:39:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:39:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:27 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:27 smithi133 ceph-mon[120445]: Upgrade: Need to upgrade myself (mgr.smithi049.rqlvwo) 2023-12-16T07:39:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.865+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f426c005da0 con 0x7f42801020e0 2023-12-16T07:39:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.865+0000 7f42677fe700 1 -- 172.21.15.49:0/2362286650 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f4274056650 con 0x7f42801020e0 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:39:27.866 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:39:27.867 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:27.867 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:39:27.867 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T07:39:27.867 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:39:27.867 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f4268068f70 msgr2=0x7f426806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f4268068f70 0x7f426806b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f427000b0d0 tx=0x7f4270009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42801020e0 msgr2=0x7f428010fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42801020e0 0x7f428010fc10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4280065dd0 tx=0x7f427400b040 comp rx=0 tx=0).stop 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 shutdown_connections 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f4268068f70 0x7f426806b420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4280066090 0x7f428010f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 --2- 172.21.15.49:0/2362286650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42801020e0 0x7f428010fc10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.868+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 >> 172.21.15.49:0/2362286650 conn(0x7f42800f7190 msgr2=0x7f42800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.869+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 shutdown_connections 2023-12-16T07:39:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:27.869+0000 7f428518e700 1 -- 172.21.15.49:0/2362286650 wait complete. 2023-12-16T07:39:28.024 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 -- 172.21.15.49:0/2813656168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 msgr2=0x7f6af4101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 --2- 172.21.15.49:0/2813656168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af4101ba0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4004940 tx=0x7f6ae4009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 -- 172.21.15.49:0/2813656168 shutdown_connections 2023-12-16T07:39:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 --2- 172.21.15.49:0/2813656168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6af41020e0 0x7f6af41044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 --2- 172.21.15.49:0/2813656168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af4101ba0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 -- 172.21.15.49:0/2813656168 >> 172.21.15.49:0/2813656168 conn(0x7f6af40f7190 msgr2=0x7f6af40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 -- 172.21.15.49:0/2813656168 shutdown_connections 2023-12-16T07:39:28.025 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.024+0000 7f6af9986700 1 -- 172.21.15.49:0/2813656168 wait complete. 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af9986700 1 Processor -- start 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af9986700 1 -- start start 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af9986700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af410f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af9986700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6af41020e0 0x7f6af410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af9986700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4110230 con 0x7f6af4066090 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af9986700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4110ad0 con 0x7f6af41020e0 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af410f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:28.026 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af410f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57038/0 (socket says 172.21.15.49:57038) 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af2ffd700 1 -- 172.21.15.49:0/2364092977 learned_addr learned my addr 172.21.15.49:0/2364092977 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.025+0000 7f6af27fc700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6af41020e0 0x7f6af410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6af2ffd700 1 -- 172.21.15.49:0/2364092977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6af41020e0 msgr2=0x7f6af410fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6af2ffd700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6af41020e0 0x7f6af410fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6af2ffd700 1 -- 172.21.15.49:0/2364092977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4005040 con 0x7f6af4066090 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6af2ffd700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af410f6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000c00 tx=0x7f6ae4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6adb7fe700 1 -- 172.21.15.49:0/2364092977 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ae4021070 con 0x7f6af4066090 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6adb7fe700 1 -- 172.21.15.49:0/2364092977 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ae401c400 con 0x7f6af4066090 2023-12-16T07:39:28.027 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af4110cd0 con 0x7f6af4066090 2023-12-16T07:39:28.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6adb7fe700 1 -- 172.21.15.49:0/2364092977 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ae400e070 con 0x7f6af4066090 2023-12-16T07:39:28.028 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.026+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af41111b0 con 0x7f6af4066090 2023-12-16T07:39:28.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.028+0000 7f6adb7fe700 1 -- 172.21.15.49:0/2364092977 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6ae401c9c0 con 0x7f6af4066090 2023-12-16T07:39:28.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.028+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af404bb80 con 0x7f6af4066090 2023-12-16T07:39:28.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.029+0000 7f6adb7fe700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6adc068f60 0x7f6adc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:28.029 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.029+0000 7f6adb7fe700 1 -- 172.21.15.49:0/2364092977 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6ae4087f90 con 0x7f6af4066090 2023-12-16T07:39:28.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.031+0000 7f6af27fc700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6adc068f60 0x7f6adc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:28.031 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.031+0000 7f6af27fc700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6adc068f60 0x7f6adc06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009b80 tx=0x7f6ae800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:28.037 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.037+0000 7f6adb7fe700 1 -- 172.21.15.49:0/2364092977 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6ae40b9a00 con 0x7f6af4066090 2023-12-16T07:39:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.312+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6af41116e0 con 0x7f6adc068f60 2023-12-16T07:39:28.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.313+0000 7f6adb7fe700 1 -- 172.21.15.49:0/2364092977 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f6af41116e0 con 0x7f6adc068f60 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "0/2 daemons upgraded", 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 image on host smithi133", 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:39:28.315 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:39:28.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6adc068f60 msgr2=0x7f6adc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:28.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6adc068f60 0x7f6adc06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009b80 tx=0x7f6ae800b040 comp rx=0 tx=0).stop 2023-12-16T07:39:28.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 msgr2=0x7f6af410f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:28.317 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af410f6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000c00 tx=0x7f6ae4009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:28.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 shutdown_connections 2023-12-16T07:39:28.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f6adc068f60 0x7f6adc06b410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:28.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6af4066090 0x7f6af410f6f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:28.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 --2- 172.21.15.49:0/2364092977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6af41020e0 0x7f6af410fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:28.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 >> 172.21.15.49:0/2364092977 conn(0x7f6af40f7190 msgr2=0x7f6af40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:28.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 shutdown_connections 2023-12-16T07:39:28.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:28.316+0000 7f6af9986700 1 -- 172.21.15.49:0/2364092977 wait complete. 2023-12-16T07:39:28.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:28 smithi049 ceph-mon[111939]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:28.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:28 smithi049 ceph-mon[111939]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 on smithi133 2023-12-16T07:39:28.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:28 smithi049 ceph-mon[111939]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:28.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:28 smithi049 ceph-mon[111939]: pgmap v164: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T07:39:28.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:28 smithi049 ceph-mon[111939]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:28.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:28 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2362286650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:39:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:28 smithi133 ceph-mon[120445]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:28 smithi133 ceph-mon[120445]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17 on smithi133 2023-12-16T07:39:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:28 smithi133 ceph-mon[120445]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:28 smithi133 ceph-mon[120445]: pgmap v164: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T07:39:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:28 smithi133 ceph-mon[120445]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:28 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2362286650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:39:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:29 smithi049 ceph-mon[111939]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:29 smithi133 ceph-mon[120445]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:39:30.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:30 smithi049 ceph-mon[111939]: pgmap v165: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T07:39:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:30 smithi133 ceph-mon[120445]: pgmap v165: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-16T07:39:32.336 INFO:tasks.workunit.client.1.smithi133.stderr:Updating files: 98% (11485/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-16T07:39:32.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:32 smithi133 ceph-mon[120445]: pgmap v166: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T07:39:32.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:32 smithi049 ceph-mon[111939]: pgmap v166: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T07:39:33.028 INFO:tasks.workunit.client.1.smithi133.stderr:Note: switching to '6d933094a156ec7587742e5aa25fba5ba27ec678'. 2023-12-16T07:39:33.028 INFO:tasks.workunit.client.1.smithi133.stderr: 2023-12-16T07:39:33.028 INFO:tasks.workunit.client.1.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T07:39:33.028 INFO:tasks.workunit.client.1.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: git switch -c 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr:Or undo this operation with: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: git switch - 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr: 2023-12-16T07:39:33.029 INFO:tasks.workunit.client.1.smithi133.stderr:HEAD is now at 6d933094a15 Merge PR #52196 into main 2023-12-16T07:39:33.033 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-16T07:39:33.104 INFO:tasks.workunit.client.1.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T07:39:33.106 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T07:39:33.106 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T07:39:33.733 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T07:39:33.793 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T07:39:33.832 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-16T07:39:33.833 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T07:39:33.834 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T07:39:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:33 smithi133 ceph-mon[120445]: pgmap v167: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T07:39:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:33 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:33.872 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-16T07:39:33.875 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:39:33.875 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-16T07:39:33.934 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-16T07:39:33.935 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T07:39:33.936 DEBUG:teuthology.orchestra.run.smithi133:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d933094a156ec7587742e5aa25fba5ba27ec678 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-16T07:39:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:33 smithi049 ceph-mon[111939]: pgmap v167: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-16T07:39:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:33 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:33.997 INFO:tasks.workunit.client.1.smithi133.stderr:+ mkdir -p fsstress 2023-12-16T07:39:33.998 INFO:tasks.workunit.client.1.smithi133.stderr:+ pushd fsstress 2023-12-16T07:39:33.999 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T07:39:33.999 INFO:tasks.workunit.client.1.smithi133.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T07:39:34.515 INFO:tasks.workunit.client.1.smithi133.stderr:+ tar xzf ltp-full.tgz 2023-12-16T07:39:36.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:36 smithi049 ceph-mon[111939]: pgmap v168: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-16T07:39:36.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:36 smithi133 ceph-mon[120445]: pgmap v168: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-16T07:39:38.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:38 smithi133 ceph-mon[120445]: pgmap v169: 65 pgs: 65 active+clean; 977 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s wr, 0 op/s 2023-12-16T07:39:38.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:38 smithi049 ceph-mon[111939]: pgmap v169: 65 pgs: 65 active+clean; 977 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s wr, 0 op/s 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to '6d933094a156ec7587742e5aa25fba5ba27ec678'. 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-12-16T07:39:38.829 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr: 2023-12-16T07:39:38.830 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at 6d933094a15 Merge PR #52196 into main 2023-12-16T07:39:38.835 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-16T07:39:38.866 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-16T07:39:38.868 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T07:39:38.869 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-16T07:39:39.409 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-16T07:39:39.481 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-16T07:39:39.520 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-16T07:39:39.522 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T07:39:39.522 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-16T07:39:39.560 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-16T07:39:39.563 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:39:39.563 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-16T07:39:39.655 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-16T07:39:39.657 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-16T07:39:39.657 DEBUG:teuthology.orchestra.run.smithi049:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d933094a156ec7587742e5aa25fba5ba27ec678 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-16T07:39:39.730 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir -p fsstress 2023-12-16T07:39:39.743 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T07:39:39.743 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd fsstress 2023-12-16T07:39:39.743 INFO:tasks.workunit.client.0.smithi049.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-16T07:39:40.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:40 smithi133 ceph-mon[120445]: pgmap v170: 65 pgs: 65 active+clean; 4.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 385 KiB/s wr, 0 op/s 2023-12-16T07:39:40.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:40 smithi049 ceph-mon[111939]: pgmap v170: 65 pgs: 65 active+clean; 4.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 385 KiB/s wr, 0 op/s 2023-12-16T07:39:41.930 INFO:tasks.workunit.client.0.smithi049.stderr:+ tar xzf ltp-full.tgz 2023-12-16T07:39:42.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:42 smithi133 ceph-mon[120445]: pgmap v171: 65 pgs: 65 active+clean; 8.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 724 KiB/s wr, 54 op/s 2023-12-16T07:39:42.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:42 smithi049 ceph-mon[111939]: pgmap v171: 65 pgs: 65 active+clean; 8.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 724 KiB/s wr, 54 op/s 2023-12-16T07:39:43.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:43 smithi133 ceph-mon[120445]: pgmap v172: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 325 op/s 2023-12-16T07:39:43.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:43 smithi049 ceph-mon[111939]: pgmap v172: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 325 op/s 2023-12-16T07:39:46.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:46 smithi049 ceph-mon[111939]: pgmap v173: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s wr, 425 op/s 2023-12-16T07:39:46.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:46 smithi133 ceph-mon[120445]: pgmap v173: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s wr, 425 op/s 2023-12-16T07:39:48.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:48 smithi133 ceph-mon[120445]: pgmap v174: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 467 op/s 2023-12-16T07:39:48.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:48 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:48.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:48 smithi049 ceph-mon[111939]: pgmap v174: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 467 op/s 2023-12-16T07:39:48.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:48 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:39:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:50 smithi133 ceph-mon[120445]: pgmap v175: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 510 op/s 2023-12-16T07:39:50.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:50 smithi049 ceph-mon[111939]: pgmap v175: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 510 op/s 2023-12-16T07:39:52.601 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:52 smithi133 ceph-mon[120445]: pgmap v176: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 510 op/s 2023-12-16T07:39:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:52 smithi049 ceph-mon[111939]: pgmap v176: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 510 op/s 2023-12-16T07:39:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:53 smithi049 ceph-mon[111939]: Upgrade: Updating mgr.smithi133.wbiduk 2023-12-16T07:39:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:39:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:39:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:53 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:39:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:53 smithi049 ceph-mon[111939]: Deploying daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:39:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:53 smithi049 ceph-mon[111939]: pgmap v177: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.9 MiB/s wr, 462 op/s 2023-12-16T07:39:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:53 smithi133 ceph-mon[120445]: Upgrade: Updating mgr.smithi133.wbiduk 2023-12-16T07:39:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:39:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:39:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:39:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:53 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:39:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:53 smithi133 ceph-mon[120445]: Deploying daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:39:54.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:53 smithi133 ceph-mon[120445]: pgmap v177: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.9 MiB/s wr, 462 op/s 2023-12-16T07:39:56.570 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:56 smithi049 ceph-mon[111939]: pgmap v178: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s wr, 193 op/s 2023-12-16T07:39:56.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:56 smithi133 ceph-mon[120445]: pgmap v178: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s wr, 193 op/s 2023-12-16T07:39:58.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 -- 172.21.15.49:0/318080137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 msgr2=0x7ffa400fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 --2- 172.21.15.49:0/318080137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 0x7ffa400fbf00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c004940 tx=0x7ffa3c009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:58.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 -- 172.21.15.49:0/318080137 shutdown_connections 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 --2- 172.21.15.49:0/318080137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 0x7ffa400fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 --2- 172.21.15.49:0/318080137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 0x7ffa400fbf00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 -- 172.21.15.49:0/318080137 >> 172.21.15.49:0/318080137 conn(0x7ffa400f7190 msgr2=0x7ffa400f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 -- 172.21.15.49:0/318080137 shutdown_connections 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.439+0000 7ffa47e19700 1 -- 172.21.15.49:0/318080137 wait complete. 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa47e19700 1 Processor -- start 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa47e19700 1 -- start start 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa47e19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 0x7ffa4010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa47e19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 0x7ffa4010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa47e19700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4010e030 con 0x7ffa400fcd00 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa47e19700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4010e8d0 con 0x7ffa400fbaf0 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa453b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 0x7ffa4010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa453b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 0x7ffa4010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58606/0 (socket says 172.21.15.49:58606) 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa453b4700 1 -- 172.21.15.49:0/1912365692 learned_addr learned my addr 172.21.15.49:0/1912365692 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.440+0000 7ffa45bb5700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 0x7ffa4010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa453b4700 1 -- 172.21.15.49:0/1912365692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 msgr2=0x7ffa4010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa453b4700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 0x7ffa4010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa453b4700 1 -- 172.21.15.49:0/1912365692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c005040 con 0x7ffa400fcd00 2023-12-16T07:39:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa453b4700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 0x7ffa4010da30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000eb40 tx=0x7ffa3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa367fc700 1 -- 172.21.15.49:0/1912365692 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa30007cc0 con 0x7ffa400fcd00 2023-12-16T07:39:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4010eb50 con 0x7ffa400fcd00 2023-12-16T07:39:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa367fc700 1 -- 172.21.15.49:0/1912365692 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa3000f040 con 0x7ffa400fcd00 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa367fc700 1 -- 172.21.15.49:0/1912365692 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3000c990 con 0x7ffa400fcd00 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.441+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4010f090 con 0x7ffa400fcd00 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.442+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4004bb80 con 0x7ffa400fcd00 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.443+0000 7ffa367fc700 1 -- 172.21.15.49:0/1912365692 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ffa3000cc00 con 0x7ffa400fcd00 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.443+0000 7ffa367fc700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ffa2c068f70 0x7ffa2c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.443+0000 7ffa367fc700 1 -- 172.21.15.49:0/1912365692 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffa300869e0 con 0x7ffa400fcd00 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.443+0000 7ffa45bb5700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ffa2c068f70 0x7ffa2c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:58.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.444+0000 7ffa45bb5700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ffa2c068f70 0x7ffa2c06b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c013680 tx=0x7ffa3c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.448+0000 7ffa367fc700 1 -- 172.21.15.49:0/1912365692 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffa3004da00 con 0x7ffa400fcd00 2023-12-16T07:39:58.457 INFO:tasks.workunit.client.1.smithi133.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T07:39:58.458 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T07:39:58.458 INFO:tasks.workunit.client.1.smithi133.stderr:+ make 2023-12-16T07:39:58.566 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:39:58 smithi133 ceph-mon[120445]: pgmap v179: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 338 op/s 2023-12-16T07:39:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.665+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa4010f4e0 con 0x7ffa2c068f70 2023-12-16T07:39:58.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.666+0000 7ffa367fc700 1 -- 172.21.15.49:0/1912365692 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7ffa4010f4e0 con 0x7ffa2c068f70 2023-12-16T07:39:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ffa2c068f70 msgr2=0x7ffa2c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ffa2c068f70 0x7ffa2c06b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c013680 tx=0x7ffa3c009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 msgr2=0x7ffa4010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 0x7ffa4010da30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000eb40 tx=0x7ffa3000b040 comp rx=0 tx=0).stop 2023-12-16T07:39:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 shutdown_connections 2023-12-16T07:39:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7ffa2c068f70 0x7ffa2c06b420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa400fbaf0 0x7ffa4010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 --2- 172.21.15.49:0/1912365692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa400fcd00 0x7ffa4010da30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 >> 172.21.15.49:0/1912365692 conn(0x7ffa400f7190 msgr2=0x7ffa40065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 shutdown_connections 2023-12-16T07:39:58.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.668+0000 7ffa47e19700 1 -- 172.21.15.49:0/1912365692 wait complete. 2023-12-16T07:39:58.679 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:39:58.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:39:58 smithi049 ceph-mon[111939]: pgmap v179: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 338 op/s 2023-12-16T07:39:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 -- 172.21.15.49:0/342517489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0faed0 msgr2=0x7f93ec0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 --2- 172.21.15.49:0/342517489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0faed0 0x7f93ec0fb2e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f93dc004940 tx=0x7f93dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 -- 172.21.15.49:0/342517489 shutdown_connections 2023-12-16T07:39:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 --2- 172.21.15.49:0/342517489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93ec0fdf60 0x7f93ec0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 --2- 172.21.15.49:0/342517489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0faed0 0x7f93ec0fb2e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 -- 172.21.15.49:0/342517489 >> 172.21.15.49:0/342517489 conn(0x7f93ec0f6950 msgr2=0x7f93ec0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 -- 172.21.15.49:0/342517489 shutdown_connections 2023-12-16T07:39:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.772+0000 7f93f1e23700 1 -- 172.21.15.49:0/342517489 wait complete. 2023-12-16T07:39:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.773+0000 7f93f1e23700 1 Processor -- start 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.773+0000 7f93f1e23700 1 -- start start 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.773+0000 7f93f1e23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93ec0faed0 0x7f93ec10d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.773+0000 7f93f1e23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0fdf60 0x7f93ec10da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.773+0000 7f93f1e23700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec10e080 con 0x7f93ec0fdf60 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.773+0000 7f93f1e23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec10e920 con 0x7f93ec0faed0 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0fdf60 0x7f93ec10da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93ec0faed0 0x7f93ec10d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0fdf60 0x7f93ec10da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58624/0 (socket says 172.21.15.49:58624) 2023-12-16T07:39:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eaffd700 1 -- 172.21.15.49:0/2313324218 learned_addr learned my addr 172.21.15.49:0/2313324218 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eaffd700 1 -- 172.21.15.49:0/2313324218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93ec0faed0 msgr2=0x7f93ec10d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eaffd700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93ec0faed0 0x7f93ec10d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eaffd700 1 -- 172.21.15.49:0/2313324218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc005040 con 0x7f93ec0fdf60 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93eaffd700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0fdf60 0x7f93ec10da80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f93e000eb40 tx=0x7f93e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93d3fff700 1 -- 172.21.15.49:0/2313324218 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e0007cc0 con 0x7f93ec0fdf60 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec10eba0 con 0x7f93ec0fdf60 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93d3fff700 1 -- 172.21.15.49:0/2313324218 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93e000f040 con 0x7f93ec0fdf60 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93d3fff700 1 -- 172.21.15.49:0/2313324218 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e000c990 con 0x7f93ec0fdf60 2023-12-16T07:39:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.774+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec10f0e0 con 0x7f93ec0fdf60 2023-12-16T07:39:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.775+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec04bb80 con 0x7f93ec0fdf60 2023-12-16T07:39:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.776+0000 7f93d3fff700 1 -- 172.21.15.49:0/2313324218 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f93e000cc00 con 0x7f93ec0fdf60 2023-12-16T07:39:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.776+0000 7f93d3fff700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f93d4068f70 0x7f93d406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.776+0000 7f93d3fff700 1 -- 172.21.15.49:0/2313324218 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f93e00869e0 con 0x7f93ec0fdf60 2023-12-16T07:39:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.776+0000 7f93eb7fe700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f93d4068f70 0x7f93d406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.777+0000 7f93eb7fe700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f93d4068f70 0x7f93d406b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009fd0 tx=0x7f93dc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:58.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.781+0000 7f93d3fff700 1 -- 172.21.15.49:0/2313324218 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f93e004da00 con 0x7f93ec0fdf60 2023-12-16T07:39:58.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.994+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93ec10f530 con 0x7f93d4068f70 2023-12-16T07:39:58.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.995+0000 7f93d3fff700 1 -- 172.21.15.49:0/2313324218 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f93ec10f530 con 0x7f93d4068f70 2023-12-16T07:39:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f93d4068f70 msgr2=0x7f93d406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f93d4068f70 0x7f93d406b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009fd0 tx=0x7f93dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0fdf60 msgr2=0x7f93ec10da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0fdf60 0x7f93ec10da80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f93e000eb40 tx=0x7f93e000b040 comp rx=0 tx=0).stop 2023-12-16T07:39:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 shutdown_connections 2023-12-16T07:39:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f93d4068f70 0x7f93d406b420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93ec0faed0 0x7f93ec10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 --2- 172.21.15.49:0/2313324218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93ec0fdf60 0x7f93ec10da80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 >> 172.21.15.49:0/2313324218 conn(0x7f93ec0f6950 msgr2=0x7f93ec101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 shutdown_connections 2023-12-16T07:39:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:58.997+0000 7f93f1e23700 1 -- 172.21.15.49:0/2313324218 wait complete. 2023-12-16T07:39:59.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 -- 172.21.15.49:0/899543150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 msgr2=0x7f1e180fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 --2- 172.21.15.49:0/899543150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e180fbf00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e14004940 tx=0x7f1e14009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 -- 172.21.15.49:0/899543150 shutdown_connections 2023-12-16T07:39:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 --2- 172.21.15.49:0/899543150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e180fcd00 0x7f1e180fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 --2- 172.21.15.49:0/899543150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e180fbf00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 -- 172.21.15.49:0/899543150 >> 172.21.15.49:0/899543150 conn(0x7f1e180f7190 msgr2=0x7f1e180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 -- 172.21.15.49:0/899543150 shutdown_connections 2023-12-16T07:39:59.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.101+0000 7f1e1f731700 1 -- 172.21.15.49:0/899543150 wait complete. 2023-12-16T07:39:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1f731700 1 Processor -- start 2023-12-16T07:39:59.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1f731700 1 -- start start 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1f731700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e18110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1f731700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e180fcd00 0x7f1e18112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1f731700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18066110 con 0x7f1e180fbaf0 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1f731700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18066250 con 0x7f1e180fcd00 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1d4cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e18110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1d4cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e18110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58638/0 (socket says 172.21.15.49:58638) 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1d4cd700 1 -- 172.21.15.49:0/2217419608 learned_addr learned my addr 172.21.15.49:0/2217419608 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1cccc700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e180fcd00 0x7f1e18112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1d4cd700 1 -- 172.21.15.49:0/2217419608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e180fcd00 msgr2=0x7f1e18112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1d4cd700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e180fcd00 0x7f1e18112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.102+0000 7f1e1d4cd700 1 -- 172.21.15.49:0/2217419608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14005040 con 0x7f1e180fbaf0 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.103+0000 7f1e1d4cd700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e18110210 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.103+0000 7f1e0dffb700 1 -- 172.21.15.49:0/2217419608 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e14021070 con 0x7f1e180fbaf0 2023-12-16T07:39:59.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.103+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e18112d00 con 0x7f1e180fbaf0 2023-12-16T07:39:59.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.103+0000 7f1e0dffb700 1 -- 172.21.15.49:0/2217419608 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e1401c400 con 0x7f1e180fbaf0 2023-12-16T07:39:59.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.103+0000 7f1e0dffb700 1 -- 172.21.15.49:0/2217419608 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1400e070 con 0x7f1e180fbaf0 2023-12-16T07:39:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.103+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e18113190 con 0x7f1e180fbaf0 2023-12-16T07:39:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.104+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1804bb80 con 0x7f1e180fbaf0 2023-12-16T07:39:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.104+0000 7f1e0dffb700 1 -- 172.21.15.49:0/2217419608 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1e1401ca00 con 0x7f1e180fbaf0 2023-12-16T07:39:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.105+0000 7f1e0dffb700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1e04068f60 0x7f1e0406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.105+0000 7f1e0dffb700 1 -- 172.21.15.49:0/2217419608 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1e14087fa0 con 0x7f1e180fbaf0 2023-12-16T07:39:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.105+0000 7f1e1cccc700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1e04068f60 0x7f1e0406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.105+0000 7f1e1cccc700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1e04068f60 0x7f1e0406b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009b80 tx=0x7f1e0800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:59.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.109+0000 7f1e0dffb700 1 -- 172.21.15.49:0/2217419608 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1e14054420 con 0x7f1e180fbaf0 2023-12-16T07:39:59.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.315+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e18101650 con 0x7f1e04068f60 2023-12-16T07:39:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.325+0000 7f1e0dffb700 1 -- 172.21.15.49:0/2217419608 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f1e18101650 con 0x7f1e04068f60 2023-12-16T07:39:59.325 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (4m) 85s ago 5m 27.1M - 0.25.0 c8568f914cd2 ac0238c966a8 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (5m) 85s ago 5m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (4m) 88s ago 4m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (4m) 85s ago 5m 88.4M - 9.4.7 954c08fa6188 f8fc00abbcaf 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (99s) 85s ago 99s 12.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (96s) 85s ago 96s 13.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (98s) 88s ago 97s 17.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (94s) 88s ago 94s 15.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:9283 running (6m) 85s ago 6m 496M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ecfbb356bee1 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283 running (4m) 88s ago 4m 438M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 29adbb1c71a5 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 85s ago 6m 75.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (4m) 88s ago 4m 57.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (5m) 85s ago 5m 15.9M - 1.5.0 0da6a335fe13 82ed4cc88c41 2023-12-16T07:39:59.326 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (4m) 88s ago 4m 19.1M - 1.5.0 0da6a335fe13 ecd5d6b45738 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (4m) 85s ago 4m 56.8M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (3m) 85s ago 3m 60.1M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (3m) 85s ago 3m 54.3M 4299M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (3m) 88s ago 3m 54.7M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (2m) 88s ago 2m 48.4M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (2m) 88s ago 2m 48.8M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (4m) 85s ago 5m 49.2M - 2.43.0 a07b618ecd1d d2e8b8e4a383 2023-12-16T07:39:59.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1e04068f60 msgr2=0x7f1e0406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1e04068f60 0x7f1e0406b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009b80 tx=0x7f1e0800b040 comp rx=0 tx=0).stop 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 msgr2=0x7f1e18110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e18110210 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e14009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 shutdown_connections 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f1e04068f60 0x7f1e0406b410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e180fbaf0 0x7f1e18110210 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 --2- 172.21.15.49:0/2217419608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e180fcd00 0x7f1e18112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 >> 172.21.15.49:0/2217419608 conn(0x7f1e180f7190 msgr2=0x7f1e180fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 shutdown_connections 2023-12-16T07:39:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.327+0000 7f1e1f731700 1 -- 172.21.15.49:0/2217419608 wait complete. 2023-12-16T07:39:59.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 -- 172.21.15.49:0/3124828996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 msgr2=0x7f78bc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 --2- 172.21.15.49:0/3124828996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc0fe250 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78b0004940 tx=0x7f78b0009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:59.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 -- 172.21.15.49:0/3124828996 shutdown_connections 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 --2- 172.21.15.49:0/3124828996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc0fe250 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 --2- 172.21.15.49:0/3124828996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78bc0fcbf0 0x7f78bc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 -- 172.21.15.49:0/3124828996 >> 172.21.15.49:0/3124828996 conn(0x7f78bc0f82d0 msgr2=0x7f78bc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 -- 172.21.15.49:0/3124828996 shutdown_connections 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 -- 172.21.15.49:0/3124828996 wait complete. 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.430+0000 7f78c447e700 1 Processor -- start 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c447e700 1 -- start start 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c447e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78bc0fcbf0 0x7f78bc071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c447e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c447e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc070590 con 0x7f78bc0fde00 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c447e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc070700 con 0x7f78bc0fcbf0 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c1a19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c1a19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58664/0 (socket says 172.21.15.49:58664) 2023-12-16T07:39:59.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c1a19700 1 -- 172.21.15.49:0/3899296771 learned_addr learned my addr 172.21.15.49:0/3899296771 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:59.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c221a700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78bc0fcbf0 0x7f78bc071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c1a19700 1 -- 172.21.15.49:0/3899296771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78bc0fcbf0 msgr2=0x7f78bc071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c1a19700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78bc0fcbf0 0x7f78bc071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c1a19700 1 -- 172.21.15.49:0/3899296771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0005040 con 0x7f78bc0fde00 2023-12-16T07:39:59.433 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.431+0000 7f78c1a19700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc06ff90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f78b0000c00 tx=0x7f78b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:59.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.432+0000 7f78aeffd700 1 -- 172.21.15.49:0/3899296771 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b0021070 con 0x7f78bc0fde00 2023-12-16T07:39:59.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.432+0000 7f78aeffd700 1 -- 172.21.15.49:0/3899296771 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78b001c400 con 0x7f78bc0fde00 2023-12-16T07:39:59.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.432+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc070980 con 0x7f78bc0fde00 2023-12-16T07:39:59.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.432+0000 7f78aeffd700 1 -- 172.21.15.49:0/3899296771 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b000e070 con 0x7f78bc0fde00 2023-12-16T07:39:59.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.432+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc115520 con 0x7f78bc0fde00 2023-12-16T07:39:59.434 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.433+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc04bb80 con 0x7f78bc0fde00 2023-12-16T07:39:59.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.433+0000 7f78aeffd700 1 -- 172.21.15.49:0/3899296771 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f78b001c9c0 con 0x7f78bc0fde00 2023-12-16T07:39:59.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.433+0000 7f78aeffd700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f78a8068f60 0x7f78a806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.434+0000 7f78aeffd700 1 -- 172.21.15.49:0/3899296771 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f78b0088020 con 0x7f78bc0fde00 2023-12-16T07:39:59.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.434+0000 7f78c221a700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f78a8068f60 0x7f78a806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.435 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.434+0000 7f78c221a700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f78a8068f60 0x7f78a806b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0718a0 tx=0x7f78b800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:59.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.438+0000 7f78aeffd700 1 -- 172.21.15.49:0/3899296771 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f78b0057f30 con 0x7f78bc0fde00 2023-12-16T07:39:59.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.721+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f78bc105590 con 0x7f78bc0fde00 2023-12-16T07:39:59.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.721+0000 7f78aeffd700 1 -- 172.21.15.49:0/3899296771 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f78b0057ac0 con 0x7f78bc0fde00 2023-12-16T07:39:59.721 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:39:59.722 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-16T07:39:59.723 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:39:59.723 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:39:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f78a8068f60 msgr2=0x7f78a806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f78a8068f60 0x7f78a806b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0718a0 tx=0x7f78b800b040 comp rx=0 tx=0).stop 2023-12-16T07:39:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 msgr2=0x7f78bc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc06ff90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f78b0000c00 tx=0x7f78b0009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 shutdown_connections 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7f78a8068f60 0x7f78a806b410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78bc0fcbf0 0x7f78bc071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 --2- 172.21.15.49:0/3899296771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78bc0fde00 0x7f78bc06ff90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 >> 172.21.15.49:0/3899296771 conn(0x7f78bc0f82d0 msgr2=0x7f78bc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 shutdown_connections 2023-12-16T07:39:59.724 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.723+0000 7f78c447e700 1 -- 172.21.15.49:0/3899296771 wait complete. 2023-12-16T07:39:59.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 -- 172.21.15.49:0/489276856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fbaf0 msgr2=0x7fe93c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 --2- 172.21.15.49:0/489276856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fbaf0 0x7fe93c0fbf00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe938004940 tx=0x7fe938009e30 comp rx=0 tx=0).stop 2023-12-16T07:39:59.830 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 -- 172.21.15.49:0/489276856 shutdown_connections 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 --2- 172.21.15.49:0/489276856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0fcd00 0x7fe93c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 --2- 172.21.15.49:0/489276856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fbaf0 0x7fe93c0fbf00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 -- 172.21.15.49:0/489276856 >> 172.21.15.49:0/489276856 conn(0x7fe93c0f71d0 msgr2=0x7fe93c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 -- 172.21.15.49:0/489276856 shutdown_connections 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 -- 172.21.15.49:0/489276856 wait complete. 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 Processor -- start 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.829+0000 7fe9445a3700 1 -- start start 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe9445a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0fbaf0 0x7fe93c1101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe9445a3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fcd00 0x7fe93c112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe9445a3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0669a0 con 0x7fe93c0fcd00 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe9445a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c066ae0 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe941b3e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fcd00 0x7fe93c112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe941b3e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fcd00 0x7fe93c112740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58678/0 (socket says 172.21.15.49:58678) 2023-12-16T07:39:59.831 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe941b3e700 1 -- 172.21.15.49:0/329932764 learned_addr learned my addr 172.21.15.49:0/329932764 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:39:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe94233f700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0fbaf0 0x7fe93c1101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe94233f700 1 -- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fcd00 msgr2=0x7fe93c112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:39:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe94233f700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fcd00 0x7fe93c112740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:39:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe94233f700 1 -- 172.21.15.49:0/329932764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938005040 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe941b3e700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fcd00 0x7fe93c112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T07:39:59.832 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe94233f700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0fbaf0 0x7fe93c1101f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe938000c00 tx=0x7fe938009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe932ffd700 1 -- 172.21.15.49:0/329932764 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe938021070 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.830+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c112ce0 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.831+0000 7fe932ffd700 1 -- 172.21.15.49:0/329932764 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe93801c400 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.831+0000 7fe932ffd700 1 -- 172.21.15.49:0/329932764 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93800e070 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.831+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c113170 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.831+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c04bb80 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.832+0000 7fe932ffd700 1 -- 172.21.15.49:0/329932764 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe93801c950 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.833 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.832+0000 7fe932ffd700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe928068f70 0x7fe92806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:39:59.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.832+0000 7fe932ffd700 1 -- 172.21.15.49:0/329932764 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe938087fa0 con 0x7fe93c0fbaf0 2023-12-16T07:39:59.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.832+0000 7fe941b3e700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe928068f70 0x7fe92806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:39:59.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.833+0000 7fe941b3e700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe928068f70 0x7fe92806b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0041d0 tx=0x7fe92c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:39:59.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:39:59.838+0000 7fe932ffd700 1 -- 172.21.15.49:0/329932764 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe938054380 con 0x7fe93c0fbaf0 2023-12-16T07:40:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.053+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 --> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe93c113450 con 0x7fe928068f70 2023-12-16T07:40:00.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.054+0000 7fe932ffd700 1 -- 172.21.15.49:0/329932764 <== mgr.14208 v2:172.21.15.49:6800/2346374523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fe93c113450 con 0x7fe928068f70 2023-12-16T07:40:00.055 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:40:00.055 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:40:00.055 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:40:00.055 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T07:40:00.055 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2023-12-16T07:40:00.055 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "0/2 daemons upgraded", 2023-12-16T07:40:00.056 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mgr daemons", 2023-12-16T07:40:00.056 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:40:00.056 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:40:00.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe928068f70 msgr2=0x7fe92806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:00.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe928068f70 0x7fe92806b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0041d0 tx=0x7fe92c00b040 comp rx=0 tx=0).stop 2023-12-16T07:40:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0fbaf0 msgr2=0x7fe93c1101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0fbaf0 0x7fe93c1101f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe938000c00 tx=0x7fe938009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 shutdown_connections 2023-12-16T07:40:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:6800/2346374523,v1:172.21.15.49:6801/2346374523] conn(0x7fe928068f70 0x7fe92806b420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0fbaf0 0x7fe93c1101f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:00.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 --2- 172.21.15.49:0/329932764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe93c0fcd00 0x7fe93c112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:00.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 >> 172.21.15.49:0/329932764 conn(0x7fe93c0f71d0 msgr2=0x7fe93c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:00.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 shutdown_connections 2023-12-16T07:40:00.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:00.056+0000 7fe9445a3700 1 -- 172.21.15.49:0/329932764 wait complete. 2023-12-16T07:40:00.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:00.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:00.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: pgmap v180: 65 pgs: 65 active+clean; 127 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 510 op/s 2023-12-16T07:40:00.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:00.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3899296771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:40:00.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:40:00.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:40:00.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:00 smithi133 ceph-mon[120445]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:40:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: pgmap v180: 65 pgs: 65 active+clean; 127 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 510 op/s 2023-12-16T07:40:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:00.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3899296771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:40:00.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:40:00.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:40:00.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:00 smithi049 ceph-mon[111939]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:40:00.749 INFO:tasks.workunit.client.1.smithi133.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T07:40:01.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:01 smithi133 ceph-mon[120445]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:01.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:01 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:01.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:01 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:01.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:01 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:01.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:01 smithi049 ceph-mon[111939]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:01 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:01 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:01 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:02 smithi133 ceph-mon[120445]: pgmap v181: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 536 op/s 2023-12-16T07:40:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:02 smithi049 ceph-mon[111939]: pgmap v181: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 536 op/s 2023-12-16T07:40:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:03 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:03 smithi133 ceph-mon[120445]: pgmap v182: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 827 op/s 2023-12-16T07:40:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:03 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:03 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:03 smithi049 ceph-mon[111939]: pgmap v182: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 827 op/s 2023-12-16T07:40:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:03 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:05.473 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:05.473 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:05 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:05.509 INFO:tasks.workunit.client.1.smithi133.stderr:++ readlink -f fsstress 2023-12-16T07:40:05.510 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-16T07:40:05.510 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-16T07:40:05.510 INFO:tasks.workunit.client.1.smithi133.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T07:40:05.511 INFO:tasks.workunit.client.1.smithi133.stderr:+ popd 2023-12-16T07:40:05.511 INFO:tasks.workunit.client.1.smithi133.stderr:+ popd 2023-12-16T07:40:05.511 INFO:tasks.workunit.client.1.smithi133.stderr:++ mktemp -d -p . 2023-12-16T07:40:05.513 INFO:tasks.workunit.client.1.smithi133.stderr:+ T=./tmp.vWudvF2W3T 2023-12-16T07:40:05.513 INFO:tasks.workunit.client.1.smithi133.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.vWudvF2W3T -l 1 -n 1000 -p 10 -v 2023-12-16T07:40:05.515 INFO:tasks.workunit.client.1.smithi133.stdout:seed = 1702540855 2023-12-16T07:40:05.519 INFO:tasks.workunit.client.1.smithi133.stdout:0/0: readlink - no filename 2023-12-16T07:40:05.522 INFO:tasks.workunit.client.1.smithi133.stdout:0/1: symlink l0 0 2023-12-16T07:40:05.523 INFO:tasks.workunit.client.1.smithi133.stdout:1/0: mkdir d0 0 2023-12-16T07:40:05.523 INFO:tasks.workunit.client.1.smithi133.stdout:1/1: dwrite - no filename 2023-12-16T07:40:05.523 INFO:tasks.workunit.client.1.smithi133.stdout:1/2: dread - no filename 2023-12-16T07:40:05.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/0: dread - no filename 2023-12-16T07:40:05.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/1: unlink - no file 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/2: rename - no filename 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/3: fsync - no filename 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/4: write - no filename 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/5: write - no filename 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/6: stat - no entries 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/7: fdatasync - no filename 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/8: unlink - no file 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/9: dread - no filename 2023-12-16T07:40:05.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/10: truncate - no filename 2023-12-16T07:40:05.526 INFO:tasks.workunit.client.1.smithi133.stdout:0/2: symlink l1 0 2023-12-16T07:40:05.526 INFO:tasks.workunit.client.1.smithi133.stdout:0/3: readlink l0 0 2023-12-16T07:40:05.526 INFO:tasks.workunit.client.1.smithi133.stdout:0/4: dwrite - no filename 2023-12-16T07:40:05.529 INFO:tasks.workunit.client.1.smithi133.stdout:1/3: creat d0/f1 x:0 0 0 2023-12-16T07:40:05.532 INFO:tasks.workunit.client.1.smithi133.stdout:2/11: creat f0 x:0 0 0 2023-12-16T07:40:05.533 INFO:tasks.workunit.client.1.smithi133.stdout:0/5: mkdir d2 0 2023-12-16T07:40:05.535 INFO:tasks.workunit.client.1.smithi133.stdout:1/4: symlink d0/l2 0 2023-12-16T07:40:05.535 INFO:tasks.workunit.client.1.smithi133.stdout:1/5: chown d0/f1 214 1 2023-12-16T07:40:05.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/0: dread - no filename 2023-12-16T07:40:05.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/1: write - no filename 2023-12-16T07:40:05.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/2: read - no filename 2023-12-16T07:40:05.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/3: chown . 4 1 2023-12-16T07:40:05.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/4: write - no filename 2023-12-16T07:40:05.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/5: dread - no filename 2023-12-16T07:40:05.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/0: mknod c0 0 2023-12-16T07:40:05.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/1: read - no filename 2023-12-16T07:40:05.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/2: fsync - no filename 2023-12-16T07:40:05.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/3: dread - no filename 2023-12-16T07:40:05.538 INFO:tasks.workunit.client.1.smithi133.stdout:2/12: creat f1 x:0 0 0 2023-12-16T07:40:05.541 INFO:tasks.workunit.client.1.smithi133.stdout:0/6: creat d2/f3 x:0 0 0 2023-12-16T07:40:05.543 INFO:tasks.workunit.client.1.smithi133.stdout:4/6: mknod c0 0 2023-12-16T07:40:05.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/0: dread - no filename 2023-12-16T07:40:05.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/1: dwrite - no filename 2023-12-16T07:40:05.546 INFO:tasks.workunit.client.1.smithi133.stdout:3/4: mknod c1 0 2023-12-16T07:40:05.546 INFO:tasks.workunit.client.1.smithi133.stdout:2/13: creat f2 x:0 0 0 2023-12-16T07:40:05.546 INFO:tasks.workunit.client.1.smithi133.stdout:2/14: stat f0 0 2023-12-16T07:40:05.548 INFO:tasks.workunit.client.1.smithi133.stdout:0/7: creat d2/f4 x:0 0 0 2023-12-16T07:40:05.550 INFO:tasks.workunit.client.1.smithi133.stdout:4/7: mknod c1 0 2023-12-16T07:40:05.550 INFO:tasks.workunit.client.1.smithi133.stdout:4/8: write - no filename 2023-12-16T07:40:05.552 INFO:tasks.workunit.client.1.smithi133.stdout:3/5: creat f2 x:0 0 0 2023-12-16T07:40:05.552 INFO:tasks.workunit.client.1.smithi133.stdout:2/15: creat f3 x:0 0 0 2023-12-16T07:40:05.553 INFO:tasks.workunit.client.1.smithi133.stdout:4/9: rename c1 to c2 0 2023-12-16T07:40:05.553 INFO:tasks.workunit.client.1.smithi133.stdout:4/10: rmdir - no directory 2023-12-16T07:40:05.553 INFO:tasks.workunit.client.1.smithi133.stdout:4/11: dread - no filename 2023-12-16T07:40:05.554 INFO:tasks.workunit.client.1.smithi133.stdout:4/12: truncate - no filename 2023-12-16T07:40:05.554 INFO:tasks.workunit.client.1.smithi133.stdout:6/0: chown . 24994690 1 2023-12-16T07:40:05.554 INFO:tasks.workunit.client.1.smithi133.stdout:6/1: chown . 0 1 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/0: rmdir - no directory 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/1: dwrite - no filename 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/2: dread - no filename 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:1/6: dwrite d0/f1 [0,4194304] 0 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:2/16: rename f0 to f4 0 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:2/17: chown f2 359 1 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:4/13: mkdir d3 0 2023-12-16T07:40:05.557 INFO:tasks.workunit.client.1.smithi133.stdout:1/7: write d0/f1 [784701,44531] 0 2023-12-16T07:40:05.558 INFO:tasks.workunit.client.1.smithi133.stdout:6/2: mkdir d0 0 2023-12-16T07:40:05.559 INFO:tasks.workunit.client.1.smithi133.stdout:7/3: symlink l0 0 2023-12-16T07:40:05.560 INFO:tasks.workunit.client.1.smithi133.stdout:7/4: dwrite - no filename 2023-12-16T07:40:05.561 INFO:tasks.workunit.client.1.smithi133.stdout:4/14: symlink d3/l4 0 2023-12-16T07:40:05.566 INFO:tasks.workunit.client.1.smithi133.stdout:6/3: creat d0/f1 x:0 0 0 2023-12-16T07:40:05.566 INFO:tasks.workunit.client.1.smithi133.stdout:6/4: write d0/f1 [954094,120062] 0 2023-12-16T07:40:05.567 INFO:tasks.workunit.client.1.smithi133.stdout:9/0: link - no file 2023-12-16T07:40:05.568 INFO:tasks.workunit.client.1.smithi133.stdout:8/0: mknod c0 0 2023-12-16T07:40:05.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/1: write - no filename 2023-12-16T07:40:05.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/2: stat c0 0 2023-12-16T07:40:05.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/3: dread - no filename 2023-12-16T07:40:05.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/4: dwrite - no filename 2023-12-16T07:40:05.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/5: chown c0 748 1 2023-12-16T07:40:05.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/6: write - no filename 2023-12-16T07:40:05.572 INFO:tasks.workunit.client.1.smithi133.stdout:4/15: symlink d3/l5 0 2023-12-16T07:40:05.573 INFO:tasks.workunit.client.1.smithi133.stdout:6/5: creat d0/f2 x:0 0 0 2023-12-16T07:40:05.574 INFO:tasks.workunit.client.1.smithi133.stdout:6/6: dread - d0/f2 zero size 2023-12-16T07:40:05.574 INFO:tasks.workunit.client.1.smithi133.stdout:6/7: chown d0 323038 1 2023-12-16T07:40:05.574 INFO:tasks.workunit.client.1.smithi133.stdout:9/1: creat f0 x:0 0 0 2023-12-16T07:40:05.575 INFO:tasks.workunit.client.1.smithi133.stdout:0/8: dwrite d2/f4 [0,4194304] 0 2023-12-16T07:40:05.576 INFO:tasks.workunit.client.1.smithi133.stdout:8/7: symlink l1 0 2023-12-16T07:40:05.578 INFO:tasks.workunit.client.1.smithi133.stdout:6/8: creat d0/f3 x:0 0 0 2023-12-16T07:40:05.578 INFO:tasks.workunit.client.1.smithi133.stdout:9/2: creat f1 x:0 0 0 2023-12-16T07:40:05.582 INFO:tasks.workunit.client.1.smithi133.stdout:8/8: symlink l2 0 2023-12-16T07:40:05.582 INFO:tasks.workunit.client.1.smithi133.stdout:8/9: dwrite - no filename 2023-12-16T07:40:05.584 INFO:tasks.workunit.client.1.smithi133.stdout:9/3: symlink l2 0 2023-12-16T07:40:05.584 INFO:tasks.workunit.client.1.smithi133.stdout:9/4: write f1 [109575,62931] 0 2023-12-16T07:40:05.586 INFO:tasks.workunit.client.1.smithi133.stdout:8/10: mknod c3 0 2023-12-16T07:40:05.586 INFO:tasks.workunit.client.1.smithi133.stdout:8/11: stat c0 0 2023-12-16T07:40:05.587 INFO:tasks.workunit.client.1.smithi133.stdout:8/12: link c3 c4 0 2023-12-16T07:40:05.587 INFO:tasks.workunit.client.1.smithi133.stdout:8/13: symlink l5 0 2023-12-16T07:40:05.588 INFO:tasks.workunit.client.1.smithi133.stdout:8/14: readlink l2 0 2023-12-16T07:40:05.588 INFO:tasks.workunit.client.1.smithi133.stdout:8/15: rename l2 to l6 0 2023-12-16T07:40:05.590 INFO:tasks.workunit.client.1.smithi133.stdout:8/16: rename l1 to l7 0 2023-12-16T07:40:05.590 INFO:tasks.workunit.client.1.smithi133.stdout:8/17: dwrite - no filename 2023-12-16T07:40:05.591 INFO:tasks.workunit.client.1.smithi133.stdout:8/18: creat f8 x:0 0 0 2023-12-16T07:40:05.592 INFO:tasks.workunit.client.1.smithi133.stdout:8/19: dread - f8 zero size 2023-12-16T07:40:05.593 INFO:tasks.workunit.client.1.smithi133.stdout:0/9: dwrite d2/f3 [0,4194304] 0 2023-12-16T07:40:05.613 INFO:tasks.workunit.client.1.smithi133.stdout:8/20: dwrite f8 [0,4194304] 0 2023-12-16T07:40:05.613 INFO:tasks.workunit.client.1.smithi133.stdout:8/21: readlink l6 0 2023-12-16T07:40:05.621 INFO:tasks.workunit.client.1.smithi133.stdout:9/5: dwrite f0 [0,4194304] 0 2023-12-16T07:40:05.621 INFO:tasks.workunit.client.1.smithi133.stdout:9/6: rmdir - no directory 2023-12-16T07:40:05.624 INFO:tasks.workunit.client.1.smithi133.stdout:0/10: dread d2/f3 [0,4194304] 0 2023-12-16T07:40:05.624 INFO:tasks.workunit.client.1.smithi133.stdout:0/11: rename d2 to d2/d5 22 2023-12-16T07:40:05.625 INFO:tasks.workunit.client.1.smithi133.stdout:8/22: dread f8 [0,4194304] 0 2023-12-16T07:40:05.626 INFO:tasks.workunit.client.1.smithi133.stdout:9/7: symlink l3 0 2023-12-16T07:40:05.626 INFO:tasks.workunit.client.1.smithi133.stdout:9/8: write f1 [1175587,38116] 0 2023-12-16T07:40:05.626 INFO:tasks.workunit.client.1.smithi133.stdout:9/9: readlink l3 0 2023-12-16T07:40:05.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/12: creat d2/f6 x:0 0 0 2023-12-16T07:40:05.628 INFO:tasks.workunit.client.1.smithi133.stdout:8/23: mkdir d9 0 2023-12-16T07:40:05.629 INFO:tasks.workunit.client.1.smithi133.stdout:8/24: chown c0 59 1 2023-12-16T07:40:05.629 INFO:tasks.workunit.client.1.smithi133.stdout:8/25: stat c4 0 2023-12-16T07:40:05.630 INFO:tasks.workunit.client.1.smithi133.stdout:8/26: write f8 [3672793,107150] 0 2023-12-16T07:40:05.633 INFO:tasks.workunit.client.1.smithi133.stdout:8/27: fdatasync f8 0 2023-12-16T07:40:05.637 INFO:tasks.workunit.client.1.smithi133.stdout:8/28: dread f8 [0,4194304] 0 2023-12-16T07:40:05.637 INFO:tasks.workunit.client.1.smithi133.stdout:8/29: readlink l7 0 2023-12-16T07:40:05.638 INFO:tasks.workunit.client.1.smithi133.stdout:8/30: mknod d9/ca 0 2023-12-16T07:40:05.639 INFO:tasks.workunit.client.1.smithi133.stdout:9/10: dread f0 [0,4194304] 0 2023-12-16T07:40:05.639 INFO:tasks.workunit.client.1.smithi133.stdout:9/11: chown f0 829001 1 2023-12-16T07:40:05.641 INFO:tasks.workunit.client.1.smithi133.stdout:9/12: symlink l4 0 2023-12-16T07:40:05.646 INFO:tasks.workunit.client.1.smithi133.stdout:0/13: dwrite d2/f3 [0,4194304] 0 2023-12-16T07:40:05.646 INFO:tasks.workunit.client.1.smithi133.stdout:0/14: stat d2 0 2023-12-16T07:40:05.651 INFO:tasks.workunit.client.1.smithi133.stdout:0/15: rename l0 to d2/l7 0 2023-12-16T07:40:05.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:05.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:05 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:06.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/5: getdents . 0 2023-12-16T07:40:06.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/6: fsync - no filename 2023-12-16T07:40:06.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/7: fdatasync - no filename 2023-12-16T07:40:06.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/8: symlink l1 0 2023-12-16T07:40:06.153 INFO:tasks.workunit.client.1.smithi133.stdout:7/9: rmdir - no directory 2023-12-16T07:40:06.153 INFO:tasks.workunit.client.1.smithi133.stdout:7/10: rmdir - no directory 2023-12-16T07:40:06.153 INFO:tasks.workunit.client.1.smithi133.stdout:7/11: dwrite - no filename 2023-12-16T07:40:06.153 INFO:tasks.workunit.client.1.smithi133.stdout:7/12: dread - no filename 2023-12-16T07:40:06.153 INFO:tasks.workunit.client.1.smithi133.stdout:7/13: creat f2 x:0 0 0 2023-12-16T07:40:06.155 INFO:tasks.workunit.client.1.smithi133.stdout:7/14: mknod c3 0 2023-12-16T07:40:06.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/8: truncate d0/f1 4125537 0 2023-12-16T07:40:06.158 INFO:tasks.workunit.client.1.smithi133.stdout:1/9: mkdir d0/d3 0 2023-12-16T07:40:06.159 INFO:tasks.workunit.client.1.smithi133.stdout:1/10: mknod d0/d3/c4 0 2023-12-16T07:40:06.165 INFO:tasks.workunit.client.1.smithi133.stdout:6/9: rmdir d0 39 2023-12-16T07:40:06.167 INFO:tasks.workunit.client.1.smithi133.stdout:6/10: mkdir d0/d4 0 2023-12-16T07:40:06.180 INFO:tasks.workunit.client.1.smithi133.stdout:7/15: dwrite f2 [0,4194304] 0 2023-12-16T07:40:06.185 INFO:tasks.workunit.client.1.smithi133.stdout:7/16: rename c3 to c4 0 2023-12-16T07:40:06.185 INFO:tasks.workunit.client.1.smithi133.stdout:7/17: chown c4 31601779 1 2023-12-16T07:40:06.186 INFO:tasks.workunit.client.1.smithi133.stdout:7/18: read f2 [2794248,105018] 0 2023-12-16T07:40:06.187 INFO:tasks.workunit.client.1.smithi133.stdout:8/31: truncate f8 1159749 0 2023-12-16T07:40:06.191 INFO:tasks.workunit.client.1.smithi133.stdout:0/16: getdents d2 0 2023-12-16T07:40:06.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/17: unlink l1 0 2023-12-16T07:40:06.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/18: fsync d2/f3 0 2023-12-16T07:40:06.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/19: truncate d2/f6 273422 0 2023-12-16T07:40:06.194 INFO:tasks.workunit.client.1.smithi133.stdout:7/19: dread f2 [0,4194304] 0 2023-12-16T07:40:06.198 INFO:tasks.workunit.client.1.smithi133.stdout:7/20: symlink l5 0 2023-12-16T07:40:06.217 INFO:tasks.workunit.client.1.smithi133.stdout:0/20: dwrite d2/f6 [0,4194304] 0 2023-12-16T07:40:06.239 INFO:tasks.workunit.client.1.smithi133.stdout:0/21: dwrite d2/f6 [0,4194304] 0 2023-12-16T07:40:06.273 INFO:tasks.workunit.client.1.smithi133.stdout:0/22: read d2/f6 [3507027,61992] 0 2023-12-16T07:40:06.274 INFO:tasks.workunit.client.1.smithi133.stdout:0/23: truncate d2/f3 733874 0 2023-12-16T07:40:06.293 INFO:tasks.workunit.client.1.smithi133.stdout:0/24: dwrite d2/f6 [0,4194304] 0 2023-12-16T07:40:06.295 INFO:tasks.workunit.client.1.smithi133.stdout:0/25: creat d2/f8 x:0 0 0 2023-12-16T07:40:06.329 INFO:tasks.workunit.client.1.smithi133.stdout:1/11: write d0/f1 [3480562,40951] 0 2023-12-16T07:40:06.330 INFO:tasks.workunit.client.1.smithi133.stdout:6/11: getdents d0 0 2023-12-16T07:40:06.330 INFO:tasks.workunit.client.1.smithi133.stdout:6/12: chown d0/f1 0 1 2023-12-16T07:40:06.331 INFO:tasks.workunit.client.1.smithi133.stdout:1/12: creat d0/d3/f5 x:0 0 0 2023-12-16T07:40:06.331 INFO:tasks.workunit.client.1.smithi133.stdout:1/13: truncate d0/d3/f5 1038045 0 2023-12-16T07:40:06.331 INFO:tasks.workunit.client.1.smithi133.stdout:7/21: write f2 [5022270,30569] 0 2023-12-16T07:40:06.333 INFO:tasks.workunit.client.1.smithi133.stdout:6/13: mknod d0/c5 0 2023-12-16T07:40:06.337 INFO:tasks.workunit.client.1.smithi133.stdout:1/14: rename d0/d3/f5 to d0/f6 0 2023-12-16T07:40:06.339 INFO:tasks.workunit.client.1.smithi133.stdout:8/32: dread f8 [0,4194304] 0 2023-12-16T07:40:06.339 INFO:tasks.workunit.client.1.smithi133.stdout:8/33: fdatasync f8 0 2023-12-16T07:40:06.340 INFO:tasks.workunit.client.1.smithi133.stdout:6/14: creat d0/f6 x:0 0 0 2023-12-16T07:40:06.341 INFO:tasks.workunit.client.1.smithi133.stdout:1/15: rename d0/d3/c4 to d0/d3/c7 0 2023-12-16T07:40:06.343 INFO:tasks.workunit.client.1.smithi133.stdout:0/26: truncate d2/f3 1533945 0 2023-12-16T07:40:06.348 INFO:tasks.workunit.client.1.smithi133.stdout:0/27: getdents d2 0 2023-12-16T07:40:06.350 INFO:tasks.workunit.client.1.smithi133.stdout:6/15: mknod d0/d4/c7 0 2023-12-16T07:40:06.352 INFO:tasks.workunit.client.1.smithi133.stdout:0/28: mkdir d2/d9 0 2023-12-16T07:40:06.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/16: mkdir d0/d4/d8 0 2023-12-16T07:40:06.355 INFO:tasks.workunit.client.1.smithi133.stdout:0/29: creat d2/d9/fa x:0 0 0 2023-12-16T07:40:06.359 INFO:tasks.workunit.client.1.smithi133.stdout:7/22: dwrite f2 [0,4194304] 0 2023-12-16T07:40:06.362 INFO:tasks.workunit.client.1.smithi133.stdout:1/16: dwrite d0/f6 [0,4194304] 0 2023-12-16T07:40:06.367 INFO:tasks.workunit.client.1.smithi133.stdout:6/17: getdents d0 0 2023-12-16T07:40:06.368 INFO:tasks.workunit.client.1.smithi133.stdout:7/23: dread f2 [0,4194304] 0 2023-12-16T07:40:06.370 INFO:tasks.workunit.client.1.smithi133.stdout:1/17: rename d0/d3/c7 to d0/c8 0 2023-12-16T07:40:06.372 INFO:tasks.workunit.client.1.smithi133.stdout:1/18: write d0/f1 [2343871,18882] 0 2023-12-16T07:40:06.373 INFO:tasks.workunit.client.1.smithi133.stdout:1/19: write d0/f6 [4049083,15613] 0 2023-12-16T07:40:06.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/30: write d2/f3 [752384,102783] 0 2023-12-16T07:40:06.374 INFO:tasks.workunit.client.1.smithi133.stdout:6/18: rmdir d0/d4/d8 0 2023-12-16T07:40:06.374 INFO:tasks.workunit.client.1.smithi133.stdout:6/19: rename d0 to d0/d4/d9 22 2023-12-16T07:40:06.377 INFO:tasks.workunit.client.1.smithi133.stdout:1/20: mknod d0/d3/c9 0 2023-12-16T07:40:06.380 INFO:tasks.workunit.client.1.smithi133.stdout:0/31: mkdir d2/d9/db 0 2023-12-16T07:40:06.380 INFO:tasks.workunit.client.1.smithi133.stdout:0/32: dread - d2/d9/fa zero size 2023-12-16T07:40:06.388 INFO:tasks.workunit.client.1.smithi133.stdout:7/24: rename f2 to f6 0 2023-12-16T07:40:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:8/34: truncate f8 137395 0 2023-12-16T07:40:06.411 INFO:tasks.workunit.client.1.smithi133.stdout:7/25: dwrite f6 [4194304,4194304] 0 2023-12-16T07:40:06.411 INFO:tasks.workunit.client.1.smithi133.stdout:1/21: dwrite d0/f1 [0,4194304] 0 2023-12-16T07:40:06.418 INFO:tasks.workunit.client.1.smithi133.stdout:0/33: dwrite d2/f4 [0,4194304] 0 2023-12-16T07:40:06.457 INFO:tasks.workunit.client.1.smithi133.stdout:6/20: getdents d0/d4 0 2023-12-16T07:40:06.457 INFO:tasks.workunit.client.1.smithi133.stdout:6/21: chown d0/f1 60096 1 2023-12-16T07:40:06.459 INFO:tasks.workunit.client.1.smithi133.stdout:6/22: read d0/f1 [255861,85899] 0 2023-12-16T07:40:06.459 INFO:tasks.workunit.client.1.smithi133.stdout:6/23: chown d0/d4 42 1 2023-12-16T07:40:06.459 INFO:tasks.workunit.client.1.smithi133.stdout:6/24: read - d0/f3 zero size 2023-12-16T07:40:06.459 INFO:tasks.workunit.client.1.smithi133.stdout:6/25: fdatasync d0/f1 0 2023-12-16T07:40:06.459 INFO:tasks.workunit.client.1.smithi133.stdout:6/26: dread - d0/f6 zero size 2023-12-16T07:40:06.462 INFO:tasks.workunit.client.1.smithi133.stdout:1/22: rename d0/d3 to d0/da 0 2023-12-16T07:40:06.462 INFO:tasks.workunit.client.1.smithi133.stdout:1/23: chown d0 51 1 2023-12-16T07:40:06.462 INFO:tasks.workunit.client.1.smithi133.stdout:1/24: write d0/f6 [4726264,28469] 0 2023-12-16T07:40:06.470 INFO:tasks.workunit.client.1.smithi133.stdout:7/26: rename l5 to l7 0 2023-12-16T07:40:06.473 INFO:tasks.workunit.client.1.smithi133.stdout:8/35: fsync f8 0 2023-12-16T07:40:06.481 INFO:tasks.workunit.client.1.smithi133.stdout:1/25: mkdir d0/da/db 0 2023-12-16T07:40:06.481 INFO:tasks.workunit.client.1.smithi133.stdout:6/27: dwrite d0/f2 [0,4194304] 0 2023-12-16T07:40:06.484 INFO:tasks.workunit.client.1.smithi133.stdout:8/36: read f8 [5285,112524] 0 2023-12-16T07:40:06.492 INFO:tasks.workunit.client.1.smithi133.stdout:7/27: dwrite f6 [4194304,4194304] 0 2023-12-16T07:40:06.492 INFO:tasks.workunit.client.1.smithi133.stdout:8/37: rmdir d9 39 2023-12-16T07:40:06.493 INFO:tasks.workunit.client.1.smithi133.stdout:8/38: write f8 [690874,41615] 0 2023-12-16T07:40:06.494 INFO:tasks.workunit.client.1.smithi133.stdout:8/39: write f8 [488803,88010] 0 2023-12-16T07:40:06.496 INFO:tasks.workunit.client.1.smithi133.stdout:1/26: write d0/f6 [3104155,86751] 0 2023-12-16T07:40:06.497 INFO:tasks.workunit.client.1.smithi133.stdout:0/34: dwrite d2/f6 [4194304,4194304] 0 2023-12-16T07:40:06.498 INFO:tasks.workunit.client.1.smithi133.stdout:8/40: creat d9/fb x:0 0 0 2023-12-16T07:40:06.498 INFO:tasks.workunit.client.1.smithi133.stdout:8/41: dread - d9/fb zero size 2023-12-16T07:40:06.499 INFO:tasks.workunit.client.1.smithi133.stdout:7/28: dread f6 [4194304,4194304] 0 2023-12-16T07:40:06.502 INFO:tasks.workunit.client.1.smithi133.stdout:7/29: write f6 [1260762,39602] 0 2023-12-16T07:40:06.502 INFO:tasks.workunit.client.1.smithi133.stdout:7/30: rmdir - no directory 2023-12-16T07:40:06.502 INFO:tasks.workunit.client.1.smithi133.stdout:7/31: chown f6 3 1 2023-12-16T07:40:06.507 INFO:tasks.workunit.client.1.smithi133.stdout:1/27: symlink d0/lc 0 2023-12-16T07:40:06.512 INFO:tasks.workunit.client.1.smithi133.stdout:8/42: mkdir d9/dc 0 2023-12-16T07:40:06.512 INFO:tasks.workunit.client.1.smithi133.stdout:8/43: write d9/fb [12902,80853] 0 2023-12-16T07:40:06.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/44: mknod d9/cd 0 2023-12-16T07:40:06.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/45: write f8 [921297,49784] 0 2023-12-16T07:40:06.521 INFO:tasks.workunit.client.1.smithi133.stdout:7/32: rename l1 to l8 0 2023-12-16T07:40:06.521 INFO:tasks.workunit.client.1.smithi133.stdout:7/33: rmdir - no directory 2023-12-16T07:40:06.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/35: dwrite d2/f8 [0,4194304] 0 2023-12-16T07:40:06.530 INFO:tasks.workunit.client.1.smithi133.stdout:8/46: dread f8 [0,4194304] 0 2023-12-16T07:40:06.532 INFO:tasks.workunit.client.1.smithi133.stdout:7/34: dread f6 [4194304,4194304] 0 2023-12-16T07:40:06.536 INFO:tasks.workunit.client.1.smithi133.stdout:0/36: unlink d2/d9/fa 0 2023-12-16T07:40:06.537 INFO:tasks.workunit.client.1.smithi133.stdout:8/47: mkdir d9/dc/de 0 2023-12-16T07:40:06.548 INFO:tasks.workunit.client.1.smithi133.stdout:7/35: creat f9 x:0 0 0 2023-12-16T07:40:06.553 INFO:tasks.workunit.client.1.smithi133.stdout:1/28: rmdir d0/da 39 2023-12-16T07:40:06.553 INFO:tasks.workunit.client.1.smithi133.stdout:1/29: chown d0/da/db 165 1 2023-12-16T07:40:06.558 INFO:tasks.workunit.client.1.smithi133.stdout:7/36: unlink f6 0 2023-12-16T07:40:06.558 INFO:tasks.workunit.client.1.smithi133.stdout:7/37: dread - f9 zero size 2023-12-16T07:40:06.561 INFO:tasks.workunit.client.1.smithi133.stdout:7/38: chown l0 329059205 1 2023-12-16T07:40:06.561 INFO:tasks.workunit.client.1.smithi133.stdout:7/39: dread - f9 zero size 2023-12-16T07:40:06.564 INFO:tasks.workunit.client.1.smithi133.stdout:1/30: dread d0/f1 [0,4194304] 0 2023-12-16T07:40:06.564 INFO:tasks.workunit.client.1.smithi133.stdout:7/40: creat fa x:0 0 0 2023-12-16T07:40:06.567 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:06 smithi049 ceph-mon[111939]: pgmap v183: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 MiB/s wr, 949 op/s 2023-12-16T07:40:06.567 INFO:tasks.workunit.client.1.smithi133.stdout:8/48: dwrite f8 [0,4194304] 0 2023-12-16T07:40:06.569 INFO:tasks.workunit.client.1.smithi133.stdout:0/37: dwrite d2/f8 [0,4194304] 0 2023-12-16T07:40:06.570 INFO:tasks.workunit.client.1.smithi133.stdout:1/31: creat d0/da/db/fd x:0 0 0 2023-12-16T07:40:06.570 INFO:tasks.workunit.client.1.smithi133.stdout:0/38: write d2/f6 [7840118,34565] 0 2023-12-16T07:40:06.570 INFO:tasks.workunit.client.1.smithi133.stdout:0/39: chown d2/d9 0 1 2023-12-16T07:40:06.572 INFO:tasks.workunit.client.1.smithi133.stdout:8/49: link d9/fb d9/dc/de/ff 0 2023-12-16T07:40:06.577 INFO:tasks.workunit.client.1.smithi133.stdout:0/40: symlink d2/d9/lc 0 2023-12-16T07:40:06.581 INFO:tasks.workunit.client.1.smithi133.stdout:7/41: mkdir db 0 2023-12-16T07:40:06.587 INFO:tasks.workunit.client.1.smithi133.stdout:7/42: mknod db/cc 0 2023-12-16T07:40:06.587 INFO:tasks.workunit.client.1.smithi133.stdout:7/43: chown l7 52 1 2023-12-16T07:40:06.587 INFO:tasks.workunit.client.1.smithi133.stdout:7/44: rename db to db/dd 22 2023-12-16T07:40:06.587 INFO:tasks.workunit.client.1.smithi133.stdout:7/45: chown l8 31 1 2023-12-16T07:40:06.595 INFO:tasks.workunit.client.1.smithi133.stdout:1/32: dwrite d0/f6 [4194304,4194304] 0 2023-12-16T07:40:06.599 INFO:tasks.workunit.client.1.smithi133.stdout:1/33: read d0/f6 [1751899,104077] 0 2023-12-16T07:40:06.603 INFO:tasks.workunit.client.1.smithi133.stdout:1/34: unlink d0/f6 0 2023-12-16T07:40:06.604 INFO:tasks.workunit.client.1.smithi133.stdout:7/46: dwrite f9 [0,4194304] 0 2023-12-16T07:40:06.606 INFO:tasks.workunit.client.1.smithi133.stdout:1/35: dread d0/f1 [0,4194304] 0 2023-12-16T07:40:06.606 INFO:tasks.workunit.client.1.smithi133.stdout:1/36: write d0/da/db/fd [276611,108039] 0 2023-12-16T07:40:06.609 INFO:tasks.workunit.client.1.smithi133.stdout:7/47: creat db/fe x:0 0 0 2023-12-16T07:40:06.610 INFO:tasks.workunit.client.1.smithi133.stdout:1/37: symlink d0/le 0 2023-12-16T07:40:06.613 INFO:tasks.workunit.client.1.smithi133.stdout:1/38: creat d0/da/db/ff x:0 0 0 2023-12-16T07:40:06.615 INFO:tasks.workunit.client.1.smithi133.stdout:1/39: creat d0/da/f10 x:0 0 0 2023-12-16T07:40:06.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:06 smithi133 ceph-mon[120445]: pgmap v183: 65 pgs: 65 active+clean; 175 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 MiB/s wr, 949 op/s 2023-12-16T07:40:06.618 INFO:tasks.workunit.client.1.smithi133.stdout:1/40: link d0/lc d0/da/db/l11 0 2023-12-16T07:40:06.619 INFO:tasks.workunit.client.1.smithi133.stdout:1/41: write d0/da/db/ff [831450,76606] 0 2023-12-16T07:40:06.620 INFO:tasks.workunit.client.1.smithi133.stdout:1/42: mkdir d0/d12 0 2023-12-16T07:40:06.631 INFO:tasks.workunit.client.1.smithi133.stdout:8/50: fsync d9/dc/de/ff 0 2023-12-16T07:40:06.631 INFO:tasks.workunit.client.1.smithi133.stdout:8/51: write d9/fb [409251,10225] 0 2023-12-16T07:40:06.637 INFO:tasks.workunit.client.1.smithi133.stdout:8/52: fdatasync d9/fb 0 2023-12-16T07:40:06.638 INFO:tasks.workunit.client.1.smithi133.stdout:1/43: dwrite d0/f1 [0,4194304] 0 2023-12-16T07:40:06.638 INFO:tasks.workunit.client.1.smithi133.stdout:1/44: chown d0 310689 1 2023-12-16T07:40:06.639 INFO:tasks.workunit.client.1.smithi133.stdout:8/53: mkdir d9/d10 0 2023-12-16T07:40:06.639 INFO:tasks.workunit.client.1.smithi133.stdout:1/45: read d0/f1 [3365107,78315] 0 2023-12-16T07:40:06.642 INFO:tasks.workunit.client.1.smithi133.stdout:8/54: dread d9/dc/de/ff [0,4194304] 0 2023-12-16T07:40:06.642 INFO:tasks.workunit.client.1.smithi133.stdout:8/55: fsync d9/fb 0 2023-12-16T07:40:06.642 INFO:tasks.workunit.client.1.smithi133.stdout:8/56: chown c4 8145 1 2023-12-16T07:40:06.648 INFO:tasks.workunit.client.1.smithi133.stdout:8/57: dread f8 [0,4194304] 0 2023-12-16T07:40:06.650 INFO:tasks.workunit.client.1.smithi133.stdout:8/58: unlink c0 0 2023-12-16T07:40:06.651 INFO:tasks.workunit.client.1.smithi133.stdout:8/59: read f8 [1151940,93941] 0 2023-12-16T07:40:06.651 INFO:tasks.workunit.client.1.smithi133.stdout:7/48: rmdir db 39 2023-12-16T07:40:06.651 INFO:tasks.workunit.client.1.smithi133.stdout:7/49: fdatasync fa 0 2023-12-16T07:40:06.652 INFO:tasks.workunit.client.1.smithi133.stdout:7/50: truncate db/fe 211618 0 2023-12-16T07:40:06.652 INFO:tasks.workunit.client.1.smithi133.stdout:7/51: fdatasync f9 0 2023-12-16T07:40:06.652 INFO:tasks.workunit.client.1.smithi133.stdout:7/52: fdatasync fa 0 2023-12-16T07:40:06.652 INFO:tasks.workunit.client.1.smithi133.stdout:7/53: write db/fe [749435,116190] 0 2023-12-16T07:40:06.653 INFO:tasks.workunit.client.1.smithi133.stdout:7/54: write f9 [2342125,116771] 0 2023-12-16T07:40:06.653 INFO:tasks.workunit.client.1.smithi133.stdout:7/55: write f9 [2265074,52420] 0 2023-12-16T07:40:06.654 INFO:tasks.workunit.client.1.smithi133.stdout:7/56: readlink l0 0 2023-12-16T07:40:06.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/57: rmdir db 39 2023-12-16T07:40:06.655 INFO:tasks.workunit.client.1.smithi133.stdout:1/46: getdents d0/da 0 2023-12-16T07:40:06.656 INFO:tasks.workunit.client.1.smithi133.stdout:1/47: chown d0/da/c9 450185 1 2023-12-16T07:40:06.659 INFO:tasks.workunit.client.1.smithi133.stdout:7/58: creat db/ff x:0 0 0 2023-12-16T07:40:06.662 INFO:tasks.workunit.client.1.smithi133.stdout:7/59: dread db/fe [0,4194304] 0 2023-12-16T07:40:06.665 INFO:tasks.workunit.client.1.smithi133.stdout:7/60: symlink db/l10 0 2023-12-16T07:40:06.667 INFO:tasks.workunit.client.1.smithi133.stdout:7/61: unlink l7 0 2023-12-16T07:40:06.667 INFO:tasks.workunit.client.1.smithi133.stdout:7/62: chown db 12 1 2023-12-16T07:40:06.670 INFO:tasks.workunit.client.1.smithi133.stdout:7/63: unlink l0 0 2023-12-16T07:40:06.672 INFO:tasks.workunit.client.1.smithi133.stdout:7/64: rename fa to db/f11 0 2023-12-16T07:40:06.672 INFO:tasks.workunit.client.1.smithi133.stdout:7/65: chown c4 2234 1 2023-12-16T07:40:06.673 INFO:tasks.workunit.client.1.smithi133.stdout:7/66: mkdir db/d12 0 2023-12-16T07:40:06.675 INFO:tasks.workunit.client.1.smithi133.stdout:7/67: write f9 [3716956,78754] 0 2023-12-16T07:40:06.680 INFO:tasks.workunit.client.1.smithi133.stdout:8/60: truncate f8 2020134 0 2023-12-16T07:40:06.680 INFO:tasks.workunit.client.1.smithi133.stdout:8/61: fdatasync d9/dc/de/ff 0 2023-12-16T07:40:06.708 INFO:tasks.workunit.client.1.smithi133.stdout:8/62: dread f8 [0,4194304] 0 2023-12-16T07:40:08.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:08 smithi133 ceph-mon[120445]: pgmap v184: 65 pgs: 65 active+clean; 214 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 967 op/s 2023-12-16T07:40:08.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:08 smithi049 ceph-mon[111939]: pgmap v184: 65 pgs: 65 active+clean; 214 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 967 op/s 2023-12-16T07:40:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:10 smithi133 ceph-mon[120445]: pgmap v185: 65 pgs: 65 active+clean; 228 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 724 op/s 2023-12-16T07:40:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:10 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk restarted 2023-12-16T07:40:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:10 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:40:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:10 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:40:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:10 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:40:10.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:10 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:40:10.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:10 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:40:10.650 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-16T07:40:10.651 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T07:40:10.651 INFO:tasks.workunit.client.0.smithi049.stderr:+ make 2023-12-16T07:40:10.702 INFO:tasks.workunit.client.0.smithi049.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-16T07:40:10.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:10 smithi049 ceph-mon[111939]: pgmap v185: 65 pgs: 65 active+clean; 228 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 724 op/s 2023-12-16T07:40:10.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:10 smithi049 ceph-mon[111939]: Standby manager daemon smithi133.wbiduk restarted 2023-12-16T07:40:10.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:10 smithi049 ceph-mon[111939]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:40:10.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:10 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:40:10.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:10 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:40:10.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:10 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:40:10.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:10 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:40:10.918 INFO:tasks.workunit.client.0.smithi049.stderr:++ readlink -f fsstress 2023-12-16T07:40:10.919 INFO:tasks.workunit.client.0.smithi049.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-16T07:40:10.919 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2023-12-16T07:40:10.919 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-16T07:40:10.920 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2023-12-16T07:40:10.920 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-16T07:40:10.920 INFO:tasks.workunit.client.0.smithi049.stderr:++ mktemp -d -p . 2023-12-16T07:40:10.921 INFO:tasks.workunit.client.0.smithi049.stderr:+ T=./tmp.C0KqtfyeYV 2023-12-16T07:40:10.921 INFO:tasks.workunit.client.0.smithi049.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.C0KqtfyeYV -l 1 -n 1000 -p 10 -v 2023-12-16T07:40:10.922 INFO:tasks.workunit.client.0.smithi049.stdout:seed = 1702052513 2023-12-16T07:40:10.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/0: write - no filename 2023-12-16T07:40:10.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/1: fdatasync - no filename 2023-12-16T07:40:10.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/2: chown . 45138273 1 2023-12-16T07:40:10.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/3: dwrite - no filename 2023-12-16T07:40:10.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/4: creat f0 x:0 0 0 2023-12-16T07:40:10.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/5: fdatasync f0 0 2023-12-16T07:40:10.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/6: chown f0 1632 1 2023-12-16T07:40:10.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/0: rmdir - no directory 2023-12-16T07:40:10.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/1: write - no filename 2023-12-16T07:40:10.926 INFO:tasks.workunit.client.0.smithi049.stdout:1/0: symlink l0 0 2023-12-16T07:40:10.927 INFO:tasks.workunit.client.0.smithi049.stdout:0/7: link f0 f1 0 2023-12-16T07:40:10.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/0: stat - no entries 2023-12-16T07:40:10.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/1: dwrite - no filename 2023-12-16T07:40:10.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/2: symlink l0 0 2023-12-16T07:40:10.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/3: write - no filename 2023-12-16T07:40:10.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/8: creat f2 x:0 0 0 2023-12-16T07:40:10.929 INFO:tasks.workunit.client.0.smithi049.stdout:3/2: mknod c0 0 2023-12-16T07:40:10.929 INFO:tasks.workunit.client.0.smithi049.stdout:3/3: dread - no filename 2023-12-16T07:40:10.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/4: chown c0 0 1 2023-12-16T07:40:10.930 INFO:tasks.workunit.client.0.smithi049.stdout:2/4: rename l0 to l1 0 2023-12-16T07:40:10.930 INFO:tasks.workunit.client.0.smithi049.stdout:2/5: chown l1 18 1 2023-12-16T07:40:10.931 INFO:tasks.workunit.client.0.smithi049.stdout:5/0: chown . 20 1 2023-12-16T07:40:10.931 INFO:tasks.workunit.client.0.smithi049.stdout:5/1: unlink - no file 2023-12-16T07:40:10.931 INFO:tasks.workunit.client.0.smithi049.stdout:5/2: dread - no filename 2023-12-16T07:40:10.931 INFO:tasks.workunit.client.0.smithi049.stdout:5/3: dread - no filename 2023-12-16T07:40:10.931 INFO:tasks.workunit.client.0.smithi049.stdout:5/4: truncate - no filename 2023-12-16T07:40:10.931 INFO:tasks.workunit.client.0.smithi049.stdout:4/0: creat f0 x:0 0 0 2023-12-16T07:40:10.933 INFO:tasks.workunit.client.0.smithi049.stdout:3/5: mkdir d1 0 2023-12-16T07:40:10.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/6: mkdir d2 0 2023-12-16T07:40:10.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/7: write - no filename 2023-12-16T07:40:10.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/8: fdatasync - no filename 2023-12-16T07:40:10.941 INFO:tasks.workunit.client.0.smithi049.stdout:5/5: mknod c0 0 2023-12-16T07:40:10.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/0: truncate - no filename 2023-12-16T07:40:10.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/1: dread - no filename 2023-12-16T07:40:10.941 INFO:tasks.workunit.client.0.smithi049.stdout:4/1: creat f1 x:0 0 0 2023-12-16T07:40:10.942 INFO:tasks.workunit.client.0.smithi049.stdout:3/6: rename c0 to d1/c2 0 2023-12-16T07:40:10.942 INFO:tasks.workunit.client.0.smithi049.stdout:3/7: write - no filename 2023-12-16T07:40:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/9: creat d2/f3 x:0 0 0 2023-12-16T07:40:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/10: dread - d2/f3 zero size 2023-12-16T07:40:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/11: dread - d2/f3 zero size 2023-12-16T07:40:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/12: fdatasync d2/f3 0 2023-12-16T07:40:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:6/2: mkdir d0 0 2023-12-16T07:40:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:6/3: truncate - no filename 2023-12-16T07:40:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:6/4: truncate - no filename 2023-12-16T07:40:10.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/6: mknod c1 0 2023-12-16T07:40:10.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/7: write - no filename 2023-12-16T07:40:10.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/2: mkdir d2 0 2023-12-16T07:40:10.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/3: write f0 [246754,80798] 0 2023-12-16T07:40:10.953 INFO:tasks.workunit.client.0.smithi049.stdout:7/0: dwrite - no filename 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/5: symlink d0/l1 0 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/6: dread - no filename 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/7: dwrite - no filename 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/8: dread - no filename 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:7/1: creat f0 x:0 0 0 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/9: unlink d0/l1 0 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/10: link - no file 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/11: chown d0 1685651 1 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/12: truncate - no filename 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/0: mkdir d0 0 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/1: chown d0 1 1 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/2: getdents d0 0 2023-12-16T07:40:10.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/3: fsync - no filename 2023-12-16T07:40:10.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/13: mkdir d0/d2 0 2023-12-16T07:40:10.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/8: mknod c2 0 2023-12-16T07:40:10.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/13: symlink d2/l4 0 2023-12-16T07:40:10.975 INFO:tasks.workunit.client.0.smithi049.stdout:8/4: creat d0/f1 x:0 0 0 2023-12-16T07:40:10.975 INFO:tasks.workunit.client.0.smithi049.stdout:6/14: creat d0/d2/f3 x:0 0 0 2023-12-16T07:40:10.975 INFO:tasks.workunit.client.0.smithi049.stdout:9/0: creat f0 x:0 0 0 2023-12-16T07:40:10.981 INFO:tasks.workunit.client.0.smithi049.stdout:5/9: creat f3 x:0 0 0 2023-12-16T07:40:10.981 INFO:tasks.workunit.client.0.smithi049.stdout:6/15: unlink d0/d2/f3 0 2023-12-16T07:40:10.981 INFO:tasks.workunit.client.0.smithi049.stdout:6/16: rename d0/d2 to d0/d2/d4 22 2023-12-16T07:40:10.989 INFO:tasks.workunit.client.0.smithi049.stdout:6/17: creat d0/d2/f5 x:0 0 0 2023-12-16T07:40:11.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/18: mknod d0/d2/c6 0 2023-12-16T07:40:11.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/19: readlink - no filename 2023-12-16T07:40:11.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/20: chown d0 14 1 2023-12-16T07:40:11.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/21: mknod d0/c7 0 2023-12-16T07:40:11.139 INFO:tasks.workunit.client.0.smithi049.stdout:0/9: dwrite f0 [0,4194304] 0 2023-12-16T07:40:11.171 INFO:tasks.workunit.client.0.smithi049.stdout:3/8: unlink d1/c2 0 2023-12-16T07:40:11.171 INFO:tasks.workunit.client.0.smithi049.stdout:3/9: unlink - no file 2023-12-16T07:40:11.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/14: fsync d2/f3 0 2023-12-16T07:40:11.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/15: readlink d2/l4 0 2023-12-16T07:40:11.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/16: write d2/f3 [658544,65311] 0 2023-12-16T07:40:11.201 INFO:tasks.workunit.client.0.smithi049.stdout:9/1: getdents . 0 2023-12-16T07:40:11.201 INFO:tasks.workunit.client.0.smithi049.stdout:9/2: chown f0 1694 1 2023-12-16T07:40:11.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/10: getdents . 0 2023-12-16T07:40:11.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/11: truncate f3 322524 0 2023-12-16T07:40:11.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/12: chown f3 69 1 2023-12-16T07:40:11.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/10: creat f3 x:0 0 0 2023-12-16T07:40:11.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:11 smithi133 ceph-mon[120445]: mgrmap e20: smithi049.rqlvwo(active, since 5m), standbys: smithi133.wbiduk 2023-12-16T07:40:11.676 INFO:tasks.workunit.client.0.smithi049.stdout:0/11: dwrite f1 [0,4194304] 0 2023-12-16T07:40:11.676 INFO:tasks.workunit.client.0.smithi049.stdout:0/12: rmdir - no directory 2023-12-16T07:40:11.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:11 smithi049 ceph-mon[111939]: mgrmap e20: smithi049.rqlvwo(active, since 5m), standbys: smithi133.wbiduk 2023-12-16T07:40:11.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/13: dwrite f0 [0,4194304] 0 2023-12-16T07:40:11.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/14: truncate f2 175347 0 2023-12-16T07:40:11.732 INFO:tasks.workunit.client.0.smithi049.stdout:4/4: dread f0 [0,4194304] 0 2023-12-16T07:40:11.732 INFO:tasks.workunit.client.0.smithi049.stdout:4/5: read - f1 zero size 2023-12-16T07:40:11.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/6: dread - f1 zero size 2023-12-16T07:40:11.740 INFO:tasks.workunit.client.0.smithi049.stdout:4/7: dread f0 [0,4194304] 0 2023-12-16T07:40:11.752 INFO:tasks.workunit.client.0.smithi049.stdout:3/10: symlink d1/l3 0 2023-12-16T07:40:11.753 INFO:tasks.workunit.client.0.smithi049.stdout:3/11: truncate - no filename 2023-12-16T07:40:11.753 INFO:tasks.workunit.client.0.smithi049.stdout:3/12: rename d1 to d1/d4 22 2023-12-16T07:40:11.758 INFO:tasks.workunit.client.0.smithi049.stdout:2/17: symlink d2/l5 0 2023-12-16T07:40:11.854 INFO:tasks.workunit.client.0.smithi049.stdout:4/8: dwrite f0 [0,4194304] 0 2023-12-16T07:40:11.855 INFO:tasks.workunit.client.0.smithi049.stdout:4/9: truncate f0 4778793 0 2023-12-16T07:40:11.861 INFO:tasks.workunit.client.0.smithi049.stdout:8/5: dwrite d0/f1 [0,4194304] 0 2023-12-16T07:40:11.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/22: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:11.886 INFO:tasks.workunit.client.0.smithi049.stdout:7/2: dwrite f0 [0,4194304] 0 2023-12-16T07:40:11.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/18: dread d2/f3 [0,4194304] 0 2023-12-16T07:40:11.934 INFO:tasks.workunit.client.0.smithi049.stdout:9/3: write f0 [649114,118516] 0 2023-12-16T07:40:11.940 INFO:tasks.workunit.client.0.smithi049.stdout:9/4: chown f0 0 1 2023-12-16T07:40:11.940 INFO:tasks.workunit.client.0.smithi049.stdout:9/5: chown f0 66575760 1 2023-12-16T07:40:11.941 INFO:tasks.workunit.client.0.smithi049.stdout:9/6: write f0 [656886,39895] 0 2023-12-16T07:40:11.941 INFO:tasks.workunit.client.0.smithi049.stdout:9/7: chown f0 0 1 2023-12-16T07:40:11.941 INFO:tasks.workunit.client.0.smithi049.stdout:9/8: dread f0 [0,4194304] 0 2023-12-16T07:40:11.941 INFO:tasks.workunit.client.0.smithi049.stdout:9/9: write f0 [1544287,110247] 0 2023-12-16T07:40:11.941 INFO:tasks.workunit.client.0.smithi049.stdout:9/10: dread f0 [0,4194304] 0 2023-12-16T07:40:11.999 INFO:tasks.workunit.client.0.smithi049.stdout:5/13: creat f4 x:0 0 0 2023-12-16T07:40:11.999 INFO:tasks.workunit.client.0.smithi049.stdout:5/14: write f4 [231055,59280] 0 2023-12-16T07:40:11.999 INFO:tasks.workunit.client.0.smithi049.stdout:5/15: read f4 [195071,36106] 0 2023-12-16T07:40:11.999 INFO:tasks.workunit.client.0.smithi049.stdout:5/16: write f3 [833254,62990] 0 2023-12-16T07:40:12.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/17: dwrite f3 [0,4194304] 0 2023-12-16T07:40:12.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: pgmap v186: 65 pgs: 65 active+clean; 231 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 515 op/s 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr fail", "who": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "mgr fail", "who": "smithi049.rqlvwo"}]': finished 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: mgrmap e21: smithi133.wbiduk(active, starting, since 0.00598933s) 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:40:12.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:40:12.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:12 smithi133 ceph-mon[120445]: Manager daemon smithi133.wbiduk is now available 2023-12-16T07:40:12.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: pgmap v186: 65 pgs: 65 active+clean; 231 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 515 op/s 2023-12-16T07:40:12.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:12.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:12.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:40:12.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:40:12.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:40:12.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr fail", "who": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: osdmap e45: 6 total, 6 up, 6 in 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.14208 172.21.15.49:0/2037395273' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "mgr fail", "who": "smithi049.rqlvwo"}]': finished 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: mgrmap e21: smithi133.wbiduk(active, starting, since 0.00598933s) 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:40:12.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:40:12.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:12 smithi049 ceph-mon[111939]: Manager daemon smithi133.wbiduk is now available 2023-12-16T07:40:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:40:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:40:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/trash_purge_schedule"}]: dispatch 2023-12-16T07:40:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/trash_purge_schedule"}]: dispatch 2023-12-16T07:40:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: Deploying cephadm binary to smithi049 2023-12-16T07:40:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: Deploying cephadm binary to smithi133 2023-12-16T07:40:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:13 smithi133 ceph-mon[120445]: mgrmap e22: smithi133.wbiduk(active, since 1.00782s) 2023-12-16T07:40:13.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/15: creat f4 x:0 0 0 2023-12-16T07:40:13.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/16: dread - f4 zero size 2023-12-16T07:40:13.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/17: stat f3 0 2023-12-16T07:40:13.636 INFO:tasks.workunit.client.0.smithi049.stdout:0/18: dwrite f1 [4194304,4194304] 0 2023-12-16T07:40:13.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:13.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:13.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:40:13.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:13.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:40:13.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:40:13.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/trash_purge_schedule"}]: dispatch 2023-12-16T07:40:13.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.wbiduk/trash_purge_schedule"}]: dispatch 2023-12-16T07:40:13.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: Deploying cephadm binary to smithi049 2023-12-16T07:40:13.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: Deploying cephadm binary to smithi133 2023-12-16T07:40:13.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:13 smithi049 ceph-mon[111939]: mgrmap e22: smithi133.wbiduk(active, since 1.00782s) 2023-12-16T07:40:13.683 INFO:tasks.workunit.client.0.smithi049.stdout:3/13: creat d1/f5 x:0 0 0 2023-12-16T07:40:13.960 INFO:tasks.workunit.client.0.smithi049.stdout:4/10: creat d2/f3 x:0 0 0 2023-12-16T07:40:13.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/11: dwrite d2/f3 [0,4194304] 0 2023-12-16T07:40:13.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/12: write f1 [794405,58638] 0 2023-12-16T07:40:13.978 INFO:tasks.workunit.client.0.smithi049.stdout:4/13: dread f1 [0,4194304] 0 2023-12-16T07:40:13.979 INFO:tasks.workunit.client.0.smithi049.stdout:4/14: dread f1 [0,4194304] 0 2023-12-16T07:40:14.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/19: rename l1 to d2/l6 0 2023-12-16T07:40:14.162 INFO:tasks.workunit.client.0.smithi049.stdout:5/18: mkdir d5 0 2023-12-16T07:40:14.163 INFO:tasks.workunit.client.0.smithi049.stdout:5/19: write f4 [128058,21103] 0 2023-12-16T07:40:14.163 INFO:tasks.workunit.client.0.smithi049.stdout:5/20: read f3 [782250,21594] 0 2023-12-16T07:40:14.165 INFO:tasks.workunit.client.0.smithi049.stdout:0/19: creat f5 x:0 0 0 2023-12-16T07:40:14.165 INFO:tasks.workunit.client.0.smithi049.stdout:0/20: fdatasync f4 0 2023-12-16T07:40:14.165 INFO:tasks.workunit.client.0.smithi049.stdout:3/14: mknod d1/c6 0 2023-12-16T07:40:14.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/15: creat d2/f4 x:0 0 0 2023-12-16T07:40:14.169 INFO:tasks.workunit.client.0.smithi049.stdout:2/20: mkdir d2/d7 0 2023-12-16T07:40:14.171 INFO:tasks.workunit.client.0.smithi049.stdout:2/21: dread d2/f3 [0,4194304] 0 2023-12-16T07:40:14.172 INFO:tasks.workunit.client.0.smithi049.stdout:5/21: creat d5/f6 x:0 0 0 2023-12-16T07:40:14.172 INFO:tasks.workunit.client.0.smithi049.stdout:5/22: dread - d5/f6 zero size 2023-12-16T07:40:14.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/21: creat f6 x:0 0 0 2023-12-16T07:40:14.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/22: fsync f1 0 2023-12-16T07:40:14.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/23: dread - f5 zero size 2023-12-16T07:40:14.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/15: symlink d1/l7 0 2023-12-16T07:40:14.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/16: dread - d1/f5 zero size 2023-12-16T07:40:14.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/17: dread - d1/f5 zero size 2023-12-16T07:40:14.179 INFO:tasks.workunit.client.0.smithi049.stdout:5/23: unlink c2 0 2023-12-16T07:40:14.182 INFO:tasks.workunit.client.0.smithi049.stdout:0/24: mknod c7 0 2023-12-16T07:40:14.198 INFO:tasks.workunit.client.0.smithi049.stdout:2/22: dwrite d2/f3 [0,4194304] 0 2023-12-16T07:40:14.199 INFO:tasks.workunit.client.0.smithi049.stdout:2/23: chown d2/f3 717014879 1 2023-12-16T07:40:14.199 INFO:tasks.workunit.client.0.smithi049.stdout:2/24: mknod d2/c8 0 2023-12-16T07:40:14.199 INFO:tasks.workunit.client.0.smithi049.stdout:2/25: chown d2/c8 12 1 2023-12-16T07:40:14.200 INFO:tasks.workunit.client.0.smithi049.stdout:2/26: creat d2/f9 x:0 0 0 2023-12-16T07:40:14.201 INFO:tasks.workunit.client.0.smithi049.stdout:2/27: symlink d2/la 0 2023-12-16T07:40:14.202 INFO:tasks.workunit.client.0.smithi049.stdout:3/18: dwrite d1/f5 [0,4194304] 0 2023-12-16T07:40:14.202 INFO:tasks.workunit.client.0.smithi049.stdout:5/24: dwrite d5/f6 [0,4194304] 0 2023-12-16T07:40:14.202 INFO:tasks.workunit.client.0.smithi049.stdout:2/28: creat d2/d7/fb x:0 0 0 2023-12-16T07:40:14.204 INFO:tasks.workunit.client.0.smithi049.stdout:0/25: dread f1 [4194304,4194304] 0 2023-12-16T07:40:14.205 INFO:tasks.workunit.client.0.smithi049.stdout:3/19: rename d1/l7 to d1/l8 0 2023-12-16T07:40:14.208 INFO:tasks.workunit.client.0.smithi049.stdout:2/29: symlink d2/d7/lc 0 2023-12-16T07:40:14.208 INFO:tasks.workunit.client.0.smithi049.stdout:5/25: dread d5/f6 [0,4194304] 0 2023-12-16T07:40:14.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/20: mknod d1/c9 0 2023-12-16T07:40:14.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/30: rename d2/d7/lc to d2/ld 0 2023-12-16T07:40:14.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/31: mkdir d2/de 0 2023-12-16T07:40:14.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/32: creat d2/ff x:0 0 0 2023-12-16T07:40:14.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/33: write d2/ff [17392,121984] 0 2023-12-16T07:40:14.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/34: chown d2/d7 221 1 2023-12-16T07:40:14.225 INFO:tasks.workunit.client.0.smithi049.stdout:0/26: dwrite f1 [4194304,4194304] 0 2023-12-16T07:40:14.226 INFO:tasks.workunit.client.0.smithi049.stdout:2/35: dread d2/f3 [0,4194304] 0 2023-12-16T07:40:14.239 INFO:tasks.workunit.client.0.smithi049.stdout:0/27: creat f8 x:0 0 0 2023-12-16T07:40:14.239 INFO:tasks.workunit.client.0.smithi049.stdout:2/36: symlink d2/d7/l10 0 2023-12-16T07:40:14.240 INFO:tasks.workunit.client.0.smithi049.stdout:0/28: readlink - no filename 2023-12-16T07:40:14.241 INFO:tasks.workunit.client.0.smithi049.stdout:2/37: mkdir d2/d7/d11 0 2023-12-16T07:40:14.242 INFO:tasks.workunit.client.0.smithi049.stdout:0/29: symlink l9 0 2023-12-16T07:40:14.244 INFO:tasks.workunit.client.0.smithi049.stdout:2/38: unlink d2/l4 0 2023-12-16T07:40:14.244 INFO:tasks.workunit.client.0.smithi049.stdout:2/39: truncate d2/f9 174770 0 2023-12-16T07:40:14.244 INFO:tasks.workunit.client.0.smithi049.stdout:2/40: truncate d2/d7/fb 328690 0 2023-12-16T07:40:14.244 INFO:tasks.workunit.client.0.smithi049.stdout:2/41: readlink d2/ld 0 2023-12-16T07:40:14.245 INFO:tasks.workunit.client.0.smithi049.stdout:0/30: rename f6 to fa 0 2023-12-16T07:40:14.246 INFO:tasks.workunit.client.0.smithi049.stdout:2/42: creat d2/f12 x:0 0 0 2023-12-16T07:40:14.248 INFO:tasks.workunit.client.0.smithi049.stdout:2/43: creat d2/d7/f13 x:0 0 0 2023-12-16T07:40:14.264 INFO:tasks.workunit.client.0.smithi049.stdout:2/44: dwrite d2/d7/f13 [0,4194304] 0 2023-12-16T07:40:14.264 INFO:tasks.workunit.client.0.smithi049.stdout:2/45: write d2/f9 [1179018,30466] 0 2023-12-16T07:40:14.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/46: truncate d2/ff 724027 0 2023-12-16T07:40:14.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/47: write d2/f9 [1554471,64076] 0 2023-12-16T07:40:14.575 INFO:tasks.workunit.client.0.smithi049.stdout:8/6: write d0/f1 [4209665,6489] 0 2023-12-16T07:40:14.577 INFO:tasks.workunit.client.0.smithi049.stdout:8/7: fsync d0/f1 0 2023-12-16T07:40:14.578 INFO:tasks.workunit.client.0.smithi049.stdout:8/8: write d0/f1 [2778141,12170] 0 2023-12-16T07:40:14.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/9: read d0/f1 [3391934,51392] 0 2023-12-16T07:40:14.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/10: rename d0 to d0/d2 22 2023-12-16T07:40:14.583 INFO:tasks.workunit.client.0.smithi049.stdout:6/23: write d0/d2/f5 [4109520,99222] 0 2023-12-16T07:40:14.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/24: read d0/d2/f5 [1750801,109518] 0 2023-12-16T07:40:14.585 INFO:tasks.workunit.client.0.smithi049.stdout:6/25: creat d0/d2/f8 x:0 0 0 2023-12-16T07:40:14.585 INFO:tasks.workunit.client.0.smithi049.stdout:6/26: creat d0/d2/f9 x:0 0 0 2023-12-16T07:40:14.586 INFO:tasks.workunit.client.0.smithi049.stdout:6/27: write d0/d2/f8 [702815,6049] 0 2023-12-16T07:40:14.586 INFO:tasks.workunit.client.0.smithi049.stdout:6/28: read - d0/d2/f9 zero size 2023-12-16T07:40:14.586 INFO:tasks.workunit.client.0.smithi049.stdout:6/29: creat d0/fa x:0 0 0 2023-12-16T07:40:14.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/30: unlink d0/fa 0 2023-12-16T07:40:14.591 INFO:tasks.workunit.client.0.smithi049.stdout:6/31: dread d0/d2/f5 [4194304,4194304] 0 2023-12-16T07:40:14.591 INFO:tasks.workunit.client.0.smithi049.stdout:6/32: chown d0/c7 0 1 2023-12-16T07:40:14.592 INFO:tasks.workunit.client.0.smithi049.stdout:6/33: mknod d0/d2/cb 0 2023-12-16T07:40:14.593 INFO:tasks.workunit.client.0.smithi049.stdout:6/34: link d0/c7 d0/cc 0 2023-12-16T07:40:14.593 INFO:tasks.workunit.client.0.smithi049.stdout:6/35: write d0/d2/f9 [886691,1539] 0 2023-12-16T07:40:14.593 INFO:tasks.workunit.client.0.smithi049.stdout:6/36: unlink d0/cc 0 2023-12-16T07:40:14.615 INFO:tasks.workunit.client.0.smithi049.stdout:6/37: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:14.619 INFO:tasks.workunit.client.0.smithi049.stdout:6/38: mkdir d0/d2/dd 0 2023-12-16T07:40:14.619 INFO:tasks.workunit.client.0.smithi049.stdout:6/39: symlink d0/d2/le 0 2023-12-16T07:40:14.632 INFO:tasks.workunit.client.0.smithi049.stdout:4/16: getdents d2 0 2023-12-16T07:40:14.634 INFO:tasks.workunit.client.0.smithi049.stdout:9/11: truncate f0 1436410 0 2023-12-16T07:40:14.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/21: truncate d1/f5 3495617 0 2023-12-16T07:40:14.639 INFO:tasks.workunit.client.0.smithi049.stdout:4/17: dread d2/f3 [0,4194304] 0 2023-12-16T07:40:14.640 INFO:tasks.workunit.client.0.smithi049.stdout:4/18: symlink d2/l5 0 2023-12-16T07:40:14.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/19: mkdir d2/d6 0 2023-12-16T07:40:14.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/20: write d2/f3 [3277225,79539] 0 2023-12-16T07:40:14.648 INFO:tasks.workunit.client.0.smithi049.stdout:4/21: symlink d2/l7 0 2023-12-16T07:40:14.648 INFO:tasks.workunit.client.0.smithi049.stdout:0/31: fsync fa 0 2023-12-16T07:40:14.648 INFO:tasks.workunit.client.0.smithi049.stdout:2/48: fsync d2/d7/f13 0 2023-12-16T07:40:14.648 INFO:tasks.workunit.client.0.smithi049.stdout:2/49: write d2/f12 [875414,68352] 0 2023-12-16T07:40:14.651 INFO:tasks.workunit.client.0.smithi049.stdout:8/11: truncate d0/f1 95570 0 2023-12-16T07:40:14.655 INFO:tasks.workunit.client.0.smithi049.stdout:0/32: creat fb x:0 0 0 2023-12-16T07:40:14.655 INFO:tasks.workunit.client.0.smithi049.stdout:2/50: unlink d2/f3 0 2023-12-16T07:40:14.655 INFO:tasks.workunit.client.0.smithi049.stdout:6/40: rmdir d0/d2 39 2023-12-16T07:40:14.666 INFO:tasks.workunit.client.0.smithi049.stdout:0/33: mknod cc 0 2023-12-16T07:40:14.666 INFO:tasks.workunit.client.0.smithi049.stdout:6/41: unlink d0/d2/le 0 2023-12-16T07:40:14.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/12: rename d0/f1 to d0/f3 0 2023-12-16T07:40:14.674 INFO:tasks.workunit.client.0.smithi049.stdout:0/34: creat fd x:0 0 0 2023-12-16T07:40:14.674 INFO:tasks.workunit.client.0.smithi049.stdout:0/35: fdatasync f8 0 2023-12-16T07:40:14.674 INFO:tasks.workunit.client.0.smithi049.stdout:0/36: write fb [522887,8139] 0 2023-12-16T07:40:14.674 INFO:tasks.workunit.client.0.smithi049.stdout:6/42: mkdir d0/d2/df 0 2023-12-16T07:40:14.676 INFO:tasks.workunit.client.0.smithi049.stdout:0/37: mknod ce 0 2023-12-16T07:40:14.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/38: write fb [38650,6196] 0 2023-12-16T07:40:14.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/39: write f5 [576474,18568] 0 2023-12-16T07:40:14.677 INFO:tasks.workunit.client.0.smithi049.stdout:6/43: symlink d0/l10 0 2023-12-16T07:40:14.681 INFO:tasks.workunit.client.0.smithi049.stdout:0/40: write f0 [4373303,106298] 0 2023-12-16T07:40:14.681 INFO:tasks.workunit.client.0.smithi049.stdout:0/41: stat f4 0 2023-12-16T07:40:14.686 INFO:tasks.workunit.client.0.smithi049.stdout:0/42: symlink lf 0 2023-12-16T07:40:14.686 INFO:tasks.workunit.client.0.smithi049.stdout:0/43: readlink l9 0 2023-12-16T07:40:14.690 INFO:tasks.workunit.client.0.smithi049.stdout:0/44: read f0 [6257921,70734] 0 2023-12-16T07:40:14.692 INFO:tasks.workunit.client.0.smithi049.stdout:0/45: link fd f10 0 2023-12-16T07:40:14.693 INFO:tasks.workunit.client.0.smithi049.stdout:3/22: dwrite d1/f5 [0,4194304] 0 2023-12-16T07:40:14.693 INFO:tasks.workunit.client.0.smithi049.stdout:2/51: dwrite d2/f9 [0,4194304] 0 2023-12-16T07:40:14.693 INFO:tasks.workunit.client.0.smithi049.stdout:2/52: chown d2/f12 0 1 2023-12-16T07:40:14.693 INFO:tasks.workunit.client.0.smithi049.stdout:9/12: dwrite f0 [0,4194304] 0 2023-12-16T07:40:14.693 INFO:tasks.workunit.client.0.smithi049.stdout:9/13: chown f0 83961678 1 2023-12-16T07:40:14.693 INFO:tasks.workunit.client.0.smithi049.stdout:9/14: stat f0 0 2023-12-16T07:40:14.694 INFO:tasks.workunit.client.0.smithi049.stdout:0/46: mknod c11 0 2023-12-16T07:40:14.694 INFO:tasks.workunit.client.0.smithi049.stdout:8/13: rmdir d0 39 2023-12-16T07:40:14.694 INFO:tasks.workunit.client.0.smithi049.stdout:8/14: chown d0 204868 1 2023-12-16T07:40:14.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/23: write d1/f5 [790255,68211] 0 2023-12-16T07:40:14.696 INFO:tasks.workunit.client.0.smithi049.stdout:8/15: read d0/f3 [84939,130817] 0 2023-12-16T07:40:14.697 INFO:tasks.workunit.client.0.smithi049.stdout:2/53: mknod d2/de/c14 0 2023-12-16T07:40:14.699 INFO:tasks.workunit.client.0.smithi049.stdout:9/15: creat f1 x:0 0 0 2023-12-16T07:40:14.700 INFO:tasks.workunit.client.0.smithi049.stdout:3/24: creat d1/fa x:0 0 0 2023-12-16T07:40:14.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/16: unlink d0/f3 0 2023-12-16T07:40:14.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/17: write - no filename 2023-12-16T07:40:14.703 INFO:tasks.workunit.client.0.smithi049.stdout:2/54: mknod d2/de/c15 0 2023-12-16T07:40:14.703 INFO:tasks.workunit.client.0.smithi049.stdout:9/16: symlink l2 0 2023-12-16T07:40:14.703 INFO:tasks.workunit.client.0.smithi049.stdout:0/47: dread f2 [0,4194304] 0 2023-12-16T07:40:14.703 INFO:tasks.workunit.client.0.smithi049.stdout:0/48: read - f8 zero size 2023-12-16T07:40:14.703 INFO:tasks.workunit.client.0.smithi049.stdout:0/49: write f5 [1628138,12027] 0 2023-12-16T07:40:14.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/44: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:14.708 INFO:tasks.workunit.client.0.smithi049.stdout:3/25: symlink d1/lb 0 2023-12-16T07:40:14.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/26: chown d1/l8 9 1 2023-12-16T07:40:14.709 INFO:tasks.workunit.client.0.smithi049.stdout:8/18: creat d0/f4 x:0 0 0 2023-12-16T07:40:14.709 INFO:tasks.workunit.client.0.smithi049.stdout:0/50: link f8 f12 0 2023-12-16T07:40:14.709 INFO:tasks.workunit.client.0.smithi049.stdout:6/45: read d0/d2/f5 [2431399,113971] 0 2023-12-16T07:40:14.709 INFO:tasks.workunit.client.0.smithi049.stdout:2/55: dread d2/d7/fb [0,4194304] 0 2023-12-16T07:40:14.709 INFO:tasks.workunit.client.0.smithi049.stdout:6/46: stat d0/d2/dd 0 2023-12-16T07:40:14.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/27: creat d1/fc x:0 0 0 2023-12-16T07:40:14.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/28: write d1/fa [860737,107893] 0 2023-12-16T07:40:14.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/19: creat d0/f5 x:0 0 0 2023-12-16T07:40:14.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/20: write d0/f5 [292840,14593] 0 2023-12-16T07:40:14.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/51: fsync f0 0 2023-12-16T07:40:14.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/52: write f12 [438061,127063] 0 2023-12-16T07:40:14.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/47: truncate d0/d2/f8 505953 0 2023-12-16T07:40:14.715 INFO:tasks.workunit.client.0.smithi049.stdout:8/21: unlink d0/f5 0 2023-12-16T07:40:14.715 INFO:tasks.workunit.client.0.smithi049.stdout:8/22: stat d0 0 2023-12-16T07:40:14.717 INFO:tasks.workunit.client.0.smithi049.stdout:9/17: dwrite f1 [0,4194304] 0 2023-12-16T07:40:14.725 INFO:tasks.workunit.client.0.smithi049.stdout:2/56: rmdir d2 39 2023-12-16T07:40:14.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/57: symlink d2/d7/d11/l16 0 2023-12-16T07:40:14.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/58: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:14.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/59: chown d2/d7/d11/l16 5820258 1 2023-12-16T07:40:14.731 INFO:tasks.workunit.client.0.smithi049.stdout:2/60: creat d2/f17 x:0 0 0 2023-12-16T07:40:14.733 INFO:tasks.workunit.client.0.smithi049.stdout:2/61: symlink d2/de/l18 0 2023-12-16T07:40:14.733 INFO:tasks.workunit.client.0.smithi049.stdout:6/48: truncate d0/d2/f5 2710893 0 2023-12-16T07:40:14.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/29: rmdir d1 39 2023-12-16T07:40:14.739 INFO:tasks.workunit.client.0.smithi049.stdout:3/30: unlink d1/c6 0 2023-12-16T07:40:14.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/53: dwrite f1 [4194304,4194304] 0 2023-12-16T07:40:14.746 INFO:tasks.workunit.client.0.smithi049.stdout:0/54: getdents . 0 2023-12-16T07:40:14.747 INFO:tasks.workunit.client.0.smithi049.stdout:8/23: dwrite d0/f4 [0,4194304] 0 2023-12-16T07:40:14.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/31: fsync d1/f5 0 2023-12-16T07:40:14.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/32: chown d1/fc 1 1 2023-12-16T07:40:14.748 INFO:tasks.workunit.client.0.smithi049.stdout:3/33: truncate d1/fa 1985486 0 2023-12-16T07:40:14.748 INFO:tasks.workunit.client.0.smithi049.stdout:2/62: dwrite d2/f12 [0,4194304] 0 2023-12-16T07:40:14.750 INFO:tasks.workunit.client.0.smithi049.stdout:2/63: dread d2/ff [0,4194304] 0 2023-12-16T07:40:14.755 INFO:tasks.workunit.client.0.smithi049.stdout:8/24: symlink d0/l6 0 2023-12-16T07:40:14.755 INFO:tasks.workunit.client.0.smithi049.stdout:3/34: mknod d1/cd 0 2023-12-16T07:40:14.759 INFO:tasks.workunit.client.0.smithi049.stdout:8/25: symlink d0/l7 0 2023-12-16T07:40:14.759 INFO:tasks.workunit.client.0.smithi049.stdout:8/26: stat d0 0 2023-12-16T07:40:14.759 INFO:tasks.workunit.client.0.smithi049.stdout:8/27: readlink d0/l7 0 2023-12-16T07:40:14.759 INFO:tasks.workunit.client.0.smithi049.stdout:8/28: fdatasync d0/f4 0 2023-12-16T07:40:14.759 INFO:tasks.workunit.client.0.smithi049.stdout:8/29: write d0/f4 [5086766,95379] 0 2023-12-16T07:40:14.760 INFO:tasks.workunit.client.0.smithi049.stdout:0/55: dwrite fb [0,4194304] 0 2023-12-16T07:40:14.760 INFO:tasks.workunit.client.0.smithi049.stdout:2/64: dread d2/f9 [0,4194304] 0 2023-12-16T07:40:14.761 INFO:tasks.workunit.client.0.smithi049.stdout:8/30: mknod d0/c8 0 2023-12-16T07:40:14.762 INFO:tasks.workunit.client.0.smithi049.stdout:8/31: write d0/f4 [1195280,89787] 0 2023-12-16T07:40:14.764 INFO:tasks.workunit.client.0.smithi049.stdout:0/56: mkdir d13 0 2023-12-16T07:40:14.765 INFO:tasks.workunit.client.0.smithi049.stdout:2/65: creat d2/f19 x:0 0 0 2023-12-16T07:40:14.766 INFO:tasks.workunit.client.0.smithi049.stdout:0/57: creat d13/f14 x:0 0 0 2023-12-16T07:40:14.781 INFO:tasks.workunit.client.0.smithi049.stdout:8/32: dread d0/f4 [0,4194304] 0 2023-12-16T07:40:14.782 INFO:tasks.workunit.client.0.smithi049.stdout:8/33: write d0/f4 [1713887,9137] 0 2023-12-16T07:40:14.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/58: dread f1 [4194304,4194304] 0 2023-12-16T07:40:14.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/59: write f4 [231762,80233] 0 2023-12-16T07:40:14.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/60: write f10 [964874,121344] 0 2023-12-16T07:40:14.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/66: dwrite d2/d7/f13 [0,4194304] 0 2023-12-16T07:40:14.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/34: fsync d0/f4 0 2023-12-16T07:40:14.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/35: write d0/f4 [4685814,62878] 0 2023-12-16T07:40:14.786 INFO:tasks.workunit.client.0.smithi049.stdout:2/67: rename d2/d7/l10 to d2/d7/l1a 0 2023-12-16T07:40:14.786 INFO:tasks.workunit.client.0.smithi049.stdout:2/68: chown d2/d7 910145 1 2023-12-16T07:40:14.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/69: write d2/f12 [2562080,77424] 0 2023-12-16T07:40:14.787 INFO:tasks.workunit.client.0.smithi049.stdout:8/36: fdatasync d0/f4 0 2023-12-16T07:40:14.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/70: creat d2/de/f1b x:0 0 0 2023-12-16T07:40:14.790 INFO:tasks.workunit.client.0.smithi049.stdout:2/71: write d2/d7/fb [1324902,62611] 0 2023-12-16T07:40:14.790 INFO:tasks.workunit.client.0.smithi049.stdout:8/37: creat d0/f9 x:0 0 0 2023-12-16T07:40:14.791 INFO:tasks.workunit.client.0.smithi049.stdout:2/72: mkdir d2/d7/d11/d1c 0 2023-12-16T07:40:14.796 INFO:tasks.workunit.client.0.smithi049.stdout:0/61: dwrite f5 [0,4194304] 0 2023-12-16T07:40:14.796 INFO:tasks.workunit.client.0.smithi049.stdout:2/73: dread d2/f9 [0,4194304] 0 2023-12-16T07:40:14.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/62: write f5 [2863668,125826] 0 2023-12-16T07:40:14.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/63: dread - f3 zero size 2023-12-16T07:40:14.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/38: getdents d0 0 2023-12-16T07:40:14.801 INFO:tasks.workunit.client.0.smithi049.stdout:2/74: mkdir d2/d1d 0 2023-12-16T07:40:14.802 INFO:tasks.workunit.client.0.smithi049.stdout:0/64: dread fb [0,4194304] 0 2023-12-16T07:40:14.802 INFO:tasks.workunit.client.0.smithi049.stdout:0/65: dread - f3 zero size 2023-12-16T07:40:14.803 INFO:tasks.workunit.client.0.smithi049.stdout:8/39: mkdir d0/da 0 2023-12-16T07:40:14.803 INFO:tasks.workunit.client.0.smithi049.stdout:8/40: chown d0/f9 1513673 1 2023-12-16T07:40:14.803 INFO:tasks.workunit.client.0.smithi049.stdout:8/41: write d0/f9 [936820,42244] 0 2023-12-16T07:40:14.809 INFO:tasks.workunit.client.0.smithi049.stdout:0/66: fsync fd 0 2023-12-16T07:40:14.809 INFO:tasks.workunit.client.0.smithi049.stdout:0/67: chown f12 1 1 2023-12-16T07:40:14.809 INFO:tasks.workunit.client.0.smithi049.stdout:0/68: chown l9 42 1 2023-12-16T07:40:14.811 INFO:tasks.workunit.client.0.smithi049.stdout:0/69: mkdir d13/d15 0 2023-12-16T07:40:14.812 INFO:tasks.workunit.client.0.smithi049.stdout:0/70: chown f3 377035648 1 2023-12-16T07:40:14.813 INFO:tasks.workunit.client.0.smithi049.stdout:0/71: link f2 d13/f16 0 2023-12-16T07:40:14.814 INFO:tasks.workunit.client.0.smithi049.stdout:0/72: read - fa zero size 2023-12-16T07:40:14.814 INFO:tasks.workunit.client.0.smithi049.stdout:2/75: dwrite d2/f17 [0,4194304] 0 2023-12-16T07:40:14.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/73: unlink f1 0 2023-12-16T07:40:14.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/74: getdents d13/d15 0 2023-12-16T07:40:14.816 INFO:tasks.workunit.client.0.smithi049.stdout:8/42: dread d0/f9 [0,4194304] 0 2023-12-16T07:40:14.818 INFO:tasks.workunit.client.0.smithi049.stdout:2/76: unlink d2/de/c14 0 2023-12-16T07:40:14.819 INFO:tasks.workunit.client.0.smithi049.stdout:0/75: creat d13/f17 x:0 0 0 2023-12-16T07:40:14.819 INFO:tasks.workunit.client.0.smithi049.stdout:0/76: truncate d13/f16 604567 0 2023-12-16T07:40:14.820 INFO:tasks.workunit.client.0.smithi049.stdout:8/43: fdatasync d0/f4 0 2023-12-16T07:40:14.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/44: dread d0/f9 [0,4194304] 0 2023-12-16T07:40:14.821 INFO:tasks.workunit.client.0.smithi049.stdout:2/77: creat d2/d7/d11/f1e x:0 0 0 2023-12-16T07:40:14.822 INFO:tasks.workunit.client.0.smithi049.stdout:8/45: write d0/f4 [2111171,93829] 0 2023-12-16T07:40:14.824 INFO:tasks.workunit.client.0.smithi049.stdout:2/78: mknod d2/d7/c1f 0 2023-12-16T07:40:14.824 INFO:tasks.workunit.client.0.smithi049.stdout:8/46: symlink d0/da/lb 0 2023-12-16T07:40:14.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/77: getdents d13 0 2023-12-16T07:40:14.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/78: write f2 [836444,11844] 0 2023-12-16T07:40:14.831 INFO:tasks.workunit.client.0.smithi049.stdout:0/79: rename f5 to d13/d15/f18 0 2023-12-16T07:40:14.832 INFO:tasks.workunit.client.0.smithi049.stdout:0/80: creat d13/d15/f19 x:0 0 0 2023-12-16T07:40:14.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/81: dread fd [0,4194304] 0 2023-12-16T07:40:14.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/82: creat d13/d15/f1a x:0 0 0 2023-12-16T07:40:14.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/83: chown fb 3942 1 2023-12-16T07:40:14.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/84: write fd [921820,68407] 0 2023-12-16T07:40:14.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/85: rename f8 to d13/f1b 0 2023-12-16T07:40:14.841 INFO:tasks.workunit.client.0.smithi049.stdout:0/86: creat d13/f1c x:0 0 0 2023-12-16T07:40:14.842 INFO:tasks.workunit.client.0.smithi049.stdout:0/87: creat d13/f1d x:0 0 0 2023-12-16T07:40:14.842 INFO:tasks.workunit.client.0.smithi049.stdout:0/88: write d13/f14 [268236,67530] 0 2023-12-16T07:40:14.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/47: dwrite d0/f9 [0,4194304] 0 2023-12-16T07:40:14.846 INFO:tasks.workunit.client.0.smithi049.stdout:2/79: dwrite d2/d7/d11/f1e [0,4194304] 0 2023-12-16T07:40:14.846 INFO:tasks.workunit.client.0.smithi049.stdout:8/48: read d0/f4 [1782228,47393] 0 2023-12-16T07:40:14.848 INFO:tasks.workunit.client.0.smithi049.stdout:2/80: creat d2/d1d/f20 x:0 0 0 2023-12-16T07:40:14.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/49: chown d0/l7 24398637 1 2023-12-16T07:40:14.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/50: rename d0/f9 to d0/da/fc 0 2023-12-16T07:40:14.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/51: readlink d0/da/lb 0 2023-12-16T07:40:14.860 INFO:tasks.workunit.client.0.smithi049.stdout:2/81: dread d2/d7/d11/f1e [0,4194304] 0 2023-12-16T07:40:14.860 INFO:tasks.workunit.client.0.smithi049.stdout:2/82: chown d2/de/c15 0 1 2023-12-16T07:40:14.860 INFO:tasks.workunit.client.0.smithi049.stdout:2/83: stat d2/de 0 2023-12-16T07:40:14.860 INFO:tasks.workunit.client.0.smithi049.stdout:2/84: fsync d2/d7/f13 0 2023-12-16T07:40:14.860 INFO:tasks.workunit.client.0.smithi049.stdout:2/85: stat d2/de/l18 0 2023-12-16T07:40:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:14 smithi133 ceph-mon[120445]: pgmap v3: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:40:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:14 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:14 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:14 smithi133 ceph-mon[120445]: [16/Dec/2023:07:40:13] ENGINE Bus STARTING 2023-12-16T07:40:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:14 smithi133 ceph-mon[120445]: [16/Dec/2023:07:40:14] ENGINE Serving on http://172.21.15.133:8765 2023-12-16T07:40:14.872 INFO:tasks.workunit.client.0.smithi049.stdout:2/86: dwrite d2/f17 [0,4194304] 0 2023-12-16T07:40:14.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/89: dwrite d13/f16 [0,4194304] 0 2023-12-16T07:40:14.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/90: dread - f3 zero size 2023-12-16T07:40:14.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/91: truncate f0 4140908 0 2023-12-16T07:40:14.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/92: write fa [422434,92973] 0 2023-12-16T07:40:14.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/93: symlink d13/l1e 0 2023-12-16T07:40:14.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/94: creat d13/d15/f1f x:0 0 0 2023-12-16T07:40:14.926 INFO:tasks.workunit.client.0.smithi049.stdout:0/95: unlink d13/f14 0 2023-12-16T07:40:14.927 INFO:tasks.workunit.client.0.smithi049.stdout:8/52: dwrite d0/f4 [4194304,4194304] 0 2023-12-16T07:40:14.927 INFO:tasks.workunit.client.0.smithi049.stdout:8/53: stat d0/da/lb 0 2023-12-16T07:40:14.929 INFO:tasks.workunit.client.0.smithi049.stdout:0/96: rename f10 to d13/f20 0 2023-12-16T07:40:14.941 INFO:tasks.workunit.client.0.smithi049.stdout:0/97: dwrite d13/d15/f18 [4194304,4194304] 0 2023-12-16T07:40:14.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/98: mkdir d13/d21 0 2023-12-16T07:40:14.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/99: fdatasync d13/f1d 0 2023-12-16T07:40:14.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/100: write d13/f16 [3475894,91229] 0 2023-12-16T07:40:14.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/101: write f2 [3306972,108923] 0 2023-12-16T07:40:14.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/102: write f12 [1264855,22380] 0 2023-12-16T07:40:14.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:14 smithi049 ceph-mon[111939]: pgmap v3: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:40:14.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:14 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:14 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:14 smithi049 ceph-mon[111939]: [16/Dec/2023:07:40:13] ENGINE Bus STARTING 2023-12-16T07:40:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:14 smithi049 ceph-mon[111939]: [16/Dec/2023:07:40:14] ENGINE Serving on http://172.21.15.133:8765 2023-12-16T07:40:14.959 INFO:tasks.workunit.client.0.smithi049.stdout:0/103: dwrite d13/f1c [0,4194304] 0 2023-12-16T07:40:14.963 INFO:tasks.workunit.client.0.smithi049.stdout:0/104: unlink d13/d15/f18 0 2023-12-16T07:40:14.963 INFO:tasks.workunit.client.0.smithi049.stdout:0/105: chown cc 555 1 2023-12-16T07:40:14.964 INFO:tasks.workunit.client.0.smithi049.stdout:0/106: link c11 d13/d21/c22 0 2023-12-16T07:40:14.966 INFO:tasks.workunit.client.0.smithi049.stdout:0/107: mknod d13/d15/c23 0 2023-12-16T07:40:14.966 INFO:tasks.workunit.client.0.smithi049.stdout:0/108: dread - d13/d15/f1f zero size 2023-12-16T07:40:14.966 INFO:tasks.workunit.client.0.smithi049.stdout:0/109: write d13/f20 [1599198,121956] 0 2023-12-16T07:40:14.968 INFO:tasks.workunit.client.0.smithi049.stdout:0/110: link lf d13/l24 0 2023-12-16T07:40:14.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/111: fsync f2 0 2023-12-16T07:40:14.973 INFO:tasks.workunit.client.0.smithi049.stdout:0/112: link c11 d13/d21/c25 0 2023-12-16T07:40:14.974 INFO:tasks.workunit.client.0.smithi049.stdout:0/113: mknod d13/d21/c26 0 2023-12-16T07:40:14.974 INFO:tasks.workunit.client.0.smithi049.stdout:0/114: chown d13/d15/f1a 20 1 2023-12-16T07:40:14.978 INFO:tasks.workunit.client.0.smithi049.stdout:0/115: dread d13/f1b [0,4194304] 0 2023-12-16T07:40:14.990 INFO:tasks.workunit.client.0.smithi049.stdout:0/116: dwrite d13/f17 [0,4194304] 0 2023-12-16T07:40:14.990 INFO:tasks.workunit.client.0.smithi049.stdout:0/117: fdatasync d13/f1c 0 2023-12-16T07:40:14.992 INFO:tasks.workunit.client.0.smithi049.stdout:0/118: getdents d13 0 2023-12-16T07:40:14.993 INFO:tasks.workunit.client.0.smithi049.stdout:0/119: unlink c7 0 2023-12-16T07:40:14.994 INFO:tasks.workunit.client.0.smithi049.stdout:0/120: truncate fb 1185405 0 2023-12-16T07:40:14.995 INFO:tasks.workunit.client.0.smithi049.stdout:0/121: mkdir d13/d21/d27 0 2023-12-16T07:40:15.053 INFO:tasks.workunit.client.0.smithi049.stdout:0/122: dwrite d13/d15/f19 [0,4194304] 0 2023-12-16T07:40:15.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/123: dread fb [0,4194304] 0 2023-12-16T07:40:15.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/124: stat d13/d15/f19 0 2023-12-16T07:40:15.056 INFO:tasks.workunit.client.0.smithi049.stdout:0/125: symlink d13/d21/d27/l28 0 2023-12-16T07:40:15.056 INFO:tasks.workunit.client.0.smithi049.stdout:0/126: dread - f3 zero size 2023-12-16T07:40:15.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/127: write fd [694144,4831] 0 2023-12-16T07:40:15.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/128: stat fb 0 2023-12-16T07:40:15.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/129: read - d13/d15/f1f zero size 2023-12-16T07:40:15.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/130: creat d13/d15/f29 x:0 0 0 2023-12-16T07:40:15.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/131: creat d13/d21/f2a x:0 0 0 2023-12-16T07:40:15.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/132: creat d13/f2b x:0 0 0 2023-12-16T07:40:15.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/133: chown f0 12 1 2023-12-16T07:40:15.074 INFO:tasks.workunit.client.0.smithi049.stdout:0/134: dwrite d13/d15/f1a [0,4194304] 0 2023-12-16T07:40:15.074 INFO:tasks.workunit.client.0.smithi049.stdout:0/135: write f0 [619674,129652] 0 2023-12-16T07:40:15.076 INFO:tasks.workunit.client.0.smithi049.stdout:0/136: truncate f2 3757593 0 2023-12-16T07:40:15.087 INFO:tasks.workunit.client.0.smithi049.stdout:0/137: truncate fd 187024 0 2023-12-16T07:40:15.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/138: mkdir d13/d21/d27/d2c 0 2023-12-16T07:40:15.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/139: dwrite f0 [0,4194304] 0 2023-12-16T07:40:15.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/140: stat d13/f20 0 2023-12-16T07:40:15.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/141: write fb [1250504,33197] 0 2023-12-16T07:40:15.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/142: symlink d13/d21/d27/l2d 0 2023-12-16T07:40:15.711 INFO:tasks.workunit.client.0.smithi049.stdout:0/143: write d13/f1c [3575473,92332] 0 2023-12-16T07:40:15.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/144: mknod d13/d21/c2e 0 2023-12-16T07:40:15.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/145: getdents d13/d21/d27/d2c 0 2023-12-16T07:40:15.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/146: unlink d13/d15/f29 0 2023-12-16T07:40:15.715 INFO:tasks.workunit.client.0.smithi049.stdout:0/147: dread f12 [0,4194304] 0 2023-12-16T07:40:15.729 INFO:tasks.workunit.client.0.smithi049.stdout:0/148: dwrite d13/f16 [0,4194304] 0 2023-12-16T07:40:15.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/149: dwrite fa [0,4194304] 0 2023-12-16T07:40:15.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/150: mkdir d13/d21/d2f 0 2023-12-16T07:40:15.754 INFO:tasks.workunit.client.0.smithi049.stdout:0/151: mknod d13/c30 0 2023-12-16T07:40:15.755 INFO:tasks.workunit.client.0.smithi049.stdout:0/152: symlink d13/d21/d27/d2c/l31 0 2023-12-16T07:40:15.757 INFO:tasks.workunit.client.0.smithi049.stdout:0/153: mknod d13/d15/c32 0 2023-12-16T07:40:15.773 INFO:tasks.workunit.client.0.smithi049.stdout:0/154: dwrite d13/f16 [0,4194304] 0 2023-12-16T07:40:15.773 INFO:tasks.workunit.client.0.smithi049.stdout:0/155: chown f3 2632 1 2023-12-16T07:40:15.774 INFO:tasks.workunit.client.0.smithi049.stdout:0/156: mknod d13/d15/c33 0 2023-12-16T07:40:15.775 INFO:tasks.workunit.client.0.smithi049.stdout:0/157: rmdir d13/d21/d27 39 2023-12-16T07:40:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:15 smithi133 ceph-mon[120445]: [16/Dec/2023:07:40:14] ENGINE Serving on https://172.21.15.133:7150 2023-12-16T07:40:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:15 smithi133 ceph-mon[120445]: [16/Dec/2023:07:40:14] ENGINE Bus STARTED 2023-12-16T07:40:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:15 smithi133 ceph-mon[120445]: pgmap v4: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:40:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:15 smithi133 ceph-mon[120445]: mgrmap e23: smithi133.wbiduk(active, since 2s) 2023-12-16T07:40:15.900 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:15 smithi049 ceph-mon[111939]: [16/Dec/2023:07:40:14] ENGINE Serving on https://172.21.15.133:7150 2023-12-16T07:40:15.900 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:15 smithi049 ceph-mon[111939]: [16/Dec/2023:07:40:14] ENGINE Bus STARTED 2023-12-16T07:40:15.901 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:15 smithi049 ceph-mon[111939]: pgmap v4: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:40:15.901 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:15 smithi049 ceph-mon[111939]: mgrmap e23: smithi133.wbiduk(active, since 2s) 2023-12-16T07:40:15.915 INFO:tasks.workunit.client.0.smithi049.stdout:3/35: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:1/1: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:9/18: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/26: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/87: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:6/49: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:1/2: write - no filename 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/3: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/88: chown d2/de/c15 1319 1 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/4: fdatasync f0 0 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/89: chown d2/d7/d11/l16 12155 1 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/5: chown f0 135032 1 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:8/54: sync 2023-12-16T07:40:15.916 INFO:tasks.workunit.client.0.smithi049.stdout:4/22: sync 2023-12-16T07:40:15.917 INFO:tasks.workunit.client.0.smithi049.stdout:2/90: read d2/d7/d11/f1e [3721506,109777] 0 2023-12-16T07:40:15.918 INFO:tasks.workunit.client.0.smithi049.stdout:2/91: rename d2/de to d2/de/d21 22 2023-12-16T07:40:15.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/19: truncate f0 531159 0 2023-12-16T07:40:15.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/20: chown f0 615 1 2023-12-16T07:40:15.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/21: fdatasync f1 0 2023-12-16T07:40:15.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/36: dread d1/fa [0,4194304] 0 2023-12-16T07:40:15.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/37: fsync d1/fa 0 2023-12-16T07:40:15.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/38: write d1/f5 [881785,17992] 0 2023-12-16T07:40:15.919 INFO:tasks.workunit.client.0.smithi049.stdout:1/3: rename l0 to l1 0 2023-12-16T07:40:15.919 INFO:tasks.workunit.client.0.smithi049.stdout:1/4: dwrite - no filename 2023-12-16T07:40:15.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/50: symlink d0/d2/l11 0 2023-12-16T07:40:15.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/51: fsync d0/d2/f9 0 2023-12-16T07:40:15.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/52: truncate d0/d2/f8 939332 0 2023-12-16T07:40:15.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/53: write d0/d2/f8 [1681290,110259] 0 2023-12-16T07:40:15.924 INFO:tasks.workunit.client.0.smithi049.stdout:7/6: getdents . 0 2023-12-16T07:40:15.924 INFO:tasks.workunit.client.0.smithi049.stdout:7/7: getdents . 0 2023-12-16T07:40:15.926 INFO:tasks.workunit.client.0.smithi049.stdout:4/23: mknod d2/d6/c8 0 2023-12-16T07:40:15.927 INFO:tasks.workunit.client.0.smithi049.stdout:8/55: creat d0/da/fd x:0 0 0 2023-12-16T07:40:15.929 INFO:tasks.workunit.client.0.smithi049.stdout:9/22: creat f3 x:0 0 0 2023-12-16T07:40:15.932 INFO:tasks.workunit.client.0.smithi049.stdout:1/5: creat f2 x:0 0 0 2023-12-16T07:40:15.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/54: creat d0/d2/dd/f12 x:0 0 0 2023-12-16T07:40:15.938 INFO:tasks.workunit.client.0.smithi049.stdout:7/8: truncate f0 1826567 0 2023-12-16T07:40:15.940 INFO:tasks.workunit.client.0.smithi049.stdout:4/24: creat d2/f9 x:0 0 0 2023-12-16T07:40:15.946 INFO:tasks.workunit.client.0.smithi049.stdout:9/23: mkdir d4 0 2023-12-16T07:40:15.946 INFO:tasks.workunit.client.0.smithi049.stdout:9/24: write f0 [985056,118651] 0 2023-12-16T07:40:15.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/25: link f0 d2/d6/fa 0 2023-12-16T07:40:15.946 INFO:tasks.workunit.client.0.smithi049.stdout:2/92: dwrite d2/f9 [0,4194304] 0 2023-12-16T07:40:15.947 INFO:tasks.workunit.client.0.smithi049.stdout:2/93: truncate d2/f12 4490326 0 2023-12-16T07:40:15.947 INFO:tasks.workunit.client.0.smithi049.stdout:9/25: link f0 d4/f5 0 2023-12-16T07:40:15.949 INFO:tasks.workunit.client.0.smithi049.stdout:2/94: unlink d2/d1d/f20 0 2023-12-16T07:40:15.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/26: mknod d4/c6 0 2023-12-16T07:40:15.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/27: stat f0 0 2023-12-16T07:40:15.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/28: chown d4/c6 50633 1 2023-12-16T07:40:15.951 INFO:tasks.workunit.client.0.smithi049.stdout:9/29: mkdir d4/d7 0 2023-12-16T07:40:15.951 INFO:tasks.workunit.client.0.smithi049.stdout:2/95: dread d2/d7/fb [0,4194304] 0 2023-12-16T07:40:15.952 INFO:tasks.workunit.client.0.smithi049.stdout:9/30: creat d4/f8 x:0 0 0 2023-12-16T07:40:15.953 INFO:tasks.workunit.client.0.smithi049.stdout:9/31: chown f1 188698 1 2023-12-16T07:40:15.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/96: creat d2/f22 x:0 0 0 2023-12-16T07:40:15.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/97: chown d2/ld 3 1 2023-12-16T07:40:15.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/98: stat d2/la 0 2023-12-16T07:40:15.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/99: write d2/f19 [602770,28155] 0 2023-12-16T07:40:15.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/100: readlink d2/la 0 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:2/101: fsync d2/f17 0 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:2/102: chown d2/ld 22 1 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:2/103: chown d2/c8 91 1 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:9/32: creat d4/d7/f9 x:0 0 0 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:9/33: chown f0 1744386 1 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:9/34: truncate d4/d7/f9 6939 0 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:9/35: stat f3 0 2023-12-16T07:40:15.955 INFO:tasks.workunit.client.0.smithi049.stdout:9/36: readlink l2 0 2023-12-16T07:40:15.956 INFO:tasks.workunit.client.0.smithi049.stdout:9/37: mknod d4/d7/ca 0 2023-12-16T07:40:15.956 INFO:tasks.workunit.client.0.smithi049.stdout:9/38: stat f3 0 2023-12-16T07:40:15.957 INFO:tasks.workunit.client.0.smithi049.stdout:9/39: mkdir d4/db 0 2023-12-16T07:40:15.957 INFO:tasks.workunit.client.0.smithi049.stdout:9/40: chown d4/d7 53325 1 2023-12-16T07:40:15.957 INFO:tasks.workunit.client.0.smithi049.stdout:9/41: chown d4/db 16303509 1 2023-12-16T07:40:15.957 INFO:tasks.workunit.client.0.smithi049.stdout:9/42: readlink l2 0 2023-12-16T07:40:15.960 INFO:tasks.workunit.client.0.smithi049.stdout:3/39: dwrite d1/f5 [4194304,4194304] 0 2023-12-16T07:40:15.960 INFO:tasks.workunit.client.0.smithi049.stdout:3/40: dread - d1/fc zero size 2023-12-16T07:40:15.960 INFO:tasks.workunit.client.0.smithi049.stdout:3/41: dread - d1/fc zero size 2023-12-16T07:40:15.963 INFO:tasks.workunit.client.0.smithi049.stdout:3/42: creat d1/fe x:0 0 0 2023-12-16T07:40:15.963 INFO:tasks.workunit.client.0.smithi049.stdout:3/43: chown d1/cd 787674 1 2023-12-16T07:40:15.964 INFO:tasks.workunit.client.0.smithi049.stdout:3/44: dread d1/fa [0,4194304] 0 2023-12-16T07:40:15.967 INFO:tasks.workunit.client.0.smithi049.stdout:1/6: dwrite f2 [0,4194304] 0 2023-12-16T07:40:15.969 INFO:tasks.workunit.client.0.smithi049.stdout:1/7: stat l1 0 2023-12-16T07:40:15.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/56: dwrite d0/f4 [0,4194304] 0 2023-12-16T07:40:15.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/26: dwrite d2/f4 [0,4194304] 0 2023-12-16T07:40:15.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/57: chown d0/da 16269 1 2023-12-16T07:40:15.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/58: chown d0/l7 6 1 2023-12-16T07:40:15.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/59: dread - d0/da/fd zero size 2023-12-16T07:40:15.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/60: fsync d0/da/fc 0 2023-12-16T07:40:15.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/104: dread d2/f19 [0,4194304] 0 2023-12-16T07:40:15.976 INFO:tasks.workunit.client.0.smithi049.stdout:4/27: mkdir d2/db 0 2023-12-16T07:40:15.977 INFO:tasks.workunit.client.0.smithi049.stdout:4/28: write d2/f3 [3552276,102050] 0 2023-12-16T07:40:15.979 INFO:tasks.workunit.client.0.smithi049.stdout:8/61: creat d0/da/fe x:0 0 0 2023-12-16T07:40:15.979 INFO:tasks.workunit.client.0.smithi049.stdout:8/62: dread - d0/da/fd zero size 2023-12-16T07:40:15.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/8: write f2 [4560136,76790] 0 2023-12-16T07:40:15.998 INFO:tasks.workunit.client.0.smithi049.stdout:1/9: creat f3 x:0 0 0 2023-12-16T07:40:15.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/10: write f3 [976438,13890] 0 2023-12-16T07:40:15.999 INFO:tasks.workunit.client.0.smithi049.stdout:4/29: dread d2/d6/fa [0,4194304] 0 2023-12-16T07:40:15.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/11: mknod c4 0 2023-12-16T07:40:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/43: dwrite d4/f5 [0,4194304] 0 2023-12-16T07:40:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:3/45: dwrite d1/fa [0,4194304] 0 2023-12-16T07:40:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/44: fdatasync d4/f8 0 2023-12-16T07:40:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/45: write d4/d7/f9 [893518,19698] 0 2023-12-16T07:40:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:4/30: rename d2/f3 to d2/fc 0 2023-12-16T07:40:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/9: dwrite f0 [0,4194304] 0 2023-12-16T07:40:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:8/63: dwrite d0/da/fc [0,4194304] 0 2023-12-16T07:40:16.002 INFO:tasks.workunit.client.0.smithi049.stdout:8/64: fdatasync d0/f4 0 2023-12-16T07:40:16.004 INFO:tasks.workunit.client.0.smithi049.stdout:8/65: write d0/f4 [1656938,69962] 0 2023-12-16T07:40:16.004 INFO:tasks.workunit.client.0.smithi049.stdout:8/66: dread - d0/da/fd zero size 2023-12-16T07:40:16.004 INFO:tasks.workunit.client.0.smithi049.stdout:9/46: mknod d4/d7/cc 0 2023-12-16T07:40:16.006 INFO:tasks.workunit.client.0.smithi049.stdout:3/46: dread d1/fa [0,4194304] 0 2023-12-16T07:40:16.007 INFO:tasks.workunit.client.0.smithi049.stdout:4/31: rename d2/d6 to d2/db/dd 0 2023-12-16T07:40:16.008 INFO:tasks.workunit.client.0.smithi049.stdout:2/105: truncate d2/f19 546153 0 2023-12-16T07:40:16.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/10: creat f1 x:0 0 0 2023-12-16T07:40:16.015 INFO:tasks.workunit.client.0.smithi049.stdout:8/67: creat d0/ff x:0 0 0 2023-12-16T07:40:16.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/47: rename d4/f8 to d4/fd 0 2023-12-16T07:40:16.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/47: creat d1/ff x:0 0 0 2023-12-16T07:40:16.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/48: fdatasync d1/ff 0 2023-12-16T07:40:16.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/49: write d1/ff [252329,40497] 0 2023-12-16T07:40:16.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/50: chown d1/f5 46 1 2023-12-16T07:40:16.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/51: readlink d1/lb 0 2023-12-16T07:40:16.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/32: mkdir d2/db/dd/de 0 2023-12-16T07:40:16.018 INFO:tasks.workunit.client.0.smithi049.stdout:7/11: link f1 f2 0 2023-12-16T07:40:16.019 INFO:tasks.workunit.client.0.smithi049.stdout:3/52: creat d1/f10 x:0 0 0 2023-12-16T07:40:16.019 INFO:tasks.workunit.client.0.smithi049.stdout:3/53: truncate d1/f10 756869 0 2023-12-16T07:40:16.019 INFO:tasks.workunit.client.0.smithi049.stdout:8/68: write d0/f4 [5626292,105319] 0 2023-12-16T07:40:16.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/33: creat d2/ff x:0 0 0 2023-12-16T07:40:16.021 INFO:tasks.workunit.client.0.smithi049.stdout:1/12: dwrite f3 [0,4194304] 0 2023-12-16T07:40:16.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/12: symlink l3 0 2023-12-16T07:40:16.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/13: truncate f2 895277 0 2023-12-16T07:40:16.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/106: dwrite d2/d7/fb [0,4194304] 0 2023-12-16T07:40:16.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/107: fdatasync d2/d7/d11/f1e 0 2023-12-16T07:40:16.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/54: symlink d1/l11 0 2023-12-16T07:40:16.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/55: chown d1/ff 258159 1 2023-12-16T07:40:16.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/56: read d1/fa [3835982,17202] 0 2023-12-16T07:40:16.033 INFO:tasks.workunit.client.0.smithi049.stdout:7/14: rename f1 to f4 0 2023-12-16T07:40:16.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/13: creat f5 x:0 0 0 2023-12-16T07:40:16.033 INFO:tasks.workunit.client.0.smithi049.stdout:7/15: rmdir - no directory 2023-12-16T07:40:16.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/14: rmdir - no directory 2023-12-16T07:40:16.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/69: mkdir d0/da/d10 0 2023-12-16T07:40:16.038 INFO:tasks.workunit.client.0.smithi049.stdout:7/16: creat f5 x:0 0 0 2023-12-16T07:40:16.038 INFO:tasks.workunit.client.0.smithi049.stdout:7/17: chown f0 51934379 1 2023-12-16T07:40:16.039 INFO:tasks.workunit.client.0.smithi049.stdout:9/48: fsync d4/fd 0 2023-12-16T07:40:16.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/49: mknod d4/db/ce 0 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:9/50: rename d4/f5 to d4/ff 0 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:9/51: readlink l2 0 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:9/52: chown d4/d7 3 1 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:3/57: dwrite d1/fc [0,4194304] 0 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/108: dread d2/f9 [0,4194304] 0 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:8/70: getdents d0/da 0 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:8/71: truncate d0/da/fd 179711 0 2023-12-16T07:40:16.046 INFO:tasks.workunit.client.0.smithi049.stdout:8/72: write d0/da/fd [271303,123959] 0 2023-12-16T07:40:16.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/15: truncate f3 2205005 0 2023-12-16T07:40:16.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/16: write f5 [905780,6927] 0 2023-12-16T07:40:16.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/53: creat d4/d7/f10 x:0 0 0 2023-12-16T07:40:16.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/54: chown d4/c6 0 1 2023-12-16T07:40:16.050 INFO:tasks.workunit.client.0.smithi049.stdout:7/18: fsync f4 0 2023-12-16T07:40:16.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/58: dread d1/f10 [0,4194304] 0 2023-12-16T07:40:16.051 INFO:tasks.workunit.client.0.smithi049.stdout:8/73: dread d0/da/fc [0,4194304] 0 2023-12-16T07:40:16.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/109: rmdir d2/d7/d11 39 2023-12-16T07:40:16.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/110: fdatasync d2/d7/f13 0 2023-12-16T07:40:16.055 INFO:tasks.workunit.client.0.smithi049.stdout:1/17: creat f6 x:0 0 0 2023-12-16T07:40:16.055 INFO:tasks.workunit.client.0.smithi049.stdout:1/18: dread - f6 zero size 2023-12-16T07:40:16.056 INFO:tasks.workunit.client.0.smithi049.stdout:9/55: mkdir d4/d7/d11 0 2023-12-16T07:40:16.056 INFO:tasks.workunit.client.0.smithi049.stdout:9/56: chown d4/d7/d11 252122841 1 2023-12-16T07:40:16.056 INFO:tasks.workunit.client.0.smithi049.stdout:3/59: creat d1/f12 x:0 0 0 2023-12-16T07:40:16.056 INFO:tasks.workunit.client.0.smithi049.stdout:3/60: write d1/fe [818625,86023] 0 2023-12-16T07:40:16.059 INFO:tasks.workunit.client.0.smithi049.stdout:1/19: creat f7 x:0 0 0 2023-12-16T07:40:16.059 INFO:tasks.workunit.client.0.smithi049.stdout:1/20: dread - f6 zero size 2023-12-16T07:40:16.060 INFO:tasks.workunit.client.0.smithi049.stdout:3/61: dread d1/fa [0,4194304] 0 2023-12-16T07:40:16.061 INFO:tasks.workunit.client.0.smithi049.stdout:9/57: mknod d4/db/c12 0 2023-12-16T07:40:16.061 INFO:tasks.workunit.client.0.smithi049.stdout:9/58: dread - d4/d7/f10 zero size 2023-12-16T07:40:16.061 INFO:tasks.workunit.client.0.smithi049.stdout:9/59: read - d4/fd zero size 2023-12-16T07:40:16.062 INFO:tasks.workunit.client.0.smithi049.stdout:8/74: symlink d0/l11 0 2023-12-16T07:40:16.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/62: creat d1/f13 x:0 0 0 2023-12-16T07:40:16.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/63: readlink d1/l3 0 2023-12-16T07:40:16.064 INFO:tasks.workunit.client.0.smithi049.stdout:9/60: creat d4/f13 x:0 0 0 2023-12-16T07:40:16.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/64: unlink d1/f5 0 2023-12-16T07:40:16.067 INFO:tasks.workunit.client.0.smithi049.stdout:9/61: creat d4/d7/d11/f14 x:0 0 0 2023-12-16T07:40:16.070 INFO:tasks.workunit.client.0.smithi049.stdout:9/62: mknod d4/db/c15 0 2023-12-16T07:40:16.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/65: rmdir d1 39 2023-12-16T07:40:16.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/66: chown d1/l11 974320 1 2023-12-16T07:40:16.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/67: stat d1/c9 0 2023-12-16T07:40:16.079 INFO:tasks.workunit.client.0.smithi049.stdout:3/68: creat d1/f14 x:0 0 0 2023-12-16T07:40:16.079 INFO:tasks.workunit.client.0.smithi049.stdout:3/69: chown d1/f14 0 1 2023-12-16T07:40:16.079 INFO:tasks.workunit.client.0.smithi049.stdout:3/70: write d1/fe [1148118,46157] 0 2023-12-16T07:40:16.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/21: dwrite f3 [0,4194304] 0 2023-12-16T07:40:16.082 INFO:tasks.workunit.client.0.smithi049.stdout:8/75: dwrite d0/da/fc [0,4194304] 0 2023-12-16T07:40:16.082 INFO:tasks.workunit.client.0.smithi049.stdout:8/76: truncate d0/da/fe 387793 0 2023-12-16T07:40:16.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/22: dread f5 [0,4194304] 0 2023-12-16T07:40:16.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/23: readlink l1 0 2023-12-16T07:40:16.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/24: chown f5 1469431056 1 2023-12-16T07:40:16.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/25: fdatasync f5 0 2023-12-16T07:40:16.084 INFO:tasks.workunit.client.0.smithi049.stdout:8/77: creat d0/f12 x:0 0 0 2023-12-16T07:40:16.085 INFO:tasks.workunit.client.0.smithi049.stdout:1/26: link c4 c8 0 2023-12-16T07:40:16.088 INFO:tasks.workunit.client.0.smithi049.stdout:1/27: creat f9 x:0 0 0 2023-12-16T07:40:16.088 INFO:tasks.workunit.client.0.smithi049.stdout:1/28: rmdir - no directory 2023-12-16T07:40:16.089 INFO:tasks.workunit.client.0.smithi049.stdout:8/78: rename d0/da to d0/d13 0 2023-12-16T07:40:16.090 INFO:tasks.workunit.client.0.smithi049.stdout:7/19: dwrite f2 [0,4194304] 0 2023-12-16T07:40:16.090 INFO:tasks.workunit.client.0.smithi049.stdout:1/29: write f3 [2465550,108758] 0 2023-12-16T07:40:16.090 INFO:tasks.workunit.client.0.smithi049.stdout:9/63: dwrite f3 [0,4194304] 0 2023-12-16T07:40:16.091 INFO:tasks.workunit.client.0.smithi049.stdout:9/64: truncate d4/f13 988437 0 2023-12-16T07:40:16.091 INFO:tasks.workunit.client.0.smithi049.stdout:9/65: stat d4/d7/f10 0 2023-12-16T07:40:16.093 INFO:tasks.workunit.client.0.smithi049.stdout:7/20: getdents . 0 2023-12-16T07:40:16.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/30: rename f3 to fa 0 2023-12-16T07:40:16.096 INFO:tasks.workunit.client.0.smithi049.stdout:7/21: read f4 [2303633,103937] 0 2023-12-16T07:40:16.099 INFO:tasks.workunit.client.0.smithi049.stdout:7/22: creat f6 x:0 0 0 2023-12-16T07:40:16.101 INFO:tasks.workunit.client.0.smithi049.stdout:0/158: sync 2023-12-16T07:40:16.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/79: dread d0/f4 [0,4194304] 0 2023-12-16T07:40:16.110 INFO:tasks.workunit.client.0.smithi049.stdout:9/66: truncate d4/f13 380750 0 2023-12-16T07:40:16.111 INFO:tasks.workunit.client.0.smithi049.stdout:9/67: write f0 [1828755,46289] 0 2023-12-16T07:40:16.112 INFO:tasks.workunit.client.0.smithi049.stdout:9/68: read f1 [805547,120767] 0 2023-12-16T07:40:16.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/69: creat d4/d7/d11/f16 x:0 0 0 2023-12-16T07:40:16.115 INFO:tasks.workunit.client.0.smithi049.stdout:9/70: link d4/c6 d4/db/c17 0 2023-12-16T07:40:16.119 INFO:tasks.workunit.client.0.smithi049.stdout:7/23: dread f4 [0,4194304] 0 2023-12-16T07:40:16.119 INFO:tasks.workunit.client.0.smithi049.stdout:7/24: dread - f5 zero size 2023-12-16T07:40:16.120 INFO:tasks.workunit.client.0.smithi049.stdout:7/25: truncate f0 3013644 0 2023-12-16T07:40:16.121 INFO:tasks.workunit.client.0.smithi049.stdout:7/26: mkdir d7 0 2023-12-16T07:40:16.128 INFO:tasks.workunit.client.0.smithi049.stdout:0/159: dwrite f0 [0,4194304] 0 2023-12-16T07:40:16.128 INFO:tasks.workunit.client.0.smithi049.stdout:1/31: dwrite f5 [0,4194304] 0 2023-12-16T07:40:16.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/80: dwrite d0/d13/fe [0,4194304] 0 2023-12-16T07:40:16.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/81: write d0/f12 [470358,7750] 0 2023-12-16T07:40:16.128 INFO:tasks.workunit.client.0.smithi049.stdout:0/160: mknod d13/d21/d27/c34 0 2023-12-16T07:40:16.131 INFO:tasks.workunit.client.0.smithi049.stdout:9/71: dread f3 [0,4194304] 0 2023-12-16T07:40:16.131 INFO:tasks.workunit.client.0.smithi049.stdout:9/72: truncate d4/fd 457925 0 2023-12-16T07:40:16.132 INFO:tasks.workunit.client.0.smithi049.stdout:1/32: rename l1 to lb 0 2023-12-16T07:40:16.139 INFO:tasks.workunit.client.0.smithi049.stdout:8/82: mknod d0/d13/c14 0 2023-12-16T07:40:16.140 INFO:tasks.workunit.client.0.smithi049.stdout:0/161: link d13/d21/c22 d13/d15/c35 0 2023-12-16T07:40:16.141 INFO:tasks.workunit.client.0.smithi049.stdout:9/73: getdents d4/db 0 2023-12-16T07:40:16.143 INFO:tasks.workunit.client.0.smithi049.stdout:7/27: rename f0 to d7/f8 0 2023-12-16T07:40:16.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/83: creat d0/d13/f15 x:0 0 0 2023-12-16T07:40:16.145 INFO:tasks.workunit.client.0.smithi049.stdout:7/28: write f2 [3197177,96033] 0 2023-12-16T07:40:16.146 INFO:tasks.workunit.client.0.smithi049.stdout:1/33: dwrite f7 [0,4194304] 0 2023-12-16T07:40:16.146 INFO:tasks.workunit.client.0.smithi049.stdout:1/34: truncate f6 251990 0 2023-12-16T07:40:16.146 INFO:tasks.workunit.client.0.smithi049.stdout:1/35: rmdir - no directory 2023-12-16T07:40:16.146 INFO:tasks.workunit.client.0.smithi049.stdout:0/162: mkdir d13/d21/d2f/d36 0 2023-12-16T07:40:16.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/84: symlink d0/d13/d10/l16 0 2023-12-16T07:40:16.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/85: readlink d0/l7 0 2023-12-16T07:40:16.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/86: stat d0/d13 0 2023-12-16T07:40:16.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/87: fdatasync d0/d13/fd 0 2023-12-16T07:40:16.153 INFO:tasks.workunit.client.0.smithi049.stdout:1/36: unlink lb 0 2023-12-16T07:40:16.153 INFO:tasks.workunit.client.0.smithi049.stdout:1/37: readlink - no filename 2023-12-16T07:40:16.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/74: dwrite d4/ff [0,4194304] 0 2023-12-16T07:40:16.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/88: truncate d0/f4 969028 0 2023-12-16T07:40:16.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/89: stat d0/d13/d10 0 2023-12-16T07:40:16.157 INFO:tasks.workunit.client.0.smithi049.stdout:1/38: creat fc x:0 0 0 2023-12-16T07:40:16.159 INFO:tasks.workunit.client.0.smithi049.stdout:0/163: rmdir d13/d21 39 2023-12-16T07:40:16.161 INFO:tasks.workunit.client.0.smithi049.stdout:6/55: sync 2023-12-16T07:40:16.161 INFO:tasks.workunit.client.0.smithi049.stdout:5/27: sync 2023-12-16T07:40:16.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/39: creat fd x:0 0 0 2023-12-16T07:40:16.164 INFO:tasks.workunit.client.0.smithi049.stdout:6/56: getdents d0 0 2023-12-16T07:40:16.166 INFO:tasks.workunit.client.0.smithi049.stdout:5/28: symlink d5/l7 0 2023-12-16T07:40:16.166 INFO:tasks.workunit.client.0.smithi049.stdout:2/111: sync 2023-12-16T07:40:16.166 INFO:tasks.workunit.client.0.smithi049.stdout:2/112: dread - d2/de/f1b zero size 2023-12-16T07:40:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:4/34: sync 2023-12-16T07:40:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:6/57: dread d0/d2/f8 [0,4194304] 0 2023-12-16T07:40:16.167 INFO:tasks.workunit.client.0.smithi049.stdout:8/90: rename d0/d13/f15 to d0/d13/d10/f17 0 2023-12-16T07:40:16.168 INFO:tasks.workunit.client.0.smithi049.stdout:9/75: dwrite d4/d7/f10 [0,4194304] 0 2023-12-16T07:40:16.169 INFO:tasks.workunit.client.0.smithi049.stdout:5/29: rename d5/f6 to d5/f8 0 2023-12-16T07:40:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:8/91: creat d0/d13/d10/f18 x:0 0 0 2023-12-16T07:40:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:0/164: dread d13/d15/f1a [0,4194304] 0 2023-12-16T07:40:16.171 INFO:tasks.workunit.client.0.smithi049.stdout:0/165: write d13/f2b [504065,8780] 0 2023-12-16T07:40:16.172 INFO:tasks.workunit.client.0.smithi049.stdout:5/30: dread f4 [0,4194304] 0 2023-12-16T07:40:16.172 INFO:tasks.workunit.client.0.smithi049.stdout:5/31: stat d5/l7 0 2023-12-16T07:40:16.174 INFO:tasks.workunit.client.0.smithi049.stdout:1/40: dread f6 [0,4194304] 0 2023-12-16T07:40:16.174 INFO:tasks.workunit.client.0.smithi049.stdout:1/41: dread - fc zero size 2023-12-16T07:40:16.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/76: mknod d4/c18 0 2023-12-16T07:40:16.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/77: stat d4/d7/cc 0 2023-12-16T07:40:16.176 INFO:tasks.workunit.client.0.smithi049.stdout:4/35: dread d2/f4 [0,4194304] 0 2023-12-16T07:40:16.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/78: write f1 [993292,109980] 0 2023-12-16T07:40:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:0/166: mknod d13/d21/d27/c37 0 2023-12-16T07:40:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:5/32: creat d5/f9 x:0 0 0 2023-12-16T07:40:16.178 INFO:tasks.workunit.client.0.smithi049.stdout:5/33: write d5/f9 [282214,130528] 0 2023-12-16T07:40:16.180 INFO:tasks.workunit.client.0.smithi049.stdout:8/92: rename d0/d13/fc to d0/f19 0 2023-12-16T07:40:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/36: symlink d2/db/dd/l10 0 2023-12-16T07:40:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/37: stat d2/ff 0 2023-12-16T07:40:16.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/38: readlink d2/l5 0 2023-12-16T07:40:16.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/79: symlink d4/l19 0 2023-12-16T07:40:16.184 INFO:tasks.workunit.client.0.smithi049.stdout:7/29: dwrite f2 [0,4194304] 0 2023-12-16T07:40:16.185 INFO:tasks.workunit.client.0.smithi049.stdout:5/34: rename c0 to d5/ca 0 2023-12-16T07:40:16.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/167: dread d13/d15/f19 [0,4194304] 0 2023-12-16T07:40:16.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/168: write d13/f17 [4411241,42288] 0 2023-12-16T07:40:16.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/169: chown d13/d21/c22 1260697620 1 2023-12-16T07:40:16.187 INFO:tasks.workunit.client.0.smithi049.stdout:8/93: unlink d0/ff 0 2023-12-16T07:40:16.187 INFO:tasks.workunit.client.0.smithi049.stdout:6/58: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/39: rename d2/db/dd/l10 to d2/db/dd/l11 0 2023-12-16T07:40:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/80: symlink d4/d7/l1a 0 2023-12-16T07:40:16.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/81: readlink d4/d7/l1a 0 2023-12-16T07:40:16.192 INFO:tasks.workunit.client.0.smithi049.stdout:7/30: mknod d7/c9 0 2023-12-16T07:40:16.194 INFO:tasks.workunit.client.0.smithi049.stdout:1/42: dwrite f2 [0,4194304] 0 2023-12-16T07:40:16.195 INFO:tasks.workunit.client.0.smithi049.stdout:5/35: creat d5/fb x:0 0 0 2023-12-16T07:40:16.197 INFO:tasks.workunit.client.0.smithi049.stdout:6/59: mknod d0/d2/df/c13 0 2023-12-16T07:40:16.197 INFO:tasks.workunit.client.0.smithi049.stdout:6/60: fsync d0/d2/f8 0 2023-12-16T07:40:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:4/40: creat d2/f12 x:0 0 0 2023-12-16T07:40:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:9/82: mknod d4/c1b 0 2023-12-16T07:40:16.201 INFO:tasks.workunit.client.0.smithi049.stdout:4/41: fsync d2/f9 0 2023-12-16T07:40:16.202 INFO:tasks.workunit.client.0.smithi049.stdout:6/61: mknod d0/c14 0 2023-12-16T07:40:16.203 INFO:tasks.workunit.client.0.smithi049.stdout:6/62: chown d0/d2/f5 446758880 1 2023-12-16T07:40:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/83: getdents d4/d7/d11 0 2023-12-16T07:40:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/84: dread - d4/d7/d11/f16 zero size 2023-12-16T07:40:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/85: fsync d4/d7/f10 0 2023-12-16T07:40:16.204 INFO:tasks.workunit.client.0.smithi049.stdout:4/42: dread d2/f4 [0,4194304] 0 2023-12-16T07:40:16.205 INFO:tasks.workunit.client.0.smithi049.stdout:6/63: creat d0/d2/dd/f15 x:0 0 0 2023-12-16T07:40:16.206 INFO:tasks.workunit.client.0.smithi049.stdout:6/64: truncate d0/d2/f5 4680981 0 2023-12-16T07:40:16.206 INFO:tasks.workunit.client.0.smithi049.stdout:6/65: fdatasync d0/d2/f9 0 2023-12-16T07:40:16.207 INFO:tasks.workunit.client.0.smithi049.stdout:9/86: mknod d4/c1c 0 2023-12-16T07:40:16.209 INFO:tasks.workunit.client.0.smithi049.stdout:1/43: dread fa [0,4194304] 0 2023-12-16T07:40:16.209 INFO:tasks.workunit.client.0.smithi049.stdout:1/44: chown f5 0 1 2023-12-16T07:40:16.210 INFO:tasks.workunit.client.0.smithi049.stdout:4/43: link d2/f12 d2/db/dd/f13 0 2023-12-16T07:40:16.210 INFO:tasks.workunit.client.0.smithi049.stdout:7/31: dread f4 [0,4194304] 0 2023-12-16T07:40:16.211 INFO:tasks.workunit.client.0.smithi049.stdout:6/66: symlink d0/d2/dd/l16 0 2023-12-16T07:40:16.211 INFO:tasks.workunit.client.0.smithi049.stdout:6/67: write d0/d2/dd/f15 [225423,55591] 0 2023-12-16T07:40:16.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/32: creat d7/fa x:0 0 0 2023-12-16T07:40:16.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/33: dread - f6 zero size 2023-12-16T07:40:16.217 INFO:tasks.workunit.client.0.smithi049.stdout:6/68: symlink d0/d2/df/l17 0 2023-12-16T07:40:16.217 INFO:tasks.workunit.client.0.smithi049.stdout:6/69: fdatasync d0/d2/f9 0 2023-12-16T07:40:16.217 INFO:tasks.workunit.client.0.smithi049.stdout:6/70: stat d0/d2/dd 0 2023-12-16T07:40:16.218 INFO:tasks.workunit.client.0.smithi049.stdout:7/34: creat d7/fb x:0 0 0 2023-12-16T07:40:16.218 INFO:tasks.workunit.client.0.smithi049.stdout:3/71: sync 2023-12-16T07:40:16.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/36: dwrite f3 [4194304,4194304] 0 2023-12-16T07:40:16.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/37: stat f3 0 2023-12-16T07:40:16.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/35: mkdir d7/dc 0 2023-12-16T07:40:16.225 INFO:tasks.workunit.client.0.smithi049.stdout:3/72: write d1/fe [311887,118168] 0 2023-12-16T07:40:16.227 INFO:tasks.workunit.client.0.smithi049.stdout:7/36: mkdir d7/dc/dd 0 2023-12-16T07:40:16.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/73: symlink d1/l15 0 2023-12-16T07:40:16.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/74: readlink d1/l3 0 2023-12-16T07:40:16.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/75: creat d1/f16 x:0 0 0 2023-12-16T07:40:16.232 INFO:tasks.workunit.client.0.smithi049.stdout:3/76: creat d1/f17 x:0 0 0 2023-12-16T07:40:16.233 INFO:tasks.workunit.client.0.smithi049.stdout:3/77: rename d1/f17 to d1/f18 0 2023-12-16T07:40:16.241 INFO:tasks.workunit.client.0.smithi049.stdout:9/87: dwrite f0 [4194304,4194304] 0 2023-12-16T07:40:16.243 INFO:tasks.workunit.client.0.smithi049.stdout:9/88: mkdir d4/d7/d11/d1d 0 2023-12-16T07:40:16.244 INFO:tasks.workunit.client.0.smithi049.stdout:9/89: read d4/f13 [154424,85244] 0 2023-12-16T07:40:16.244 INFO:tasks.workunit.client.0.smithi049.stdout:9/90: chown d4/d7/ca 1 1 2023-12-16T07:40:16.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/44: dwrite d2/f9 [0,4194304] 0 2023-12-16T07:40:16.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/45: fdatasync f1 0 2023-12-16T07:40:16.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/91: write f0 [5213829,36767] 0 2023-12-16T07:40:16.250 INFO:tasks.workunit.client.0.smithi049.stdout:9/92: mknod d4/d7/d11/c1e 0 2023-12-16T07:40:16.250 INFO:tasks.workunit.client.0.smithi049.stdout:4/46: dread d2/db/dd/fa [0,4194304] 0 2023-12-16T07:40:16.250 INFO:tasks.workunit.client.0.smithi049.stdout:4/47: write d2/db/dd/f13 [995447,64873] 0 2023-12-16T07:40:16.251 INFO:tasks.workunit.client.0.smithi049.stdout:4/48: write d2/fc [327016,128696] 0 2023-12-16T07:40:16.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/71: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:16.251 INFO:tasks.workunit.client.0.smithi049.stdout:3/78: dwrite d1/fc [0,4194304] 0 2023-12-16T07:40:16.256 INFO:tasks.workunit.client.0.smithi049.stdout:6/72: dread d0/d2/dd/f15 [0,4194304] 0 2023-12-16T07:40:16.258 INFO:tasks.workunit.client.0.smithi049.stdout:3/79: unlink d1/f14 0 2023-12-16T07:40:16.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/80: chown d1/cd 5 1 2023-12-16T07:40:16.259 INFO:tasks.workunit.client.0.smithi049.stdout:7/37: truncate f4 12839 0 2023-12-16T07:40:16.269 INFO:tasks.workunit.client.0.smithi049.stdout:6/73: symlink d0/d2/df/l18 0 2023-12-16T07:40:16.269 INFO:tasks.workunit.client.0.smithi049.stdout:6/74: fdatasync d0/d2/f8 0 2023-12-16T07:40:16.271 INFO:tasks.workunit.client.0.smithi049.stdout:3/81: rename d1/l3 to d1/l19 0 2023-12-16T07:40:16.272 INFO:tasks.workunit.client.0.smithi049.stdout:7/38: symlink d7/dc/dd/le 0 2023-12-16T07:40:16.273 INFO:tasks.workunit.client.0.smithi049.stdout:5/38: truncate f3 2949464 0 2023-12-16T07:40:16.275 INFO:tasks.workunit.client.0.smithi049.stdout:5/39: symlink d5/lc 0 2023-12-16T07:40:16.275 INFO:tasks.workunit.client.0.smithi049.stdout:5/40: readlink d5/lc 0 2023-12-16T07:40:16.277 INFO:tasks.workunit.client.0.smithi049.stdout:5/41: creat d5/fd x:0 0 0 2023-12-16T07:40:16.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/39: dread d7/f8 [0,4194304] 0 2023-12-16T07:40:16.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/40: dread - d7/fa zero size 2023-12-16T07:40:16.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/41: creat d7/dc/dd/ff x:0 0 0 2023-12-16T07:40:16.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/42: write d7/fb [762213,122784] 0 2023-12-16T07:40:16.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/43: fdatasync f4 0 2023-12-16T07:40:16.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/44: rename d7 to d7/dc/dd/d10 22 2023-12-16T07:40:16.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/45: creat d7/f11 x:0 0 0 2023-12-16T07:40:16.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/46: dread - d7/fa zero size 2023-12-16T07:40:16.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/47: write d7/fa [567125,61087] 0 2023-12-16T07:40:16.304 INFO:tasks.workunit.client.0.smithi049.stdout:4/49: dwrite d2/ff [0,4194304] 0 2023-12-16T07:40:16.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/93: dwrite f0 [4194304,4194304] 0 2023-12-16T07:40:16.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/94: chown d4/d7/d11/f14 16 1 2023-12-16T07:40:16.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/95: chown d4/d7/f9 60836 1 2023-12-16T07:40:16.305 INFO:tasks.workunit.client.0.smithi049.stdout:6/75: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:16.305 INFO:tasks.workunit.client.0.smithi049.stdout:3/82: dwrite d1/f13 [0,4194304] 0 2023-12-16T07:40:16.305 INFO:tasks.workunit.client.0.smithi049.stdout:3/83: chown d1/fe 49409 1 2023-12-16T07:40:16.305 INFO:tasks.workunit.client.0.smithi049.stdout:3/84: write d1/fa [4958265,90737] 0 2023-12-16T07:40:16.307 INFO:tasks.workunit.client.0.smithi049.stdout:4/50: symlink d2/db/dd/de/l14 0 2023-12-16T07:40:16.310 INFO:tasks.workunit.client.0.smithi049.stdout:9/96: creat d4/f1f x:0 0 0 2023-12-16T07:40:16.312 INFO:tasks.workunit.client.0.smithi049.stdout:7/48: dread f4 [0,4194304] 0 2023-12-16T07:40:16.316 INFO:tasks.workunit.client.0.smithi049.stdout:6/76: unlink d0/d2/df/l17 0 2023-12-16T07:40:16.316 INFO:tasks.workunit.client.0.smithi049.stdout:6/77: dread - d0/d2/dd/f12 zero size 2023-12-16T07:40:16.318 INFO:tasks.workunit.client.0.smithi049.stdout:6/78: dread d0/d2/f8 [0,4194304] 0 2023-12-16T07:40:16.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/85: dwrite d1/f18 [0,4194304] 0 2023-12-16T07:40:16.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/86: fsync d1/f18 0 2023-12-16T07:40:16.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/87: write d1/f12 [191616,41158] 0 2023-12-16T07:40:16.321 INFO:tasks.workunit.client.0.smithi049.stdout:4/51: getdents d2/db 0 2023-12-16T07:40:16.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/52: read d2/fc [200318,1955] 0 2023-12-16T07:40:16.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/53: write d2/f12 [1051002,61967] 0 2023-12-16T07:40:16.322 INFO:tasks.workunit.client.0.smithi049.stdout:3/88: read d1/fe [432413,103252] 0 2023-12-16T07:40:16.324 INFO:tasks.workunit.client.0.smithi049.stdout:9/97: link d4/ff d4/d7/d11/f20 0 2023-12-16T07:40:16.329 INFO:tasks.workunit.client.0.smithi049.stdout:7/49: fsync d7/f11 0 2023-12-16T07:40:16.329 INFO:tasks.workunit.client.0.smithi049.stdout:7/50: chown f5 0 1 2023-12-16T07:40:16.333 INFO:tasks.workunit.client.0.smithi049.stdout:5/42: dread f3 [0,4194304] 0 2023-12-16T07:40:16.333 INFO:tasks.workunit.client.0.smithi049.stdout:4/54: link d2/db/dd/fa d2/db/f15 0 2023-12-16T07:40:16.334 INFO:tasks.workunit.client.0.smithi049.stdout:4/55: write d2/db/dd/fa [2128608,65350] 0 2023-12-16T07:40:16.335 INFO:tasks.workunit.client.0.smithi049.stdout:9/98: creat d4/d7/f21 x:0 0 0 2023-12-16T07:40:16.336 INFO:tasks.workunit.client.0.smithi049.stdout:2/113: sync 2023-12-16T07:40:16.336 INFO:tasks.workunit.client.0.smithi049.stdout:2/114: write d2/f9 [4208928,72524] 0 2023-12-16T07:40:16.336 INFO:tasks.workunit.client.0.smithi049.stdout:2/115: fdatasync d2/f12 0 2023-12-16T07:40:16.337 INFO:tasks.workunit.client.0.smithi049.stdout:7/51: symlink d7/dc/l12 0 2023-12-16T07:40:16.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/52: chown d7/dc/dd/le 1814126 1 2023-12-16T07:40:16.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/53: stat d7/dc 0 2023-12-16T07:40:16.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/54: truncate f2 363605 0 2023-12-16T07:40:16.338 INFO:tasks.workunit.client.0.smithi049.stdout:4/56: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:16.338 INFO:tasks.workunit.client.0.smithi049.stdout:5/43: mkdir d5/de 0 2023-12-16T07:40:16.338 INFO:tasks.workunit.client.0.smithi049.stdout:4/57: write d2/ff [2686220,43342] 0 2023-12-16T07:40:16.339 INFO:tasks.workunit.client.0.smithi049.stdout:4/58: chown d2/db/f15 3274235 1 2023-12-16T07:40:16.339 INFO:tasks.workunit.client.0.smithi049.stdout:7/55: symlink d7/l13 0 2023-12-16T07:40:16.339 INFO:tasks.workunit.client.0.smithi049.stdout:7/56: read - d7/f11 zero size 2023-12-16T07:40:16.339 INFO:tasks.workunit.client.0.smithi049.stdout:7/57: chown f5 35712 1 2023-12-16T07:40:16.341 INFO:tasks.workunit.client.0.smithi049.stdout:0/170: sync 2023-12-16T07:40:16.342 INFO:tasks.workunit.client.0.smithi049.stdout:4/59: mkdir d2/d16 0 2023-12-16T07:40:16.342 INFO:tasks.workunit.client.0.smithi049.stdout:4/60: write d2/f9 [5002332,121911] 0 2023-12-16T07:40:16.342 INFO:tasks.workunit.client.0.smithi049.stdout:6/79: rmdir d0/d2 39 2023-12-16T07:40:16.343 INFO:tasks.workunit.client.0.smithi049.stdout:6/80: write d0/d2/f8 [1487161,81600] 0 2023-12-16T07:40:16.343 INFO:tasks.workunit.client.0.smithi049.stdout:6/81: dread - d0/d2/dd/f12 zero size 2023-12-16T07:40:16.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/58: unlink d7/l13 0 2023-12-16T07:40:16.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/59: readlink l3 0 2023-12-16T07:40:16.346 INFO:tasks.workunit.client.0.smithi049.stdout:4/61: creat d2/db/dd/de/f17 x:0 0 0 2023-12-16T07:40:16.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/82: symlink d0/d2/df/l19 0 2023-12-16T07:40:16.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/83: dread - d0/d2/dd/f12 zero size 2023-12-16T07:40:16.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/84: stat d0/d2/f8 0 2023-12-16T07:40:16.349 INFO:tasks.workunit.client.0.smithi049.stdout:1/45: sync 2023-12-16T07:40:16.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/94: sync 2023-12-16T07:40:16.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/46: write f6 [546455,128416] 0 2023-12-16T07:40:16.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/47: rmdir - no directory 2023-12-16T07:40:16.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/48: dread - f9 zero size 2023-12-16T07:40:16.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/60: mkdir d7/dc/dd/d14 0 2023-12-16T07:40:16.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/61: stat d7/fa 0 2023-12-16T07:40:16.351 INFO:tasks.workunit.client.0.smithi049.stdout:4/62: creat d2/f18 x:0 0 0 2023-12-16T07:40:16.352 INFO:tasks.workunit.client.0.smithi049.stdout:6/85: symlink d0/l1a 0 2023-12-16T07:40:16.353 INFO:tasks.workunit.client.0.smithi049.stdout:1/49: creat fe x:0 0 0 2023-12-16T07:40:16.356 INFO:tasks.workunit.client.0.smithi049.stdout:7/62: mkdir d7/dc/d15 0 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:0/171: write d13/f1c [3672542,1422] 0 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:0/172: chown d13/f16 73445 1 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:0/173: stat d13/d15/f19 0 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:8/95: write d0/d13/fe [3225980,102902] 0 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:8/96: write d0/d13/fd [630300,130717] 0 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/86: creat d0/f1b x:0 0 0 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/87: readlink d0/l10 0 2023-12-16T07:40:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/88: chown d0/d2/df/l19 11 1 2023-12-16T07:40:16.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/97: read d0/f12 [381319,48796] 0 2023-12-16T07:40:16.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/98: chown d0/f19 3983 1 2023-12-16T07:40:16.360 INFO:tasks.workunit.client.0.smithi049.stdout:0/174: write d13/d15/f1a [2327666,36087] 0 2023-12-16T07:40:16.360 INFO:tasks.workunit.client.0.smithi049.stdout:0/175: stat d13/d15/f19 0 2023-12-16T07:40:16.360 INFO:tasks.workunit.client.0.smithi049.stdout:1/50: rename fd to ff 0 2023-12-16T07:40:16.361 INFO:tasks.workunit.client.0.smithi049.stdout:9/99: dwrite d4/f1f [0,4194304] 0 2023-12-16T07:40:16.361 INFO:tasks.workunit.client.0.smithi049.stdout:9/100: stat f1 0 2023-12-16T07:40:16.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/63: mkdir d7/dc/d16 0 2023-12-16T07:40:16.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/64: dread - d7/dc/dd/ff zero size 2023-12-16T07:40:16.362 INFO:tasks.workunit.client.0.smithi049.stdout:5/44: dwrite d5/fb [0,4194304] 0 2023-12-16T07:40:16.362 INFO:tasks.workunit.client.0.smithi049.stdout:5/45: fdatasync f3 0 2023-12-16T07:40:16.363 INFO:tasks.workunit.client.0.smithi049.stdout:8/99: read d0/d13/fe [3556082,61889] 0 2023-12-16T07:40:16.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/176: mkdir d13/d21/d2f/d36/d38 0 2023-12-16T07:40:16.365 INFO:tasks.workunit.client.0.smithi049.stdout:6/89: fdatasync d0/d2/f8 0 2023-12-16T07:40:16.365 INFO:tasks.workunit.client.0.smithi049.stdout:6/90: fdatasync d0/f1b 0 2023-12-16T07:40:16.365 INFO:tasks.workunit.client.0.smithi049.stdout:6/91: readlink d0/l1a 0 2023-12-16T07:40:16.366 INFO:tasks.workunit.client.0.smithi049.stdout:8/100: dread d0/f4 [0,4194304] 0 2023-12-16T07:40:16.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/101: link d4/ff d4/db/f22 0 2023-12-16T07:40:16.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/102: readlink d4/d7/l1a 0 2023-12-16T07:40:16.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/103: stat d4/c1c 0 2023-12-16T07:40:16.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/104: write d4/d7/f10 [4821959,3983] 0 2023-12-16T07:40:16.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/105: readlink l2 0 2023-12-16T07:40:16.368 INFO:tasks.workunit.client.0.smithi049.stdout:2/116: dwrite d2/de/f1b [0,4194304] 0 2023-12-16T07:40:16.373 INFO:tasks.workunit.client.0.smithi049.stdout:5/46: mknod d5/de/cf 0 2023-12-16T07:40:16.373 INFO:tasks.workunit.client.0.smithi049.stdout:6/92: rmdir d0/d2 39 2023-12-16T07:40:16.373 INFO:tasks.workunit.client.0.smithi049.stdout:5/47: truncate d5/fd 120837 0 2023-12-16T07:40:16.373 INFO:tasks.workunit.client.0.smithi049.stdout:5/48: fsync f4 0 2023-12-16T07:40:16.374 INFO:tasks.workunit.client.0.smithi049.stdout:8/101: creat d0/d13/d10/f1a x:0 0 0 2023-12-16T07:40:16.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/63: dwrite d2/fc [0,4194304] 0 2023-12-16T07:40:16.378 INFO:tasks.workunit.client.0.smithi049.stdout:5/49: creat d5/f10 x:0 0 0 2023-12-16T07:40:16.380 INFO:tasks.workunit.client.0.smithi049.stdout:8/102: getdents d0 0 2023-12-16T07:40:16.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/64: mknod d2/db/dd/c19 0 2023-12-16T07:40:16.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/65: stat d2/fc 0 2023-12-16T07:40:16.383 INFO:tasks.workunit.client.0.smithi049.stdout:9/106: dwrite d4/d7/d11/f14 [0,4194304] 0 2023-12-16T07:40:16.386 INFO:tasks.workunit.client.0.smithi049.stdout:0/177: dread fa [0,4194304] 0 2023-12-16T07:40:16.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/50: unlink d5/ca 0 2023-12-16T07:40:16.388 INFO:tasks.workunit.client.0.smithi049.stdout:4/66: symlink d2/db/l1a 0 2023-12-16T07:40:16.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/65: dwrite d7/f8 [0,4194304] 0 2023-12-16T07:40:16.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/66: write d7/dc/dd/ff [606735,107683] 0 2023-12-16T07:40:16.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/67: write d7/dc/dd/ff [899320,17447] 0 2023-12-16T07:40:16.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/68: chown d7/dc/dd 15 1 2023-12-16T07:40:16.391 INFO:tasks.workunit.client.0.smithi049.stdout:9/107: mknod d4/db/c23 0 2023-12-16T07:40:16.392 INFO:tasks.workunit.client.0.smithi049.stdout:4/67: fsync d2/ff 0 2023-12-16T07:40:16.393 INFO:tasks.workunit.client.0.smithi049.stdout:1/51: dwrite f5 [4194304,4194304] 0 2023-12-16T07:40:16.393 INFO:tasks.workunit.client.0.smithi049.stdout:1/52: write f6 [674083,53180] 0 2023-12-16T07:40:16.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/93: dwrite d0/f1b [0,4194304] 0 2023-12-16T07:40:16.395 INFO:tasks.workunit.client.0.smithi049.stdout:5/51: unlink d5/f10 0 2023-12-16T07:40:16.396 INFO:tasks.workunit.client.0.smithi049.stdout:7/69: creat d7/dc/f17 x:0 0 0 2023-12-16T07:40:16.396 INFO:tasks.workunit.client.0.smithi049.stdout:7/70: readlink l3 0 2023-12-16T07:40:16.397 INFO:tasks.workunit.client.0.smithi049.stdout:0/178: rename d13/d21/d2f/d36 to d13/d39 0 2023-12-16T07:40:16.398 INFO:tasks.workunit.client.0.smithi049.stdout:9/108: symlink d4/d7/d11/d1d/l24 0 2023-12-16T07:40:16.399 INFO:tasks.workunit.client.0.smithi049.stdout:4/68: getdents d2/db/dd/de 0 2023-12-16T07:40:16.403 INFO:tasks.workunit.client.0.smithi049.stdout:1/53: creat f10 x:0 0 0 2023-12-16T07:40:16.476 INFO:tasks.workunit.client.0.smithi049.stdout:6/94: link d0/c7 d0/d2/df/c1c 0 2023-12-16T07:40:16.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/117: truncate d2/f9 43651 0 2023-12-16T07:40:16.483 INFO:tasks.workunit.client.0.smithi049.stdout:5/52: creat d5/f11 x:0 0 0 2023-12-16T07:40:16.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/71: symlink d7/dc/d15/l18 0 2023-12-16T07:40:16.484 INFO:tasks.workunit.client.0.smithi049.stdout:5/53: dread d5/f9 [0,4194304] 0 2023-12-16T07:40:16.485 INFO:tasks.workunit.client.0.smithi049.stdout:5/54: chown f4 5 1 2023-12-16T07:40:16.485 INFO:tasks.workunit.client.0.smithi049.stdout:7/72: write d7/fa [260053,7699] 0 2023-12-16T07:40:16.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/179: rename d13/d21/d27/l2d to d13/d39/d38/l3a 0 2023-12-16T07:40:16.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/180: read d13/d15/f1a [2860712,92780] 0 2023-12-16T07:40:16.487 INFO:tasks.workunit.client.0.smithi049.stdout:9/109: creat d4/d7/d11/d1d/f25 x:0 0 0 2023-12-16T07:40:16.487 INFO:tasks.workunit.client.0.smithi049.stdout:9/110: fdatasync f1 0 2023-12-16T07:40:16.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/69: mknod d2/db/c1b 0 2023-12-16T07:40:16.488 INFO:tasks.workunit.client.0.smithi049.stdout:9/111: read d4/d7/d11/f14 [3154788,91992] 0 2023-12-16T07:40:16.489 INFO:tasks.workunit.client.0.smithi049.stdout:6/95: rmdir d0/d2/dd 39 2023-12-16T07:40:16.489 INFO:tasks.workunit.client.0.smithi049.stdout:9/112: write f0 [896188,35673] 0 2023-12-16T07:40:16.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/118: unlink d2/d7/f13 0 2023-12-16T07:40:16.492 INFO:tasks.workunit.client.0.smithi049.stdout:0/181: dread f2 [0,4194304] 0 2023-12-16T07:40:16.492 INFO:tasks.workunit.client.0.smithi049.stdout:0/182: write d13/d15/f19 [2636142,4167] 0 2023-12-16T07:40:16.497 INFO:tasks.workunit.client.0.smithi049.stdout:7/73: rmdir d7/dc/d16 0 2023-12-16T07:40:16.501 INFO:tasks.workunit.client.0.smithi049.stdout:4/70: creat d2/d16/f1c x:0 0 0 2023-12-16T07:40:16.502 INFO:tasks.workunit.client.0.smithi049.stdout:2/119: mknod d2/d7/d11/c23 0 2023-12-16T07:40:16.503 INFO:tasks.workunit.client.0.smithi049.stdout:2/120: truncate d2/f17 4689956 0 2023-12-16T07:40:16.505 INFO:tasks.workunit.client.0.smithi049.stdout:0/183: creat d13/d39/f3b x:0 0 0 2023-12-16T07:40:16.505 INFO:tasks.workunit.client.0.smithi049.stdout:0/184: write f4 [1128314,88301] 0 2023-12-16T07:40:16.506 INFO:tasks.workunit.client.0.smithi049.stdout:7/74: symlink d7/dc/l19 0 2023-12-16T07:40:16.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/71: mknod d2/db/c1d 0 2023-12-16T07:40:16.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/72: truncate d2/f12 1463558 0 2023-12-16T07:40:16.509 INFO:tasks.workunit.client.0.smithi049.stdout:2/121: mkdir d2/d1d/d24 0 2023-12-16T07:40:16.509 INFO:tasks.workunit.client.0.smithi049.stdout:0/185: mkdir d13/d3c 0 2023-12-16T07:40:16.511 INFO:tasks.workunit.client.0.smithi049.stdout:9/113: dwrite d4/d7/d11/f20 [4194304,4194304] 0 2023-12-16T07:40:16.512 INFO:tasks.workunit.client.0.smithi049.stdout:7/75: link d7/c9 d7/dc/c1a 0 2023-12-16T07:40:16.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/73: mkdir d2/db/dd/de/d1e 0 2023-12-16T07:40:16.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/74: fdatasync d2/db/f15 0 2023-12-16T07:40:16.514 INFO:tasks.workunit.client.0.smithi049.stdout:0/186: mknod d13/d21/d27/c3d 0 2023-12-16T07:40:16.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/76: write f2 [18348,104466] 0 2023-12-16T07:40:16.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/77: truncate f4 671153 0 2023-12-16T07:40:16.514 INFO:tasks.workunit.client.0.smithi049.stdout:9/114: rmdir d4/d7/d11 39 2023-12-16T07:40:16.516 INFO:tasks.workunit.client.0.smithi049.stdout:4/75: mknod d2/db/dd/c1f 0 2023-12-16T07:40:16.516 INFO:tasks.workunit.client.0.smithi049.stdout:2/122: dread d2/d7/fb [0,4194304] 0 2023-12-16T07:40:16.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/187: mknod d13/d39/c3e 0 2023-12-16T07:40:16.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/123: creat d2/d7/d11/f25 x:0 0 0 2023-12-16T07:40:16.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/188: mknod d13/d3c/c3f 0 2023-12-16T07:40:16.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/189: stat d13/d21/c26 0 2023-12-16T07:40:16.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/190: stat d13/f2b 0 2023-12-16T07:40:16.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/191: creat d13/f40 x:0 0 0 2023-12-16T07:40:16.529 INFO:tasks.workunit.client.0.smithi049.stdout:4/76: dwrite d2/d16/f1c [0,4194304] 0 2023-12-16T07:40:16.530 INFO:tasks.workunit.client.0.smithi049.stdout:0/192: creat d13/d21/d27/d2c/f41 x:0 0 0 2023-12-16T07:40:16.530 INFO:tasks.workunit.client.0.smithi049.stdout:0/193: dread - d13/d15/f1f zero size 2023-12-16T07:40:16.533 INFO:tasks.workunit.client.0.smithi049.stdout:9/115: dwrite f3 [0,4194304] 0 2023-12-16T07:40:16.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/77: creat d2/d16/f20 x:0 0 0 2023-12-16T07:40:16.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/78: chown d2/db 11661 1 2023-12-16T07:40:16.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/79: chown d2/db/c1b 100 1 2023-12-16T07:40:16.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/80: fdatasync f0 0 2023-12-16T07:40:16.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/81: write f1 [1552293,11058] 0 2023-12-16T07:40:16.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/82: fdatasync d2/f12 0 2023-12-16T07:40:16.535 INFO:tasks.workunit.client.0.smithi049.stdout:0/194: link d13/d15/f19 d13/d21/f42 0 2023-12-16T07:40:16.536 INFO:tasks.workunit.client.0.smithi049.stdout:9/116: mkdir d4/d7/d11/d26 0 2023-12-16T07:40:16.537 INFO:tasks.workunit.client.0.smithi049.stdout:9/117: write f1 [427992,50742] 0 2023-12-16T07:40:16.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/83: mkdir d2/db/dd/de/d1e/d21 0 2023-12-16T07:40:16.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/84: write d2/f18 [577492,44610] 0 2023-12-16T07:40:16.539 INFO:tasks.workunit.client.0.smithi049.stdout:0/195: symlink d13/l43 0 2023-12-16T07:40:16.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/85: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:16.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/118: symlink d4/d7/d11/d26/l27 0 2023-12-16T07:40:16.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/196: mknod d13/d21/d27/d2c/c44 0 2023-12-16T07:40:16.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/86: unlink f0 0 2023-12-16T07:40:16.549 INFO:tasks.workunit.client.0.smithi049.stdout:0/197: mknod d13/d21/d27/c45 0 2023-12-16T07:40:16.550 INFO:tasks.workunit.client.0.smithi049.stdout:0/198: readlink d13/d21/d27/l28 0 2023-12-16T07:40:16.557 INFO:tasks.workunit.client.0.smithi049.stdout:4/87: mknod d2/db/dd/de/d1e/c22 0 2023-12-16T07:40:16.557 INFO:tasks.workunit.client.0.smithi049.stdout:4/88: chown d2/db/dd 986033 1 2023-12-16T07:40:16.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/199: mkdir d13/d15/d46 0 2023-12-16T07:40:16.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/200: fdatasync d13/f1b 0 2023-12-16T07:40:16.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/89: write d2/db/f15 [658797,59590] 0 2023-12-16T07:40:16.561 INFO:tasks.workunit.client.0.smithi049.stdout:9/119: dwrite d4/ff [4194304,4194304] 0 2023-12-16T07:40:16.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/90: mknod d2/c23 0 2023-12-16T07:40:16.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/91: chown d2/c23 1083 1 2023-12-16T07:40:16.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/120: truncate d4/f1f 1886196 0 2023-12-16T07:40:16.566 INFO:tasks.workunit.client.0.smithi049.stdout:9/121: write f0 [390189,3081] 0 2023-12-16T07:40:16.568 INFO:tasks.workunit.client.0.smithi049.stdout:4/92: dread d2/fc [0,4194304] 0 2023-12-16T07:40:16.574 INFO:tasks.workunit.client.0.smithi049.stdout:4/93: write d2/f9 [2695282,42121] 0 2023-12-16T07:40:16.576 INFO:tasks.workunit.client.0.smithi049.stdout:4/94: mknod d2/c24 0 2023-12-16T07:40:16.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/95: write d2/d16/f1c [49686,64710] 0 2023-12-16T07:40:16.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/96: write d2/d16/f20 [679161,25440] 0 2023-12-16T07:40:16.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/97: write d2/db/dd/f13 [1817136,8857] 0 2023-12-16T07:40:16.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/98: dread - d2/db/dd/de/f17 zero size 2023-12-16T07:40:16.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/122: dread f3 [0,4194304] 0 2023-12-16T07:40:16.584 INFO:tasks.workunit.client.0.smithi049.stdout:4/99: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:16.585 INFO:tasks.workunit.client.0.smithi049.stdout:4/100: readlink d2/db/l1a 0 2023-12-16T07:40:16.587 INFO:tasks.workunit.client.0.smithi049.stdout:4/101: creat d2/db/dd/de/d1e/d21/f25 x:0 0 0 2023-12-16T07:40:16.589 INFO:tasks.workunit.client.0.smithi049.stdout:4/102: creat d2/d16/f26 x:0 0 0 2023-12-16T07:40:16.604 INFO:tasks.workunit.client.0.smithi049.stdout:5/55: rmdir d5 39 2023-12-16T07:40:16.608 INFO:tasks.workunit.client.0.smithi049.stdout:5/56: truncate f4 197229 0 2023-12-16T07:40:16.608 INFO:tasks.workunit.client.0.smithi049.stdout:8/103: sync 2023-12-16T07:40:16.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/54: sync 2023-12-16T07:40:16.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/55: truncate fa 4650331 0 2023-12-16T07:40:16.609 INFO:tasks.workunit.client.0.smithi049.stdout:3/89: sync 2023-12-16T07:40:16.609 INFO:tasks.workunit.client.0.smithi049.stdout:3/90: stat d1/l11 0 2023-12-16T07:40:16.617 INFO:tasks.workunit.client.0.smithi049.stdout:3/91: creat d1/f1a x:0 0 0 2023-12-16T07:40:16.620 INFO:tasks.workunit.client.0.smithi049.stdout:3/92: unlink d1/f1a 0 2023-12-16T07:40:16.621 INFO:tasks.workunit.client.0.smithi049.stdout:3/93: unlink d1/f13 0 2023-12-16T07:40:16.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/56: dwrite fe [0,4194304] 0 2023-12-16T07:40:16.630 INFO:tasks.workunit.client.0.smithi049.stdout:5/57: dread d5/fb [0,4194304] 0 2023-12-16T07:40:16.630 INFO:tasks.workunit.client.0.smithi049.stdout:8/104: dwrite d0/d13/fd [0,4194304] 0 2023-12-16T07:40:16.630 INFO:tasks.workunit.client.0.smithi049.stdout:8/105: truncate d0/f19 4544527 0 2023-12-16T07:40:16.635 INFO:tasks.workunit.client.0.smithi049.stdout:3/94: dread d1/fc [0,4194304] 0 2023-12-16T07:40:16.640 INFO:tasks.workunit.client.0.smithi049.stdout:1/57: link fc f11 0 2023-12-16T07:40:16.645 INFO:tasks.workunit.client.0.smithi049.stdout:8/106: symlink d0/l1b 0 2023-12-16T07:40:16.646 INFO:tasks.workunit.client.0.smithi049.stdout:1/58: mknod c12 0 2023-12-16T07:40:16.648 INFO:tasks.workunit.client.0.smithi049.stdout:8/107: getdents d0/d13/d10 0 2023-12-16T07:40:16.648 INFO:tasks.workunit.client.0.smithi049.stdout:8/108: write d0/d13/d10/f1a [666041,33611] 0 2023-12-16T07:40:16.652 INFO:tasks.workunit.client.0.smithi049.stdout:8/109: truncate d0/d13/fe 3056458 0 2023-12-16T07:40:16.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/58: dwrite d5/f9 [0,4194304] 0 2023-12-16T07:40:16.655 INFO:tasks.workunit.client.0.smithi049.stdout:8/110: mkdir d0/d13/d10/d1c 0 2023-12-16T07:40:16.658 INFO:tasks.workunit.client.0.smithi049.stdout:4/103: truncate d2/db/dd/f13 962338 0 2023-12-16T07:40:16.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/95: dwrite d1/fe [0,4194304] 0 2023-12-16T07:40:16.660 INFO:tasks.workunit.client.0.smithi049.stdout:5/59: symlink d5/de/l12 0 2023-12-16T07:40:16.660 INFO:tasks.workunit.client.0.smithi049.stdout:5/60: stat d5/f11 0 2023-12-16T07:40:16.666 INFO:tasks.workunit.client.0.smithi049.stdout:3/96: unlink d1/f10 0 2023-12-16T07:40:16.669 INFO:tasks.workunit.client.0.smithi049.stdout:3/97: creat d1/f1b x:0 0 0 2023-12-16T07:40:16.670 INFO:tasks.workunit.client.0.smithi049.stdout:5/61: dread d5/fb [0,4194304] 0 2023-12-16T07:40:16.671 INFO:tasks.workunit.client.0.smithi049.stdout:5/62: write d5/fb [1679422,75997] 0 2023-12-16T07:40:16.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/98: rename d1/lb to d1/l1c 0 2023-12-16T07:40:16.674 INFO:tasks.workunit.client.0.smithi049.stdout:1/59: dwrite ff [0,4194304] 0 2023-12-16T07:40:16.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/96: rmdir d0/d2 39 2023-12-16T07:40:16.677 INFO:tasks.workunit.client.0.smithi049.stdout:6/97: chown d0/d2 136090 1 2023-12-16T07:40:16.677 INFO:tasks.workunit.client.0.smithi049.stdout:6/98: chown d0/d2/f8 1764 1 2023-12-16T07:40:16.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/99: dread d1/fa [0,4194304] 0 2023-12-16T07:40:16.679 INFO:tasks.workunit.client.0.smithi049.stdout:3/100: symlink d1/l1d 0 2023-12-16T07:40:16.682 INFO:tasks.workunit.client.0.smithi049.stdout:2/124: rmdir d2 39 2023-12-16T07:40:16.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/78: sync 2023-12-16T07:40:16.683 INFO:tasks.workunit.client.0.smithi049.stdout:3/101: read d1/ff [178395,84754] 0 2023-12-16T07:40:16.683 INFO:tasks.workunit.client.0.smithi049.stdout:2/125: fdatasync d2/d7/d11/f1e 0 2023-12-16T07:40:16.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/79: dread - d7/dc/f17 zero size 2023-12-16T07:40:16.685 INFO:tasks.workunit.client.0.smithi049.stdout:3/102: rename d1/c9 to d1/c1e 0 2023-12-16T07:40:16.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/80: unlink d7/dc/l19 0 2023-12-16T07:40:16.688 INFO:tasks.workunit.client.0.smithi049.stdout:4/104: dwrite d2/f9 [0,4194304] 0 2023-12-16T07:40:16.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/126: mkdir d2/d26 0 2023-12-16T07:40:16.689 INFO:tasks.workunit.client.0.smithi049.stdout:3/103: creat d1/f1f x:0 0 0 2023-12-16T07:40:16.689 INFO:tasks.workunit.client.0.smithi049.stdout:3/104: stat d1/fe 0 2023-12-16T07:40:16.691 INFO:tasks.workunit.client.0.smithi049.stdout:8/111: dwrite d0/f4 [0,4194304] 0 2023-12-16T07:40:16.691 INFO:tasks.workunit.client.0.smithi049.stdout:8/112: stat d0/d13/d10/l16 0 2023-12-16T07:40:16.691 INFO:tasks.workunit.client.0.smithi049.stdout:8/113: write d0/d13/d10/f1a [749526,46072] 0 2023-12-16T07:40:16.691 INFO:tasks.workunit.client.0.smithi049.stdout:8/114: dread - d0/d13/d10/f18 zero size 2023-12-16T07:40:16.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/105: fdatasync d2/db/dd/fa 0 2023-12-16T07:40:16.691 INFO:tasks.workunit.client.0.smithi049.stdout:8/115: chown d0/d13/fe 1687299 1 2023-12-16T07:40:16.692 INFO:tasks.workunit.client.0.smithi049.stdout:4/106: dread f1 [0,4194304] 0 2023-12-16T07:40:16.693 INFO:tasks.workunit.client.0.smithi049.stdout:4/107: dread f1 [0,4194304] 0 2023-12-16T07:40:16.694 INFO:tasks.workunit.client.0.smithi049.stdout:4/108: write d2/db/dd/de/d1e/d21/f25 [559160,46697] 0 2023-12-16T07:40:16.702 INFO:tasks.workunit.client.0.smithi049.stdout:2/127: symlink d2/l27 0 2023-12-16T07:40:16.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/116: creat d0/f1d x:0 0 0 2023-12-16T07:40:16.702 INFO:tasks.workunit.client.0.smithi049.stdout:2/128: write d2/f17 [2503221,121657] 0 2023-12-16T07:40:16.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/109: fsync d2/db/dd/de/d1e/d21/f25 0 2023-12-16T07:40:16.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/110: chown d2 1 1 2023-12-16T07:40:16.704 INFO:tasks.workunit.client.0.smithi049.stdout:7/81: dwrite d7/f11 [0,4194304] 0 2023-12-16T07:40:16.704 INFO:tasks.workunit.client.0.smithi049.stdout:7/82: chown d7/dc/c1a 272182 1 2023-12-16T07:40:16.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/60: dwrite f9 [0,4194304] 0 2023-12-16T07:40:16.706 INFO:tasks.workunit.client.0.smithi049.stdout:8/117: link d0/l7 d0/d13/d10/d1c/l1e 0 2023-12-16T07:40:16.706 INFO:tasks.workunit.client.0.smithi049.stdout:8/118: write d0/d13/d10/f1a [1333604,14279] 0 2023-12-16T07:40:16.707 INFO:tasks.workunit.client.0.smithi049.stdout:2/129: mkdir d2/d1d/d28 0 2023-12-16T07:40:16.707 INFO:tasks.workunit.client.0.smithi049.stdout:2/130: fsync d2/f12 0 2023-12-16T07:40:16.707 INFO:tasks.workunit.client.0.smithi049.stdout:2/131: fdatasync d2/f9 0 2023-12-16T07:40:16.708 INFO:tasks.workunit.client.0.smithi049.stdout:1/61: dread fa [0,4194304] 0 2023-12-16T07:40:16.709 INFO:tasks.workunit.client.0.smithi049.stdout:0/201: sync 2023-12-16T07:40:16.711 INFO:tasks.workunit.client.0.smithi049.stdout:9/123: sync 2023-12-16T07:40:16.712 INFO:tasks.workunit.client.0.smithi049.stdout:4/111: mknod d2/db/dd/c27 0 2023-12-16T07:40:16.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/83: creat d7/dc/f1b x:0 0 0 2023-12-16T07:40:16.714 INFO:tasks.workunit.client.0.smithi049.stdout:7/84: read d7/fa [199508,34442] 0 2023-12-16T07:40:16.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/62: symlink l13 0 2023-12-16T07:40:16.718 INFO:tasks.workunit.client.0.smithi049.stdout:2/132: dwrite d2/f22 [0,4194304] 0 2023-12-16T07:40:16.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/124: mknod d4/c28 0 2023-12-16T07:40:16.721 INFO:tasks.workunit.client.0.smithi049.stdout:4/112: creat d2/f28 x:0 0 0 2023-12-16T07:40:16.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/85: symlink d7/dc/dd/l1c 0 2023-12-16T07:40:16.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/86: stat l3 0 2023-12-16T07:40:16.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/87: write f6 [112704,51463] 0 2023-12-16T07:40:16.724 INFO:tasks.workunit.client.0.smithi049.stdout:1/63: creat f14 x:0 0 0 2023-12-16T07:40:16.726 INFO:tasks.workunit.client.0.smithi049.stdout:9/125: dread d4/d7/d11/f14 [0,4194304] 0 2023-12-16T07:40:16.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/133: creat d2/d1d/f29 x:0 0 0 2023-12-16T07:40:16.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/134: write d2/f12 [2483553,44358] 0 2023-12-16T07:40:16.729 INFO:tasks.workunit.client.0.smithi049.stdout:7/88: link d7/fa d7/dc/f1d 0 2023-12-16T07:40:16.729 INFO:tasks.workunit.client.0.smithi049.stdout:7/89: chown d7/f11 17206680 1 2023-12-16T07:40:16.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/64: unlink f9 0 2023-12-16T07:40:16.732 INFO:tasks.workunit.client.0.smithi049.stdout:9/126: dread d4/db/f22 [0,4194304] 0 2023-12-16T07:40:16.732 INFO:tasks.workunit.client.0.smithi049.stdout:9/127: fsync d4/ff 0 2023-12-16T07:40:16.734 INFO:tasks.workunit.client.0.smithi049.stdout:3/105: getdents d1 0 2023-12-16T07:40:16.737 INFO:tasks.workunit.client.0.smithi049.stdout:2/135: dread d2/de/f1b [0,4194304] 0 2023-12-16T07:40:16.738 INFO:tasks.workunit.client.0.smithi049.stdout:2/136: dread d2/f9 [0,4194304] 0 2023-12-16T07:40:16.739 INFO:tasks.workunit.client.0.smithi049.stdout:8/119: rename d0/d13/d10 to d0/d1f 0 2023-12-16T07:40:16.739 INFO:tasks.workunit.client.0.smithi049.stdout:8/120: chown d0/c8 2613126 1 2023-12-16T07:40:16.739 INFO:tasks.workunit.client.0.smithi049.stdout:8/121: stat d0/d13 0 2023-12-16T07:40:16.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/65: creat f15 x:0 0 0 2023-12-16T07:40:16.740 INFO:tasks.workunit.client.0.smithi049.stdout:3/106: unlink d1/f12 0 2023-12-16T07:40:16.742 INFO:tasks.workunit.client.0.smithi049.stdout:2/137: mknod d2/de/c2a 0 2023-12-16T07:40:16.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/202: rename d13/d39/c3e to d13/d21/c47 0 2023-12-16T07:40:16.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/203: fdatasync d13/d15/f1a 0 2023-12-16T07:40:16.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/204: chown d13/d21/d2f 52685234 1 2023-12-16T07:40:16.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/205: fsync d13/d39/f3b 0 2023-12-16T07:40:16.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/66: symlink l16 0 2023-12-16T07:40:16.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/122: rename d0/l6 to d0/d13/l20 0 2023-12-16T07:40:16.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/123: dread - d0/f1d zero size 2023-12-16T07:40:16.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/67: symlink l17 0 2023-12-16T07:40:16.749 INFO:tasks.workunit.client.0.smithi049.stdout:2/138: rename d2/f9 to d2/d1d/d28/f2b 0 2023-12-16T07:40:16.749 INFO:tasks.workunit.client.0.smithi049.stdout:1/68: creat f18 x:0 0 0 2023-12-16T07:40:16.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/69: write f5 [4388617,94930] 0 2023-12-16T07:40:16.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/70: chown f2 1114 1 2023-12-16T07:40:16.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/71: chown c4 3024939 1 2023-12-16T07:40:16.752 INFO:tasks.workunit.client.0.smithi049.stdout:1/72: chown f6 4305 1 2023-12-16T07:40:16.752 INFO:tasks.workunit.client.0.smithi049.stdout:3/107: rename d1/cd to d1/c20 0 2023-12-16T07:40:16.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/206: rename d13/d3c/c3f to d13/d21/c48 0 2023-12-16T07:40:16.754 INFO:tasks.workunit.client.0.smithi049.stdout:2/139: creat d2/d7/d11/f2c x:0 0 0 2023-12-16T07:40:16.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/113: getdents d2 0 2023-12-16T07:40:16.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/114: chown d2/c24 7047 1 2023-12-16T07:40:16.756 INFO:tasks.workunit.client.0.smithi049.stdout:2/140: write d2/de/f1b [2572009,71180] 0 2023-12-16T07:40:16.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/73: creat f19 x:0 0 0 2023-12-16T07:40:16.760 INFO:tasks.workunit.client.0.smithi049.stdout:0/207: mknod d13/d39/c49 0 2023-12-16T07:40:16.761 INFO:tasks.workunit.client.0.smithi049.stdout:7/90: fsync d7/dc/f1d 0 2023-12-16T07:40:16.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/108: symlink d1/l21 0 2023-12-16T07:40:16.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/124: dwrite d0/d13/fd [0,4194304] 0 2023-12-16T07:40:16.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/125: write d0/d1f/f17 [761654,17582] 0 2023-12-16T07:40:16.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/126: write d0/f12 [1315294,114918] 0 2023-12-16T07:40:16.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/127: fdatasync d0/f1d 0 2023-12-16T07:40:16.764 INFO:tasks.workunit.client.0.smithi049.stdout:1/74: mknod c1a 0 2023-12-16T07:40:16.769 INFO:tasks.workunit.client.0.smithi049.stdout:3/109: fdatasync d1/f1b 0 2023-12-16T07:40:16.769 INFO:tasks.workunit.client.0.smithi049.stdout:0/208: getdents d13/d39/d38 0 2023-12-16T07:40:16.770 INFO:tasks.workunit.client.0.smithi049.stdout:6/99: sync 2023-12-16T07:40:16.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/63: sync 2023-12-16T07:40:16.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/64: fdatasync d5/f9 0 2023-12-16T07:40:16.775 INFO:tasks.workunit.client.0.smithi049.stdout:4/115: dwrite d2/f9 [4194304,4194304] 0 2023-12-16T07:40:16.775 INFO:tasks.workunit.client.0.smithi049.stdout:4/116: chown d2/ff 12971289 1 2023-12-16T07:40:16.775 INFO:tasks.workunit.client.0.smithi049.stdout:4/117: stat d2/d16/f20 0 2023-12-16T07:40:16.775 INFO:tasks.workunit.client.0.smithi049.stdout:0/209: rename d13/l24 to d13/d3c/l4a 0 2023-12-16T07:40:16.775 INFO:tasks.workunit.client.0.smithi049.stdout:0/210: dread - d13/d15/f1f zero size 2023-12-16T07:40:16.776 INFO:tasks.workunit.client.0.smithi049.stdout:6/100: creat d0/d2/dd/f1d x:0 0 0 2023-12-16T07:40:16.778 INFO:tasks.workunit.client.0.smithi049.stdout:5/65: creat d5/f13 x:0 0 0 2023-12-16T07:40:16.778 INFO:tasks.workunit.client.0.smithi049.stdout:6/101: write d0/d2/f9 [2991800,109591] 0 2023-12-16T07:40:16.779 INFO:tasks.workunit.client.0.smithi049.stdout:3/110: mknod d1/c22 0 2023-12-16T07:40:16.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/91: dwrite d7/dc/f1d [0,4194304] 0 2023-12-16T07:40:16.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/118: mknod d2/d16/c29 0 2023-12-16T07:40:16.785 INFO:tasks.workunit.client.0.smithi049.stdout:0/211: link d13/d15/c33 d13/d3c/c4b 0 2023-12-16T07:40:16.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/66: link f3 d5/de/f14 0 2023-12-16T07:40:16.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/67: chown d5/lc 1861 1 2023-12-16T07:40:16.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/141: dwrite d2/d1d/f29 [0,4194304] 0 2023-12-16T07:40:16.788 INFO:tasks.workunit.client.0.smithi049.stdout:2/142: dread d2/f19 [0,4194304] 0 2023-12-16T07:40:16.790 INFO:tasks.workunit.client.0.smithi049.stdout:2/143: write d2/f12 [565404,108605] 0 2023-12-16T07:40:16.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/75: dwrite f6 [0,4194304] 0 2023-12-16T07:40:16.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/76: rmdir - no directory 2023-12-16T07:40:16.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/68: dread d5/f8 [0,4194304] 0 2023-12-16T07:40:16.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/69: chown f3 547367 1 2023-12-16T07:40:16.791 INFO:tasks.workunit.client.0.smithi049.stdout:6/102: symlink d0/d2/dd/l1e 0 2023-12-16T07:40:16.795 INFO:tasks.workunit.client.0.smithi049.stdout:7/92: link f5 d7/dc/dd/f1e 0 2023-12-16T07:40:16.795 INFO:tasks.workunit.client.0.smithi049.stdout:7/93: stat d7/dc/dd/f1e 0 2023-12-16T07:40:16.797 INFO:tasks.workunit.client.0.smithi049.stdout:2/144: symlink d2/d1d/d28/l2d 0 2023-12-16T07:40:16.803 INFO:tasks.workunit.client.0.smithi049.stdout:5/70: creat d5/f15 x:0 0 0 2023-12-16T07:40:16.803 INFO:tasks.workunit.client.0.smithi049.stdout:6/103: truncate d0/d2/f5 219745 0 2023-12-16T07:40:16.804 INFO:tasks.workunit.client.0.smithi049.stdout:6/104: stat d0/d2/df/c13 0 2023-12-16T07:40:16.805 INFO:tasks.workunit.client.0.smithi049.stdout:7/94: creat d7/f1f x:0 0 0 2023-12-16T07:40:16.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/119: dwrite d2/f9 [8388608,4194304] 0 2023-12-16T07:40:16.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/120: stat d2/db/dd/c1f 0 2023-12-16T07:40:16.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/121: fsync d2/db/dd/de/d1e/d21/f25 0 2023-12-16T07:40:16.806 INFO:tasks.workunit.client.0.smithi049.stdout:1/77: truncate f5 2735355 0 2023-12-16T07:40:16.806 INFO:tasks.workunit.client.0.smithi049.stdout:1/78: readlink l16 0 2023-12-16T07:40:16.806 INFO:tasks.workunit.client.0.smithi049.stdout:1/79: stat fa 0 2023-12-16T07:40:16.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/71: rename d5/fd to d5/de/f16 0 2023-12-16T07:40:16.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/72: chown d5/de/f16 630933215 1 2023-12-16T07:40:16.811 INFO:tasks.workunit.client.0.smithi049.stdout:6/105: dread d0/d2/dd/f15 [0,4194304] 0 2023-12-16T07:40:16.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/80: creat f1b x:0 0 0 2023-12-16T07:40:16.816 INFO:tasks.workunit.client.0.smithi049.stdout:4/122: rename d2/d16 to d2/db/dd/d2a 0 2023-12-16T07:40:16.822 INFO:tasks.workunit.client.0.smithi049.stdout:6/106: creat d0/d2/dd/f1f x:0 0 0 2023-12-16T07:40:16.822 INFO:tasks.workunit.client.0.smithi049.stdout:0/212: dwrite d13/f1c [0,4194304] 0 2023-12-16T07:40:16.822 INFO:tasks.workunit.client.0.smithi049.stdout:4/123: truncate f1 959021 0 2023-12-16T07:40:16.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/124: write d2/db/dd/d2a/f26 [795356,88284] 0 2023-12-16T07:40:16.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/213: truncate f4 541729 0 2023-12-16T07:40:16.826 INFO:tasks.workunit.client.0.smithi049.stdout:4/125: unlink d2/c23 0 2023-12-16T07:40:16.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/214: creat d13/d3c/f4c x:0 0 0 2023-12-16T07:40:16.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/215: dread - d13/f40 zero size 2023-12-16T07:40:16.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/81: truncate f6 869896 0 2023-12-16T07:40:16.832 INFO:tasks.workunit.client.0.smithi049.stdout:1/82: rename f10 to f1c 0 2023-12-16T07:40:16.833 INFO:tasks.workunit.client.0.smithi049.stdout:0/216: dread d13/d21/f42 [0,4194304] 0 2023-12-16T07:40:16.834 INFO:tasks.workunit.client.0.smithi049.stdout:2/145: dwrite d2/f22 [4194304,4194304] 0 2023-12-16T07:40:16.834 INFO:tasks.workunit.client.0.smithi049.stdout:7/95: dwrite d7/fa [0,4194304] 0 2023-12-16T07:40:16.835 INFO:tasks.workunit.client.0.smithi049.stdout:7/96: write d7/fb [738592,84588] 0 2023-12-16T07:40:16.835 INFO:tasks.workunit.client.0.smithi049.stdout:7/97: getdents d7/dc/dd/d14 0 2023-12-16T07:40:16.835 INFO:tasks.workunit.client.0.smithi049.stdout:7/98: truncate d7/dc/dd/f1e 1004887 0 2023-12-16T07:40:16.835 INFO:tasks.workunit.client.0.smithi049.stdout:7/99: readlink d7/dc/dd/l1c 0 2023-12-16T07:40:16.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/100: write d7/dc/dd/ff [530968,101344] 0 2023-12-16T07:40:16.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/101: stat d7/dc/dd/le 0 2023-12-16T07:40:16.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/102: write f5 [1711718,2481] 0 2023-12-16T07:40:16.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/103: write d7/f1f [275493,54834] 0 2023-12-16T07:40:16.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/217: creat d13/d21/d27/f4d x:0 0 0 2023-12-16T07:40:16.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/104: write f4 [952608,7205] 0 2023-12-16T07:40:16.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/73: dwrite d5/de/f16 [0,4194304] 0 2023-12-16T07:40:16.840 INFO:tasks.workunit.client.0.smithi049.stdout:2/146: creat d2/d1d/d24/f2e x:0 0 0 2023-12-16T07:40:16.840 INFO:tasks.workunit.client.0.smithi049.stdout:2/147: chown d2/f19 80237 1 2023-12-16T07:40:16.841 INFO:tasks.workunit.client.0.smithi049.stdout:5/74: write d5/fb [296525,102513] 0 2023-12-16T07:40:16.841 INFO:tasks.workunit.client.0.smithi049.stdout:5/75: chown d5/f9 0 1 2023-12-16T07:40:16.842 INFO:tasks.workunit.client.0.smithi049.stdout:2/148: write d2/de/f1b [525242,119256] 0 2023-12-16T07:40:16.847 INFO:tasks.workunit.client.0.smithi049.stdout:0/218: read fd [11625,73703] 0 2023-12-16T07:40:16.847 INFO:tasks.workunit.client.0.smithi049.stdout:0/219: chown d13/f20 325202 1 2023-12-16T07:40:16.847 INFO:tasks.workunit.client.0.smithi049.stdout:0/220: fdatasync fb 0 2023-12-16T07:40:16.849 INFO:tasks.workunit.client.0.smithi049.stdout:7/105: unlink d7/f1f 0 2023-12-16T07:40:16.850 INFO:tasks.workunit.client.0.smithi049.stdout:2/149: dread d2/f17 [0,4194304] 0 2023-12-16T07:40:16.850 INFO:tasks.workunit.client.0.smithi049.stdout:1/83: rename f5 to f1d 0 2023-12-16T07:40:16.854 INFO:tasks.workunit.client.0.smithi049.stdout:6/107: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:16.854 INFO:tasks.workunit.client.0.smithi049.stdout:6/108: truncate d0/d2/f8 2212525 0 2023-12-16T07:40:16.860 INFO:tasks.workunit.client.0.smithi049.stdout:0/221: mknod d13/d21/d2f/c4e 0 2023-12-16T07:40:16.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/106: mknod d7/dc/dd/c20 0 2023-12-16T07:40:16.863 INFO:tasks.workunit.client.0.smithi049.stdout:2/150: creat d2/d1d/d28/f2f x:0 0 0 2023-12-16T07:40:16.863 INFO:tasks.workunit.client.0.smithi049.stdout:2/151: chown d2/d1d/d28/f2b 237686 1 2023-12-16T07:40:16.863 INFO:tasks.workunit.client.0.smithi049.stdout:2/152: write d2/d1d/d28/f2b [326105,36417] 0 2023-12-16T07:40:16.863 INFO:tasks.workunit.client.0.smithi049.stdout:2/153: write d2/d7/d11/f25 [831779,20950] 0 2023-12-16T07:40:16.863 INFO:tasks.workunit.client.0.smithi049.stdout:2/154: chown d2/ff 0 1 2023-12-16T07:40:16.864 INFO:tasks.workunit.client.0.smithi049.stdout:1/84: symlink l1e 0 2023-12-16T07:40:16.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/109: rename d0/l1a to d0/d2/dd/l20 0 2023-12-16T07:40:16.867 INFO:tasks.workunit.client.0.smithi049.stdout:0/222: mknod d13/d21/d27/d2c/c4f 0 2023-12-16T07:40:16.868 INFO:tasks.workunit.client.0.smithi049.stdout:7/107: mknod d7/dc/c21 0 2023-12-16T07:40:16.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/85: dread fe [0,4194304] 0 2023-12-16T07:40:16.871 INFO:tasks.workunit.client.0.smithi049.stdout:2/155: creat d2/d26/f30 x:0 0 0 2023-12-16T07:40:16.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/110: symlink d0/d2/dd/l21 0 2023-12-16T07:40:16.873 INFO:tasks.workunit.client.0.smithi049.stdout:0/223: creat d13/d21/d2f/f50 x:0 0 0 2023-12-16T07:40:16.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/128: sync 2023-12-16T07:40:16.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/156: dread d2/ff [0,4194304] 0 2023-12-16T07:40:16.880 INFO:tasks.workunit.client.0.smithi049.stdout:7/108: creat d7/dc/dd/d14/f22 x:0 0 0 2023-12-16T07:40:16.881 INFO:tasks.workunit.client.0.smithi049.stdout:1/86: creat f1f x:0 0 0 2023-12-16T07:40:16.881 INFO:tasks.workunit.client.0.smithi049.stdout:1/87: fdatasync f18 0 2023-12-16T07:40:16.881 INFO:tasks.workunit.client.0.smithi049.stdout:6/111: mkdir d0/d22 0 2023-12-16T07:40:16.882 INFO:tasks.workunit.client.0.smithi049.stdout:2/157: mkdir d2/d26/d31 0 2023-12-16T07:40:16.883 INFO:tasks.workunit.client.0.smithi049.stdout:7/109: symlink d7/dc/d15/l23 0 2023-12-16T07:40:16.883 INFO:tasks.workunit.client.0.smithi049.stdout:7/110: truncate f6 872931 0 2023-12-16T07:40:16.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/129: dwrite d4/d7/d11/f14 [0,4194304] 0 2023-12-16T07:40:16.891 INFO:tasks.workunit.client.0.smithi049.stdout:9/130: write d4/ff [7794039,79977] 0 2023-12-16T07:40:16.891 INFO:tasks.workunit.client.0.smithi049.stdout:9/131: chown d4/fd 3472 1 2023-12-16T07:40:16.892 INFO:tasks.workunit.client.0.smithi049.stdout:2/158: write d2/de/f1b [2346517,122881] 0 2023-12-16T07:40:16.892 INFO:tasks.workunit.client.0.smithi049.stdout:8/128: sync 2023-12-16T07:40:16.893 INFO:tasks.workunit.client.0.smithi049.stdout:6/112: rmdir d0/d2/dd 39 2023-12-16T07:40:16.893 INFO:tasks.workunit.client.0.smithi049.stdout:6/113: fsync d0/f1b 0 2023-12-16T07:40:16.893 INFO:tasks.workunit.client.0.smithi049.stdout:6/114: chown d0/d2/dd/l21 13138 1 2023-12-16T07:40:16.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/88: getdents . 0 2023-12-16T07:40:16.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/89: fdatasync f6 0 2023-12-16T07:40:16.897 INFO:tasks.workunit.client.0.smithi049.stdout:1/90: readlink l13 0 2023-12-16T07:40:16.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/132: mknod d4/d7/d11/c29 0 2023-12-16T07:40:16.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/91: mkdir d20 0 2023-12-16T07:40:16.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/92: read - f1f zero size 2023-12-16T07:40:16.900 INFO:tasks.workunit.client.0.smithi049.stdout:9/133: creat d4/db/f2a x:0 0 0 2023-12-16T07:40:16.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/93: truncate f1d 2159784 0 2023-12-16T07:40:16.901 INFO:tasks.workunit.client.0.smithi049.stdout:8/129: dread d0/f19 [0,4194304] 0 2023-12-16T07:40:16.902 INFO:tasks.workunit.client.0.smithi049.stdout:9/134: link d4/d7/cc d4/d7/d11/d1d/c2b 0 2023-12-16T07:40:16.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/94: creat d20/f21 x:0 0 0 2023-12-16T07:40:16.906 INFO:tasks.workunit.client.0.smithi049.stdout:8/130: symlink d0/d1f/d1c/l21 0 2023-12-16T07:40:16.907 INFO:tasks.workunit.client.0.smithi049.stdout:0/224: dwrite d13/d21/d27/d2c/f41 [0,4194304] 0 2023-12-16T07:40:16.911 INFO:tasks.workunit.client.0.smithi049.stdout:9/135: symlink d4/l2c 0 2023-12-16T07:40:16.911 INFO:tasks.workunit.client.0.smithi049.stdout:9/136: stat d4/d7/d11/f14 0 2023-12-16T07:40:16.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/131: creat d0/d1f/f22 x:0 0 0 2023-12-16T07:40:16.913 INFO:tasks.workunit.client.0.smithi049.stdout:9/137: symlink d4/db/l2d 0 2023-12-16T07:40:16.915 INFO:tasks.workunit.client.0.smithi049.stdout:8/132: rmdir d0/d13 39 2023-12-16T07:40:16.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/111: dwrite f2 [0,4194304] 0 2023-12-16T07:40:16.917 INFO:tasks.workunit.client.0.smithi049.stdout:2/159: dwrite d2/d7/d11/f1e [0,4194304] 0 2023-12-16T07:40:16.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/138: mknod d4/d7/d11/d26/c2e 0 2023-12-16T07:40:16.918 INFO:tasks.workunit.client.0.smithi049.stdout:6/115: dwrite d0/d2/dd/f1d [0,4194304] 0 2023-12-16T07:40:16.919 INFO:tasks.workunit.client.0.smithi049.stdout:7/112: symlink d7/l24 0 2023-12-16T07:40:16.919 INFO:tasks.workunit.client.0.smithi049.stdout:7/113: readlink d7/dc/dd/l1c 0 2023-12-16T07:40:16.922 INFO:tasks.workunit.client.0.smithi049.stdout:1/95: write f1d [1048929,110142] 0 2023-12-16T07:40:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:6/116: creat d0/f23 x:0 0 0 2023-12-16T07:40:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:6/117: read - d0/d2/dd/f12 zero size 2023-12-16T07:40:16.928 INFO:tasks.workunit.client.0.smithi049.stdout:6/118: chown d0/d2/dd/l16 3 1 2023-12-16T07:40:16.931 INFO:tasks.workunit.client.0.smithi049.stdout:0/225: dwrite f4 [0,4194304] 0 2023-12-16T07:40:16.932 INFO:tasks.workunit.client.0.smithi049.stdout:1/96: rmdir d20 39 2023-12-16T07:40:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:0/226: dread d13/d21/f42 [0,4194304] 0 2023-12-16T07:40:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:6/119: creat d0/d2/df/f24 x:0 0 0 2023-12-16T07:40:16.934 INFO:tasks.workunit.client.0.smithi049.stdout:6/120: dread - d0/d2/df/f24 zero size 2023-12-16T07:40:16.935 INFO:tasks.workunit.client.0.smithi049.stdout:9/139: rmdir d4 39 2023-12-16T07:40:16.935 INFO:tasks.workunit.client.0.smithi049.stdout:0/227: write f0 [3069294,80711] 0 2023-12-16T07:40:16.936 INFO:tasks.workunit.client.0.smithi049.stdout:2/160: dwrite d2/d1d/d28/f2f [0,4194304] 0 2023-12-16T07:40:16.937 INFO:tasks.workunit.client.0.smithi049.stdout:7/114: getdents d7 0 2023-12-16T07:40:16.937 INFO:tasks.workunit.client.0.smithi049.stdout:7/115: stat d7/dc/c21 0 2023-12-16T07:40:16.939 INFO:tasks.workunit.client.0.smithi049.stdout:1/97: creat d20/f22 x:0 0 0 2023-12-16T07:40:16.940 INFO:tasks.workunit.client.0.smithi049.stdout:1/98: truncate f18 742182 0 2023-12-16T07:40:16.940 INFO:tasks.workunit.client.0.smithi049.stdout:1/99: dread - f15 zero size 2023-12-16T07:40:16.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/121: rename d0/d2/dd/l20 to d0/l25 0 2023-12-16T07:40:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:6/122: chown d0/d2/df 0 1 2023-12-16T07:40:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:3/111: sync 2023-12-16T07:40:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/126: sync 2023-12-16T07:40:16.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/127: chown d2/db/dd/fa 10248649 1 2023-12-16T07:40:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:9/140: mknod d4/c2f 0 2023-12-16T07:40:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:9/141: chown f1 2620768 1 2023-12-16T07:40:16.943 INFO:tasks.workunit.client.0.smithi049.stdout:4/128: write d2/f12 [308572,102707] 0 2023-12-16T07:40:16.944 INFO:tasks.workunit.client.0.smithi049.stdout:4/129: rename d2/db to d2/db/dd/d2b 22 2023-12-16T07:40:16.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/123: dread d0/d2/f8 [0,4194304] 0 2023-12-16T07:40:16.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/228: symlink d13/d21/l51 0 2023-12-16T07:40:16.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/124: write d0/d2/f9 [275199,9048] 0 2023-12-16T07:40:16.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/130: read d2/db/dd/de/d1e/d21/f25 [23330,46982] 0 2023-12-16T07:40:16.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/116: creat d7/dc/f25 x:0 0 0 2023-12-16T07:40:16.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/76: sync 2023-12-16T07:40:16.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/100: mknod d20/c23 0 2023-12-16T07:40:16.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/101: chown f15 251 1 2023-12-16T07:40:16.947 INFO:tasks.workunit.client.0.smithi049.stdout:7/117: write d7/dc/f1d [2160800,80149] 0 2023-12-16T07:40:16.948 INFO:tasks.workunit.client.0.smithi049.stdout:3/112: chown d1/l8 174365046 1 2023-12-16T07:40:16.948 INFO:tasks.workunit.client.0.smithi049.stdout:9/142: mknod d4/d7/d11/d1d/c30 0 2023-12-16T07:40:16.949 INFO:tasks.workunit.client.0.smithi049.stdout:0/229: creat d13/d21/d2f/f52 x:0 0 0 2023-12-16T07:40:16.949 INFO:tasks.workunit.client.0.smithi049.stdout:0/230: write d13/d15/f19 [4678414,103049] 0 2023-12-16T07:40:16.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/125: link d0/d2/dd/f12 d0/d2/dd/f26 0 2023-12-16T07:40:16.952 INFO:tasks.workunit.client.0.smithi049.stdout:4/131: link d2/db/dd/de/d1e/c22 d2/c2c 0 2023-12-16T07:40:16.952 INFO:tasks.workunit.client.0.smithi049.stdout:4/132: write d2/db/dd/d2a/f26 [1239739,99125] 0 2023-12-16T07:40:16.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/161: dwrite d2/d1d/d28/f2b [0,4194304] 0 2023-12-16T07:40:16.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/162: dread - d2/d26/f30 zero size 2023-12-16T07:40:16.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/163: readlink d2/d7/l1a 0 2023-12-16T07:40:16.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/77: symlink d5/l17 0 2023-12-16T07:40:16.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/78: dread - d5/f13 zero size 2023-12-16T07:40:16.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/118: symlink d7/dc/dd/l26 0 2023-12-16T07:40:16.959 INFO:tasks.workunit.client.0.smithi049.stdout:9/143: truncate d4/db/f22 4865483 0 2023-12-16T07:40:16.962 INFO:tasks.workunit.client.0.smithi049.stdout:1/102: dwrite f6 [0,4194304] 0 2023-12-16T07:40:16.963 INFO:tasks.workunit.client.0.smithi049.stdout:0/231: mkdir d13/d39/d53 0 2023-12-16T07:40:16.963 INFO:tasks.workunit.client.0.smithi049.stdout:0/232: truncate d13/d15/f1f 97059 0 2023-12-16T07:40:16.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/164: rmdir d2/d26/d31 0 2023-12-16T07:40:16.967 INFO:tasks.workunit.client.0.smithi049.stdout:5/79: creat d5/f18 x:0 0 0 2023-12-16T07:40:16.967 INFO:tasks.workunit.client.0.smithi049.stdout:7/119: mkdir d7/dc/dd/d27 0 2023-12-16T07:40:16.968 INFO:tasks.workunit.client.0.smithi049.stdout:3/113: link d1/l21 d1/l23 0 2023-12-16T07:40:16.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/233: truncate d13/f1b 1163231 0 2023-12-16T07:40:16.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/234: fsync d13/d21/d27/d2c/f41 0 2023-12-16T07:40:16.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/235: fsync d13/d15/f1a 0 2023-12-16T07:40:16.972 INFO:tasks.workunit.client.0.smithi049.stdout:2/165: symlink d2/d1d/d24/l32 0 2023-12-16T07:40:16.973 INFO:tasks.workunit.client.0.smithi049.stdout:7/120: mknod d7/dc/c28 0 2023-12-16T07:40:16.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/80: creat d5/f19 x:0 0 0 2023-12-16T07:40:16.977 INFO:tasks.workunit.client.0.smithi049.stdout:3/114: write d1/f1f [292157,128222] 0 2023-12-16T07:40:16.979 INFO:tasks.workunit.client.0.smithi049.stdout:2/166: dread d2/d7/d11/f1e [0,4194304] 0 2023-12-16T07:40:16.979 INFO:tasks.workunit.client.0.smithi049.stdout:2/167: chown d2/d7/d11/f1e 71 1 2023-12-16T07:40:16.979 INFO:tasks.workunit.client.0.smithi049.stdout:2/168: truncate d2/d7/d11/f2c 485339 0 2023-12-16T07:40:16.979 INFO:tasks.workunit.client.0.smithi049.stdout:2/169: readlink d2/d1d/d24/l32 0 2023-12-16T07:40:16.980 INFO:tasks.workunit.client.0.smithi049.stdout:5/81: mknod d5/de/c1a 0 2023-12-16T07:40:16.983 INFO:tasks.workunit.client.0.smithi049.stdout:3/115: fdatasync d1/fc 0 2023-12-16T07:40:16.985 INFO:tasks.workunit.client.0.smithi049.stdout:2/170: creat d2/d1d/d24/f33 x:0 0 0 2023-12-16T07:40:16.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/82: mknod d5/de/c1b 0 2023-12-16T07:40:16.987 INFO:tasks.workunit.client.0.smithi049.stdout:5/83: dread - d5/f19 zero size 2023-12-16T07:40:16.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/171: unlink d2/de/c2a 0 2023-12-16T07:40:16.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/84: mkdir d5/de/d1c 0 2023-12-16T07:40:16.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/85: fdatasync d5/f9 0 2023-12-16T07:40:16.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/86: stat d5/lc 0 2023-12-16T07:40:16.991 INFO:tasks.workunit.client.0.smithi049.stdout:3/116: write d1/fa [3193962,3843] 0 2023-12-16T07:40:16.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/87: truncate d5/de/f16 3655051 0 2023-12-16T07:40:16.994 INFO:tasks.workunit.client.0.smithi049.stdout:5/88: link d5/f11 d5/de/f1d 0 2023-12-16T07:40:16.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/89: mkdir d5/d1e 0 2023-12-16T07:40:16.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/90: chown d5/d1e 6 1 2023-12-16T07:40:16.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/91: dread - d5/f11 zero size 2023-12-16T07:40:16.996 INFO:tasks.workunit.client.0.smithi049.stdout:3/117: rename d1/fe to d1/f24 0 2023-12-16T07:40:16.997 INFO:tasks.workunit.client.0.smithi049.stdout:3/118: creat d1/f25 x:0 0 0 2023-12-16T07:40:16.998 INFO:tasks.workunit.client.0.smithi049.stdout:4/133: dwrite d2/ff [4194304,4194304] 0 2023-12-16T07:40:16.999 INFO:tasks.workunit.client.0.smithi049.stdout:6/126: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:17.000 INFO:tasks.workunit.client.0.smithi049.stdout:0/236: dwrite d13/f20 [0,4194304] 0 2023-12-16T07:40:17.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/103: dwrite f2 [4194304,4194304] 0 2023-12-16T07:40:17.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/104: write f1c [591345,21264] 0 2023-12-16T07:40:17.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/105: chown f19 38617 1 2023-12-16T07:40:17.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/106: truncate f1b 354503 0 2023-12-16T07:40:17.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/127: mkdir d0/d2/dd/d27 0 2023-12-16T07:40:17.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/128: write d0/d2/dd/f1f [527043,43246] 0 2023-12-16T07:40:17.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/129: stat d0/d2/dd/f1f 0 2023-12-16T07:40:17.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/130: rename d0/d2/df to d0/d2/df/d28 22 2023-12-16T07:40:17.021 INFO:tasks.workunit.client.0.smithi049.stdout:1/107: symlink d20/l24 0 2023-12-16T07:40:17.027 INFO:tasks.workunit.client.0.smithi049.stdout:6/131: truncate d0/d2/f5 2449617 0 2023-12-16T07:40:17.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/132: creat d0/d22/f29 x:0 0 0 2023-12-16T07:40:17.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/133: dread - d0/d2/dd/f26 zero size 2023-12-16T07:40:17.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/134: unlink d0/d2/df/l18 0 2023-12-16T07:40:17.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/135: symlink d0/d2/l2a 0 2023-12-16T07:40:17.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/172: getdents d2/d1d/d24 0 2023-12-16T07:40:17.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/136: creat d0/d22/f2b x:0 0 0 2023-12-16T07:40:17.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/92: dwrite d5/f19 [0,4194304] 0 2023-12-16T07:40:17.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/108: dread ff [0,4194304] 0 2023-12-16T07:40:17.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/93: chown d5/f9 21359 1 2023-12-16T07:40:17.035 INFO:tasks.workunit.client.0.smithi049.stdout:2/173: rename d2/l6 to d2/l34 0 2023-12-16T07:40:17.036 INFO:tasks.workunit.client.0.smithi049.stdout:6/137: mkdir d0/d22/d2c 0 2023-12-16T07:40:17.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/174: write d2/f17 [1877235,76342] 0 2023-12-16T07:40:17.037 INFO:tasks.workunit.client.0.smithi049.stdout:1/109: mknod d20/c25 0 2023-12-16T07:40:17.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/94: mknod d5/c1f 0 2023-12-16T07:40:17.039 INFO:tasks.workunit.client.0.smithi049.stdout:5/95: write f3 [386081,13209] 0 2023-12-16T07:40:17.039 INFO:tasks.workunit.client.0.smithi049.stdout:2/175: dread d2/d7/fb [0,4194304] 0 2023-12-16T07:40:17.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/110: read fe [540947,75250] 0 2023-12-16T07:40:17.042 INFO:tasks.workunit.client.0.smithi049.stdout:5/96: mkdir d5/d1e/d20 0 2023-12-16T07:40:17.042 INFO:tasks.workunit.client.0.smithi049.stdout:2/176: rename d2/de/l18 to d2/d7/d11/d1c/l35 0 2023-12-16T07:40:17.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/119: dwrite d1/fc [0,4194304] 0 2023-12-16T07:40:17.043 INFO:tasks.workunit.client.0.smithi049.stdout:0/237: dwrite d13/d21/d2f/f52 [0,4194304] 0 2023-12-16T07:40:17.044 INFO:tasks.workunit.client.0.smithi049.stdout:5/97: mkdir d5/d1e/d21 0 2023-12-16T07:40:17.044 INFO:tasks.workunit.client.0.smithi049.stdout:4/134: dwrite d2/ff [4194304,4194304] 0 2023-12-16T07:40:17.044 INFO:tasks.workunit.client.0.smithi049.stdout:4/135: chown d2 18156 1 2023-12-16T07:40:17.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/177: creat d2/f36 x:0 0 0 2023-12-16T07:40:17.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/178: chown d2/f22 448958 1 2023-12-16T07:40:17.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/238: creat d13/d39/d38/f54 x:0 0 0 2023-12-16T07:40:17.051 INFO:tasks.workunit.client.0.smithi049.stdout:5/98: mknod d5/de/c22 0 2023-12-16T07:40:17.054 INFO:tasks.workunit.client.0.smithi049.stdout:8/133: sync 2023-12-16T07:40:17.054 INFO:tasks.workunit.client.0.smithi049.stdout:1/111: dwrite d20/f22 [0,4194304] 0 2023-12-16T07:40:17.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/239: dread d13/f17 [0,4194304] 0 2023-12-16T07:40:17.057 INFO:tasks.workunit.client.0.smithi049.stdout:2/179: mkdir d2/d37 0 2023-12-16T07:40:17.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/99: mknod d5/de/d1c/c23 0 2023-12-16T07:40:17.064 INFO:tasks.workunit.client.0.smithi049.stdout:8/134: rename d0/l11 to d0/d1f/d1c/l23 0 2023-12-16T07:40:17.065 INFO:tasks.workunit.client.0.smithi049.stdout:2/180: write d2/d1d/d28/f2b [2649382,18936] 0 2023-12-16T07:40:17.065 INFO:tasks.workunit.client.0.smithi049.stdout:2/181: readlink d2/l27 0 2023-12-16T07:40:17.066 INFO:tasks.workunit.client.0.smithi049.stdout:4/136: dwrite d2/f4 [0,4194304] 0 2023-12-16T07:40:17.066 INFO:tasks.workunit.client.0.smithi049.stdout:1/112: mknod d20/c26 0 2023-12-16T07:40:17.066 INFO:tasks.workunit.client.0.smithi049.stdout:4/137: write d2/f4 [2447032,28496] 0 2023-12-16T07:40:17.067 INFO:tasks.workunit.client.0.smithi049.stdout:2/182: write d2/d1d/d28/f2b [2336115,87942] 0 2023-12-16T07:40:17.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/240: truncate f0 1211223 0 2023-12-16T07:40:17.068 INFO:tasks.workunit.client.0.smithi049.stdout:6/138: rmdir d0/d22 39 2023-12-16T07:40:17.069 INFO:tasks.workunit.client.0.smithi049.stdout:5/100: mknod d5/d1e/d21/c24 0 2023-12-16T07:40:17.069 INFO:tasks.workunit.client.0.smithi049.stdout:5/101: stat d5/f8 0 2023-12-16T07:40:17.069 INFO:tasks.workunit.client.0.smithi049.stdout:5/102: stat d5/de/f16 0 2023-12-16T07:40:17.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/135: rename d0/l7 to d0/d13/l24 0 2023-12-16T07:40:17.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/136: fsync d0/f19 0 2023-12-16T07:40:17.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/137: write d0/d1f/f18 [626006,14073] 0 2023-12-16T07:40:17.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/241: dread d13/f17 [0,4194304] 0 2023-12-16T07:40:17.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/138: read d0/d1f/f1a [113860,49740] 0 2023-12-16T07:40:17.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/139: write d0/d1f/f1a [825357,97192] 0 2023-12-16T07:40:17.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/140: dread - d0/f1d zero size 2023-12-16T07:40:17.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/183: write d2/f19 [547724,116230] 0 2023-12-16T07:40:17.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/184: chown d2/d7/d11/d1c/l35 9635361 1 2023-12-16T07:40:17.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/185: readlink d2/d7/d11/l16 0 2023-12-16T07:40:17.074 INFO:tasks.workunit.client.0.smithi049.stdout:4/138: creat d2/db/dd/de/d1e/f2d x:0 0 0 2023-12-16T07:40:17.076 INFO:tasks.workunit.client.0.smithi049.stdout:8/141: dread d0/d1f/f1a [0,4194304] 0 2023-12-16T07:40:17.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/139: symlink d0/d22/d2c/l2d 0 2023-12-16T07:40:17.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/140: stat d0 0 2023-12-16T07:40:17.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/141: read - d0/d2/df/f24 zero size 2023-12-16T07:40:17.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/120: dwrite d1/ff [0,4194304] 0 2023-12-16T07:40:17.077 INFO:tasks.workunit.client.0.smithi049.stdout:5/103: truncate d5/f9 3662298 0 2023-12-16T07:40:17.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/242: creat d13/d21/d27/d2c/f55 x:0 0 0 2023-12-16T07:40:17.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/243: write f2 [1966262,118547] 0 2023-12-16T07:40:17.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/244: chown d13/d21/d27/d2c/f55 101 1 2023-12-16T07:40:17.082 INFO:tasks.workunit.client.0.smithi049.stdout:2/186: mkdir d2/d1d/d38 0 2023-12-16T07:40:17.082 INFO:tasks.workunit.client.0.smithi049.stdout:2/187: chown d2/l27 18348 1 2023-12-16T07:40:17.085 INFO:tasks.workunit.client.0.smithi049.stdout:8/142: creat d0/d13/f25 x:0 0 0 2023-12-16T07:40:17.085 INFO:tasks.workunit.client.0.smithi049.stdout:8/143: stat d0/d13/c14 0 2023-12-16T07:40:17.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/142: truncate d0/d2/f8 205197 0 2023-12-16T07:40:17.087 INFO:tasks.workunit.client.0.smithi049.stdout:6/143: write d0/d2/dd/f1d [2001795,109528] 0 2023-12-16T07:40:17.087 INFO:tasks.workunit.client.0.smithi049.stdout:1/113: dwrite fc [0,4194304] 0 2023-12-16T07:40:17.089 INFO:tasks.workunit.client.0.smithi049.stdout:0/245: getdents d13/d21/d2f 0 2023-12-16T07:40:17.093 INFO:tasks.workunit.client.0.smithi049.stdout:2/188: creat d2/d26/f39 x:0 0 0 2023-12-16T07:40:17.093 INFO:tasks.workunit.client.0.smithi049.stdout:7/121: sync 2023-12-16T07:40:17.093 INFO:tasks.workunit.client.0.smithi049.stdout:7/122: fsync d7/dc/f17 0 2023-12-16T07:40:17.093 INFO:tasks.workunit.client.0.smithi049.stdout:9/144: sync 2023-12-16T07:40:17.094 INFO:tasks.workunit.client.0.smithi049.stdout:3/121: write d1/f18 [1558666,106092] 0 2023-12-16T07:40:17.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/139: rename d2/l5 to d2/db/l2e 0 2023-12-16T07:40:17.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/104: dwrite d5/f15 [0,4194304] 0 2023-12-16T07:40:17.097 INFO:tasks.workunit.client.0.smithi049.stdout:8/144: creat d0/d1f/d1c/f26 x:0 0 0 2023-12-16T07:40:17.097 INFO:tasks.workunit.client.0.smithi049.stdout:9/145: dread d4/ff [0,4194304] 0 2023-12-16T07:40:17.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/144: link d0/d22/f2b d0/d2/df/f2e 0 2023-12-16T07:40:17.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/114: link fc d20/f27 0 2023-12-16T07:40:17.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/115: fsync f18 0 2023-12-16T07:40:17.102 INFO:tasks.workunit.client.0.smithi049.stdout:7/123: symlink d7/l29 0 2023-12-16T07:40:17.107 INFO:tasks.workunit.client.0.smithi049.stdout:3/122: rmdir d1 39 2023-12-16T07:40:17.107 INFO:tasks.workunit.client.0.smithi049.stdout:3/123: chown d1/fc 312160 1 2023-12-16T07:40:17.111 INFO:tasks.workunit.client.0.smithi049.stdout:5/105: creat d5/de/d1c/f25 x:0 0 0 2023-12-16T07:40:17.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/145: unlink d0/d1f/d1c/f26 0 2023-12-16T07:40:17.115 INFO:tasks.workunit.client.0.smithi049.stdout:9/146: truncate f3 549522 0 2023-12-16T07:40:17.118 INFO:tasks.workunit.client.0.smithi049.stdout:6/145: symlink d0/d2/l2f 0 2023-12-16T07:40:17.121 INFO:tasks.workunit.client.0.smithi049.stdout:3/124: dread d1/f18 [0,4194304] 0 2023-12-16T07:40:17.124 INFO:tasks.workunit.client.0.smithi049.stdout:7/124: creat d7/dc/dd/d14/f2a x:0 0 0 2023-12-16T07:40:17.125 INFO:tasks.workunit.client.0.smithi049.stdout:8/146: unlink d0/d13/c14 0 2023-12-16T07:40:17.127 INFO:tasks.workunit.client.0.smithi049.stdout:9/147: truncate d4/d7/d11/f20 74655 0 2023-12-16T07:40:17.128 INFO:tasks.workunit.client.0.smithi049.stdout:5/106: dwrite d5/f8 [0,4194304] 0 2023-12-16T07:40:17.129 INFO:tasks.workunit.client.0.smithi049.stdout:3/125: creat d1/f26 x:0 0 0 2023-12-16T07:40:17.130 INFO:tasks.workunit.client.0.smithi049.stdout:7/125: mkdir d7/d2b 0 2023-12-16T07:40:17.132 INFO:tasks.workunit.client.0.smithi049.stdout:6/146: dread d0/d2/dd/f1d [0,4194304] 0 2023-12-16T07:40:17.132 INFO:tasks.workunit.client.0.smithi049.stdout:6/147: write d0/d2/dd/f1f [578016,88997] 0 2023-12-16T07:40:17.132 INFO:tasks.workunit.client.0.smithi049.stdout:6/148: readlink d0/d2/l2a 0 2023-12-16T07:40:17.132 INFO:tasks.workunit.client.0.smithi049.stdout:8/147: symlink d0/d13/l27 0 2023-12-16T07:40:17.132 INFO:tasks.workunit.client.0.smithi049.stdout:8/148: fsync d0/f19 0 2023-12-16T07:40:17.132 INFO:tasks.workunit.client.0.smithi049.stdout:8/149: write d0/d1f/f18 [1429664,119992] 0 2023-12-16T07:40:17.132 INFO:tasks.workunit.client.0.smithi049.stdout:8/150: readlink d0/d13/lb 0 2023-12-16T07:40:17.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/151: read d0/f19 [1783978,119594] 0 2023-12-16T07:40:17.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/152: chown d0/d1f/d1c/l1e 7 1 2023-12-16T07:40:17.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/153: truncate d0/f4 4379317 0 2023-12-16T07:40:17.133 INFO:tasks.workunit.client.0.smithi049.stdout:9/148: creat d4/db/f31 x:0 0 0 2023-12-16T07:40:17.135 INFO:tasks.workunit.client.0.smithi049.stdout:8/154: read d0/d13/fe [466080,26808] 0 2023-12-16T07:40:17.136 INFO:tasks.workunit.client.0.smithi049.stdout:5/107: creat d5/f26 x:0 0 0 2023-12-16T07:40:17.138 INFO:tasks.workunit.client.0.smithi049.stdout:7/126: symlink d7/dc/dd/l2c 0 2023-12-16T07:40:17.138 INFO:tasks.workunit.client.0.smithi049.stdout:7/127: stat l3 0 2023-12-16T07:40:17.139 INFO:tasks.workunit.client.0.smithi049.stdout:6/149: creat d0/f30 x:0 0 0 2023-12-16T07:40:17.139 INFO:tasks.workunit.client.0.smithi049.stdout:1/116: rmdir d20 39 2023-12-16T07:40:17.140 INFO:tasks.workunit.client.0.smithi049.stdout:1/117: write ff [4338174,30355] 0 2023-12-16T07:40:17.141 INFO:tasks.workunit.client.0.smithi049.stdout:8/155: unlink d0/d1f/d1c/l1e 0 2023-12-16T07:40:17.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/126: dwrite d1/f1f [0,4194304] 0 2023-12-16T07:40:17.143 INFO:tasks.workunit.client.0.smithi049.stdout:5/108: link d5/de/d1c/c23 d5/d1e/c27 0 2023-12-16T07:40:17.143 INFO:tasks.workunit.client.0.smithi049.stdout:5/109: chown d5/de/l12 8730 1 2023-12-16T07:40:17.144 INFO:tasks.workunit.client.0.smithi049.stdout:7/128: mknod d7/d2b/c2d 0 2023-12-16T07:40:17.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/156: getdents d0/d1f 0 2023-12-16T07:40:17.154 INFO:tasks.workunit.client.0.smithi049.stdout:1/118: write f11 [2415375,103438] 0 2023-12-16T07:40:17.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/157: rmdir d0/d1f 39 2023-12-16T07:40:17.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/158: readlink d0/d1f/d1c/l23 0 2023-12-16T07:40:17.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/119: creat d20/f28 x:0 0 0 2023-12-16T07:40:17.164 INFO:tasks.workunit.client.0.smithi049.stdout:1/120: fdatasync f15 0 2023-12-16T07:40:17.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/127: link d1/l23 d1/l27 0 2023-12-16T07:40:17.165 INFO:tasks.workunit.client.0.smithi049.stdout:1/121: creat d20/f29 x:0 0 0 2023-12-16T07:40:17.168 INFO:tasks.workunit.client.0.smithi049.stdout:1/122: creat d20/f2a x:0 0 0 2023-12-16T07:40:17.168 INFO:tasks.workunit.client.0.smithi049.stdout:1/123: write d20/f29 [1043601,79218] 0 2023-12-16T07:40:17.168 INFO:tasks.workunit.client.0.smithi049.stdout:1/124: chown d20/l24 1693441 1 2023-12-16T07:40:17.170 INFO:tasks.workunit.client.0.smithi049.stdout:3/128: link d1/l1c d1/l28 0 2023-12-16T07:40:17.174 INFO:tasks.workunit.client.0.smithi049.stdout:6/150: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:17.174 INFO:tasks.workunit.client.0.smithi049.stdout:6/151: fsync d0/d2/dd/f26 0 2023-12-16T07:40:17.174 INFO:tasks.workunit.client.0.smithi049.stdout:6/152: read - d0/d2/df/f24 zero size 2023-12-16T07:40:17.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/149: read f0 [850,108522] 0 2023-12-16T07:40:17.176 INFO:tasks.workunit.client.0.smithi049.stdout:5/110: dwrite d5/f18 [0,4194304] 0 2023-12-16T07:40:17.176 INFO:tasks.workunit.client.0.smithi049.stdout:7/129: dwrite d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:17.176 INFO:tasks.workunit.client.0.smithi049.stdout:7/130: stat d7/dc/dd/l26 0 2023-12-16T07:40:17.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/150: symlink d4/db/l32 0 2023-12-16T07:40:17.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/151: chown d4/c6 435744062 1 2023-12-16T07:40:17.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/152: stat d4/db/c15 0 2023-12-16T07:40:17.177 INFO:tasks.workunit.client.0.smithi049.stdout:1/125: write f11 [1006250,122402] 0 2023-12-16T07:40:17.184 INFO:tasks.workunit.client.0.smithi049.stdout:5/111: mknod d5/c28 0 2023-12-16T07:40:17.184 INFO:tasks.workunit.client.0.smithi049.stdout:5/112: readlink d5/l7 0 2023-12-16T07:40:17.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/131: getdents d7/dc/dd/d14 0 2023-12-16T07:40:17.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/132: chown d7/f11 492 1 2023-12-16T07:40:17.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/153: creat d4/db/f33 x:0 0 0 2023-12-16T07:40:17.190 INFO:tasks.workunit.client.0.smithi049.stdout:9/154: read - d4/d7/d11/d1d/f25 zero size 2023-12-16T07:40:17.191 INFO:tasks.workunit.client.0.smithi049.stdout:1/126: mknod d20/c2b 0 2023-12-16T07:40:17.195 INFO:tasks.workunit.client.0.smithi049.stdout:9/155: creat d4/f34 x:0 0 0 2023-12-16T07:40:17.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/133: dread d7/fa [0,4194304] 0 2023-12-16T07:40:17.200 INFO:tasks.workunit.client.0.smithi049.stdout:0/246: sync 2023-12-16T07:40:17.200 INFO:tasks.workunit.client.0.smithi049.stdout:2/189: sync 2023-12-16T07:40:17.200 INFO:tasks.workunit.client.0.smithi049.stdout:4/140: sync 2023-12-16T07:40:17.200 INFO:tasks.workunit.client.0.smithi049.stdout:0/247: dread - d13/d39/f3b zero size 2023-12-16T07:40:17.201 INFO:tasks.workunit.client.0.smithi049.stdout:0/248: write d13/f17 [1571632,48961] 0 2023-12-16T07:40:17.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/156: rename d4/db/c12 to d4/d7/d11/d1d/c35 0 2023-12-16T07:40:17.204 INFO:tasks.workunit.client.0.smithi049.stdout:2/190: getdents d2 0 2023-12-16T07:40:17.204 INFO:tasks.workunit.client.0.smithi049.stdout:7/134: write d7/dc/dd/ff [2143782,35523] 0 2023-12-16T07:40:17.206 INFO:tasks.workunit.client.0.smithi049.stdout:0/249: rename d13/d21/d2f/f50 to d13/d21/f56 0 2023-12-16T07:40:17.207 INFO:tasks.workunit.client.0.smithi049.stdout:9/157: symlink d4/d7/d11/d1d/l36 0 2023-12-16T07:40:17.208 INFO:tasks.workunit.client.0.smithi049.stdout:2/191: symlink d2/d7/d11/d1c/l3a 0 2023-12-16T07:40:17.208 INFO:tasks.workunit.client.0.smithi049.stdout:2/192: fsync d2/d1d/d24/f2e 0 2023-12-16T07:40:17.209 INFO:tasks.workunit.client.0.smithi049.stdout:0/250: symlink d13/d21/d2f/l57 0 2023-12-16T07:40:17.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/251: fdatasync d13/d21/d27/d2c/f55 0 2023-12-16T07:40:17.213 INFO:tasks.workunit.client.0.smithi049.stdout:0/252: unlink d13/f20 0 2023-12-16T07:40:17.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/113: dwrite d5/f19 [0,4194304] 0 2023-12-16T07:40:17.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/253: creat d13/d39/d38/f58 x:0 0 0 2023-12-16T07:40:17.216 INFO:tasks.workunit.client.0.smithi049.stdout:5/114: symlink d5/d1e/l29 0 2023-12-16T07:40:17.216 INFO:tasks.workunit.client.0.smithi049.stdout:3/129: dwrite d1/f1f [4194304,4194304] 0 2023-12-16T07:40:17.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/254: stat d13/d21/c25 0 2023-12-16T07:40:17.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/255: chown d13/d39/c49 1 1 2023-12-16T07:40:17.219 INFO:tasks.workunit.client.0.smithi049.stdout:5/115: truncate d5/f8 46016 0 2023-12-16T07:40:17.221 INFO:tasks.workunit.client.0.smithi049.stdout:2/193: rmdir d2/d7/d11 39 2023-12-16T07:40:17.224 INFO:tasks.workunit.client.0.smithi049.stdout:0/256: symlink d13/l59 0 2023-12-16T07:40:17.224 INFO:tasks.workunit.client.0.smithi049.stdout:2/194: creat d2/d1d/f3b x:0 0 0 2023-12-16T07:40:17.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/257: unlink c11 0 2023-12-16T07:40:17.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/195: creat d2/d7/d11/d1c/f3c x:0 0 0 2023-12-16T07:40:17.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/258: mknod d13/d39/d53/c5a 0 2023-12-16T07:40:17.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/259: truncate d13/d39/d38/f58 465188 0 2023-12-16T07:40:17.231 INFO:tasks.workunit.client.0.smithi049.stdout:0/260: link f2 d13/f5b 0 2023-12-16T07:40:17.231 INFO:tasks.workunit.client.0.smithi049.stdout:0/261: stat fa 0 2023-12-16T07:40:17.232 INFO:tasks.workunit.client.0.smithi049.stdout:7/135: dwrite d7/dc/f1b [0,4194304] 0 2023-12-16T07:40:17.232 INFO:tasks.workunit.client.0.smithi049.stdout:7/136: chown d7/f11 173 1 2023-12-16T07:40:17.232 INFO:tasks.workunit.client.0.smithi049.stdout:7/137: read f5 [1008862,88335] 0 2023-12-16T07:40:17.237 INFO:tasks.workunit.client.0.smithi049.stdout:7/138: symlink d7/dc/dd/d14/l2e 0 2023-12-16T07:40:17.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/139: mkdir d7/dc/d2f 0 2023-12-16T07:40:17.243 INFO:tasks.workunit.client.0.smithi049.stdout:7/140: rmdir d7/dc/d15 39 2023-12-16T07:40:17.244 INFO:tasks.workunit.client.0.smithi049.stdout:9/158: dwrite d4/db/f22 [0,4194304] 0 2023-12-16T07:40:17.245 INFO:tasks.workunit.client.0.smithi049.stdout:1/127: dwrite fc [0,4194304] 0 2023-12-16T07:40:17.245 INFO:tasks.workunit.client.0.smithi049.stdout:7/141: rename d7/dc/c28 to d7/d2b/c30 0 2023-12-16T07:40:17.246 INFO:tasks.workunit.client.0.smithi049.stdout:5/116: dwrite d5/de/f16 [0,4194304] 0 2023-12-16T07:40:17.246 INFO:tasks.workunit.client.0.smithi049.stdout:1/128: symlink d20/l2c 0 2023-12-16T07:40:17.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/129: readlink l1e 0 2023-12-16T07:40:17.250 INFO:tasks.workunit.client.0.smithi049.stdout:7/142: getdents d7/dc/d15 0 2023-12-16T07:40:17.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/159: dread d4/d7/d11/f14 [0,4194304] 0 2023-12-16T07:40:17.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/160: write d4/f13 [348697,6953] 0 2023-12-16T07:40:17.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/161: stat f3 0 2023-12-16T07:40:17.253 INFO:tasks.workunit.client.0.smithi049.stdout:7/143: mkdir d7/dc/dd/d31 0 2023-12-16T07:40:17.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/144: write d7/dc/f1d [837771,32854] 0 2023-12-16T07:40:17.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/145: getdents d7/dc/dd/d31 0 2023-12-16T07:40:17.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/146: read - d7/dc/dd/d14/f22 zero size 2023-12-16T07:40:17.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/147: write d7/dc/f1d [2800966,2208] 0 2023-12-16T07:40:17.260 INFO:tasks.workunit.client.0.smithi049.stdout:7/148: link d7/dc/f25 d7/dc/dd/d14/f32 0 2023-12-16T07:40:17.261 INFO:tasks.workunit.client.0.smithi049.stdout:7/149: write f5 [400599,40116] 0 2023-12-16T07:40:17.261 INFO:tasks.workunit.client.0.smithi049.stdout:7/150: dread - d7/dc/dd/d14/f32 zero size 2023-12-16T07:40:17.265 INFO:tasks.workunit.client.0.smithi049.stdout:9/162: truncate f0 3928385 0 2023-12-16T07:40:17.269 INFO:tasks.workunit.client.0.smithi049.stdout:5/117: dwrite d5/de/f1d [0,4194304] 0 2023-12-16T07:40:17.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/151: dread f5 [0,4194304] 0 2023-12-16T07:40:17.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/159: sync 2023-12-16T07:40:17.271 INFO:tasks.workunit.client.0.smithi049.stdout:6/153: sync 2023-12-16T07:40:17.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/160: truncate d0/d13/fe 3630215 0 2023-12-16T07:40:17.273 INFO:tasks.workunit.client.0.smithi049.stdout:5/118: write d5/de/f14 [967245,111453] 0 2023-12-16T07:40:17.273 INFO:tasks.workunit.client.0.smithi049.stdout:5/119: write f3 [3582847,13197] 0 2023-12-16T07:40:17.273 INFO:tasks.workunit.client.0.smithi049.stdout:5/120: readlink d5/lc 0 2023-12-16T07:40:17.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/152: mknod d7/dc/dd/c33 0 2023-12-16T07:40:17.277 INFO:tasks.workunit.client.0.smithi049.stdout:6/154: rename d0/d2/dd/f15 to d0/d2/df/f31 0 2023-12-16T07:40:17.277 INFO:tasks.workunit.client.0.smithi049.stdout:6/155: fsync d0/d2/dd/f12 0 2023-12-16T07:40:17.277 INFO:tasks.workunit.client.0.smithi049.stdout:6/156: dread - d0/d2/dd/f12 zero size 2023-12-16T07:40:17.277 INFO:tasks.workunit.client.0.smithi049.stdout:6/157: write d0/d2/f8 [238438,75615] 0 2023-12-16T07:40:17.278 INFO:tasks.workunit.client.0.smithi049.stdout:6/158: fsync d0/f23 0 2023-12-16T07:40:17.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/161: creat d0/f28 x:0 0 0 2023-12-16T07:40:17.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/162: write d0/d1f/f22 [882616,91541] 0 2023-12-16T07:40:17.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/153: rename d7/dc/dd/c20 to d7/c34 0 2023-12-16T07:40:17.282 INFO:tasks.workunit.client.0.smithi049.stdout:7/154: rename d7/dc/dd/d31 to d7/dc/dd/d35 0 2023-12-16T07:40:17.282 INFO:tasks.workunit.client.0.smithi049.stdout:9/163: dwrite d4/db/f2a [0,4194304] 0 2023-12-16T07:40:17.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/155: mkdir d7/dc/dd/d35/d36 0 2023-12-16T07:40:17.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/156: read - d7/dc/f17 zero size 2023-12-16T07:40:17.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/157: write d7/dc/dd/d14/f2a [225493,105568] 0 2023-12-16T07:40:17.287 INFO:tasks.workunit.client.0.smithi049.stdout:9/164: link f0 d4/d7/d11/d26/f37 0 2023-12-16T07:40:17.287 INFO:tasks.workunit.client.0.smithi049.stdout:9/165: write d4/f13 [888478,62815] 0 2023-12-16T07:40:17.289 INFO:tasks.workunit.client.0.smithi049.stdout:7/158: mkdir d7/dc/dd/d37 0 2023-12-16T07:40:17.293 INFO:tasks.workunit.client.0.smithi049.stdout:7/159: write d7/f11 [4134213,69266] 0 2023-12-16T07:40:17.304 INFO:tasks.workunit.client.0.smithi049.stdout:5/121: dwrite d5/f18 [0,4194304] 0 2023-12-16T07:40:17.304 INFO:tasks.workunit.client.0.smithi049.stdout:5/122: chown d5/de/c22 423056325 1 2023-12-16T07:40:17.305 INFO:tasks.workunit.client.0.smithi049.stdout:8/163: dwrite d0/f1d [0,4194304] 0 2023-12-16T07:40:17.305 INFO:tasks.workunit.client.0.smithi049.stdout:8/164: chown d0/d1f/l16 1 1 2023-12-16T07:40:17.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/165: truncate d0/d13/fd 4265188 0 2023-12-16T07:40:17.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/166: chown d0/d1f/d1c/l21 100923204 1 2023-12-16T07:40:17.307 INFO:tasks.workunit.client.0.smithi049.stdout:6/159: dwrite d0/d2/df/f31 [0,4194304] 0 2023-12-16T07:40:17.307 INFO:tasks.workunit.client.0.smithi049.stdout:6/160: write d0/f30 [47459,58275] 0 2023-12-16T07:40:17.309 INFO:tasks.workunit.client.0.smithi049.stdout:7/160: getdents d7 0 2023-12-16T07:40:17.309 INFO:tasks.workunit.client.0.smithi049.stdout:7/161: read f6 [216177,126832] 0 2023-12-16T07:40:17.311 INFO:tasks.workunit.client.0.smithi049.stdout:8/167: mknod d0/d1f/c29 0 2023-12-16T07:40:17.316 INFO:tasks.workunit.client.0.smithi049.stdout:7/162: mkdir d7/dc/d2f/d38 0 2023-12-16T07:40:17.318 INFO:tasks.workunit.client.0.smithi049.stdout:8/168: write d0/f4 [576009,62238] 0 2023-12-16T07:40:17.318 INFO:tasks.workunit.client.0.smithi049.stdout:6/161: dread d0/d2/df/f31 [0,4194304] 0 2023-12-16T07:40:17.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/163: truncate f2 1302113 0 2023-12-16T07:40:17.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/164: dread - d7/dc/dd/d14/f22 zero size 2023-12-16T07:40:17.323 INFO:tasks.workunit.client.0.smithi049.stdout:5/123: dwrite d5/de/f16 [0,4194304] 0 2023-12-16T07:40:17.324 INFO:tasks.workunit.client.0.smithi049.stdout:7/165: symlink d7/dc/d2f/l39 0 2023-12-16T07:40:17.327 INFO:tasks.workunit.client.0.smithi049.stdout:5/124: creat d5/f2a x:0 0 0 2023-12-16T07:40:17.327 INFO:tasks.workunit.client.0.smithi049.stdout:6/162: dread d0/f1b [0,4194304] 0 2023-12-16T07:40:17.327 INFO:tasks.workunit.client.0.smithi049.stdout:7/166: write d7/dc/dd/f1e [649247,66100] 0 2023-12-16T07:40:17.329 INFO:tasks.workunit.client.0.smithi049.stdout:5/125: link d5/f8 d5/de/d1c/f2b 0 2023-12-16T07:40:17.329 INFO:tasks.workunit.client.0.smithi049.stdout:5/126: fdatasync f3 0 2023-12-16T07:40:17.329 INFO:tasks.workunit.client.0.smithi049.stdout:6/163: mkdir d0/d2/dd/d32 0 2023-12-16T07:40:17.331 INFO:tasks.workunit.client.0.smithi049.stdout:6/164: mkdir d0/d22/d33 0 2023-12-16T07:40:17.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/169: dread d0/f4 [0,4194304] 0 2023-12-16T07:40:17.334 INFO:tasks.workunit.client.0.smithi049.stdout:6/165: write d0/d2/f9 [227993,85252] 0 2023-12-16T07:40:17.334 INFO:tasks.workunit.client.0.smithi049.stdout:6/166: truncate d0/d22/f29 166985 0 2023-12-16T07:40:17.334 INFO:tasks.workunit.client.0.smithi049.stdout:8/170: getdents d0/d1f/d1c 0 2023-12-16T07:40:17.335 INFO:tasks.workunit.client.0.smithi049.stdout:4/141: sync 2023-12-16T07:40:17.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/167: symlink d0/l34 0 2023-12-16T07:40:17.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/168: fdatasync d0/d2/df/f31 0 2023-12-16T07:40:17.337 INFO:tasks.workunit.client.0.smithi049.stdout:8/171: unlink d0/l1b 0 2023-12-16T07:40:17.337 INFO:tasks.workunit.client.0.smithi049.stdout:4/142: write d2/db/dd/d2a/f1c [1703965,98921] 0 2023-12-16T07:40:17.338 INFO:tasks.workunit.client.0.smithi049.stdout:6/169: write d0/d2/f5 [1938860,31222] 0 2023-12-16T07:40:17.339 INFO:tasks.workunit.client.0.smithi049.stdout:8/172: rmdir d0/d1f 39 2023-12-16T07:40:17.339 INFO:tasks.workunit.client.0.smithi049.stdout:8/173: write d0/f28 [671869,109338] 0 2023-12-16T07:40:17.339 INFO:tasks.workunit.client.0.smithi049.stdout:8/174: write d0/d1f/f1a [1589189,32385] 0 2023-12-16T07:40:17.344 INFO:tasks.workunit.client.0.smithi049.stdout:4/143: truncate d2/db/dd/fa 4255769 0 2023-12-16T07:40:17.344 INFO:tasks.workunit.client.0.smithi049.stdout:6/170: creat d0/f35 x:0 0 0 2023-12-16T07:40:17.344 INFO:tasks.workunit.client.0.smithi049.stdout:8/175: truncate d0/f12 469894 0 2023-12-16T07:40:17.344 INFO:tasks.workunit.client.0.smithi049.stdout:4/144: chown d2/ff 6265 1 2023-12-16T07:40:17.345 INFO:tasks.workunit.client.0.smithi049.stdout:4/145: chown d2/f28 493344927 1 2023-12-16T07:40:17.345 INFO:tasks.workunit.client.0.smithi049.stdout:6/171: fdatasync d0/d22/f2b 0 2023-12-16T07:40:17.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/176: rename d0/d1f/d1c/l21 to d0/d13/l2a 0 2023-12-16T07:40:17.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/177: rmdir d0/d1f/d1c 39 2023-12-16T07:40:17.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/178: stat d0/d13/lb 0 2023-12-16T07:40:17.357 INFO:tasks.workunit.client.0.smithi049.stdout:7/167: dwrite d7/dc/dd/d14/f22 [0,4194304] 0 2023-12-16T07:40:17.357 INFO:tasks.workunit.client.0.smithi049.stdout:5/127: dwrite d5/f11 [0,4194304] 0 2023-12-16T07:40:17.359 INFO:tasks.workunit.client.0.smithi049.stdout:4/146: dread d2/f9 [0,4194304] 0 2023-12-16T07:40:17.362 INFO:tasks.workunit.client.0.smithi049.stdout:4/147: truncate d2/db/dd/f13 198181 0 2023-12-16T07:40:17.367 INFO:tasks.workunit.client.0.smithi049.stdout:8/179: dwrite d0/d1f/f17 [0,4194304] 0 2023-12-16T07:40:17.367 INFO:tasks.workunit.client.0.smithi049.stdout:8/180: write d0/f1d [4646097,16989] 0 2023-12-16T07:40:17.368 INFO:tasks.workunit.client.0.smithi049.stdout:6/172: dwrite d0/f1b [0,4194304] 0 2023-12-16T07:40:17.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/168: dread d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:17.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/169: fdatasync d7/dc/f17 0 2023-12-16T07:40:17.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/173: creat d0/d22/d2c/f36 x:0 0 0 2023-12-16T07:40:17.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/174: fdatasync d0/d2/df/f31 0 2023-12-16T07:40:17.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/175: chown d0/d2/cb 154796 1 2023-12-16T07:40:17.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/170: symlink d7/dc/d2f/d38/l3a 0 2023-12-16T07:40:17.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/176: rename d0/l25 to d0/d2/dd/d27/l37 0 2023-12-16T07:40:17.385 INFO:tasks.workunit.client.0.smithi049.stdout:6/177: symlink d0/d2/l38 0 2023-12-16T07:40:17.385 INFO:tasks.workunit.client.0.smithi049.stdout:6/178: truncate d0/d22/d2c/f36 352105 0 2023-12-16T07:40:17.386 INFO:tasks.workunit.client.0.smithi049.stdout:4/148: dwrite d2/db/dd/d2a/f26 [0,4194304] 0 2023-12-16T07:40:17.386 INFO:tasks.workunit.client.0.smithi049.stdout:4/149: write d2/db/dd/de/f17 [158709,75816] 0 2023-12-16T07:40:17.387 INFO:tasks.workunit.client.0.smithi049.stdout:7/171: dread f2 [0,4194304] 0 2023-12-16T07:40:17.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/150: rmdir d2 39 2023-12-16T07:40:17.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/151: truncate d2/db/dd/f13 1152675 0 2023-12-16T07:40:17.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/152: chown d2/db/dd/de/d1e/d21 0 1 2023-12-16T07:40:17.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/130: sync 2023-12-16T07:40:17.398 INFO:tasks.workunit.client.0.smithi049.stdout:8/181: dwrite d0/f1d [0,4194304] 0 2023-12-16T07:40:17.398 INFO:tasks.workunit.client.0.smithi049.stdout:2/196: sync 2023-12-16T07:40:17.398 INFO:tasks.workunit.client.0.smithi049.stdout:8/182: chown d0/d1f/f17 14 1 2023-12-16T07:40:17.399 INFO:tasks.workunit.client.0.smithi049.stdout:4/153: dread d2/ff [4194304,4194304] 0 2023-12-16T07:40:17.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/128: dwrite d5/f13 [0,4194304] 0 2023-12-16T07:40:17.399 INFO:tasks.workunit.client.0.smithi049.stdout:4/154: fdatasync d2/db/dd/de/d1e/f2d 0 2023-12-16T07:40:17.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/129: chown d5/de/f16 7538 1 2023-12-16T07:40:17.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/183: unlink d0/d1f/f1a 0 2023-12-16T07:40:17.408 INFO:tasks.workunit.client.0.smithi049.stdout:5/130: getdents d5 0 2023-12-16T07:40:17.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/131: rename d1/f1b to d1/f29 0 2023-12-16T07:40:17.411 INFO:tasks.workunit.client.0.smithi049.stdout:3/132: write d1/f1f [1424901,87183] 0 2023-12-16T07:40:17.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/184: link d0/d1f/l16 d0/l2b 0 2023-12-16T07:40:17.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/185: truncate d0/f4 4335020 0 2023-12-16T07:40:17.413 INFO:tasks.workunit.client.0.smithi049.stdout:6/179: dwrite d0/d22/d2c/f36 [0,4194304] 0 2023-12-16T07:40:17.413 INFO:tasks.workunit.client.0.smithi049.stdout:3/133: mkdir d1/d2a 0 2023-12-16T07:40:17.415 INFO:tasks.workunit.client.0.smithi049.stdout:8/186: link d0/d13/lb d0/d1f/d1c/l2c 0 2023-12-16T07:40:17.415 INFO:tasks.workunit.client.0.smithi049.stdout:7/172: dwrite d7/dc/f1b [4194304,4194304] 0 2023-12-16T07:40:17.417 INFO:tasks.workunit.client.0.smithi049.stdout:6/180: stat d0/c7 0 2023-12-16T07:40:17.418 INFO:tasks.workunit.client.0.smithi049.stdout:6/181: chown d0/d2/df/f2e 10545353 1 2023-12-16T07:40:17.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/187: truncate d0/d1f/f18 266688 0 2023-12-16T07:40:17.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/173: mknod d7/dc/d2f/d38/c3b 0 2023-12-16T07:40:17.424 INFO:tasks.workunit.client.0.smithi049.stdout:6/182: mkdir d0/d39 0 2023-12-16T07:40:17.425 INFO:tasks.workunit.client.0.smithi049.stdout:6/183: dread d0/f30 [0,4194304] 0 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/262: sync 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/166: sync 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:1/130: sync 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/134: mkdir d1/d2b 0 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/167: fsync f3 0 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/168: chown f1 5898 1 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:8/188: dread d0/d1f/f17 [0,4194304] 0 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/169: readlink d4/d7/d11/d1d/l36 0 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:7/174: link f4 d7/dc/dd/d27/f3c 0 2023-12-16T07:40:17.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/170: read d4/d7/f9 [570154,29838] 0 2023-12-16T07:40:17.428 INFO:tasks.workunit.client.0.smithi049.stdout:6/184: mknod d0/d2/dd/d32/c3a 0 2023-12-16T07:40:17.428 INFO:tasks.workunit.client.0.smithi049.stdout:1/131: dread f1c [0,4194304] 0 2023-12-16T07:40:17.429 INFO:tasks.workunit.client.0.smithi049.stdout:7/175: creat d7/dc/d2f/d38/f3d x:0 0 0 2023-12-16T07:40:17.430 INFO:tasks.workunit.client.0.smithi049.stdout:6/185: mkdir d0/d39/d3b 0 2023-12-16T07:40:17.431 INFO:tasks.workunit.client.0.smithi049.stdout:0/263: rename d13/d21/l51 to d13/d15/l5c 0 2023-12-16T07:40:17.431 INFO:tasks.workunit.client.0.smithi049.stdout:3/135: dread d1/f18 [0,4194304] 0 2023-12-16T07:40:17.432 INFO:tasks.workunit.client.0.smithi049.stdout:1/132: link fa d20/f2d 0 2023-12-16T07:40:17.433 INFO:tasks.workunit.client.0.smithi049.stdout:7/176: link d7/dc/f1d d7/dc/dd/d35/d36/f3e 0 2023-12-16T07:40:17.434 INFO:tasks.workunit.client.0.smithi049.stdout:9/171: rename d4/f13 to d4/d7/f38 0 2023-12-16T07:40:17.434 INFO:tasks.workunit.client.0.smithi049.stdout:9/172: chown d4/d7 12935416 1 2023-12-16T07:40:17.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/136: creat d1/f2c x:0 0 0 2023-12-16T07:40:17.436 INFO:tasks.workunit.client.0.smithi049.stdout:6/186: rename d0/d2/dd/l1e to d0/d22/l3c 0 2023-12-16T07:40:17.436 INFO:tasks.workunit.client.0.smithi049.stdout:6/187: readlink d0/d22/d2c/l2d 0 2023-12-16T07:40:17.437 INFO:tasks.workunit.client.0.smithi049.stdout:9/173: creat d4/db/f39 x:0 0 0 2023-12-16T07:40:17.437 INFO:tasks.workunit.client.0.smithi049.stdout:5/131: dwrite d5/fb [4194304,4194304] 0 2023-12-16T07:40:17.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/155: dwrite d2/f28 [0,4194304] 0 2023-12-16T07:40:17.439 INFO:tasks.workunit.client.0.smithi049.stdout:0/264: mknod d13/d21/d27/c5d 0 2023-12-16T07:40:17.439 INFO:tasks.workunit.client.0.smithi049.stdout:9/174: write d4/db/f2a [3232715,104765] 0 2023-12-16T07:40:17.439 INFO:tasks.workunit.client.0.smithi049.stdout:2/197: dwrite d2/d26/f39 [0,4194304] 0 2023-12-16T07:40:17.439 INFO:tasks.workunit.client.0.smithi049.stdout:0/265: write f12 [1111857,28205] 0 2023-12-16T07:40:17.439 INFO:tasks.workunit.client.0.smithi049.stdout:0/266: dread - f3 zero size 2023-12-16T07:40:17.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/137: creat d1/d2b/f2d x:0 0 0 2023-12-16T07:40:17.440 INFO:tasks.workunit.client.0.smithi049.stdout:2/198: write d2/d1d/f29 [2307957,48079] 0 2023-12-16T07:40:17.440 INFO:tasks.workunit.client.0.smithi049.stdout:7/177: rename d7/f8 to d7/dc/dd/d35/d36/f3f 0 2023-12-16T07:40:17.442 INFO:tasks.workunit.client.0.smithi049.stdout:2/199: dread d2/ff [0,4194304] 0 2023-12-16T07:40:17.442 INFO:tasks.workunit.client.0.smithi049.stdout:2/200: write d2/f36 [167941,57194] 0 2023-12-16T07:40:17.444 INFO:tasks.workunit.client.0.smithi049.stdout:1/133: dread d20/f27 [0,4194304] 0 2023-12-16T07:40:17.446 INFO:tasks.workunit.client.0.smithi049.stdout:5/132: link d5/c28 d5/de/c2c 0 2023-12-16T07:40:17.446 INFO:tasks.workunit.client.0.smithi049.stdout:5/133: readlink d5/l17 0 2023-12-16T07:40:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:1/134: read d20/f22 [2469096,67247] 0 2023-12-16T07:40:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/175: symlink d4/l3a 0 2023-12-16T07:40:17.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/176: fdatasync f3 0 2023-12-16T07:40:17.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/267: mknod d13/d39/c5e 0 2023-12-16T07:40:17.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/268: truncate f3 600412 0 2023-12-16T07:40:17.453 INFO:tasks.workunit.client.0.smithi049.stdout:4/156: dwrite d2/db/dd/d2a/f1c [0,4194304] 0 2023-12-16T07:40:17.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/188: dread d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:17.455 INFO:tasks.workunit.client.0.smithi049.stdout:7/178: mkdir d7/dc/d2f/d40 0 2023-12-16T07:40:17.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/201: unlink d2/d1d/f3b 0 2023-12-16T07:40:17.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/202: fsync d2/f19 0 2023-12-16T07:40:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:2/203: write d2/ff [74041,11401] 0 2023-12-16T07:40:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/189: dread d0/f4 [0,4194304] 0 2023-12-16T07:40:17.458 INFO:tasks.workunit.client.0.smithi049.stdout:5/134: mkdir d5/de/d2d 0 2023-12-16T07:40:17.461 INFO:tasks.workunit.client.0.smithi049.stdout:1/135: rename f11 to d20/f2e 0 2023-12-16T07:40:17.461 INFO:tasks.workunit.client.0.smithi049.stdout:1/136: chown c12 105662223 1 2023-12-16T07:40:17.463 INFO:tasks.workunit.client.0.smithi049.stdout:9/177: symlink d4/l3b 0 2023-12-16T07:40:17.464 INFO:tasks.workunit.client.0.smithi049.stdout:0/269: write d13/d21/f2a [695284,71529] 0 2023-12-16T07:40:17.465 INFO:tasks.workunit.client.0.smithi049.stdout:4/157: dread d2/db/dd/d2a/f26 [0,4194304] 0 2023-12-16T07:40:17.467 INFO:tasks.workunit.client.0.smithi049.stdout:3/138: unlink d1/c1e 0 2023-12-16T07:40:17.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/137: dread d20/f22 [0,4194304] 0 2023-12-16T07:40:17.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/138: dread - f15 zero size 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/189: creat d0/d22/f3d x:0 0 0 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/190: write d0/d2/df/f31 [4379307,95303] 0 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/191: stat d0/d2/df/f24 0 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/192: write d0/f23 [736487,116459] 0 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/193: chown d0/d2/dd/l21 524595945 1 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/194: fdatasync d0/d22/d2c/f36 0 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/195: dread - d0/d2/dd/f12 zero size 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/196: stat d0/d2/df/c13 0 2023-12-16T07:40:17.471 INFO:tasks.workunit.client.0.smithi049.stdout:7/179: creat d7/dc/dd/d35/f41 x:0 0 0 2023-12-16T07:40:17.472 INFO:tasks.workunit.client.0.smithi049.stdout:2/204: getdents d2/d7/d11 0 2023-12-16T07:40:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/190: link d0/d1f/f18 d0/d1f/f2d 0 2023-12-16T07:40:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/191: write d0/f1d [5350764,130267] 0 2023-12-16T07:40:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/192: fdatasync d0/d1f/f17 0 2023-12-16T07:40:17.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/193: truncate d0/f12 1029797 0 2023-12-16T07:40:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:8/194: fdatasync d0/d13/f25 0 2023-12-16T07:40:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:8/195: write d0/d1f/f22 [620654,104199] 0 2023-12-16T07:40:17.474 INFO:tasks.workunit.client.0.smithi049.stdout:9/178: getdents d4/db 0 2023-12-16T07:40:17.476 INFO:tasks.workunit.client.0.smithi049.stdout:0/270: creat d13/d21/d27/f5f x:0 0 0 2023-12-16T07:40:17.476 INFO:tasks.workunit.client.0.smithi049.stdout:5/135: dwrite d5/f2a [0,4194304] 0 2023-12-16T07:40:17.477 INFO:tasks.workunit.client.0.smithi049.stdout:4/158: mkdir d2/d2f 0 2023-12-16T07:40:17.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/139: fdatasync d1/f16 0 2023-12-16T07:40:17.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/140: stat d1/f25 0 2023-12-16T07:40:17.480 INFO:tasks.workunit.client.0.smithi049.stdout:1/139: symlink d20/l2f 0 2023-12-16T07:40:17.480 INFO:tasks.workunit.client.0.smithi049.stdout:1/140: dread - d20/f2a zero size 2023-12-16T07:40:17.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/141: read d20/f22 [2862709,130105] 0 2023-12-16T07:40:17.481 INFO:tasks.workunit.client.0.smithi049.stdout:8/196: dread d0/f28 [0,4194304] 0 2023-12-16T07:40:17.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/179: dread f1 [0,4194304] 0 2023-12-16T07:40:17.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/180: write d4/db/f31 [898759,41726] 0 2023-12-16T07:40:17.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/180: symlink d7/dc/dd/d37/l42 0 2023-12-16T07:40:17.484 INFO:tasks.workunit.client.0.smithi049.stdout:6/197: creat d0/d2/f3e x:0 0 0 2023-12-16T07:40:17.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/181: dread - d7/dc/d2f/d38/f3d zero size 2023-12-16T07:40:17.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/182: chown d7/dc/c21 159132 1 2023-12-16T07:40:17.484 INFO:tasks.workunit.client.0.smithi049.stdout:6/198: truncate d0/d2/dd/f26 496393 0 2023-12-16T07:40:17.485 INFO:tasks.workunit.client.0.smithi049.stdout:5/136: dread d5/f13 [0,4194304] 0 2023-12-16T07:40:17.485 INFO:tasks.workunit.client.0.smithi049.stdout:5/137: rename d5/d1e/d20 to d5/d1e/d20/d2e 22 2023-12-16T07:40:17.485 INFO:tasks.workunit.client.0.smithi049.stdout:5/138: getdents d5 0 2023-12-16T07:40:17.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/205: rmdir d2/d37 0 2023-12-16T07:40:17.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/206: chown d2/d1d/d24 75155 1 2023-12-16T07:40:17.489 INFO:tasks.workunit.client.0.smithi049.stdout:0/271: creat d13/d15/d46/f60 x:0 0 0 2023-12-16T07:40:17.489 INFO:tasks.workunit.client.0.smithi049.stdout:0/272: chown d13/d39/d53 1336628 1 2023-12-16T07:40:17.489 INFO:tasks.workunit.client.0.smithi049.stdout:0/273: write d13/d21/d27/d2c/f55 [309976,68266] 0 2023-12-16T07:40:17.492 INFO:tasks.workunit.client.0.smithi049.stdout:4/159: symlink d2/db/dd/d2a/l30 0 2023-12-16T07:40:17.494 INFO:tasks.workunit.client.0.smithi049.stdout:3/141: rmdir d1/d2b 39 2023-12-16T07:40:17.499 INFO:tasks.workunit.client.0.smithi049.stdout:8/197: getdents d0/d1f/d1c 0 2023-12-16T07:40:17.499 INFO:tasks.workunit.client.0.smithi049.stdout:8/198: fdatasync d0/d1f/f2d 0 2023-12-16T07:40:17.501 INFO:tasks.workunit.client.0.smithi049.stdout:6/199: mknod d0/c3f 0 2023-12-16T07:40:17.501 INFO:tasks.workunit.client.0.smithi049.stdout:6/200: stat d0/d22/d2c/f36 0 2023-12-16T07:40:17.503 INFO:tasks.workunit.client.0.smithi049.stdout:5/139: mkdir d5/de/d2d/d2f 0 2023-12-16T07:40:17.505 INFO:tasks.workunit.client.0.smithi049.stdout:2/207: creat d2/d7/d11/f3d x:0 0 0 2023-12-16T07:40:17.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/142: dwrite d20/f21 [0,4194304] 0 2023-12-16T07:40:17.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/143: write f14 [996591,120835] 0 2023-12-16T07:40:17.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/160: truncate d2/f4 2040368 0 2023-12-16T07:40:17.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/161: chown d2/db/dd/de/d1e/c22 443540 1 2023-12-16T07:40:17.508 INFO:tasks.workunit.client.0.smithi049.stdout:7/183: dwrite d7/dc/dd/d35/d36/f3f [0,4194304] 0 2023-12-16T07:40:17.514 INFO:tasks.workunit.client.0.smithi049.stdout:3/142: symlink d1/d2a/l2e 0 2023-12-16T07:40:17.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/199: rename d0/c8 to d0/d13/c2e 0 2023-12-16T07:40:17.517 INFO:tasks.workunit.client.0.smithi049.stdout:6/201: creat d0/f40 x:0 0 0 2023-12-16T07:40:17.518 INFO:tasks.workunit.client.0.smithi049.stdout:5/140: mknod d5/c30 0 2023-12-16T07:40:17.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/208: symlink d2/d1d/l3e 0 2023-12-16T07:40:17.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/144: symlink d20/l30 0 2023-12-16T07:40:17.524 INFO:tasks.workunit.client.0.smithi049.stdout:1/145: dread f1c [0,4194304] 0 2023-12-16T07:40:17.531 INFO:tasks.workunit.client.0.smithi049.stdout:4/162: mknod d2/db/dd/de/d1e/d21/c31 0 2023-12-16T07:40:17.532 INFO:tasks.workunit.client.0.smithi049.stdout:4/163: write d2/f4 [154871,126489] 0 2023-12-16T07:40:17.532 INFO:tasks.workunit.client.0.smithi049.stdout:7/184: getdents d7/d2b 0 2023-12-16T07:40:17.534 INFO:tasks.workunit.client.0.smithi049.stdout:3/143: creat d1/d2a/f2f x:0 0 0 2023-12-16T07:40:17.535 INFO:tasks.workunit.client.0.smithi049.stdout:3/144: chown d1/d2a/f2f 6336 1 2023-12-16T07:40:17.535 INFO:tasks.workunit.client.0.smithi049.stdout:6/202: dwrite d0/d22/f2b [0,4194304] 0 2023-12-16T07:40:17.535 INFO:tasks.workunit.client.0.smithi049.stdout:3/145: dread - d1/f2c zero size 2023-12-16T07:40:17.537 INFO:tasks.workunit.client.0.smithi049.stdout:8/200: rename d0/f1d to d0/d13/f2f 0 2023-12-16T07:40:17.541 INFO:tasks.workunit.client.0.smithi049.stdout:7/185: symlink d7/dc/dd/d14/l43 0 2023-12-16T07:40:17.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/209: rename d2/l34 to d2/d1d/l3f 0 2023-12-16T07:40:17.543 INFO:tasks.workunit.client.0.smithi049.stdout:6/203: dread d0/f1b [0,4194304] 0 2023-12-16T07:40:17.544 INFO:tasks.workunit.client.0.smithi049.stdout:3/146: dread d1/ff [0,4194304] 0 2023-12-16T07:40:17.544 INFO:tasks.workunit.client.0.smithi049.stdout:8/201: truncate d0/d13/f2f 1096651 0 2023-12-16T07:40:17.546 INFO:tasks.workunit.client.0.smithi049.stdout:3/147: write d1/f18 [367318,2378] 0 2023-12-16T07:40:17.547 INFO:tasks.workunit.client.0.smithi049.stdout:7/186: mknod d7/dc/dd/d27/c44 0 2023-12-16T07:40:17.551 INFO:tasks.workunit.client.0.smithi049.stdout:3/148: truncate d1/f1f 6084852 0 2023-12-16T07:40:17.560 INFO:tasks.workunit.client.0.smithi049.stdout:3/149: unlink d1/fa 0 2023-12-16T07:40:17.560 INFO:tasks.workunit.client.0.smithi049.stdout:3/150: fdatasync d1/f25 0 2023-12-16T07:40:17.562 INFO:tasks.workunit.client.0.smithi049.stdout:3/151: creat d1/d2a/f30 x:0 0 0 2023-12-16T07:40:17.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/152: mknod d1/d2a/c31 0 2023-12-16T07:40:17.565 INFO:tasks.workunit.client.0.smithi049.stdout:3/153: creat d1/d2a/f32 x:0 0 0 2023-12-16T07:40:17.566 INFO:tasks.workunit.client.0.smithi049.stdout:3/154: read - d1/f25 zero size 2023-12-16T07:40:17.566 INFO:tasks.workunit.client.0.smithi049.stdout:3/155: dread - d1/d2a/f32 zero size 2023-12-16T07:40:17.566 INFO:tasks.workunit.client.0.smithi049.stdout:3/156: stat d1/l1c 0 2023-12-16T07:40:17.566 INFO:tasks.workunit.client.0.smithi049.stdout:3/157: stat d1/f2c 0 2023-12-16T07:40:17.566 INFO:tasks.workunit.client.0.smithi049.stdout:3/158: readlink d1/l1d 0 2023-12-16T07:40:17.569 INFO:tasks.workunit.client.0.smithi049.stdout:3/159: unlink d1/l1c 0 2023-12-16T07:40:17.577 INFO:tasks.workunit.client.0.smithi049.stdout:2/210: dwrite d2/d1d/d24/f33 [0,4194304] 0 2023-12-16T07:40:17.579 INFO:tasks.workunit.client.0.smithi049.stdout:2/211: symlink d2/d7/l40 0 2023-12-16T07:40:17.581 INFO:tasks.workunit.client.0.smithi049.stdout:2/212: unlink d2/d1d/l3e 0 2023-12-16T07:40:17.581 INFO:tasks.workunit.client.0.smithi049.stdout:2/213: mknod d2/d1d/d28/c41 0 2023-12-16T07:40:17.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/164: dwrite d2/db/f15 [0,4194304] 0 2023-12-16T07:40:17.587 INFO:tasks.workunit.client.0.smithi049.stdout:7/187: dwrite f6 [0,4194304] 0 2023-12-16T07:40:17.588 INFO:tasks.workunit.client.0.smithi049.stdout:8/202: dwrite d0/d13/f25 [0,4194304] 0 2023-12-16T07:40:17.588 INFO:tasks.workunit.client.0.smithi049.stdout:3/160: dwrite d1/f25 [0,4194304] 0 2023-12-16T07:40:17.590 INFO:tasks.workunit.client.0.smithi049.stdout:6/204: dwrite d0/f23 [0,4194304] 0 2023-12-16T07:40:17.590 INFO:tasks.workunit.client.0.smithi049.stdout:2/214: dread d2/f17 [0,4194304] 0 2023-12-16T07:40:17.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/188: rename d7/dc/dd/d14/l43 to d7/l45 0 2023-12-16T07:40:17.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/203: mknod d0/c30 0 2023-12-16T07:40:17.597 INFO:tasks.workunit.client.0.smithi049.stdout:2/215: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:17.597 INFO:tasks.workunit.client.0.smithi049.stdout:6/205: dread d0/d2/dd/f1d [0,4194304] 0 2023-12-16T07:40:17.597 INFO:tasks.workunit.client.0.smithi049.stdout:6/206: dread - d0/f35 zero size 2023-12-16T07:40:17.597 INFO:tasks.workunit.client.0.smithi049.stdout:6/207: write d0/f35 [57270,4395] 0 2023-12-16T07:40:17.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/161: truncate d1/f1f 5420589 0 2023-12-16T07:40:17.603 INFO:tasks.workunit.client.0.smithi049.stdout:4/165: dwrite d2/f4 [0,4194304] 0 2023-12-16T07:40:17.603 INFO:tasks.workunit.client.0.smithi049.stdout:4/166: read - d2/db/dd/de/d1e/f2d zero size 2023-12-16T07:40:17.604 INFO:tasks.workunit.client.0.smithi049.stdout:7/189: mkdir d7/dc/dd/d27/d46 0 2023-12-16T07:40:17.604 INFO:tasks.workunit.client.0.smithi049.stdout:8/204: creat d0/d13/f31 x:0 0 0 2023-12-16T07:40:17.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/205: readlink d0/d1f/d1c/l23 0 2023-12-16T07:40:17.607 INFO:tasks.workunit.client.0.smithi049.stdout:2/216: rename d2/f19 to d2/d1d/d24/f42 0 2023-12-16T07:40:17.611 INFO:tasks.workunit.client.0.smithi049.stdout:6/208: symlink d0/d2/dd/l41 0 2023-12-16T07:40:17.615 INFO:tasks.workunit.client.0.smithi049.stdout:7/190: creat d7/dc/dd/d14/f47 x:0 0 0 2023-12-16T07:40:17.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/206: mknod d0/d13/c32 0 2023-12-16T07:40:17.619 INFO:tasks.workunit.client.0.smithi049.stdout:4/167: rename d2/db/dd/de/d1e/d21/c31 to d2/db/dd/de/d1e/c32 0 2023-12-16T07:40:17.620 INFO:tasks.workunit.client.0.smithi049.stdout:2/217: getdents d2/d1d 0 2023-12-16T07:40:17.621 INFO:tasks.workunit.client.0.smithi049.stdout:6/209: creat d0/d22/f42 x:0 0 0 2023-12-16T07:40:17.622 INFO:tasks.workunit.client.0.smithi049.stdout:6/210: dread d0/f30 [0,4194304] 0 2023-12-16T07:40:17.623 INFO:tasks.workunit.client.0.smithi049.stdout:3/162: creat d1/d2b/f33 x:0 0 0 2023-12-16T07:40:17.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/191: creat d7/dc/dd/d27/f48 x:0 0 0 2023-12-16T07:40:17.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/207: getdents d0/d1f 0 2023-12-16T07:40:17.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/208: fdatasync d0/f4 0 2023-12-16T07:40:17.629 INFO:tasks.workunit.client.0.smithi049.stdout:4/168: symlink d2/db/dd/de/d1e/l33 0 2023-12-16T07:40:17.631 INFO:tasks.workunit.client.0.smithi049.stdout:5/141: sync 2023-12-16T07:40:17.631 INFO:tasks.workunit.client.0.smithi049.stdout:9/181: sync 2023-12-16T07:40:17.631 INFO:tasks.workunit.client.0.smithi049.stdout:0/274: sync 2023-12-16T07:40:17.631 INFO:tasks.workunit.client.0.smithi049.stdout:9/182: getdents d4/db 0 2023-12-16T07:40:17.631 INFO:tasks.workunit.client.0.smithi049.stdout:0/275: chown d13/d15 2 1 2023-12-16T07:40:17.631 INFO:tasks.workunit.client.0.smithi049.stdout:0/276: write d13/d39/d38/f54 [639566,54170] 0 2023-12-16T07:40:17.631 INFO:tasks.workunit.client.0.smithi049.stdout:0/277: dread - d13/f1d zero size 2023-12-16T07:40:17.632 INFO:tasks.workunit.client.0.smithi049.stdout:2/218: mkdir d2/d26/d43 0 2023-12-16T07:40:17.632 INFO:tasks.workunit.client.0.smithi049.stdout:1/146: sync 2023-12-16T07:40:17.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/211: creat d0/d2/f43 x:0 0 0 2023-12-16T07:40:17.634 INFO:tasks.workunit.client.0.smithi049.stdout:7/192: rename d7/dc/dd/l2c to d7/dc/d2f/d40/l49 0 2023-12-16T07:40:17.635 INFO:tasks.workunit.client.0.smithi049.stdout:0/278: stat d13/d21/f56 0 2023-12-16T07:40:17.636 INFO:tasks.workunit.client.0.smithi049.stdout:5/142: read d5/f9 [3302739,23277] 0 2023-12-16T07:40:17.636 INFO:tasks.workunit.client.0.smithi049.stdout:8/209: dread d0/f19 [0,4194304] 0 2023-12-16T07:40:17.636 INFO:tasks.workunit.client.0.smithi049.stdout:8/210: chown d0/d1f/f18 0 1 2023-12-16T07:40:17.636 INFO:tasks.workunit.client.0.smithi049.stdout:1/147: symlink d20/l31 0 2023-12-16T07:40:17.636 INFO:tasks.workunit.client.0.smithi049.stdout:3/163: write d1/ff [2050221,69148] 0 2023-12-16T07:40:17.637 INFO:tasks.workunit.client.0.smithi049.stdout:4/169: dread d2/f28 [0,4194304] 0 2023-12-16T07:40:17.638 INFO:tasks.workunit.client.0.smithi049.stdout:7/193: mknod d7/dc/d2f/d38/c4a 0 2023-12-16T07:40:17.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/183: write d4/ff [1417033,43830] 0 2023-12-16T07:40:17.639 INFO:tasks.workunit.client.0.smithi049.stdout:0/279: creat d13/d39/f61 x:0 0 0 2023-12-16T07:40:17.640 INFO:tasks.workunit.client.0.smithi049.stdout:5/143: rmdir d5/d1e/d21 39 2023-12-16T07:40:17.640 INFO:tasks.workunit.client.0.smithi049.stdout:8/211: rename d0/c30 to d0/d1f/c33 0 2023-12-16T07:40:17.641 INFO:tasks.workunit.client.0.smithi049.stdout:1/148: creat d20/f32 x:0 0 0 2023-12-16T07:40:17.641 INFO:tasks.workunit.client.0.smithi049.stdout:1/149: chown f1c 212124 1 2023-12-16T07:40:17.641 INFO:tasks.workunit.client.0.smithi049.stdout:1/150: stat l17 0 2023-12-16T07:40:17.642 INFO:tasks.workunit.client.0.smithi049.stdout:3/164: fsync d1/d2a/f32 0 2023-12-16T07:40:17.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/170: unlink d2/f4 0 2023-12-16T07:40:17.644 INFO:tasks.workunit.client.0.smithi049.stdout:0/280: mkdir d13/d21/d27/d2c/d62 0 2023-12-16T07:40:17.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/144: creat d5/de/f31 x:0 0 0 2023-12-16T07:40:17.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/184: rename d4/d7/d11/f14 to d4/d7/f3c 0 2023-12-16T07:40:17.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/185: chown d4/c1b 2739 1 2023-12-16T07:40:17.646 INFO:tasks.workunit.client.0.smithi049.stdout:1/151: creat d20/f33 x:0 0 0 2023-12-16T07:40:17.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/165: write d1/f18 [1593379,26154] 0 2023-12-16T07:40:17.647 INFO:tasks.workunit.client.0.smithi049.stdout:4/171: readlink d2/db/l1a 0 2023-12-16T07:40:17.650 INFO:tasks.workunit.client.0.smithi049.stdout:0/281: creat d13/d15/d46/f63 x:0 0 0 2023-12-16T07:40:17.651 INFO:tasks.workunit.client.0.smithi049.stdout:5/145: rename d5/de/cf to d5/de/d1c/c32 0 2023-12-16T07:40:17.652 INFO:tasks.workunit.client.0.smithi049.stdout:1/152: symlink d20/l34 0 2023-12-16T07:40:17.655 INFO:tasks.workunit.client.0.smithi049.stdout:3/166: unlink d1/d2b/f33 0 2023-12-16T07:40:17.656 INFO:tasks.workunit.client.0.smithi049.stdout:4/172: creat d2/db/dd/de/d1e/f34 x:0 0 0 2023-12-16T07:40:17.658 INFO:tasks.workunit.client.0.smithi049.stdout:0/282: symlink d13/d15/l64 0 2023-12-16T07:40:17.658 INFO:tasks.workunit.client.0.smithi049.stdout:0/283: fsync d13/d21/d27/f5f 0 2023-12-16T07:40:17.660 INFO:tasks.workunit.client.0.smithi049.stdout:0/284: dread d13/d21/f2a [0,4194304] 0 2023-12-16T07:40:17.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/173: rename d2/db/dd/c1f to d2/db/dd/d2a/c35 0 2023-12-16T07:40:17.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/174: chown d2/db/dd/c19 2741 1 2023-12-16T07:40:17.662 INFO:tasks.workunit.client.0.smithi049.stdout:3/167: unlink d1/f29 0 2023-12-16T07:40:17.663 INFO:tasks.workunit.client.0.smithi049.stdout:0/285: mkdir d13/d15/d46/d65 0 2023-12-16T07:40:17.663 INFO:tasks.workunit.client.0.smithi049.stdout:0/286: write d13/d21/d27/f4d [391633,5686] 0 2023-12-16T07:40:17.663 INFO:tasks.workunit.client.0.smithi049.stdout:0/287: fsync d13/d21/d27/f5f 0 2023-12-16T07:40:17.663 INFO:tasks.workunit.client.0.smithi049.stdout:4/175: getdents d2/db/dd/de 0 2023-12-16T07:40:17.664 INFO:tasks.workunit.client.0.smithi049.stdout:3/168: symlink d1/d2b/l34 0 2023-12-16T07:40:17.664 INFO:tasks.workunit.client.0.smithi049.stdout:5/146: dread f3 [0,4194304] 0 2023-12-16T07:40:17.664 INFO:tasks.workunit.client.0.smithi049.stdout:0/288: mknod d13/d39/d38/c66 0 2023-12-16T07:40:17.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/147: dread f4 [0,4194304] 0 2023-12-16T07:40:17.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/148: write d5/f15 [4999029,2604] 0 2023-12-16T07:40:17.666 INFO:tasks.workunit.client.0.smithi049.stdout:4/176: mkdir d2/db/d36 0 2023-12-16T07:40:17.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/219: dwrite d2/d1d/d28/f2b [0,4194304] 0 2023-12-16T07:40:17.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/220: dread - d2/d26/f30 zero size 2023-12-16T07:40:17.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/221: chown d2/l27 0 1 2023-12-16T07:40:17.668 INFO:tasks.workunit.client.0.smithi049.stdout:5/149: creat d5/de/d2d/f33 x:0 0 0 2023-12-16T07:40:17.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/177: rename d2/d2f to d2/db/dd/de/d1e/d37 0 2023-12-16T07:40:17.672 INFO:tasks.workunit.client.0.smithi049.stdout:5/150: rename d5/de/c1a to d5/de/d2d/c34 0 2023-12-16T07:40:17.674 INFO:tasks.workunit.client.0.smithi049.stdout:4/178: creat d2/db/dd/de/d1e/d37/f38 x:0 0 0 2023-12-16T07:40:17.674 INFO:tasks.workunit.client.0.smithi049.stdout:4/179: stat d2 0 2023-12-16T07:40:17.675 INFO:tasks.workunit.client.0.smithi049.stdout:6/212: dwrite d0/d2/f8 [0,4194304] 0 2023-12-16T07:40:17.675 INFO:tasks.workunit.client.0.smithi049.stdout:6/213: fsync d0/d2/f5 0 2023-12-16T07:40:17.675 INFO:tasks.workunit.client.0.smithi049.stdout:6/214: rename d0 to d0/d2/dd/d44 22 2023-12-16T07:40:17.675 INFO:tasks.workunit.client.0.smithi049.stdout:5/151: truncate d5/de/f16 3039955 0 2023-12-16T07:40:17.676 INFO:tasks.workunit.client.0.smithi049.stdout:4/180: truncate d2/db/dd/fa 639160 0 2023-12-16T07:40:17.678 INFO:tasks.workunit.client.0.smithi049.stdout:5/152: write d5/de/f14 [3178577,103446] 0 2023-12-16T07:40:17.678 INFO:tasks.workunit.client.0.smithi049.stdout:5/153: write d5/f15 [5119390,11531] 0 2023-12-16T07:40:17.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/154: rename f4 to d5/de/d1c/f35 0 2023-12-16T07:40:17.682 INFO:tasks.workunit.client.0.smithi049.stdout:5/155: creat d5/d1e/d20/f36 x:0 0 0 2023-12-16T07:40:17.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/156: mknod d5/c37 0 2023-12-16T07:40:17.684 INFO:tasks.workunit.client.0.smithi049.stdout:7/194: dwrite d7/dc/dd/d14/f47 [0,4194304] 0 2023-12-16T07:40:17.684 INFO:tasks.workunit.client.0.smithi049.stdout:6/215: dread d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:17.685 INFO:tasks.workunit.client.0.smithi049.stdout:6/216: truncate d0/d2/dd/f1d 4989915 0 2023-12-16T07:40:17.685 INFO:tasks.workunit.client.0.smithi049.stdout:4/181: dread d2/db/dd/d2a/f1c [0,4194304] 0 2023-12-16T07:40:17.685 INFO:tasks.workunit.client.0.smithi049.stdout:4/182: chown d2/l7 10769065 1 2023-12-16T07:40:17.685 INFO:tasks.workunit.client.0.smithi049.stdout:4/183: chown d2/l7 16391678 1 2023-12-16T07:40:17.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/195: creat d7/dc/d2f/d40/f4b x:0 0 0 2023-12-16T07:40:17.687 INFO:tasks.workunit.client.0.smithi049.stdout:9/186: dwrite d4/d7/f38 [0,4194304] 0 2023-12-16T07:40:17.688 INFO:tasks.workunit.client.0.smithi049.stdout:9/187: chown d4/d7/d11/d26/c2e 94 1 2023-12-16T07:40:17.688 INFO:tasks.workunit.client.0.smithi049.stdout:6/217: creat d0/d2/dd/d27/f45 x:0 0 0 2023-12-16T07:40:17.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/196: link d7/dc/dd/le d7/dc/dd/d35/d36/l4c 0 2023-12-16T07:40:17.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/197: chown d7/dc/f17 6 1 2023-12-16T07:40:17.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/198: dread - d7/dc/dd/d35/f41 zero size 2023-12-16T07:40:17.690 INFO:tasks.workunit.client.0.smithi049.stdout:6/218: read d0/d22/f29 [131980,25758] 0 2023-12-16T07:40:17.691 INFO:tasks.workunit.client.0.smithi049.stdout:3/169: dwrite d1/d2b/f2d [0,4194304] 0 2023-12-16T07:40:17.692 INFO:tasks.workunit.client.0.smithi049.stdout:6/219: mkdir d0/d2/dd/d27/d46 0 2023-12-16T07:40:17.692 INFO:tasks.workunit.client.0.smithi049.stdout:9/188: dread f1 [0,4194304] 0 2023-12-16T07:40:17.692 INFO:tasks.workunit.client.0.smithi049.stdout:9/189: readlink l2 0 2023-12-16T07:40:17.693 INFO:tasks.workunit.client.0.smithi049.stdout:2/222: dwrite d2/d26/f39 [4194304,4194304] 0 2023-12-16T07:40:17.696 INFO:tasks.workunit.client.0.smithi049.stdout:3/170: symlink d1/d2b/l35 0 2023-12-16T07:40:17.701 INFO:tasks.workunit.client.0.smithi049.stdout:2/223: rename d2/d7/d11/c23 to d2/de/c44 0 2023-12-16T07:40:17.701 INFO:tasks.workunit.client.0.smithi049.stdout:2/224: read - d2/d26/f30 zero size 2023-12-16T07:40:17.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/171: getdents d1/d2a 0 2023-12-16T07:40:17.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/172: getdents d1/d2a 0 2023-12-16T07:40:17.704 INFO:tasks.workunit.client.0.smithi049.stdout:2/225: mknod d2/d26/d43/c45 0 2023-12-16T07:40:17.704 INFO:tasks.workunit.client.0.smithi049.stdout:2/226: readlink d2/d7/l1a 0 2023-12-16T07:40:17.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/153: fsync d20/f32 0 2023-12-16T07:40:17.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/154: stat f1d 0 2023-12-16T07:40:17.705 INFO:tasks.workunit.client.0.smithi049.stdout:2/227: write d2/ff [399574,29149] 0 2023-12-16T07:40:17.705 INFO:tasks.workunit.client.0.smithi049.stdout:2/228: dread - d2/d1d/d24/f2e zero size 2023-12-16T07:40:17.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/190: dwrite d4/d7/d11/d1d/f25 [0,4194304] 0 2023-12-16T07:40:17.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/155: dread d20/f21 [0,4194304] 0 2023-12-16T07:40:17.713 INFO:tasks.workunit.client.0.smithi049.stdout:9/191: truncate d4/f1f 1624553 0 2023-12-16T07:40:17.713 INFO:tasks.workunit.client.0.smithi049.stdout:9/192: truncate d4/fd 1001529 0 2023-12-16T07:40:17.714 INFO:tasks.workunit.client.0.smithi049.stdout:1/156: creat d20/f35 x:0 0 0 2023-12-16T07:40:17.719 INFO:tasks.workunit.client.0.smithi049.stdout:6/220: dwrite d0/f35 [0,4194304] 0 2023-12-16T07:40:17.721 INFO:tasks.workunit.client.0.smithi049.stdout:9/193: rename d4/d7/d11/d1d/c30 to d4/d7/d11/d26/c3d 0 2023-12-16T07:40:17.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/221: creat d0/d2/f47 x:0 0 0 2023-12-16T07:40:17.724 INFO:tasks.workunit.client.0.smithi049.stdout:6/222: symlink d0/d22/d33/l48 0 2023-12-16T07:40:17.724 INFO:tasks.workunit.client.0.smithi049.stdout:6/223: fsync d0/d22/f2b 0 2023-12-16T07:40:17.725 INFO:tasks.workunit.client.0.smithi049.stdout:6/224: stat d0/d2/df/c13 0 2023-12-16T07:40:17.725 INFO:tasks.workunit.client.0.smithi049.stdout:9/194: dread d4/db/f31 [0,4194304] 0 2023-12-16T07:40:17.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/225: unlink d0/d2/f43 0 2023-12-16T07:40:17.732 INFO:tasks.workunit.client.0.smithi049.stdout:7/199: dwrite d7/dc/f17 [0,4194304] 0 2023-12-16T07:40:17.733 INFO:tasks.workunit.client.0.smithi049.stdout:3/173: dwrite d1/ff [0,4194304] 0 2023-12-16T07:40:17.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/157: dwrite d20/f21 [0,4194304] 0 2023-12-16T07:40:17.738 INFO:tasks.workunit.client.0.smithi049.stdout:6/226: rename d0/d22/f29 to d0/d22/d33/f49 0 2023-12-16T07:40:17.738 INFO:tasks.workunit.client.0.smithi049.stdout:6/227: chown d0/c7 174659 1 2023-12-16T07:40:17.738 INFO:tasks.workunit.client.0.smithi049.stdout:6/228: chown d0/d2/l2f 26697 1 2023-12-16T07:40:17.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/158: dread fc [0,4194304] 0 2023-12-16T07:40:17.742 INFO:tasks.workunit.client.0.smithi049.stdout:7/200: unlink d7/dc/dd/d14/f22 0 2023-12-16T07:40:17.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/195: dwrite f3 [0,4194304] 0 2023-12-16T07:40:17.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/196: chown d4/d7/f3c 7428 1 2023-12-16T07:40:17.751 INFO:tasks.workunit.client.0.smithi049.stdout:3/174: symlink d1/d2a/l36 0 2023-12-16T07:40:17.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/229: mkdir d0/d39/d3b/d4a 0 2023-12-16T07:40:17.753 INFO:tasks.workunit.client.0.smithi049.stdout:7/201: write d7/f11 [2443814,9730] 0 2023-12-16T07:40:17.754 INFO:tasks.workunit.client.0.smithi049.stdout:9/197: mkdir d4/d3e 0 2023-12-16T07:40:17.754 INFO:tasks.workunit.client.0.smithi049.stdout:9/198: getdents d4/db 0 2023-12-16T07:40:17.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/199: chown d4/c18 28385 1 2023-12-16T07:40:17.755 INFO:tasks.workunit.client.0.smithi049.stdout:3/175: mkdir d1/d2a/d37 0 2023-12-16T07:40:17.757 INFO:tasks.workunit.client.0.smithi049.stdout:1/159: dwrite d20/f29 [0,4194304] 0 2023-12-16T07:40:17.757 INFO:tasks.workunit.client.0.smithi049.stdout:1/160: chown d20/f27 1689 1 2023-12-16T07:40:17.757 INFO:tasks.workunit.client.0.smithi049.stdout:1/161: dread - f15 zero size 2023-12-16T07:40:17.761 INFO:tasks.workunit.client.0.smithi049.stdout:6/230: creat d0/d22/d2c/f4b x:0 0 0 2023-12-16T07:40:17.761 INFO:tasks.workunit.client.0.smithi049.stdout:9/200: mkdir d4/d7/d11/d3f 0 2023-12-16T07:40:17.764 INFO:tasks.workunit.client.0.smithi049.stdout:6/231: dread d0/d2/dd/f1f [0,4194304] 0 2023-12-16T07:40:17.764 INFO:tasks.workunit.client.0.smithi049.stdout:1/162: creat d20/f36 x:0 0 0 2023-12-16T07:40:17.765 INFO:tasks.workunit.client.0.smithi049.stdout:1/163: fdatasync fc 0 2023-12-16T07:40:17.765 INFO:tasks.workunit.client.0.smithi049.stdout:1/164: truncate d20/f32 888404 0 2023-12-16T07:40:17.765 INFO:tasks.workunit.client.0.smithi049.stdout:6/232: dread d0/d2/dd/f1f [0,4194304] 0 2023-12-16T07:40:17.766 INFO:tasks.workunit.client.0.smithi049.stdout:9/201: symlink d4/d7/d11/d3f/l40 0 2023-12-16T07:40:17.766 INFO:tasks.workunit.client.0.smithi049.stdout:9/202: write d4/d7/f21 [651903,89698] 0 2023-12-16T07:40:17.768 INFO:tasks.workunit.client.0.smithi049.stdout:1/165: creat d20/f37 x:0 0 0 2023-12-16T07:40:17.769 INFO:tasks.workunit.client.0.smithi049.stdout:6/233: rmdir d0/d2/dd/d27/d46 0 2023-12-16T07:40:17.771 INFO:tasks.workunit.client.0.smithi049.stdout:7/202: dwrite d7/dc/f25 [0,4194304] 0 2023-12-16T07:40:17.771 INFO:tasks.workunit.client.0.smithi049.stdout:7/203: dread - d7/dc/dd/d27/f48 zero size 2023-12-16T07:40:17.771 INFO:tasks.workunit.client.0.smithi049.stdout:6/234: mkdir d0/d2/dd/d4c 0 2023-12-16T07:40:17.777 INFO:tasks.workunit.client.0.smithi049.stdout:3/176: dread d1/fc [0,4194304] 0 2023-12-16T07:40:17.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/204: link d7/dc/d2f/d38/c3b d7/dc/dd/d35/c4d 0 2023-12-16T07:40:17.779 INFO:tasks.workunit.client.0.smithi049.stdout:6/235: mkdir d0/d2/dd/d4c/d4d 0 2023-12-16T07:40:17.779 INFO:tasks.workunit.client.0.smithi049.stdout:6/236: fsync d0/d2/f8 0 2023-12-16T07:40:17.779 INFO:tasks.workunit.client.0.smithi049.stdout:6/237: chown d0/d2/df/c13 5 1 2023-12-16T07:40:17.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/212: sync 2023-12-16T07:40:17.780 INFO:tasks.workunit.client.0.smithi049.stdout:7/205: write d7/dc/f17 [796241,99708] 0 2023-12-16T07:40:17.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/206: write d7/dc/f1d [2795763,8762] 0 2023-12-16T07:40:17.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/207: fdatasync d7/dc/dd/d27/f3c 0 2023-12-16T07:40:17.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/213: write d0/d13/fe [1512330,76512] 0 2023-12-16T07:40:17.786 INFO:tasks.workunit.client.0.smithi049.stdout:7/208: link d7/l29 d7/dc/d2f/l4e 0 2023-12-16T07:40:17.787 INFO:tasks.workunit.client.0.smithi049.stdout:8/214: symlink d0/d1f/l34 0 2023-12-16T07:40:17.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/177: write d1/f24 [3663683,116269] 0 2023-12-16T07:40:17.790 INFO:tasks.workunit.client.0.smithi049.stdout:7/209: write d7/dc/f1d [3320693,67589] 0 2023-12-16T07:40:17.792 INFO:tasks.workunit.client.0.smithi049.stdout:0/289: sync 2023-12-16T07:40:17.793 INFO:tasks.workunit.client.0.smithi049.stdout:1/166: dwrite d20/f32 [0,4194304] 0 2023-12-16T07:40:17.794 INFO:tasks.workunit.client.0.smithi049.stdout:7/210: dread d7/dc/dd/d27/f3c [0,4194304] 0 2023-12-16T07:40:17.794 INFO:tasks.workunit.client.0.smithi049.stdout:6/238: dwrite d0/f35 [4194304,4194304] 0 2023-12-16T07:40:17.794 INFO:tasks.workunit.client.0.smithi049.stdout:6/239: write d0/d2/df/f24 [840956,3714] 0 2023-12-16T07:40:17.797 INFO:tasks.workunit.client.0.smithi049.stdout:1/167: rmdir d20 39 2023-12-16T07:40:17.798 INFO:tasks.workunit.client.0.smithi049.stdout:3/178: write d1/f24 [2939499,96129] 0 2023-12-16T07:40:17.799 INFO:tasks.workunit.client.0.smithi049.stdout:1/168: write fc [1995779,46539] 0 2023-12-16T07:40:17.799 INFO:tasks.workunit.client.0.smithi049.stdout:1/169: chown l1e 143 1 2023-12-16T07:40:17.802 INFO:tasks.workunit.client.0.smithi049.stdout:6/240: mkdir d0/d2/df/d4e 0 2023-12-16T07:40:17.802 INFO:tasks.workunit.client.0.smithi049.stdout:3/179: mknod d1/d2a/c38 0 2023-12-16T07:40:17.803 INFO:tasks.workunit.client.0.smithi049.stdout:3/180: fsync d1/d2b/f2d 0 2023-12-16T07:40:17.804 INFO:tasks.workunit.client.0.smithi049.stdout:6/241: creat d0/d39/d3b/f4f x:0 0 0 2023-12-16T07:40:17.804 INFO:tasks.workunit.client.0.smithi049.stdout:6/242: stat d0/d2/dd/f26 0 2023-12-16T07:40:17.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/181: dread - d1/f2c zero size 2023-12-16T07:40:17.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/182: rename d1 to d1/d2b/d39 22 2023-12-16T07:40:17.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/183: fsync d1/fc 0 2023-12-16T07:40:17.805 INFO:tasks.workunit.client.0.smithi049.stdout:8/215: dwrite d0/d1f/f2d [0,4194304] 0 2023-12-16T07:40:17.805 INFO:tasks.workunit.client.0.smithi049.stdout:0/290: dread f4 [0,4194304] 0 2023-12-16T07:40:17.805 INFO:tasks.workunit.client.0.smithi049.stdout:0/291: stat d13/d15/c23 0 2023-12-16T07:40:17.806 INFO:tasks.workunit.client.0.smithi049.stdout:7/211: rmdir d7/dc 39 2023-12-16T07:40:17.812 INFO:tasks.workunit.client.0.smithi049.stdout:0/292: creat d13/d39/d38/f67 x:0 0 0 2023-12-16T07:40:17.813 INFO:tasks.workunit.client.0.smithi049.stdout:3/184: symlink d1/l3a 0 2023-12-16T07:40:17.814 INFO:tasks.workunit.client.0.smithi049.stdout:3/185: chown d1/d2b/l34 1562775 1 2023-12-16T07:40:17.815 INFO:tasks.workunit.client.0.smithi049.stdout:7/212: symlink d7/dc/d2f/l4f 0 2023-12-16T07:40:17.815 INFO:tasks.workunit.client.0.smithi049.stdout:7/213: write d7/dc/f1d [4463555,12815] 0 2023-12-16T07:40:17.815 INFO:tasks.workunit.client.0.smithi049.stdout:7/214: readlink l3 0 2023-12-16T07:40:17.816 INFO:tasks.workunit.client.0.smithi049.stdout:0/293: mknod d13/d21/d27/d2c/c68 0 2023-12-16T07:40:17.818 INFO:tasks.workunit.client.0.smithi049.stdout:7/215: symlink d7/dc/dd/d37/l50 0 2023-12-16T07:40:17.819 INFO:tasks.workunit.client.0.smithi049.stdout:7/216: mknod d7/c51 0 2023-12-16T07:40:17.819 INFO:tasks.workunit.client.0.smithi049.stdout:7/217: write d7/dc/dd/d14/f2a [814120,10260] 0 2023-12-16T07:40:17.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/218: creat d7/dc/dd/d14/f52 x:0 0 0 2023-12-16T07:40:17.822 INFO:tasks.workunit.client.0.smithi049.stdout:1/170: dwrite f18 [0,4194304] 0 2023-12-16T07:40:17.823 INFO:tasks.workunit.client.0.smithi049.stdout:6/243: dwrite d0/d2/f47 [0,4194304] 0 2023-12-16T07:40:17.825 INFO:tasks.workunit.client.0.smithi049.stdout:7/219: mknod d7/dc/c53 0 2023-12-16T07:40:17.825 INFO:tasks.workunit.client.0.smithi049.stdout:7/220: write f2 [183687,126411] 0 2023-12-16T07:40:17.828 INFO:tasks.workunit.client.0.smithi049.stdout:1/171: rename d20/f2a to d20/f38 0 2023-12-16T07:40:17.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/294: write d13/f1c [719008,36066] 0 2023-12-16T07:40:17.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/295: fsync d13/f40 0 2023-12-16T07:40:17.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/296: write d13/d21/d27/f5f [759559,25521] 0 2023-12-16T07:40:17.833 INFO:tasks.workunit.client.0.smithi049.stdout:6/244: dread d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:17.834 INFO:tasks.workunit.client.0.smithi049.stdout:6/245: chown d0/d2/cb 94245674 1 2023-12-16T07:40:17.834 INFO:tasks.workunit.client.0.smithi049.stdout:7/221: symlink d7/dc/dd/d27/d46/l54 0 2023-12-16T07:40:17.835 INFO:tasks.workunit.client.0.smithi049.stdout:1/172: rmdir d20 39 2023-12-16T07:40:17.835 INFO:tasks.workunit.client.0.smithi049.stdout:3/186: dwrite d1/f24 [4194304,4194304] 0 2023-12-16T07:40:17.838 INFO:tasks.workunit.client.0.smithi049.stdout:7/222: write d7/dc/dd/d14/f47 [3400217,54534] 0 2023-12-16T07:40:17.838 INFO:tasks.workunit.client.0.smithi049.stdout:7/223: write d7/dc/dd/ff [4426361,42319] 0 2023-12-16T07:40:17.844 INFO:tasks.workunit.client.0.smithi049.stdout:6/246: symlink d0/d2/l50 0 2023-12-16T07:40:17.844 INFO:tasks.workunit.client.0.smithi049.stdout:6/247: dread - d0/d22/f3d zero size 2023-12-16T07:40:17.844 INFO:tasks.workunit.client.0.smithi049.stdout:3/187: creat d1/d2a/f3b x:0 0 0 2023-12-16T07:40:17.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/297: symlink d13/d21/d2f/l69 0 2023-12-16T07:40:17.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/298: chown d13/d21/d27/d2c/c4f 820112686 1 2023-12-16T07:40:17.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/299: chown d13/d39/f3b 221 1 2023-12-16T07:40:17.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/248: write d0/d2/df/f31 [3678225,114888] 0 2023-12-16T07:40:17.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/173: dread d20/f29 [0,4194304] 0 2023-12-16T07:40:17.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/224: symlink d7/dc/dd/d14/l55 0 2023-12-16T07:40:17.849 INFO:tasks.workunit.client.0.smithi049.stdout:0/300: getdents d13/d15 0 2023-12-16T07:40:17.852 INFO:tasks.workunit.client.0.smithi049.stdout:6/249: creat d0/d22/f51 x:0 0 0 2023-12-16T07:40:17.853 INFO:tasks.workunit.client.0.smithi049.stdout:1/174: mknod d20/c39 0 2023-12-16T07:40:17.855 INFO:tasks.workunit.client.0.smithi049.stdout:7/225: mknod d7/dc/dd/d35/d36/c56 0 2023-12-16T07:40:17.856 INFO:tasks.workunit.client.0.smithi049.stdout:0/301: mknod d13/d21/d27/d2c/c6a 0 2023-12-16T07:40:17.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/229: sync 2023-12-16T07:40:17.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/157: sync 2023-12-16T07:40:17.857 INFO:tasks.workunit.client.0.smithi049.stdout:4/184: sync 2023-12-16T07:40:17.857 INFO:tasks.workunit.client.0.smithi049.stdout:0/302: write d13/f17 [1711928,10156] 0 2023-12-16T07:40:17.861 INFO:tasks.workunit.client.0.smithi049.stdout:0/303: chown d13/d39/f3b 8267 1 2023-12-16T07:40:17.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/250: symlink d0/d39/l52 0 2023-12-16T07:40:17.862 INFO:tasks.workunit.client.0.smithi049.stdout:1/175: link l17 d20/l3a 0 2023-12-16T07:40:17.862 INFO:tasks.workunit.client.0.smithi049.stdout:1/176: dread - d20/f35 zero size 2023-12-16T07:40:17.862 INFO:tasks.workunit.client.0.smithi049.stdout:2/230: unlink d2/d1d/f29 0 2023-12-16T07:40:17.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/158: creat d5/de/d2d/d2f/f38 x:0 0 0 2023-12-16T07:40:17.864 INFO:tasks.workunit.client.0.smithi049.stdout:4/185: creat d2/db/dd/de/d1e/d21/f39 x:0 0 0 2023-12-16T07:40:17.864 INFO:tasks.workunit.client.0.smithi049.stdout:3/188: dwrite d1/f18 [0,4194304] 0 2023-12-16T07:40:17.865 INFO:tasks.workunit.client.0.smithi049.stdout:0/304: creat d13/d39/f6b x:0 0 0 2023-12-16T07:40:17.865 INFO:tasks.workunit.client.0.smithi049.stdout:9/203: sync 2023-12-16T07:40:17.865 INFO:tasks.workunit.client.0.smithi049.stdout:9/204: write d4/d7/d11/f16 [761365,130154] 0 2023-12-16T07:40:17.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/251: dread d0/f23 [0,4194304] 0 2023-12-16T07:40:17.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/252: write d0/d22/d33/f49 [252466,128322] 0 2023-12-16T07:40:17.868 INFO:tasks.workunit.client.0.smithi049.stdout:0/305: symlink d13/d3c/l6c 0 2023-12-16T07:40:17.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/226: dread d7/dc/dd/d14/f2a [0,4194304] 0 2023-12-16T07:40:17.870 INFO:tasks.workunit.client.0.smithi049.stdout:7/227: dread - d7/dc/dd/d14/f52 zero size 2023-12-16T07:40:17.872 INFO:tasks.workunit.client.0.smithi049.stdout:0/306: mkdir d13/d15/d6d 0 2023-12-16T07:40:17.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/253: dread d0/d2/dd/f12 [0,4194304] 0 2023-12-16T07:40:17.874 INFO:tasks.workunit.client.0.smithi049.stdout:7/228: mkdir d7/dc/d15/d57 0 2023-12-16T07:40:17.875 INFO:tasks.workunit.client.0.smithi049.stdout:0/307: rename lf to d13/l6e 0 2023-12-16T07:40:17.880 INFO:tasks.workunit.client.0.smithi049.stdout:1/177: dwrite d20/f22 [0,4194304] 0 2023-12-16T07:40:17.880 INFO:tasks.workunit.client.0.smithi049.stdout:1/178: truncate f1d 3099887 0 2023-12-16T07:40:17.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/308: rename d13/f5b to d13/d15/d46/f6f 0 2023-12-16T07:40:17.880 INFO:tasks.workunit.client.0.smithi049.stdout:6/254: fdatasync d0/d2/df/f31 0 2023-12-16T07:40:17.880 INFO:tasks.workunit.client.0.smithi049.stdout:6/255: dread - d0/f40 zero size 2023-12-16T07:40:17.880 INFO:tasks.workunit.client.0.smithi049.stdout:6/256: dread - d0/d2/f3e zero size 2023-12-16T07:40:17.881 INFO:tasks.workunit.client.0.smithi049.stdout:9/205: dwrite d4/d7/d11/d1d/f25 [0,4194304] 0 2023-12-16T07:40:17.881 INFO:tasks.workunit.client.0.smithi049.stdout:5/159: dread d5/f18 [0,4194304] 0 2023-12-16T07:40:17.881 INFO:tasks.workunit.client.0.smithi049.stdout:9/206: write d4/d7/f10 [51386,72774] 0 2023-12-16T07:40:17.883 INFO:tasks.workunit.client.0.smithi049.stdout:9/207: dread d4/db/f31 [0,4194304] 0 2023-12-16T07:40:17.883 INFO:tasks.workunit.client.0.smithi049.stdout:9/208: fsync d4/d7/d11/d26/f37 0 2023-12-16T07:40:17.883 INFO:tasks.workunit.client.0.smithi049.stdout:1/179: mknod d20/c3b 0 2023-12-16T07:40:17.885 INFO:tasks.workunit.client.0.smithi049.stdout:6/257: mkdir d0/d2/dd/d53 0 2023-12-16T07:40:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:5/160: mkdir d5/d1e/d39 0 2023-12-16T07:40:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:5/161: truncate d5/f19 4875640 0 2023-12-16T07:40:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:7/229: write d7/dc/f17 [2374514,91288] 0 2023-12-16T07:40:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:0/309: dread f2 [0,4194304] 0 2023-12-16T07:40:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:0/310: dread - d13/d39/d38/f67 zero size 2023-12-16T07:40:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:8/216: sync 2023-12-16T07:40:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/209: read d4/d7/f10 [3218905,120504] 0 2023-12-16T07:40:17.888 INFO:tasks.workunit.client.0.smithi049.stdout:1/180: creat d20/f3c x:0 0 0 2023-12-16T07:40:17.888 INFO:tasks.workunit.client.0.smithi049.stdout:1/181: fsync f14 0 2023-12-16T07:40:17.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/189: truncate d1/f18 3189720 0 2023-12-16T07:40:17.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/190: dread - d1/d2a/f30 zero size 2023-12-16T07:40:17.890 INFO:tasks.workunit.client.0.smithi049.stdout:6/258: creat d0/d39/f54 x:0 0 0 2023-12-16T07:40:17.891 INFO:tasks.workunit.client.0.smithi049.stdout:5/162: mknod d5/de/c3a 0 2023-12-16T07:40:17.892 INFO:tasks.workunit.client.0.smithi049.stdout:7/230: mknod d7/dc/d2f/d38/c58 0 2023-12-16T07:40:17.892 INFO:tasks.workunit.client.0.smithi049.stdout:7/231: chown d7/dc/dd/d35/d36/l4c 3134 1 2023-12-16T07:40:17.894 INFO:tasks.workunit.client.0.smithi049.stdout:8/217: unlink d0/d1f/f2d 0 2023-12-16T07:40:17.894 INFO:tasks.workunit.client.0.smithi049.stdout:8/218: read - d0/d13/f31 zero size 2023-12-16T07:40:17.895 INFO:tasks.workunit.client.0.smithi049.stdout:8/219: read d0/d13/fd [1650139,23204] 0 2023-12-16T07:40:17.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/182: link d20/f35 d20/f3d 0 2023-12-16T07:40:17.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/183: write d20/f2e [4484886,75352] 0 2023-12-16T07:40:17.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/231: dwrite d2/d1d/d24/f33 [0,4194304] 0 2023-12-16T07:40:17.897 INFO:tasks.workunit.client.0.smithi049.stdout:4/186: dwrite d2/f18 [0,4194304] 0 2023-12-16T07:40:17.897 INFO:tasks.workunit.client.0.smithi049.stdout:2/232: truncate d2/f36 1246550 0 2023-12-16T07:40:17.898 INFO:tasks.workunit.client.0.smithi049.stdout:1/184: write d20/f27 [3323213,8691] 0 2023-12-16T07:40:17.899 INFO:tasks.workunit.client.0.smithi049.stdout:9/210: dread d4/db/f22 [0,4194304] 0 2023-12-16T07:40:17.899 INFO:tasks.workunit.client.0.smithi049.stdout:9/211: truncate d4/db/f31 1192120 0 2023-12-16T07:40:17.900 INFO:tasks.workunit.client.0.smithi049.stdout:6/259: getdents d0/d22 0 2023-12-16T07:40:17.901 INFO:tasks.workunit.client.0.smithi049.stdout:0/311: dwrite d13/d21/d27/f4d [0,4194304] 0 2023-12-16T07:40:17.902 INFO:tasks.workunit.client.0.smithi049.stdout:5/163: link d5/de/f1d d5/d1e/d21/f3b 0 2023-12-16T07:40:17.902 INFO:tasks.workunit.client.0.smithi049.stdout:5/164: write d5/de/f1d [4579576,113476] 0 2023-12-16T07:40:17.904 INFO:tasks.workunit.client.0.smithi049.stdout:9/212: dread d4/d7/d11/f16 [0,4194304] 0 2023-12-16T07:40:17.908 INFO:tasks.workunit.client.0.smithi049.stdout:8/220: rename d0/d13/l20 to d0/d1f/l35 0 2023-12-16T07:40:17.908 INFO:tasks.workunit.client.0.smithi049.stdout:7/232: mkdir d7/d2b/d59 0 2023-12-16T07:40:17.909 INFO:tasks.workunit.client.0.smithi049.stdout:2/233: truncate d2/d7/d11/f25 781925 0 2023-12-16T07:40:17.909 INFO:tasks.workunit.client.0.smithi049.stdout:5/165: dread f3 [0,4194304] 0 2023-12-16T07:40:17.910 INFO:tasks.workunit.client.0.smithi049.stdout:1/185: creat d20/f3e x:0 0 0 2023-12-16T07:40:17.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/233: write d7/dc/dd/d14/f32 [2610818,40014] 0 2023-12-16T07:40:17.912 INFO:tasks.workunit.client.0.smithi049.stdout:3/191: unlink d1/f1f 0 2023-12-16T07:40:17.914 INFO:tasks.workunit.client.0.smithi049.stdout:0/312: getdents d13/d21 0 2023-12-16T07:40:17.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/234: write d7/dc/f17 [542570,72726] 0 2023-12-16T07:40:17.915 INFO:tasks.workunit.client.0.smithi049.stdout:2/234: write d2/d26/f39 [1237544,62636] 0 2023-12-16T07:40:17.916 INFO:tasks.workunit.client.0.smithi049.stdout:9/213: creat d4/db/f41 x:0 0 0 2023-12-16T07:40:17.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/166: getdents d5/de/d2d 0 2023-12-16T07:40:17.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/167: write d5/de/d1c/f25 [438337,105731] 0 2023-12-16T07:40:17.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/168: readlink d5/lc 0 2023-12-16T07:40:17.919 INFO:tasks.workunit.client.0.smithi049.stdout:8/221: rmdir d0/d1f 39 2023-12-16T07:40:17.920 INFO:tasks.workunit.client.0.smithi049.stdout:1/186: rename d20/f2e to d20/f3f 0 2023-12-16T07:40:17.920 INFO:tasks.workunit.client.0.smithi049.stdout:4/187: dwrite d2/db/dd/fa [0,4194304] 0 2023-12-16T07:40:17.921 INFO:tasks.workunit.client.0.smithi049.stdout:6/260: dwrite d0/f30 [0,4194304] 0 2023-12-16T07:40:17.922 INFO:tasks.workunit.client.0.smithi049.stdout:3/192: creat d1/f3c x:0 0 0 2023-12-16T07:40:17.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/313: mkdir d13/d21/d27/d2c/d62/d70 0 2023-12-16T07:40:17.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/314: dread - d13/d21/f56 zero size 2023-12-16T07:40:17.927 INFO:tasks.workunit.client.0.smithi049.stdout:2/235: creat d2/de/f46 x:0 0 0 2023-12-16T07:40:17.927 INFO:tasks.workunit.client.0.smithi049.stdout:2/236: read - d2/d7/d11/f3d zero size 2023-12-16T07:40:17.929 INFO:tasks.workunit.client.0.smithi049.stdout:8/222: mkdir d0/d1f/d36 0 2023-12-16T07:40:17.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/187: mkdir d20/d40 0 2023-12-16T07:40:17.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/261: creat d0/d39/d3b/f55 x:0 0 0 2023-12-16T07:40:17.937 INFO:tasks.workunit.client.0.smithi049.stdout:3/193: stat d1/l1d 0 2023-12-16T07:40:17.938 INFO:tasks.workunit.client.0.smithi049.stdout:7/235: dread d7/dc/dd/d14/f47 [0,4194304] 0 2023-12-16T07:40:17.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/188: dwrite d2/f18 [4194304,4194304] 0 2023-12-16T07:40:17.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/315: rename d13/d21/d27/c3d to d13/d15/d46/d65/c71 0 2023-12-16T07:40:17.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/236: dwrite d7/dc/d2f/d38/f3d [0,4194304] 0 2023-12-16T07:40:17.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/237: dread - d7/dc/dd/d14/f52 zero size 2023-12-16T07:40:17.956 INFO:tasks.workunit.client.0.smithi049.stdout:2/237: unlink d2/d7/d11/l16 0 2023-12-16T07:40:17.958 INFO:tasks.workunit.client.0.smithi049.stdout:5/169: truncate d5/d1e/d21/f3b 3691780 0 2023-12-16T07:40:17.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:17 smithi049 ceph-mon[111939]: pgmap v5: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:40:17.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:17 smithi049 ceph-mon[111939]: mgrmap e24: smithi133.wbiduk(active, since 4s) 2023-12-16T07:40:17.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/223: symlink d0/d1f/d1c/l37 0 2023-12-16T07:40:17.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/188: mkdir d20/d41 0 2023-12-16T07:40:17.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/189: readlink l13 0 2023-12-16T07:40:17.962 INFO:tasks.workunit.client.0.smithi049.stdout:6/262: creat d0/d2/df/d4e/f56 x:0 0 0 2023-12-16T07:40:17.962 INFO:tasks.workunit.client.0.smithi049.stdout:6/263: dread - d0/d2/dd/d27/f45 zero size 2023-12-16T07:40:17.965 INFO:tasks.workunit.client.0.smithi049.stdout:3/194: rename d1/d2a/c38 to d1/d2a/d37/c3d 0 2023-12-16T07:40:17.965 INFO:tasks.workunit.client.0.smithi049.stdout:3/195: fsync d1/fc 0 2023-12-16T07:40:17.965 INFO:tasks.workunit.client.0.smithi049.stdout:3/196: chown d1/f2c 32 1 2023-12-16T07:40:17.965 INFO:tasks.workunit.client.0.smithi049.stdout:0/316: mknod d13/d39/c72 0 2023-12-16T07:40:17.968 INFO:tasks.workunit.client.0.smithi049.stdout:7/238: symlink d7/dc/d15/d57/l5a 0 2023-12-16T07:40:17.969 INFO:tasks.workunit.client.0.smithi049.stdout:5/170: mkdir d5/de/d2d/d3c 0 2023-12-16T07:40:17.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/171: write d5/fb [7769415,90935] 0 2023-12-16T07:40:17.972 INFO:tasks.workunit.client.0.smithi049.stdout:1/190: mknod d20/d40/c42 0 2023-12-16T07:40:17.972 INFO:tasks.workunit.client.0.smithi049.stdout:1/191: write f14 [1518629,93552] 0 2023-12-16T07:40:17.972 INFO:tasks.workunit.client.0.smithi049.stdout:1/192: readlink l13 0 2023-12-16T07:40:17.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/264: symlink d0/d39/d3b/d4a/l57 0 2023-12-16T07:40:17.977 INFO:tasks.workunit.client.0.smithi049.stdout:4/189: rename d2/db/dd/de/f17 to d2/db/dd/d2a/f3a 0 2023-12-16T07:40:17.978 INFO:tasks.workunit.client.0.smithi049.stdout:3/197: write d1/f26 [212569,83831] 0 2023-12-16T07:40:17.979 INFO:tasks.workunit.client.0.smithi049.stdout:8/224: dread d0/d1f/f18 [0,4194304] 0 2023-12-16T07:40:17.979 INFO:tasks.workunit.client.0.smithi049.stdout:8/225: fsync d0/d1f/f22 0 2023-12-16T07:40:17.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/239: mknod d7/dc/dd/d35/d36/c5b 0 2023-12-16T07:40:17.983 INFO:tasks.workunit.client.0.smithi049.stdout:7/240: dread f4 [0,4194304] 0 2023-12-16T07:40:17.984 INFO:tasks.workunit.client.0.smithi049.stdout:1/193: truncate d20/f29 2088701 0 2023-12-16T07:40:17.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/172: dwrite d5/f8 [0,4194304] 0 2023-12-16T07:40:17.986 INFO:tasks.workunit.client.0.smithi049.stdout:0/317: rename d13/d39/d38/f58 to d13/d15/d46/d65/f73 0 2023-12-16T07:40:17.989 INFO:tasks.workunit.client.0.smithi049.stdout:3/198: stat d1/l21 0 2023-12-16T07:40:17.989 INFO:tasks.workunit.client.0.smithi049.stdout:3/199: chown d1/f18 213301075 1 2023-12-16T07:40:17.992 INFO:tasks.workunit.client.0.smithi049.stdout:7/241: rmdir d7/dc/dd 39 2023-12-16T07:40:17.992 INFO:tasks.workunit.client.0.smithi049.stdout:7/242: fdatasync d7/dc/dd/d14/f52 0 2023-12-16T07:40:17.993 INFO:tasks.workunit.client.0.smithi049.stdout:1/194: mkdir d20/d43 0 2023-12-16T07:40:17.995 INFO:tasks.workunit.client.0.smithi049.stdout:4/190: rmdir d2 39 2023-12-16T07:40:18.003 INFO:tasks.workunit.client.0.smithi049.stdout:6/265: rename d0/d22 to d0/d2/dd/d58 0 2023-12-16T07:40:18.003 INFO:tasks.workunit.client.0.smithi049.stdout:0/318: getdents d13/d21/d27/d2c/d62 0 2023-12-16T07:40:18.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/243: mkdir d7/dc/dd/d37/d5c 0 2023-12-16T07:40:18.003 INFO:tasks.workunit.client.0.smithi049.stdout:6/266: write d0/d2/dd/d58/f3d [681203,126907] 0 2023-12-16T07:40:18.003 INFO:tasks.workunit.client.0.smithi049.stdout:3/200: chown d1/l8 127284 1 2023-12-16T07:40:18.003 INFO:tasks.workunit.client.0.smithi049.stdout:3/201: dread - d1/d2a/f2f zero size 2023-12-16T07:40:18.003 INFO:tasks.workunit.client.0.smithi049.stdout:1/195: rmdir d20 39 2023-12-16T07:40:18.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/244: write f2 [522639,90863] 0 2023-12-16T07:40:18.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/245: fsync d7/dc/f1b 0 2023-12-16T07:40:18.005 INFO:tasks.workunit.client.0.smithi049.stdout:0/319: rename d13/d21/d2f/l57 to d13/d39/d53/l74 0 2023-12-16T07:40:18.005 INFO:tasks.workunit.client.0.smithi049.stdout:0/320: write d13/f40 [1017291,7908] 0 2023-12-16T07:40:18.005 INFO:tasks.workunit.client.0.smithi049.stdout:0/321: stat d13/d15/l5c 0 2023-12-16T07:40:18.005 INFO:tasks.workunit.client.0.smithi049.stdout:0/322: chown d13/d39/c72 247 1 2023-12-16T07:40:18.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/267: mknod d0/d39/d3b/c59 0 2023-12-16T07:40:18.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/196: mknod d20/d43/c44 0 2023-12-16T07:40:18.009 INFO:tasks.workunit.client.0.smithi049.stdout:7/246: mkdir d7/dc/d2f/d40/d5d 0 2023-12-16T07:40:18.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/247: write d7/dc/d2f/d38/f3d [4456295,99452] 0 2023-12-16T07:40:18.010 INFO:tasks.workunit.client.0.smithi049.stdout:9/214: sync 2023-12-16T07:40:18.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/202: mknod d1/c3e 0 2023-12-16T07:40:18.012 INFO:tasks.workunit.client.0.smithi049.stdout:3/203: chown d1/f2c 810767 1 2023-12-16T07:40:18.012 INFO:tasks.workunit.client.0.smithi049.stdout:3/204: dread - d1/f2c zero size 2023-12-16T07:40:18.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/191: dwrite d2/db/dd/d2a/f1c [0,4194304] 0 2023-12-16T07:40:18.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/192: write d2/db/dd/d2a/f1c [489589,83737] 0 2023-12-16T07:40:18.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/323: dread d13/f16 [0,4194304] 0 2023-12-16T07:40:18.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/324: truncate fa 4886208 0 2023-12-16T07:40:18.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/325: write d13/d15/d46/f6f [3011968,105004] 0 2023-12-16T07:40:18.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/193: dread d2/ff [0,4194304] 0 2023-12-16T07:40:18.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/248: creat d7/d2b/d59/f5e x:0 0 0 2023-12-16T07:40:18.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/215: getdents d4/d7/d11/d3f 0 2023-12-16T07:40:18.019 INFO:tasks.workunit.client.0.smithi049.stdout:3/205: truncate d1/ff 2235421 0 2023-12-16T07:40:18.019 INFO:tasks.workunit.client.0.smithi049.stdout:3/206: chown d1/f24 2048279 1 2023-12-16T07:40:18.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/249: dread - d7/dc/dd/d27/f48 zero size 2023-12-16T07:40:18.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/250: chown d7/dc/d2f/d40/d5d 15688 1 2023-12-16T07:40:18.020 INFO:tasks.workunit.client.0.smithi049.stdout:4/194: read d2/db/dd/de/d1e/d21/f25 [526733,24838] 0 2023-12-16T07:40:18.020 INFO:tasks.workunit.client.0.smithi049.stdout:4/195: write d2/db/dd/de/d1e/d21/f39 [473348,67994] 0 2023-12-16T07:40:18.020 INFO:tasks.workunit.client.0.smithi049.stdout:4/196: chown d2/db/dd/de/d1e/d37/f38 96 1 2023-12-16T07:40:18.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/326: rmdir d13/d21/d27/d2c 39 2023-12-16T07:40:18.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/327: truncate d13/f1d 776823 0 2023-12-16T07:40:18.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/328: chown d13/f1d 273799 1 2023-12-16T07:40:18.022 INFO:tasks.workunit.client.0.smithi049.stdout:9/216: symlink d4/d3e/l42 0 2023-12-16T07:40:18.023 INFO:tasks.workunit.client.0.smithi049.stdout:7/251: creat d7/dc/dd/d35/d36/f5f x:0 0 0 2023-12-16T07:40:18.023 INFO:tasks.workunit.client.0.smithi049.stdout:7/252: fsync d7/fb 0 2023-12-16T07:40:18.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/253: read d7/fa [1822245,44700] 0 2023-12-16T07:40:18.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/254: write d7/dc/dd/f1e [2636833,116807] 0 2023-12-16T07:40:18.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/255: write d7/dc/d2f/d40/f4b [392560,26366] 0 2023-12-16T07:40:18.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/256: write d7/dc/f25 [1851754,124373] 0 2023-12-16T07:40:18.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/197: creat d2/db/dd/de/d1e/f3b x:0 0 0 2023-12-16T07:40:18.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/257: fdatasync f6 0 2023-12-16T07:40:18.026 INFO:tasks.workunit.client.0.smithi049.stdout:0/329: symlink d13/d21/d27/l75 0 2023-12-16T07:40:18.027 INFO:tasks.workunit.client.0.smithi049.stdout:6/268: dwrite d0/d2/dd/f26 [0,4194304] 0 2023-12-16T07:40:18.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/198: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:18.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/199: fsync d2/ff 0 2023-12-16T07:40:18.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/217: symlink d4/d7/d11/l43 0 2023-12-16T07:40:18.031 INFO:tasks.workunit.client.0.smithi049.stdout:0/330: symlink d13/d21/l76 0 2023-12-16T07:40:18.031 INFO:tasks.workunit.client.0.smithi049.stdout:0/331: truncate d13/d15/f19 5532464 0 2023-12-16T07:40:18.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/269: mknod d0/d39/d3b/d4a/c5a 0 2023-12-16T07:40:18.035 INFO:tasks.workunit.client.0.smithi049.stdout:6/270: chown d0/l34 12 1 2023-12-16T07:40:18.035 INFO:tasks.workunit.client.0.smithi049.stdout:6/271: fsync d0/d2/f5 0 2023-12-16T07:40:18.035 INFO:tasks.workunit.client.0.smithi049.stdout:6/272: dread - d0/d2/dd/d58/d2c/f4b zero size 2023-12-16T07:40:18.035 INFO:tasks.workunit.client.0.smithi049.stdout:6/273: stat d0/d39/d3b/d4a 0 2023-12-16T07:40:18.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/200: creat d2/db/dd/de/d1e/d37/f3c x:0 0 0 2023-12-16T07:40:18.045 INFO:tasks.workunit.client.0.smithi049.stdout:3/207: dwrite d1/f16 [0,4194304] 0 2023-12-16T07:40:18.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/208: mkdir d1/d2a/d37/d3f 0 2023-12-16T07:40:18.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/209: write d1/f3c [103638,9992] 0 2023-12-16T07:40:18.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/210: dread - d1/d2a/f3b zero size 2023-12-16T07:40:18.056 INFO:tasks.workunit.client.0.smithi049.stdout:4/201: write d2/db/f15 [1579899,78800] 0 2023-12-16T07:40:18.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/218: dwrite f0 [4194304,4194304] 0 2023-12-16T07:40:18.069 INFO:tasks.workunit.client.0.smithi049.stdout:7/258: dwrite d7/fa [0,4194304] 0 2023-12-16T07:40:18.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/259: link d7/dc/d2f/d38/f3d d7/dc/d2f/f60 0 2023-12-16T07:40:18.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/260: rmdir d7/dc/d2f/d40 39 2023-12-16T07:40:18.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/261: chown d7/dc/dd/c33 1 1 2023-12-16T07:40:18.072 INFO:tasks.workunit.client.0.smithi049.stdout:9/219: dread d4/d7/d11/d26/f37 [0,4194304] 0 2023-12-16T07:40:18.072 INFO:tasks.workunit.client.0.smithi049.stdout:7/262: rename d7/f11 to d7/dc/f61 0 2023-12-16T07:40:18.073 INFO:tasks.workunit.client.0.smithi049.stdout:9/220: creat d4/db/f44 x:0 0 0 2023-12-16T07:40:18.074 INFO:tasks.workunit.client.0.smithi049.stdout:7/263: mknod d7/dc/dd/d14/c62 0 2023-12-16T07:40:18.074 INFO:tasks.workunit.client.0.smithi049.stdout:9/221: mkdir d4/d45 0 2023-12-16T07:40:18.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/222: mknod d4/d3e/c46 0 2023-12-16T07:40:18.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/223: fdatasync d4/fd 0 2023-12-16T07:40:18.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/202: dwrite d2/db/dd/f13 [0,4194304] 0 2023-12-16T07:40:18.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/332: dwrite d13/d15/d46/f63 [0,4194304] 0 2023-12-16T07:40:18.077 INFO:tasks.workunit.client.0.smithi049.stdout:6/274: dwrite d0/d2/dd/f1d [4194304,4194304] 0 2023-12-16T07:40:18.083 INFO:tasks.workunit.client.0.smithi049.stdout:4/203: dread d2/db/dd/d2a/f3a [0,4194304] 0 2023-12-16T07:40:18.085 INFO:tasks.workunit.client.0.smithi049.stdout:0/333: symlink d13/d21/d2f/l77 0 2023-12-16T07:40:18.085 INFO:tasks.workunit.client.0.smithi049.stdout:0/334: dread - d13/d39/f61 zero size 2023-12-16T07:40:18.093 INFO:tasks.workunit.client.0.smithi049.stdout:6/275: dread d0/d2/dd/f1d [4194304,4194304] 0 2023-12-16T07:40:18.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/204: creat d2/db/dd/f3d x:0 0 0 2023-12-16T07:40:18.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/205: write d2/db/dd/d2a/f3a [209359,75191] 0 2023-12-16T07:40:18.095 INFO:tasks.workunit.client.0.smithi049.stdout:9/224: dwrite d4/ff [4194304,4194304] 0 2023-12-16T07:40:18.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/276: mkdir d0/d39/d5b 0 2023-12-16T07:40:18.097 INFO:tasks.workunit.client.0.smithi049.stdout:9/225: dread d4/d7/f9 [0,4194304] 0 2023-12-16T07:40:18.098 INFO:tasks.workunit.client.0.smithi049.stdout:9/226: fsync d4/d7/d11/f20 0 2023-12-16T07:40:18.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/277: creat d0/d2/dd/d58/f5c x:0 0 0 2023-12-16T07:40:18.102 INFO:tasks.workunit.client.0.smithi049.stdout:9/227: mkdir d4/d7/d11/d26/d47 0 2023-12-16T07:40:18.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/228: mkdir d4/d7/d11/d1d/d48 0 2023-12-16T07:40:18.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/229: fsync d4/f1f 0 2023-12-16T07:40:18.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/230: rename d4/d7 to d4/d7/d11/d26/d47/d49 22 2023-12-16T07:40:18.105 INFO:tasks.workunit.client.0.smithi049.stdout:0/335: dwrite f12 [0,4194304] 0 2023-12-16T07:40:18.106 INFO:tasks.workunit.client.0.smithi049.stdout:9/231: creat d4/d3e/f4a x:0 0 0 2023-12-16T07:40:18.108 INFO:tasks.workunit.client.0.smithi049.stdout:0/336: mkdir d13/d39/d78 0 2023-12-16T07:40:18.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/232: rename d4/d7/d11/d3f/l40 to d4/d7/d11/d3f/l4b 0 2023-12-16T07:40:18.111 INFO:tasks.workunit.client.0.smithi049.stdout:0/337: link d13/d21/d2f/l77 d13/d21/l79 0 2023-12-16T07:40:18.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/238: sync 2023-12-16T07:40:18.113 INFO:tasks.workunit.client.0.smithi049.stdout:0/338: dread d13/f40 [0,4194304] 0 2023-12-16T07:40:18.114 INFO:tasks.workunit.client.0.smithi049.stdout:0/339: truncate d13/d15/f19 969680 0 2023-12-16T07:40:18.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/340: rmdir d13/d21 39 2023-12-16T07:40:18.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/341: write fa [5488049,6686] 0 2023-12-16T07:40:18.115 INFO:tasks.workunit.client.0.smithi049.stdout:8/226: sync 2023-12-16T07:40:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:17 smithi133 ceph-mon[120445]: pgmap v5: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:40:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:17 smithi133 ceph-mon[120445]: mgrmap e24: smithi133.wbiduk(active, since 4s) 2023-12-16T07:40:18.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/227: mknod d0/c38 0 2023-12-16T07:40:18.120 INFO:tasks.workunit.client.0.smithi049.stdout:6/278: dwrite d0/d2/dd/d58/f51 [0,4194304] 0 2023-12-16T07:40:18.126 INFO:tasks.workunit.client.0.smithi049.stdout:6/279: unlink d0/d39/d3b/c59 0 2023-12-16T07:40:18.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/239: dwrite d2/f17 [0,4194304] 0 2023-12-16T07:40:18.132 INFO:tasks.workunit.client.0.smithi049.stdout:2/240: mkdir d2/d7/d11/d47 0 2023-12-16T07:40:18.144 INFO:tasks.workunit.client.0.smithi049.stdout:6/280: dread d0/d2/dd/d58/d2c/f36 [0,4194304] 0 2023-12-16T07:40:18.146 INFO:tasks.workunit.client.0.smithi049.stdout:6/281: mkdir d0/d2/df/d4e/d5d 0 2023-12-16T07:40:18.147 INFO:tasks.workunit.client.0.smithi049.stdout:0/342: dwrite d13/d15/d46/f63 [0,4194304] 0 2023-12-16T07:40:18.147 INFO:tasks.workunit.client.0.smithi049.stdout:0/343: chown d13/d21/d27/f4d 89 1 2023-12-16T07:40:18.148 INFO:tasks.workunit.client.0.smithi049.stdout:0/344: truncate d13/d15/f1f 1052251 0 2023-12-16T07:40:18.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/228: dwrite d0/d1f/f17 [4194304,4194304] 0 2023-12-16T07:40:18.148 INFO:tasks.workunit.client.0.smithi049.stdout:0/345: stat fd 0 2023-12-16T07:40:18.149 INFO:tasks.workunit.client.0.smithi049.stdout:6/282: dread d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:18.153 INFO:tasks.workunit.client.0.smithi049.stdout:0/346: dread d13/f16 [0,4194304] 0 2023-12-16T07:40:18.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/241: dwrite d2/de/f46 [0,4194304] 0 2023-12-16T07:40:18.161 INFO:tasks.workunit.client.0.smithi049.stdout:2/242: truncate d2/de/f1b 3734531 0 2023-12-16T07:40:18.161 INFO:tasks.workunit.client.0.smithi049.stdout:2/243: chown d2/d7/fb 415608455 1 2023-12-16T07:40:18.161 INFO:tasks.workunit.client.0.smithi049.stdout:2/244: fsync d2/d7/d11/f1e 0 2023-12-16T07:40:18.174 INFO:tasks.workunit.client.0.smithi049.stdout:5/173: sync 2023-12-16T07:40:18.175 INFO:tasks.workunit.client.0.smithi049.stdout:1/197: sync 2023-12-16T07:40:18.175 INFO:tasks.workunit.client.0.smithi049.stdout:1/198: fsync f18 0 2023-12-16T07:40:18.175 INFO:tasks.workunit.client.0.smithi049.stdout:3/211: sync 2023-12-16T07:40:18.175 INFO:tasks.workunit.client.0.smithi049.stdout:3/212: chown d1 15 1 2023-12-16T07:40:18.176 INFO:tasks.workunit.client.0.smithi049.stdout:1/199: mkdir d20/d45 0 2023-12-16T07:40:18.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/213: dread d1/f3c [0,4194304] 0 2023-12-16T07:40:18.178 INFO:tasks.workunit.client.0.smithi049.stdout:3/214: read d1/f26 [202551,94011] 0 2023-12-16T07:40:18.178 INFO:tasks.workunit.client.0.smithi049.stdout:0/347: dwrite d13/d21/f2a [0,4194304] 0 2023-12-16T07:40:18.178 INFO:tasks.workunit.client.0.smithi049.stdout:0/348: readlink d13/d3c/l6c 0 2023-12-16T07:40:18.179 INFO:tasks.workunit.client.0.smithi049.stdout:0/349: dread - d13/d39/f61 zero size 2023-12-16T07:40:18.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/200: rename d20/l31 to d20/d41/l46 0 2023-12-16T07:40:18.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/245: dwrite d2/d7/d11/f1e [0,4194304] 0 2023-12-16T07:40:18.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/246: rename d2/d1d/d38 to d2/d1d/d38/d48 22 2023-12-16T07:40:18.182 INFO:tasks.workunit.client.0.smithi049.stdout:6/283: dwrite d0/d2/dd/f1f [0,4194304] 0 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:8/229: dwrite d0/d13/f25 [0,4194304] 0 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:8/230: chown d0/d1f/d1c/l23 415778284 1 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:8/231: chown d0/d1f/d1c/l23 3617 1 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:0/350: symlink d13/d39/d38/l7a 0 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:0/351: readlink d13/d39/d38/l7a 0 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:0/352: readlink d13/d3c/l6c 0 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:0/353: write d13/d15/d46/f6f [4656265,127878] 0 2023-12-16T07:40:18.183 INFO:tasks.workunit.client.0.smithi049.stdout:1/201: rmdir d20/d43 39 2023-12-16T07:40:18.184 INFO:tasks.workunit.client.0.smithi049.stdout:2/247: symlink d2/d1d/l49 0 2023-12-16T07:40:18.187 INFO:tasks.workunit.client.0.smithi049.stdout:6/284: truncate d0/f23 3413694 0 2023-12-16T07:40:18.189 INFO:tasks.workunit.client.0.smithi049.stdout:8/232: creat d0/d1f/d1c/f39 x:0 0 0 2023-12-16T07:40:18.190 INFO:tasks.workunit.client.0.smithi049.stdout:0/354: unlink d13/d21/d2f/l69 0 2023-12-16T07:40:18.191 INFO:tasks.workunit.client.0.smithi049.stdout:1/202: truncate d20/f29 1115670 0 2023-12-16T07:40:18.191 INFO:tasks.workunit.client.0.smithi049.stdout:1/203: write f7 [1159055,123094] 0 2023-12-16T07:40:18.195 INFO:tasks.workunit.client.0.smithi049.stdout:2/248: rename d2/l27 to d2/de/l4a 0 2023-12-16T07:40:18.196 INFO:tasks.workunit.client.0.smithi049.stdout:6/285: symlink d0/d2/dd/d53/l5e 0 2023-12-16T07:40:18.196 INFO:tasks.workunit.client.0.smithi049.stdout:8/233: rmdir d0/d1f 39 2023-12-16T07:40:18.196 INFO:tasks.workunit.client.0.smithi049.stdout:8/234: write d0/d13/f31 [794166,24351] 0 2023-12-16T07:40:18.199 INFO:tasks.workunit.client.0.smithi049.stdout:1/204: truncate fa 4247234 0 2023-12-16T07:40:18.201 INFO:tasks.workunit.client.0.smithi049.stdout:2/249: unlink d2/f12 0 2023-12-16T07:40:18.204 INFO:tasks.workunit.client.0.smithi049.stdout:1/205: mkdir d20/d45/d47 0 2023-12-16T07:40:18.204 INFO:tasks.workunit.client.0.smithi049.stdout:5/174: dwrite d5/de/f1d [0,4194304] 0 2023-12-16T07:40:18.204 INFO:tasks.workunit.client.0.smithi049.stdout:5/175: fsync d5/f2a 0 2023-12-16T07:40:18.207 INFO:tasks.workunit.client.0.smithi049.stdout:1/206: creat d20/d45/f48 x:0 0 0 2023-12-16T07:40:18.208 INFO:tasks.workunit.client.0.smithi049.stdout:5/176: unlink d5/lc 0 2023-12-16T07:40:18.209 INFO:tasks.workunit.client.0.smithi049.stdout:5/177: chown d5 28420 1 2023-12-16T07:40:18.210 INFO:tasks.workunit.client.0.smithi049.stdout:1/207: mkdir d20/d41/d49 0 2023-12-16T07:40:18.210 INFO:tasks.workunit.client.0.smithi049.stdout:1/208: stat d20/d41 0 2023-12-16T07:40:18.211 INFO:tasks.workunit.client.0.smithi049.stdout:5/178: rmdir d5/de/d1c 39 2023-12-16T07:40:18.214 INFO:tasks.workunit.client.0.smithi049.stdout:7/264: sync 2023-12-16T07:40:18.214 INFO:tasks.workunit.client.0.smithi049.stdout:7/265: readlink d7/dc/d2f/l39 0 2023-12-16T07:40:18.215 INFO:tasks.workunit.client.0.smithi049.stdout:1/209: truncate fc 1699668 0 2023-12-16T07:40:18.216 INFO:tasks.workunit.client.0.smithi049.stdout:5/179: mkdir d5/de/d3d 0 2023-12-16T07:40:18.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/266: unlink d7/dc/d15/l23 0 2023-12-16T07:40:18.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/267: fsync f6 0 2023-12-16T07:40:18.218 INFO:tasks.workunit.client.0.smithi049.stdout:3/215: dwrite d1/f24 [0,4194304] 0 2023-12-16T07:40:18.219 INFO:tasks.workunit.client.0.smithi049.stdout:1/210: rename d20/c2b to d20/d41/c4a 0 2023-12-16T07:40:18.219 INFO:tasks.workunit.client.0.smithi049.stdout:1/211: chown fe 53558 1 2023-12-16T07:40:18.219 INFO:tasks.workunit.client.0.smithi049.stdout:1/212: truncate f1f 779353 0 2023-12-16T07:40:18.219 INFO:tasks.workunit.client.0.smithi049.stdout:3/216: creat d1/d2a/f40 x:0 0 0 2023-12-16T07:40:18.221 INFO:tasks.workunit.client.0.smithi049.stdout:0/355: dwrite d13/d15/f1f [0,4194304] 0 2023-12-16T07:40:18.221 INFO:tasks.workunit.client.0.smithi049.stdout:8/235: dwrite d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:18.221 INFO:tasks.workunit.client.0.smithi049.stdout:7/268: rename d7/dc/dd/d27/f3c to d7/dc/d2f/d38/f63 0 2023-12-16T07:40:18.221 INFO:tasks.workunit.client.0.smithi049.stdout:7/269: chown d7/dc/d2f/d38/c4a 12051482 1 2023-12-16T07:40:18.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/250: getdents d2/de 0 2023-12-16T07:40:18.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/356: rmdir d13/d15/d6d 0 2023-12-16T07:40:18.235 INFO:tasks.workunit.client.0.smithi049.stdout:5/180: dwrite d5/de/d2d/f33 [0,4194304] 0 2023-12-16T07:40:18.236 INFO:tasks.workunit.client.0.smithi049.stdout:8/236: creat d0/d1f/d36/f3a x:0 0 0 2023-12-16T07:40:18.236 INFO:tasks.workunit.client.0.smithi049.stdout:5/181: read d5/f2a [1181612,43305] 0 2023-12-16T07:40:18.236 INFO:tasks.workunit.client.0.smithi049.stdout:5/182: dread - d5/f26 zero size 2023-12-16T07:40:18.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/183: write d5/f18 [3135825,44334] 0 2023-12-16T07:40:18.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/184: stat d5/de/c1b 0 2023-12-16T07:40:18.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/185: chown d5/de/d1c/c23 1034 1 2023-12-16T07:40:18.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/186: stat d5/de/f1d 0 2023-12-16T07:40:18.237 INFO:tasks.workunit.client.0.smithi049.stdout:7/270: creat d7/d2b/d59/f64 x:0 0 0 2023-12-16T07:40:18.238 INFO:tasks.workunit.client.0.smithi049.stdout:2/251: creat d2/d1d/d38/f4b x:0 0 0 2023-12-16T07:40:18.238 INFO:tasks.workunit.client.0.smithi049.stdout:0/357: mknod d13/c7b 0 2023-12-16T07:40:18.242 INFO:tasks.workunit.client.0.smithi049.stdout:1/213: truncate d20/f27 2746324 0 2023-12-16T07:40:18.242 INFO:tasks.workunit.client.0.smithi049.stdout:1/214: chown d20/d43 4975873 1 2023-12-16T07:40:18.242 INFO:tasks.workunit.client.0.smithi049.stdout:1/215: fsync f15 0 2023-12-16T07:40:18.243 INFO:tasks.workunit.client.0.smithi049.stdout:1/216: write d20/f33 [57886,75429] 0 2023-12-16T07:40:18.244 INFO:tasks.workunit.client.0.smithi049.stdout:5/187: rmdir d5/de/d3d 0 2023-12-16T07:40:18.251 INFO:tasks.workunit.client.0.smithi049.stdout:0/358: write fd [4166409,116773] 0 2023-12-16T07:40:18.251 INFO:tasks.workunit.client.0.smithi049.stdout:0/359: fdatasync d13/d39/f6b 0 2023-12-16T07:40:18.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/271: dread d7/dc/dd/d14/f32 [0,4194304] 0 2023-12-16T07:40:18.251 INFO:tasks.workunit.client.0.smithi049.stdout:5/188: creat d5/f3e x:0 0 0 2023-12-16T07:40:18.252 INFO:tasks.workunit.client.0.smithi049.stdout:7/272: rename d7/dc/dd/le to d7/dc/l65 0 2023-12-16T07:40:18.252 INFO:tasks.workunit.client.0.smithi049.stdout:0/360: creat d13/f7c x:0 0 0 2023-12-16T07:40:18.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/217: rmdir d1 39 2023-12-16T07:40:18.255 INFO:tasks.workunit.client.0.smithi049.stdout:7/273: rename d7/dc/dd/d27/d46 to d7/dc/d15/d66 0 2023-12-16T07:40:18.255 INFO:tasks.workunit.client.0.smithi049.stdout:0/361: write d13/d21/d27/f4d [61025,5727] 0 2023-12-16T07:40:18.257 INFO:tasks.workunit.client.0.smithi049.stdout:7/274: getdents d7/dc/dd/d35/d36 0 2023-12-16T07:40:18.260 INFO:tasks.workunit.client.0.smithi049.stdout:8/237: dwrite d0/d1f/d36/f3a [0,4194304] 0 2023-12-16T07:40:18.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/238: fdatasync d0/f28 0 2023-12-16T07:40:18.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/239: chown d0/d1f/f18 116 1 2023-12-16T07:40:18.261 INFO:tasks.workunit.client.0.smithi049.stdout:2/252: dwrite d2/d1d/d28/f2f [4194304,4194304] 0 2023-12-16T07:40:18.261 INFO:tasks.workunit.client.0.smithi049.stdout:2/253: chown d2/d1d/l3f 36 1 2023-12-16T07:40:18.261 INFO:tasks.workunit.client.0.smithi049.stdout:0/362: mkdir d13/d21/d2f/d7d 0 2023-12-16T07:40:18.270 INFO:tasks.workunit.client.0.smithi049.stdout:8/240: rename d0/d1f/d1c/l23 to d0/d1f/d36/l3b 0 2023-12-16T07:40:18.270 INFO:tasks.workunit.client.0.smithi049.stdout:1/217: dwrite fe [4194304,4194304] 0 2023-12-16T07:40:18.270 INFO:tasks.workunit.client.0.smithi049.stdout:1/218: read - d20/f38 zero size 2023-12-16T07:40:18.270 INFO:tasks.workunit.client.0.smithi049.stdout:1/219: write d20/f38 [608546,49645] 0 2023-12-16T07:40:18.272 INFO:tasks.workunit.client.0.smithi049.stdout:8/241: creat d0/d1f/d36/f3c x:0 0 0 2023-12-16T07:40:18.274 INFO:tasks.workunit.client.0.smithi049.stdout:4/206: sync 2023-12-16T07:40:18.274 INFO:tasks.workunit.client.0.smithi049.stdout:9/233: sync 2023-12-16T07:40:18.274 INFO:tasks.workunit.client.0.smithi049.stdout:4/207: write d2/db/dd/de/d1e/d37/f3c [133520,24063] 0 2023-12-16T07:40:18.275 INFO:tasks.workunit.client.0.smithi049.stdout:1/220: write d20/f27 [1044973,63642] 0 2023-12-16T07:40:18.275 INFO:tasks.workunit.client.0.smithi049.stdout:8/242: truncate d0/d1f/f18 1349485 0 2023-12-16T07:40:18.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/234: rename d4/d7/d11/c29 to d4/d7/d11/d1d/d48/c4c 0 2023-12-16T07:40:18.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/235: stat f1 0 2023-12-16T07:40:18.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/236: stat d4/d7/d11/f16 0 2023-12-16T07:40:18.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/237: chown d4/d7/d11/c1e 7841054 1 2023-12-16T07:40:18.278 INFO:tasks.workunit.client.0.smithi049.stdout:5/189: dwrite d5/de/f31 [0,4194304] 0 2023-12-16T07:40:18.279 INFO:tasks.workunit.client.0.smithi049.stdout:8/243: dread d0/f19 [0,4194304] 0 2023-12-16T07:40:18.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/275: dwrite d7/dc/dd/f1e [0,4194304] 0 2023-12-16T07:40:18.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/276: fsync d7/d2b/d59/f5e 0 2023-12-16T07:40:18.280 INFO:tasks.workunit.client.0.smithi049.stdout:4/208: link d2/db/dd/d2a/c29 d2/db/dd/de/d1e/c3e 0 2023-12-16T07:40:18.282 INFO:tasks.workunit.client.0.smithi049.stdout:1/221: rename d20/f27 to d20/d41/f4b 0 2023-12-16T07:40:18.286 INFO:tasks.workunit.client.0.smithi049.stdout:0/363: dwrite d13/d15/d46/f60 [0,4194304] 0 2023-12-16T07:40:18.286 INFO:tasks.workunit.client.0.smithi049.stdout:5/190: symlink d5/d1e/l3f 0 2023-12-16T07:40:18.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/244: creat d0/f3d x:0 0 0 2023-12-16T07:40:18.288 INFO:tasks.workunit.client.0.smithi049.stdout:0/364: read fa [2294192,14809] 0 2023-12-16T07:40:18.290 INFO:tasks.workunit.client.0.smithi049.stdout:9/238: rename d4/d7/d11/d26/c2e to d4/d45/c4d 0 2023-12-16T07:40:18.295 INFO:tasks.workunit.client.0.smithi049.stdout:0/365: dread d13/d21/f2a [0,4194304] 0 2023-12-16T07:40:18.295 INFO:tasks.workunit.client.0.smithi049.stdout:5/191: unlink d5/de/d2d/d2f/f38 0 2023-12-16T07:40:18.299 INFO:tasks.workunit.client.0.smithi049.stdout:4/209: link d2/db/c1d d2/c3f 0 2023-12-16T07:40:18.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/239: creat d4/d3e/f4e x:0 0 0 2023-12-16T07:40:18.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/240: readlink d4/l3a 0 2023-12-16T07:40:18.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/241: readlink d4/d7/l1a 0 2023-12-16T07:40:18.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/242: truncate d4/d7/f38 4935964 0 2023-12-16T07:40:18.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/366: mkdir d13/d39/d38/d7e 0 2023-12-16T07:40:18.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/367: readlink d13/d21/l76 0 2023-12-16T07:40:18.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/368: write d13/f7c [60822,18781] 0 2023-12-16T07:40:18.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/243: creat d4/d7/d11/d26/d47/f4f x:0 0 0 2023-12-16T07:40:18.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/244: write d4/d7/f21 [889773,104070] 0 2023-12-16T07:40:18.303 INFO:tasks.workunit.client.0.smithi049.stdout:1/222: dwrite f1f [0,4194304] 0 2023-12-16T07:40:18.305 INFO:tasks.workunit.client.0.smithi049.stdout:0/369: rename d13/d21/f42 to d13/d39/d78/f7f 0 2023-12-16T07:40:18.310 INFO:tasks.workunit.client.0.smithi049.stdout:5/192: dwrite d5/f26 [0,4194304] 0 2023-12-16T07:40:18.311 INFO:tasks.workunit.client.0.smithi049.stdout:9/245: getdents d4/d7/d11/d1d/d48 0 2023-12-16T07:40:18.311 INFO:tasks.workunit.client.0.smithi049.stdout:9/246: fsync d4/d7/f10 0 2023-12-16T07:40:18.313 INFO:tasks.workunit.client.0.smithi049.stdout:1/223: creat d20/d41/d49/f4c x:0 0 0 2023-12-16T07:40:18.315 INFO:tasks.workunit.client.0.smithi049.stdout:0/370: creat d13/d21/d2f/f80 x:0 0 0 2023-12-16T07:40:18.315 INFO:tasks.workunit.client.0.smithi049.stdout:0/371: chown d13/d15/l64 1392 1 2023-12-16T07:40:18.316 INFO:tasks.workunit.client.0.smithi049.stdout:8/245: rmdir d0 39 2023-12-16T07:40:18.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/210: dwrite d2/db/dd/d2a/f3a [0,4194304] 0 2023-12-16T07:40:18.324 INFO:tasks.workunit.client.0.smithi049.stdout:5/193: dread d5/de/f16 [0,4194304] 0 2023-12-16T07:40:18.324 INFO:tasks.workunit.client.0.smithi049.stdout:0/372: symlink d13/d21/d27/d2c/l81 0 2023-12-16T07:40:18.324 INFO:tasks.workunit.client.0.smithi049.stdout:1/224: symlink d20/d45/d47/l4d 0 2023-12-16T07:40:18.326 INFO:tasks.workunit.client.0.smithi049.stdout:8/246: rename d0/f4 to d0/d13/f3e 0 2023-12-16T07:40:18.331 INFO:tasks.workunit.client.0.smithi049.stdout:9/247: dwrite d4/f34 [0,4194304] 0 2023-12-16T07:40:18.334 INFO:tasks.workunit.client.0.smithi049.stdout:4/211: creat d2/db/dd/de/d1e/d21/f40 x:0 0 0 2023-12-16T07:40:18.334 INFO:tasks.workunit.client.0.smithi049.stdout:5/194: truncate d5/de/f1d 1809544 0 2023-12-16T07:40:18.334 INFO:tasks.workunit.client.0.smithi049.stdout:1/225: mknod d20/c4e 0 2023-12-16T07:40:18.336 INFO:tasks.workunit.client.0.smithi049.stdout:1/226: mkdir d20/d41/d4f 0 2023-12-16T07:40:18.340 INFO:tasks.workunit.client.0.smithi049.stdout:4/212: write d2/db/dd/f13 [3455375,30920] 0 2023-12-16T07:40:18.341 INFO:tasks.workunit.client.0.smithi049.stdout:4/213: write d2/db/dd/d2a/f26 [2291812,117667] 0 2023-12-16T07:40:18.359 INFO:tasks.workunit.client.0.smithi049.stdout:4/214: symlink d2/db/dd/d2a/l41 0 2023-12-16T07:40:18.360 INFO:tasks.workunit.client.0.smithi049.stdout:4/215: rmdir d2/db/dd/de 39 2023-12-16T07:40:18.361 INFO:tasks.workunit.client.0.smithi049.stdout:4/216: mknod d2/db/dd/de/d1e/d37/c42 0 2023-12-16T07:40:18.362 INFO:tasks.workunit.client.0.smithi049.stdout:4/217: creat d2/db/dd/d2a/f43 x:0 0 0 2023-12-16T07:40:18.362 INFO:tasks.workunit.client.0.smithi049.stdout:4/218: write d2/db/dd/de/d1e/d21/f40 [778610,11675] 0 2023-12-16T07:40:18.363 INFO:tasks.workunit.client.0.smithi049.stdout:4/219: mkdir d2/db/dd/de/d1e/d44 0 2023-12-16T07:40:18.364 INFO:tasks.workunit.client.0.smithi049.stdout:4/220: symlink d2/db/dd/de/d1e/d37/l45 0 2023-12-16T07:40:18.364 INFO:tasks.workunit.client.0.smithi049.stdout:4/221: read d2/db/dd/de/d1e/d21/f40 [437878,30658] 0 2023-12-16T07:40:18.366 INFO:tasks.workunit.client.0.smithi049.stdout:4/222: truncate d2/db/dd/d2a/f1c 3098333 0 2023-12-16T07:40:18.371 INFO:tasks.workunit.client.0.smithi049.stdout:0/373: dwrite d13/d15/d46/f60 [0,4194304] 0 2023-12-16T07:40:18.371 INFO:tasks.workunit.client.0.smithi049.stdout:5/195: dwrite d5/de/d1c/f25 [0,4194304] 0 2023-12-16T07:40:18.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/248: dwrite d4/db/f31 [0,4194304] 0 2023-12-16T07:40:18.372 INFO:tasks.workunit.client.0.smithi049.stdout:8/247: dwrite d0/f3d [0,4194304] 0 2023-12-16T07:40:18.376 INFO:tasks.workunit.client.0.smithi049.stdout:0/374: mkdir d13/d15/d46/d65/d82 0 2023-12-16T07:40:18.376 INFO:tasks.workunit.client.0.smithi049.stdout:5/196: creat d5/de/f40 x:0 0 0 2023-12-16T07:40:18.376 INFO:tasks.workunit.client.0.smithi049.stdout:0/375: read d13/d15/d46/d65/f73 [281316,34915] 0 2023-12-16T07:40:18.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/223: dwrite f1 [0,4194304] 0 2023-12-16T07:40:18.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/249: dread d4/d7/d11/d1d/f25 [0,4194304] 0 2023-12-16T07:40:18.382 INFO:tasks.workunit.client.0.smithi049.stdout:8/248: rmdir d0/d1f/d36 39 2023-12-16T07:40:18.382 INFO:tasks.workunit.client.0.smithi049.stdout:8/249: chown d0/d13/l2a 658 1 2023-12-16T07:40:18.388 INFO:tasks.workunit.client.0.smithi049.stdout:5/197: mknod d5/de/c41 0 2023-12-16T07:40:18.393 INFO:tasks.workunit.client.0.smithi049.stdout:4/224: symlink d2/db/dd/de/d1e/d44/l46 0 2023-12-16T07:40:18.395 INFO:tasks.workunit.client.0.smithi049.stdout:9/250: rmdir d4 39 2023-12-16T07:40:18.397 INFO:tasks.workunit.client.0.smithi049.stdout:8/250: link d0/d1f/d36/l3b d0/d1f/d36/l3f 0 2023-12-16T07:40:18.399 INFO:tasks.workunit.client.0.smithi049.stdout:9/251: rmdir d4/d3e 39 2023-12-16T07:40:18.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/376: dwrite d13/d39/f6b [0,4194304] 0 2023-12-16T07:40:18.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/377: chown d13/d21/d27/f5f 1459391 1 2023-12-16T07:40:18.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/251: creat d0/d1f/f40 x:0 0 0 2023-12-16T07:40:18.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/252: write d0/d1f/d36/f3c [881485,8258] 0 2023-12-16T07:40:18.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/253: truncate d0/d1f/d36/f3c 1376215 0 2023-12-16T07:40:18.402 INFO:tasks.workunit.client.0.smithi049.stdout:9/252: symlink d4/d7/d11/d26/d47/l50 0 2023-12-16T07:40:18.402 INFO:tasks.workunit.client.0.smithi049.stdout:9/253: stat d4/c18 0 2023-12-16T07:40:18.402 INFO:tasks.workunit.client.0.smithi049.stdout:9/254: truncate d4/d7/d11/f16 1921509 0 2023-12-16T07:40:18.404 INFO:tasks.workunit.client.0.smithi049.stdout:0/378: write fd [765660,31189] 0 2023-12-16T07:40:18.404 INFO:tasks.workunit.client.0.smithi049.stdout:8/254: write d0/d1f/f18 [1156181,109021] 0 2023-12-16T07:40:18.404 INFO:tasks.workunit.client.0.smithi049.stdout:8/255: write d0/d13/fd [4740194,5086] 0 2023-12-16T07:40:18.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/256: rmdir d0 39 2023-12-16T07:40:18.409 INFO:tasks.workunit.client.0.smithi049.stdout:8/257: link d0/f3d d0/f41 0 2023-12-16T07:40:18.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/258: truncate d0/d13/f25 1163700 0 2023-12-16T07:40:18.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/198: dwrite d5/f11 [0,4194304] 0 2023-12-16T07:40:18.413 INFO:tasks.workunit.client.0.smithi049.stdout:8/259: mkdir d0/d13/d42 0 2023-12-16T07:40:18.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/260: creat d0/f43 x:0 0 0 2023-12-16T07:40:18.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/261: read d0/d1f/d1c/f39 [31830,61516] 0 2023-12-16T07:40:18.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/379: dwrite d13/f40 [0,4194304] 0 2023-12-16T07:40:18.427 INFO:tasks.workunit.client.0.smithi049.stdout:4/225: dwrite d2/db/dd/de/d1e/d37/f3c [0,4194304] 0 2023-12-16T07:40:18.427 INFO:tasks.workunit.client.0.smithi049.stdout:4/226: chown d2/db/dd 3887 1 2023-12-16T07:40:18.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/255: dwrite f1 [0,4194304] 0 2023-12-16T07:40:18.428 INFO:tasks.workunit.client.0.smithi049.stdout:9/256: write d4/db/f31 [1168362,1637] 0 2023-12-16T07:40:18.431 INFO:tasks.workunit.client.0.smithi049.stdout:0/380: mkdir d13/d39/d78/d83 0 2023-12-16T07:40:18.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/227: link d2/c3f d2/db/dd/d2a/c47 0 2023-12-16T07:40:18.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/228: chown d2/db/dd/d2a/l41 29195 1 2023-12-16T07:40:18.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/229: fsync d2/db/dd/f13 0 2023-12-16T07:40:18.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/230: chown d2/db/dd/c19 10472589 1 2023-12-16T07:40:18.444 INFO:tasks.workunit.client.0.smithi049.stdout:8/262: dwrite d0/d1f/f40 [0,4194304] 0 2023-12-16T07:40:18.445 INFO:tasks.workunit.client.0.smithi049.stdout:6/286: sync 2023-12-16T07:40:18.445 INFO:tasks.workunit.client.0.smithi049.stdout:6/287: write d0/d2/dd/d58/f51 [2384395,94386] 0 2023-12-16T07:40:18.447 INFO:tasks.workunit.client.0.smithi049.stdout:8/263: mknod d0/d1f/c44 0 2023-12-16T07:40:18.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/288: rmdir d0/d2/dd/d53 39 2023-12-16T07:40:18.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/289: link d0/f35 d0/d2/dd/d53/f5f 0 2023-12-16T07:40:18.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/290: write d0/d2/dd/d58/f3d [1669680,106031] 0 2023-12-16T07:40:18.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/291: rmdir d0/d2/dd/d58/d33 39 2023-12-16T07:40:18.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/292: symlink d0/d39/d3b/d4a/l60 0 2023-12-16T07:40:18.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/293: chown d0/d2/f5 14 1 2023-12-16T07:40:18.457 INFO:tasks.workunit.client.0.smithi049.stdout:9/257: dwrite d4/d7/f9 [0,4194304] 0 2023-12-16T07:40:18.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/264: dread d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:18.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/265: fdatasync d0/d13/f31 0 2023-12-16T07:40:18.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/266: fdatasync d0/f12 0 2023-12-16T07:40:18.461 INFO:tasks.workunit.client.0.smithi049.stdout:9/258: rename f1 to d4/d7/d11/d3f/f51 0 2023-12-16T07:40:18.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/381: dwrite d13/d39/f3b [0,4194304] 0 2023-12-16T07:40:18.464 INFO:tasks.workunit.client.0.smithi049.stdout:8/267: creat d0/d1f/d36/f45 x:0 0 0 2023-12-16T07:40:18.464 INFO:tasks.workunit.client.0.smithi049.stdout:8/268: fdatasync d0/d13/fe 0 2023-12-16T07:40:18.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/231: dwrite d2/db/dd/de/d1e/d21/f25 [0,4194304] 0 2023-12-16T07:40:18.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/232: readlink d2/db/dd/de/d1e/d37/l45 0 2023-12-16T07:40:18.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/269: dread d0/d1f/f22 [0,4194304] 0 2023-12-16T07:40:18.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/270: fdatasync d0/d13/fd 0 2023-12-16T07:40:18.476 INFO:tasks.workunit.client.0.smithi049.stdout:4/233: rmdir d2/db/d36 0 2023-12-16T07:40:18.476 INFO:tasks.workunit.client.0.smithi049.stdout:4/234: chown d2/db/dd/de/d1e/c22 234578352 1 2023-12-16T07:40:18.476 INFO:tasks.workunit.client.0.smithi049.stdout:8/271: rename d0/c38 to d0/d1f/d36/c46 0 2023-12-16T07:40:18.477 INFO:tasks.workunit.client.0.smithi049.stdout:4/235: mknod d2/c48 0 2023-12-16T07:40:18.478 INFO:tasks.workunit.client.0.smithi049.stdout:8/272: creat d0/d1f/d36/f47 x:0 0 0 2023-12-16T07:40:18.478 INFO:tasks.workunit.client.0.smithi049.stdout:8/273: readlink d0/d1f/d36/l3b 0 2023-12-16T07:40:18.478 INFO:tasks.workunit.client.0.smithi049.stdout:8/274: fsync d0/f12 0 2023-12-16T07:40:18.478 INFO:tasks.workunit.client.0.smithi049.stdout:4/236: write d2/f28 [712340,8190] 0 2023-12-16T07:40:18.479 INFO:tasks.workunit.client.0.smithi049.stdout:8/275: symlink d0/d13/d42/l48 0 2023-12-16T07:40:18.480 INFO:tasks.workunit.client.0.smithi049.stdout:4/237: getdents d2/db/dd/de/d1e/d37 0 2023-12-16T07:40:18.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/276: write d0/f3d [277733,84913] 0 2023-12-16T07:40:18.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/382: dwrite d13/d21/d27/d2c/f55 [0,4194304] 0 2023-12-16T07:40:18.486 INFO:tasks.workunit.client.0.smithi049.stdout:9/259: dwrite d4/d7/d11/d26/d47/f4f [0,4194304] 0 2023-12-16T07:40:18.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/383: dread d13/d21/d27/f4d [0,4194304] 0 2023-12-16T07:40:18.495 INFO:tasks.workunit.client.0.smithi049.stdout:4/238: dread d2/db/f15 [0,4194304] 0 2023-12-16T07:40:18.496 INFO:tasks.workunit.client.0.smithi049.stdout:4/239: mknod d2/db/dd/de/d1e/d21/c49 0 2023-12-16T07:40:18.497 INFO:tasks.workunit.client.0.smithi049.stdout:4/240: read d2/db/dd/d2a/f1c [2823819,37423] 0 2023-12-16T07:40:18.498 INFO:tasks.workunit.client.0.smithi049.stdout:4/241: rename d2/db/dd/c8 to d2/db/dd/c4a 0 2023-12-16T07:40:18.498 INFO:tasks.workunit.client.0.smithi049.stdout:4/242: readlink d2/db/dd/d2a/l41 0 2023-12-16T07:40:18.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/260: dread d4/db/f2a [0,4194304] 0 2023-12-16T07:40:18.500 INFO:tasks.workunit.client.0.smithi049.stdout:4/243: link d2/fc d2/db/dd/f4b 0 2023-12-16T07:40:18.502 INFO:tasks.workunit.client.0.smithi049.stdout:4/244: mknod d2/db/dd/de/d1e/d44/c4c 0 2023-12-16T07:40:18.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/245: write d2/db/dd/fa [3454122,14437] 0 2023-12-16T07:40:18.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/277: dwrite d0/d1f/d36/f47 [0,4194304] 0 2023-12-16T07:40:18.506 INFO:tasks.workunit.client.0.smithi049.stdout:4/246: mkdir d2/db/dd/de/d1e/d4d 0 2023-12-16T07:40:18.507 INFO:tasks.workunit.client.0.smithi049.stdout:4/247: write d2/db/dd/fa [3508636,12806] 0 2023-12-16T07:40:18.508 INFO:tasks.workunit.client.0.smithi049.stdout:8/278: truncate d0/f3d 3733281 0 2023-12-16T07:40:18.508 INFO:tasks.workunit.client.0.smithi049.stdout:8/279: rename d0/d1f to d0/d1f/d1c/d49 22 2023-12-16T07:40:18.508 INFO:tasks.workunit.client.0.smithi049.stdout:8/280: chown d0/d1f/l16 52098 1 2023-12-16T07:40:18.509 INFO:tasks.workunit.client.0.smithi049.stdout:3/218: sync 2023-12-16T07:40:18.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/248: mkdir d2/db/dd/de/d1e/d37/d4e 0 2023-12-16T07:40:18.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/249: truncate d2/db/dd/d2a/f3a 4674116 0 2023-12-16T07:40:18.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/281: mknod d0/d1f/d1c/c4a 0 2023-12-16T07:40:18.511 INFO:tasks.workunit.client.0.smithi049.stdout:8/282: mknod d0/d1f/c4b 0 2023-12-16T07:40:18.513 INFO:tasks.workunit.client.0.smithi049.stdout:8/283: creat d0/d13/d42/f4c x:0 0 0 2023-12-16T07:40:18.515 INFO:tasks.workunit.client.0.smithi049.stdout:8/284: symlink d0/d13/l4d 0 2023-12-16T07:40:18.516 INFO:tasks.workunit.client.0.smithi049.stdout:0/384: dwrite fd [0,4194304] 0 2023-12-16T07:40:18.516 INFO:tasks.workunit.client.0.smithi049.stdout:0/385: getdents d13/d21/d27/d2c/d62/d70 0 2023-12-16T07:40:18.516 INFO:tasks.workunit.client.0.smithi049.stdout:0/386: chown d13/d39/f6b 1 1 2023-12-16T07:40:18.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/285: mkdir d0/d1f/d4e 0 2023-12-16T07:40:18.522 INFO:tasks.workunit.client.0.smithi049.stdout:0/387: dread d13/d15/d46/f60 [0,4194304] 0 2023-12-16T07:40:18.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/388: dread d13/d15/d46/f60 [0,4194304] 0 2023-12-16T07:40:18.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/389: fsync d13/d21/d2f/f52 0 2023-12-16T07:40:18.528 INFO:tasks.workunit.client.0.smithi049.stdout:0/390: creat d13/d21/d27/d2c/d62/f84 x:0 0 0 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:0/391: rename d13/d21/d27/l75 to d13/d39/d38/d7e/l85 0 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:0/392: chown d13/d3c 1 1 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:0/393: fdatasync d13/d21/d27/d2c/f41 0 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:7/277: sync 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:5/199: sync 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/254: sync 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:1/227: sync 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:7/278: readlink d7/dc/dd/l26 0 2023-12-16T07:40:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:0/394: truncate d13/d21/f2a 2110551 0 2023-12-16T07:40:18.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/200: creat d5/d1e/d39/f42 x:0 0 0 2023-12-16T07:40:18.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/228: symlink d20/d40/l50 0 2023-12-16T07:40:18.537 INFO:tasks.workunit.client.0.smithi049.stdout:2/255: symlink d2/d7/l4c 0 2023-12-16T07:40:18.539 INFO:tasks.workunit.client.0.smithi049.stdout:1/229: creat d20/d41/d4f/f51 x:0 0 0 2023-12-16T07:40:18.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/250: dwrite d2/db/dd/de/d1e/d37/f3c [0,4194304] 0 2023-12-16T07:40:18.541 INFO:tasks.workunit.client.0.smithi049.stdout:2/256: creat d2/f4d x:0 0 0 2023-12-16T07:40:18.541 INFO:tasks.workunit.client.0.smithi049.stdout:2/257: write d2/d26/f39 [8489904,4097] 0 2023-12-16T07:40:18.541 INFO:tasks.workunit.client.0.smithi049.stdout:2/258: readlink d2/la 0 2023-12-16T07:40:18.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/286: dwrite d0/d13/f25 [0,4194304] 0 2023-12-16T07:40:18.546 INFO:tasks.workunit.client.0.smithi049.stdout:2/259: rename d2/d1d/d28/f2f to d2/d1d/d24/f4e 0 2023-12-16T07:40:18.546 INFO:tasks.workunit.client.0.smithi049.stdout:2/260: chown d2/d1d 134190868 1 2023-12-16T07:40:18.548 INFO:tasks.workunit.client.0.smithi049.stdout:5/201: getdents d5/d1e/d39 0 2023-12-16T07:40:18.549 INFO:tasks.workunit.client.0.smithi049.stdout:8/287: creat d0/f4f x:0 0 0 2023-12-16T07:40:18.554 INFO:tasks.workunit.client.0.smithi049.stdout:2/261: mknod d2/de/c4f 0 2023-12-16T07:40:18.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/251: truncate d2/db/dd/de/d1e/d37/f3c 349674 0 2023-12-16T07:40:18.554 INFO:tasks.workunit.client.0.smithi049.stdout:2/262: write d2/d26/f30 [469329,12800] 0 2023-12-16T07:40:18.554 INFO:tasks.workunit.client.0.smithi049.stdout:5/202: dread d5/f9 [0,4194304] 0 2023-12-16T07:40:18.555 INFO:tasks.workunit.client.0.smithi049.stdout:4/252: rename d2/fc to d2/db/dd/de/d1e/d21/f4f 0 2023-12-16T07:40:18.556 INFO:tasks.workunit.client.0.smithi049.stdout:2/263: creat d2/d1d/d24/f50 x:0 0 0 2023-12-16T07:40:18.557 INFO:tasks.workunit.client.0.smithi049.stdout:5/203: rmdir d5/d1e/d21 39 2023-12-16T07:40:18.558 INFO:tasks.workunit.client.0.smithi049.stdout:4/253: symlink d2/db/dd/de/d1e/d44/l50 0 2023-12-16T07:40:18.560 INFO:tasks.workunit.client.0.smithi049.stdout:2/264: creat d2/d7/d11/f51 x:0 0 0 2023-12-16T07:40:18.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/254: mknod d2/db/dd/de/c51 0 2023-12-16T07:40:18.561 INFO:tasks.workunit.client.0.smithi049.stdout:2/265: creat d2/d1d/d28/f52 x:0 0 0 2023-12-16T07:40:18.563 INFO:tasks.workunit.client.0.smithi049.stdout:4/255: mkdir d2/db/dd/d52 0 2023-12-16T07:40:18.564 INFO:tasks.workunit.client.0.smithi049.stdout:2/266: symlink d2/d1d/d24/l53 0 2023-12-16T07:40:18.564 INFO:tasks.workunit.client.0.smithi049.stdout:2/267: readlink d2/d1d/d24/l53 0 2023-12-16T07:40:18.565 INFO:tasks.workunit.client.0.smithi049.stdout:1/230: dwrite fc [0,4194304] 0 2023-12-16T07:40:18.565 INFO:tasks.workunit.client.0.smithi049.stdout:1/231: chown d20/d41/d4f/f51 15 1 2023-12-16T07:40:18.568 INFO:tasks.workunit.client.0.smithi049.stdout:1/232: mkdir d20/d41/d52 0 2023-12-16T07:40:18.569 INFO:tasks.workunit.client.0.smithi049.stdout:1/233: link d20/f37 d20/d41/d4f/f53 0 2023-12-16T07:40:18.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/234: write d20/f32 [1521455,106330] 0 2023-12-16T07:40:18.573 INFO:tasks.workunit.client.0.smithi049.stdout:1/235: link fa d20/d40/f54 0 2023-12-16T07:40:18.573 INFO:tasks.workunit.client.0.smithi049.stdout:1/236: write d20/d41/d49/f4c [813611,95696] 0 2023-12-16T07:40:18.573 INFO:tasks.workunit.client.0.smithi049.stdout:1/237: write f1c [1369709,100821] 0 2023-12-16T07:40:18.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/288: read d0/d13/fe [1975009,8361] 0 2023-12-16T07:40:18.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/395: dread d13/d39/f3b [0,4194304] 0 2023-12-16T07:40:18.577 INFO:tasks.workunit.client.0.smithi049.stdout:8/289: unlink d0/d1f/d36/f3a 0 2023-12-16T07:40:18.578 INFO:tasks.workunit.client.0.smithi049.stdout:5/204: dwrite d5/de/d1c/f25 [4194304,4194304] 0 2023-12-16T07:40:18.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/290: rename d0/d13/c2e to d0/d13/c50 0 2023-12-16T07:40:18.580 INFO:tasks.workunit.client.0.smithi049.stdout:4/256: dread d2/db/dd/d2a/f26 [0,4194304] 0 2023-12-16T07:40:18.580 INFO:tasks.workunit.client.0.smithi049.stdout:2/268: read d2/d1d/d28/f2b [3129779,107934] 0 2023-12-16T07:40:18.580 INFO:tasks.workunit.client.0.smithi049.stdout:2/269: chown d2/d1d/d28/f2b 0 1 2023-12-16T07:40:18.582 INFO:tasks.workunit.client.0.smithi049.stdout:8/291: write d0/d13/f2f [322066,77719] 0 2023-12-16T07:40:18.583 INFO:tasks.workunit.client.0.smithi049.stdout:5/205: creat d5/d1e/d39/f43 x:0 0 0 2023-12-16T07:40:18.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/396: dread f3 [0,4194304] 0 2023-12-16T07:40:18.585 INFO:tasks.workunit.client.0.smithi049.stdout:4/257: mknod d2/db/dd/de/d1e/d4d/c53 0 2023-12-16T07:40:18.586 INFO:tasks.workunit.client.0.smithi049.stdout:8/292: link d0/d13/l2a d0/l51 0 2023-12-16T07:40:18.587 INFO:tasks.workunit.client.0.smithi049.stdout:5/206: truncate d5/f2a 120095 0 2023-12-16T07:40:18.588 INFO:tasks.workunit.client.0.smithi049.stdout:0/397: creat d13/d21/d27/f86 x:0 0 0 2023-12-16T07:40:18.589 INFO:tasks.workunit.client.0.smithi049.stdout:4/258: symlink d2/db/dd/l54 0 2023-12-16T07:40:18.591 INFO:tasks.workunit.client.0.smithi049.stdout:8/293: creat d0/d1f/d1c/f52 x:0 0 0 2023-12-16T07:40:18.592 INFO:tasks.workunit.client.0.smithi049.stdout:5/207: creat d5/d1e/d21/f44 x:0 0 0 2023-12-16T07:40:18.592 INFO:tasks.workunit.client.0.smithi049.stdout:8/294: write d0/d13/f31 [727740,106183] 0 2023-12-16T07:40:18.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/398: creat d13/d39/f87 x:0 0 0 2023-12-16T07:40:18.593 INFO:tasks.workunit.client.0.smithi049.stdout:5/208: read d5/f8 [498406,27584] 0 2023-12-16T07:40:18.594 INFO:tasks.workunit.client.0.smithi049.stdout:8/295: rename d0/d1f/d1c/l2c to d0/d1f/l53 0 2023-12-16T07:40:18.594 INFO:tasks.workunit.client.0.smithi049.stdout:0/399: truncate d13/d15/f1a 1088030 0 2023-12-16T07:40:18.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/238: dwrite f1d [0,4194304] 0 2023-12-16T07:40:18.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/239: stat d20/d43/c44 0 2023-12-16T07:40:18.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/240: chown f2 14315 1 2023-12-16T07:40:18.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/241: truncate f1b 1164524 0 2023-12-16T07:40:18.598 INFO:tasks.workunit.client.0.smithi049.stdout:4/259: read d2/db/dd/d2a/f3a [2764733,88974] 0 2023-12-16T07:40:18.599 INFO:tasks.workunit.client.0.smithi049.stdout:5/209: rmdir d5/d1e/d20 39 2023-12-16T07:40:18.599 INFO:tasks.workunit.client.0.smithi049.stdout:8/296: creat d0/d1f/d36/f54 x:0 0 0 2023-12-16T07:40:18.599 INFO:tasks.workunit.client.0.smithi049.stdout:0/400: creat d13/d21/d27/f88 x:0 0 0 2023-12-16T07:40:18.600 INFO:tasks.workunit.client.0.smithi049.stdout:1/242: mkdir d20/d41/d4f/d55 0 2023-12-16T07:40:18.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/270: dwrite d2/d1d/d24/f33 [0,4194304] 0 2023-12-16T07:40:18.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/260: rename d2/db/dd/d2a/f3a to d2/db/dd/de/d1e/f55 0 2023-12-16T07:40:18.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/261: write f1 [613040,53068] 0 2023-12-16T07:40:18.603 INFO:tasks.workunit.client.0.smithi049.stdout:4/262: write d2/db/dd/d2a/f26 [706352,97966] 0 2023-12-16T07:40:18.603 INFO:tasks.workunit.client.0.smithi049.stdout:4/263: chown d2/db/dd/de/d1e/d44/l50 353 1 2023-12-16T07:40:18.609 INFO:tasks.workunit.client.0.smithi049.stdout:4/264: dread d2/db/f15 [0,4194304] 0 2023-12-16T07:40:18.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/210: creat d5/d1e/d21/f45 x:0 0 0 2023-12-16T07:40:18.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/211: dread - d5/f3e zero size 2023-12-16T07:40:18.612 INFO:tasks.workunit.client.0.smithi049.stdout:1/243: dread fc [0,4194304] 0 2023-12-16T07:40:18.612 INFO:tasks.workunit.client.0.smithi049.stdout:1/244: stat d20/l34 0 2023-12-16T07:40:18.613 INFO:tasks.workunit.client.0.smithi049.stdout:8/297: creat d0/d13/f55 x:0 0 0 2023-12-16T07:40:18.614 INFO:tasks.workunit.client.0.smithi049.stdout:0/401: creat d13/d39/d38/f89 x:0 0 0 2023-12-16T07:40:18.615 INFO:tasks.workunit.client.0.smithi049.stdout:2/271: symlink d2/d7/l54 0 2023-12-16T07:40:18.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/265: creat d2/db/dd/de/d1e/d37/d4e/f56 x:0 0 0 2023-12-16T07:40:18.623 INFO:tasks.workunit.client.0.smithi049.stdout:5/212: link d5/f19 d5/de/d1c/f46 0 2023-12-16T07:40:18.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/245: creat d20/d45/d47/f56 x:0 0 0 2023-12-16T07:40:18.623 INFO:tasks.workunit.client.0.smithi049.stdout:0/402: dread fa [0,4194304] 0 2023-12-16T07:40:18.624 INFO:tasks.workunit.client.0.smithi049.stdout:2/272: mkdir d2/d1d/d24/d55 0 2023-12-16T07:40:18.624 INFO:tasks.workunit.client.0.smithi049.stdout:2/273: stat d2/d7/l54 0 2023-12-16T07:40:18.632 INFO:tasks.workunit.client.0.smithi049.stdout:5/213: dread d5/fb [4194304,4194304] 0 2023-12-16T07:40:18.633 INFO:tasks.workunit.client.0.smithi049.stdout:8/298: dwrite d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:18.634 INFO:tasks.workunit.client.0.smithi049.stdout:5/214: link d5/d1e/l29 d5/d1e/l47 0 2023-12-16T07:40:18.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/299: mkdir d0/d1f/d56 0 2023-12-16T07:40:18.639 INFO:tasks.workunit.client.0.smithi049.stdout:5/215: mknod d5/d1e/d20/c48 0 2023-12-16T07:40:18.639 INFO:tasks.workunit.client.0.smithi049.stdout:5/216: readlink d5/d1e/l3f 0 2023-12-16T07:40:18.641 INFO:tasks.workunit.client.0.smithi049.stdout:5/217: creat d5/de/d2d/d2f/f49 x:0 0 0 2023-12-16T07:40:18.641 INFO:tasks.workunit.client.0.smithi049.stdout:5/218: fdatasync d5/f13 0 2023-12-16T07:40:18.642 INFO:tasks.workunit.client.0.smithi049.stdout:5/219: write d5/de/f14 [2019427,5628] 0 2023-12-16T07:40:18.642 INFO:tasks.workunit.client.0.smithi049.stdout:5/220: chown d5/c1f 87 1 2023-12-16T07:40:18.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/221: mknod d5/de/d2d/c4a 0 2023-12-16T07:40:18.648 INFO:tasks.workunit.client.0.smithi049.stdout:0/403: rmdir d13 39 2023-12-16T07:40:18.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/222: chown d5/f13 210365 1 2023-12-16T07:40:18.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/223: chown d5/d1e/d21 21403 1 2023-12-16T07:40:18.651 INFO:tasks.workunit.client.0.smithi049.stdout:0/404: dread d13/d15/f1a [0,4194304] 0 2023-12-16T07:40:18.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/294: sync 2023-12-16T07:40:18.652 INFO:tasks.workunit.client.0.smithi049.stdout:0/405: mkdir d13/d39/d8a 0 2023-12-16T07:40:18.657 INFO:tasks.workunit.client.0.smithi049.stdout:0/406: write d13/d39/f3b [3070421,39720] 0 2023-12-16T07:40:18.657 INFO:tasks.workunit.client.0.smithi049.stdout:8/300: dread d0/f41 [0,4194304] 0 2023-12-16T07:40:18.657 INFO:tasks.workunit.client.0.smithi049.stdout:8/301: mknod d0/d13/c57 0 2023-12-16T07:40:18.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/266: dwrite d2/db/dd/d2a/f43 [0,4194304] 0 2023-12-16T07:40:18.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/267: truncate d2/db/dd/f3d 830809 0 2023-12-16T07:40:18.662 INFO:tasks.workunit.client.0.smithi049.stdout:2/274: dwrite d2/d7/d11/f1e [0,4194304] 0 2023-12-16T07:40:18.667 INFO:tasks.workunit.client.0.smithi049.stdout:6/295: dread d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:18.667 INFO:tasks.workunit.client.0.smithi049.stdout:1/246: dwrite d20/f3e [0,4194304] 0 2023-12-16T07:40:18.668 INFO:tasks.workunit.client.0.smithi049.stdout:0/407: write d13/d21/d2f/f52 [296586,77213] 0 2023-12-16T07:40:18.668 INFO:tasks.workunit.client.0.smithi049.stdout:0/408: readlink d13/d15/l5c 0 2023-12-16T07:40:18.668 INFO:tasks.workunit.client.0.smithi049.stdout:6/296: write d0/d2/f47 [3413744,101027] 0 2023-12-16T07:40:18.668 INFO:tasks.workunit.client.0.smithi049.stdout:2/275: rename d2/d7 to d2/d1d/d28/d56 0 2023-12-16T07:40:18.670 INFO:tasks.workunit.client.0.smithi049.stdout:5/224: dwrite d5/f2a [0,4194304] 0 2023-12-16T07:40:18.671 INFO:tasks.workunit.client.0.smithi049.stdout:4/268: dread d2/db/dd/de/d1e/d21/f4f [0,4194304] 0 2023-12-16T07:40:18.677 INFO:tasks.workunit.client.0.smithi049.stdout:1/247: rmdir d20/d41/d4f 39 2023-12-16T07:40:18.678 INFO:tasks.workunit.client.0.smithi049.stdout:6/297: creat d0/d2/dd/d53/f61 x:0 0 0 2023-12-16T07:40:18.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/225: rename d5/de/d2d/c34 to d5/de/c4b 0 2023-12-16T07:40:18.685 INFO:tasks.workunit.client.0.smithi049.stdout:4/269: creat d2/db/dd/f57 x:0 0 0 2023-12-16T07:40:18.685 INFO:tasks.workunit.client.0.smithi049.stdout:1/248: mknod d20/d45/c57 0 2023-12-16T07:40:18.688 INFO:tasks.workunit.client.0.smithi049.stdout:5/226: symlink d5/de/d2d/d2f/l4c 0 2023-12-16T07:40:18.689 INFO:tasks.workunit.client.0.smithi049.stdout:1/249: mkdir d20/d41/d4f/d55/d58 0 2023-12-16T07:40:18.689 INFO:tasks.workunit.client.0.smithi049.stdout:8/302: dwrite d0/d1f/d36/f47 [4194304,4194304] 0 2023-12-16T07:40:18.690 INFO:tasks.workunit.client.0.smithi049.stdout:8/303: chown d0/d1f/c4b 21 1 2023-12-16T07:40:18.690 INFO:tasks.workunit.client.0.smithi049.stdout:5/227: symlink d5/de/l4d 0 2023-12-16T07:40:18.691 INFO:tasks.workunit.client.0.smithi049.stdout:9/261: sync 2023-12-16T07:40:18.691 INFO:tasks.workunit.client.0.smithi049.stdout:9/262: write d4/db/f41 [386233,107681] 0 2023-12-16T07:40:18.692 INFO:tasks.workunit.client.0.smithi049.stdout:1/250: creat d20/d41/d4f/d55/f59 x:0 0 0 2023-12-16T07:40:18.693 INFO:tasks.workunit.client.0.smithi049.stdout:1/251: write d20/f33 [184676,2501] 0 2023-12-16T07:40:18.694 INFO:tasks.workunit.client.0.smithi049.stdout:8/304: link d0/f19 d0/f58 0 2023-12-16T07:40:18.696 INFO:tasks.workunit.client.0.smithi049.stdout:2/276: dwrite d2/d1d/d28/d56/d11/f3d [0,4194304] 0 2023-12-16T07:40:18.696 INFO:tasks.workunit.client.0.smithi049.stdout:2/277: getdents d2/d1d/d28/d56/d11/d47 0 2023-12-16T07:40:18.696 INFO:tasks.workunit.client.0.smithi049.stdout:2/278: truncate d2/d1d/d24/f42 943340 0 2023-12-16T07:40:18.696 INFO:tasks.workunit.client.0.smithi049.stdout:0/409: dwrite d13/f7c [0,4194304] 0 2023-12-16T07:40:18.696 INFO:tasks.workunit.client.0.smithi049.stdout:6/298: dwrite d0/f30 [0,4194304] 0 2023-12-16T07:40:18.697 INFO:tasks.workunit.client.0.smithi049.stdout:4/270: dread d2/db/dd/fa [0,4194304] 0 2023-12-16T07:40:18.698 INFO:tasks.workunit.client.0.smithi049.stdout:5/228: mkdir d5/d1e/d21/d4e 0 2023-12-16T07:40:18.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/229: write d5/f8 [2812818,53674] 0 2023-12-16T07:40:18.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/230: dread - d5/d1e/d39/f42 zero size 2023-12-16T07:40:18.699 INFO:tasks.workunit.client.0.smithi049.stdout:9/263: write d4/d7/f9 [2801647,17649] 0 2023-12-16T07:40:18.699 INFO:tasks.workunit.client.0.smithi049.stdout:7/279: sync 2023-12-16T07:40:18.699 INFO:tasks.workunit.client.0.smithi049.stdout:7/280: dread - d7/d2b/d59/f64 zero size 2023-12-16T07:40:18.702 INFO:tasks.workunit.client.0.smithi049.stdout:3/219: sync 2023-12-16T07:40:18.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/305: dread d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:18.702 INFO:tasks.workunit.client.0.smithi049.stdout:2/279: symlink d2/d1d/d24/l57 0 2023-12-16T07:40:18.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/220: write d1/f16 [622835,85333] 0 2023-12-16T07:40:18.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/221: truncate d1/d2a/f40 64204 0 2023-12-16T07:40:18.705 INFO:tasks.workunit.client.0.smithi049.stdout:3/222: dread d1/f26 [0,4194304] 0 2023-12-16T07:40:18.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/410: mkdir d13/d39/d38/d7e/d8b 0 2023-12-16T07:40:18.706 INFO:tasks.workunit.client.0.smithi049.stdout:6/299: mknod d0/d39/d3b/d4a/c62 0 2023-12-16T07:40:18.706 INFO:tasks.workunit.client.0.smithi049.stdout:6/300: fsync d0/d2/df/f2e 0 2023-12-16T07:40:18.708 INFO:tasks.workunit.client.0.smithi049.stdout:4/271: creat d2/db/dd/de/f58 x:0 0 0 2023-12-16T07:40:18.711 INFO:tasks.workunit.client.0.smithi049.stdout:5/231: mknod d5/de/d2d/c4f 0 2023-12-16T07:40:18.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/281: creat d7/f67 x:0 0 0 2023-12-16T07:40:18.715 INFO:tasks.workunit.client.0.smithi049.stdout:2/280: creat d2/d26/f58 x:0 0 0 2023-12-16T07:40:18.718 INFO:tasks.workunit.client.0.smithi049.stdout:3/223: creat d1/d2a/d37/d3f/f41 x:0 0 0 2023-12-16T07:40:18.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/301: symlink d0/d2/l63 0 2023-12-16T07:40:18.723 INFO:tasks.workunit.client.0.smithi049.stdout:4/272: creat d2/db/dd/d52/f59 x:0 0 0 2023-12-16T07:40:18.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/232: rmdir d5/d1e/d39 39 2023-12-16T07:40:18.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/233: fdatasync d5/f19 0 2023-12-16T07:40:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/281: unlink d2/d1d/d24/f4e 0 2023-12-16T07:40:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/282: symlink d7/dc/d15/d57/l68 0 2023-12-16T07:40:18.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/283: fsync d7/dc/f25 0 2023-12-16T07:40:18.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/224: creat d1/d2a/d37/f42 x:0 0 0 2023-12-16T07:40:18.730 INFO:tasks.workunit.client.0.smithi049.stdout:6/302: unlink d0/d39/l52 0 2023-12-16T07:40:18.731 INFO:tasks.workunit.client.0.smithi049.stdout:4/273: link d2/db/dd/f3d d2/db/dd/de/d1e/d37/d4e/f5a 0 2023-12-16T07:40:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:8/306: dwrite d0/d13/f2f [0,4194304] 0 2023-12-16T07:40:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/234: dread d5/de/f16 [0,4194304] 0 2023-12-16T07:40:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:3/225: mknod d1/d2a/d37/d3f/c43 0 2023-12-16T07:40:18.732 INFO:tasks.workunit.client.0.smithi049.stdout:3/226: stat d1/d2a/f2f 0 2023-12-16T07:40:18.733 INFO:tasks.workunit.client.0.smithi049.stdout:6/303: creat d0/f64 x:0 0 0 2023-12-16T07:40:18.735 INFO:tasks.workunit.client.0.smithi049.stdout:4/274: getdents d2/db/dd 0 2023-12-16T07:40:18.735 INFO:tasks.workunit.client.0.smithi049.stdout:4/275: write d2/db/dd/de/d1e/d37/d4e/f56 [471430,41348] 0 2023-12-16T07:40:18.736 INFO:tasks.workunit.client.0.smithi049.stdout:2/282: dread d2/d1d/d28/d56/d11/f2c [0,4194304] 0 2023-12-16T07:40:18.736 INFO:tasks.workunit.client.0.smithi049.stdout:8/307: creat d0/d1f/f59 x:0 0 0 2023-12-16T07:40:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:5/235: creat d5/de/d2d/f50 x:0 0 0 2023-12-16T07:40:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:5/236: write d5/d1e/d20/f36 [347371,105997] 0 2023-12-16T07:40:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:5/237: chown d5/de/d2d/d2f/l4c 10 1 2023-12-16T07:40:18.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/304: rmdir d0/d2/dd 39 2023-12-16T07:40:18.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/305: readlink d0/d2/dd/d58/d2c/l2d 0 2023-12-16T07:40:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:4/276: unlink d2/db/dd/de/d1e/c32 0 2023-12-16T07:40:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:7/284: dread d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:18.741 INFO:tasks.workunit.client.0.smithi049.stdout:4/277: write d2/db/dd/de/d1e/f3b [63815,7066] 0 2023-12-16T07:40:18.742 INFO:tasks.workunit.client.0.smithi049.stdout:3/227: write d1/f16 [442774,21682] 0 2023-12-16T07:40:18.742 INFO:tasks.workunit.client.0.smithi049.stdout:8/308: rename d0/d1f/d1c/l37 to d0/d1f/d56/l5a 0 2023-12-16T07:40:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/238: link d5/f13 d5/d1e/f51 0 2023-12-16T07:40:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:6/306: rmdir d0/d2/dd/d53 39 2023-12-16T07:40:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:6/307: stat d0/d2/l50 0 2023-12-16T07:40:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/285: dread f6 [0,4194304] 0 2023-12-16T07:40:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/309: truncate d0/f41 2226208 0 2023-12-16T07:40:18.753 INFO:tasks.workunit.client.0.smithi049.stdout:5/239: symlink d5/de/d2d/d3c/l52 0 2023-12-16T07:40:18.753 INFO:tasks.workunit.client.0.smithi049.stdout:5/240: dread - d5/d1e/d21/f44 zero size 2023-12-16T07:40:18.753 INFO:tasks.workunit.client.0.smithi049.stdout:5/241: truncate d5/d1e/d21/f44 370237 0 2023-12-16T07:40:18.755 INFO:tasks.workunit.client.0.smithi049.stdout:6/308: rename d0/d2/dd to d0/d39/d5b/d65 0 2023-12-16T07:40:18.757 INFO:tasks.workunit.client.0.smithi049.stdout:7/286: truncate d7/dc/dd/ff 3485666 0 2023-12-16T07:40:18.757 INFO:tasks.workunit.client.0.smithi049.stdout:7/287: stat d7/dc/dd/d37/d5c 0 2023-12-16T07:40:18.757 INFO:tasks.workunit.client.0.smithi049.stdout:7/288: chown f2 0 1 2023-12-16T07:40:18.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/310: mkdir d0/d13/d42/d5b 0 2023-12-16T07:40:18.758 INFO:tasks.workunit.client.0.smithi049.stdout:4/278: dwrite d2/db/dd/de/d1e/d21/f39 [0,4194304] 0 2023-12-16T07:40:18.759 INFO:tasks.workunit.client.0.smithi049.stdout:8/311: dread d0/d1f/f22 [0,4194304] 0 2023-12-16T07:40:18.759 INFO:tasks.workunit.client.0.smithi049.stdout:5/242: mknod d5/de/d2d/d2f/c53 0 2023-12-16T07:40:18.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/243: write d5/d1e/d39/f43 [194352,82316] 0 2023-12-16T07:40:18.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/244: write d5/f8 [3767189,52549] 0 2023-12-16T07:40:18.761 INFO:tasks.workunit.client.0.smithi049.stdout:6/309: creat d0/d39/d5b/d65/d53/f66 x:0 0 0 2023-12-16T07:40:18.761 INFO:tasks.workunit.client.0.smithi049.stdout:6/310: dread - d0/d39/d5b/d65/d27/f45 zero size 2023-12-16T07:40:18.762 INFO:tasks.workunit.client.0.smithi049.stdout:6/311: fdatasync d0/d39/d5b/d65/d58/f51 0 2023-12-16T07:40:18.762 INFO:tasks.workunit.client.0.smithi049.stdout:6/312: fsync d0/d2/f9 0 2023-12-16T07:40:18.763 INFO:tasks.workunit.client.0.smithi049.stdout:7/289: creat d7/dc/f69 x:0 0 0 2023-12-16T07:40:18.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/279: mknod d2/c5b 0 2023-12-16T07:40:18.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/280: truncate d2/db/dd/d52/f59 490012 0 2023-12-16T07:40:18.770 INFO:tasks.workunit.client.0.smithi049.stdout:8/312: symlink d0/d13/d42/l5c 0 2023-12-16T07:40:18.771 INFO:tasks.workunit.client.0.smithi049.stdout:3/228: truncate d1/f16 3777696 0 2023-12-16T07:40:18.773 INFO:tasks.workunit.client.0.smithi049.stdout:5/245: rename d5/d1e/d39 to d5/de/d54 0 2023-12-16T07:40:18.775 INFO:tasks.workunit.client.0.smithi049.stdout:6/313: getdents d0/d39/d5b/d65/d58 0 2023-12-16T07:40:18.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/290: symlink d7/dc/dd/l6a 0 2023-12-16T07:40:18.779 INFO:tasks.workunit.client.0.smithi049.stdout:8/313: unlink d0/l2b 0 2023-12-16T07:40:18.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/281: rename d2/db/dd/f57 to d2/db/dd/de/d1e/d37/f5c 0 2023-12-16T07:40:18.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/282: truncate d2/db/dd/d2a/f20 1051211 0 2023-12-16T07:40:18.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/246: rmdir d5/d1e 39 2023-12-16T07:40:18.785 INFO:tasks.workunit.client.0.smithi049.stdout:6/314: creat d0/d39/d5b/d65/d4c/f67 x:0 0 0 2023-12-16T07:40:18.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/314: rename d0/d13/d42/l48 to d0/d13/d42/d5b/l5d 0 2023-12-16T07:40:18.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/247: rename d5/de/d1c/f2b to d5/de/d1c/f55 0 2023-12-16T07:40:18.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/229: dwrite d1/f24 [0,4194304] 0 2023-12-16T07:40:18.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/230: dread - d1/d2a/d37/d3f/f41 zero size 2023-12-16T07:40:18.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/231: stat d1/d2a 0 2023-12-16T07:40:18.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/315: rmdir d0/d39/d5b/d65/d32 39 2023-12-16T07:40:18.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/315: symlink d0/d13/l5e 0 2023-12-16T07:40:18.795 INFO:tasks.workunit.client.0.smithi049.stdout:5/248: creat d5/d1e/d20/f56 x:0 0 0 2023-12-16T07:40:18.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/232: creat d1/f44 x:0 0 0 2023-12-16T07:40:18.797 INFO:tasks.workunit.client.0.smithi049.stdout:6/316: symlink d0/d39/d5b/d65/d27/l68 0 2023-12-16T07:40:18.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/316: creat d0/d1f/f5f x:0 0 0 2023-12-16T07:40:18.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/317: readlink d0/d13/d42/d5b/l5d 0 2023-12-16T07:40:18.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/318: write d0/f3d [1005259,102656] 0 2023-12-16T07:40:18.800 INFO:tasks.workunit.client.0.smithi049.stdout:4/283: dwrite d2/db/dd/f13 [0,4194304] 0 2023-12-16T07:40:18.802 INFO:tasks.workunit.client.0.smithi049.stdout:5/249: rename d5/de/d2d to d5/de/d54/d57 0 2023-12-16T07:40:18.803 INFO:tasks.workunit.client.0.smithi049.stdout:5/250: write d5/f26 [4055157,118558] 0 2023-12-16T07:40:18.803 INFO:tasks.workunit.client.0.smithi049.stdout:5/251: fdatasync d5/de/d1c/f46 0 2023-12-16T07:40:18.803 INFO:tasks.workunit.client.0.smithi049.stdout:3/233: getdents d1/d2a/d37/d3f 0 2023-12-16T07:40:18.803 INFO:tasks.workunit.client.0.smithi049.stdout:3/234: write d1/f2c [469705,31610] 0 2023-12-16T07:40:18.804 INFO:tasks.workunit.client.0.smithi049.stdout:6/317: rmdir d0/d39/d5b 39 2023-12-16T07:40:18.806 INFO:tasks.workunit.client.0.smithi049.stdout:8/319: symlink d0/d13/l60 0 2023-12-16T07:40:18.806 INFO:tasks.workunit.client.0.smithi049.stdout:8/320: readlink d0/d13/l60 0 2023-12-16T07:40:18.806 INFO:tasks.workunit.client.0.smithi049.stdout:8/321: fsync d0/f12 0 2023-12-16T07:40:18.809 INFO:tasks.workunit.client.0.smithi049.stdout:5/252: mkdir d5/d1e/d21/d58 0 2023-12-16T07:40:18.810 INFO:tasks.workunit.client.0.smithi049.stdout:5/253: chown d5/d1e/d20/f36 3952671 1 2023-12-16T07:40:18.810 INFO:tasks.workunit.client.0.smithi049.stdout:5/254: getdents d5/d1e/d21/d4e 0 2023-12-16T07:40:18.816 INFO:tasks.workunit.client.0.smithi049.stdout:8/322: getdents d0/d1f/d1c 0 2023-12-16T07:40:18.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/323: write d0/d1f/d36/f3c [185167,113497] 0 2023-12-16T07:40:18.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/255: creat d5/d1e/d21/d4e/f59 x:0 0 0 2023-12-16T07:40:18.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/256: fdatasync d5/de/d54/d57/f50 0 2023-12-16T07:40:18.819 INFO:tasks.workunit.client.0.smithi049.stdout:3/235: dread d1/d2a/f40 [0,4194304] 0 2023-12-16T07:40:18.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/318: dwrite d0/d2/f3e [0,4194304] 0 2023-12-16T07:40:18.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/319: write d0/d39/d5b/d65/d58/d33/f49 [1407491,5846] 0 2023-12-16T07:40:18.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/320: dread - d0/d2/df/d4e/f56 zero size 2023-12-16T07:40:18.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/324: creat d0/d13/d42/d5b/f61 x:0 0 0 2023-12-16T07:40:18.821 INFO:tasks.workunit.client.0.smithi049.stdout:1/252: sync 2023-12-16T07:40:18.822 INFO:tasks.workunit.client.0.smithi049.stdout:5/257: mkdir d5/d1e/d21/d5a 0 2023-12-16T07:40:18.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/258: dread d5/de/d54/f43 [0,4194304] 0 2023-12-16T07:40:18.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/259: chown d5/d1e/d21/f3b 1766 1 2023-12-16T07:40:18.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/260: fdatasync d5/de/f40 0 2023-12-16T07:40:18.825 INFO:tasks.workunit.client.0.smithi049.stdout:6/321: symlink d0/d39/d5b/l69 0 2023-12-16T07:40:18.825 INFO:tasks.workunit.client.0.smithi049.stdout:6/322: fdatasync d0/d2/df/f31 0 2023-12-16T07:40:18.826 INFO:tasks.workunit.client.0.smithi049.stdout:6/323: write d0/d2/f47 [1751934,118193] 0 2023-12-16T07:40:18.833 INFO:tasks.workunit.client.0.smithi049.stdout:1/253: rename d20/d41/d49/f4c to d20/d41/f5a 0 2023-12-16T07:40:18.834 INFO:tasks.workunit.client.0.smithi049.stdout:3/236: truncate d1/f25 2293143 0 2023-12-16T07:40:18.837 INFO:tasks.workunit.client.0.smithi049.stdout:6/324: unlink d0/d2/df/f2e 0 2023-12-16T07:40:18.837 INFO:tasks.workunit.client.0.smithi049.stdout:6/325: dread - d0/d39/f54 zero size 2023-12-16T07:40:18.839 INFO:tasks.workunit.client.0.smithi049.stdout:5/261: rename d5/de/d54/d57/d3c/l52 to d5/d1e/l5b 0 2023-12-16T07:40:18.840 INFO:tasks.workunit.client.0.smithi049.stdout:5/262: chown d5/f3e 242 1 2023-12-16T07:40:18.840 INFO:tasks.workunit.client.0.smithi049.stdout:5/263: chown d5/de/d1c/c23 1864 1 2023-12-16T07:40:18.841 INFO:tasks.workunit.client.0.smithi049.stdout:8/325: dwrite d0/f28 [0,4194304] 0 2023-12-16T07:40:18.841 INFO:tasks.workunit.client.0.smithi049.stdout:3/237: symlink d1/d2a/d37/d3f/l45 0 2023-12-16T07:40:18.841 INFO:tasks.workunit.client.0.smithi049.stdout:8/326: write d0/d1f/f18 [1127857,53406] 0 2023-12-16T07:40:18.842 INFO:tasks.workunit.client.0.smithi049.stdout:6/326: getdents d0/d39/d3b 0 2023-12-16T07:40:18.842 INFO:tasks.workunit.client.0.smithi049.stdout:6/327: write d0/d39/d5b/d65/d58/f42 [157554,23837] 0 2023-12-16T07:40:18.843 INFO:tasks.workunit.client.0.smithi049.stdout:6/328: write d0/d39/d5b/d65/f26 [1333404,40847] 0 2023-12-16T07:40:18.843 INFO:tasks.workunit.client.0.smithi049.stdout:6/329: dread - d0/d39/d5b/d65/d4c/f67 zero size 2023-12-16T07:40:18.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/264: mkdir d5/de/d54/d5c 0 2023-12-16T07:40:18.843 INFO:tasks.workunit.client.0.smithi049.stdout:6/330: read d0/d2/f47 [3939578,104236] 0 2023-12-16T07:40:18.849 INFO:tasks.workunit.client.0.smithi049.stdout:6/331: dread d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:18.851 INFO:tasks.workunit.client.0.smithi049.stdout:8/327: symlink d0/d13/d42/l62 0 2023-12-16T07:40:18.851 INFO:tasks.workunit.client.0.smithi049.stdout:5/265: rename d5/de/d54/f43 to d5/de/d54/d57/d3c/f5d 0 2023-12-16T07:40:18.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/328: creat d0/d13/d42/d5b/f63 x:0 0 0 2023-12-16T07:40:18.853 INFO:tasks.workunit.client.0.smithi049.stdout:1/254: dwrite f1b [0,4194304] 0 2023-12-16T07:40:18.854 INFO:tasks.workunit.client.0.smithi049.stdout:5/266: symlink d5/de/d54/l5e 0 2023-12-16T07:40:18.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/238: link d1/l15 d1/l46 0 2023-12-16T07:40:18.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/239: write d1/d2a/d37/f42 [31732,83023] 0 2023-12-16T07:40:18.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/240: chown d1/d2a/f3b 2 1 2023-12-16T07:40:18.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/329: unlink d0/d13/f25 0 2023-12-16T07:40:18.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/330: chown d0/d1f/d56 206089 1 2023-12-16T07:40:18.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/332: dread d0/d39/d5b/d65/f26 [0,4194304] 0 2023-12-16T07:40:18.865 INFO:tasks.workunit.client.0.smithi049.stdout:1/255: link d20/d41/f5a d20/f5b 0 2023-12-16T07:40:18.865 INFO:tasks.workunit.client.0.smithi049.stdout:5/267: symlink d5/de/l5f 0 2023-12-16T07:40:18.866 INFO:tasks.workunit.client.0.smithi049.stdout:3/241: creat d1/d2a/f47 x:0 0 0 2023-12-16T07:40:18.866 INFO:tasks.workunit.client.0.smithi049.stdout:3/242: write d1/f44 [870103,59536] 0 2023-12-16T07:40:18.867 INFO:tasks.workunit.client.0.smithi049.stdout:8/331: creat d0/d1f/d36/f64 x:0 0 0 2023-12-16T07:40:18.868 INFO:tasks.workunit.client.0.smithi049.stdout:3/243: dread d1/f2c [0,4194304] 0 2023-12-16T07:40:18.868 INFO:tasks.workunit.client.0.smithi049.stdout:6/333: mkdir d0/d39/d5b/d65/d4c/d4d/d6a 0 2023-12-16T07:40:18.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/256: mknod d20/d43/c5c 0 2023-12-16T07:40:18.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/257: fsync f18 0 2023-12-16T07:40:18.871 INFO:tasks.workunit.client.0.smithi049.stdout:5/268: rmdir d5/d1e/d21/d4e 39 2023-12-16T07:40:18.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/332: truncate d0/d1f/f40 2097726 0 2023-12-16T07:40:18.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/333: write d0/d13/f31 [1758016,90763] 0 2023-12-16T07:40:18.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/334: truncate d0/f4f 921585 0 2023-12-16T07:40:18.876 INFO:tasks.workunit.client.0.smithi049.stdout:3/244: creat d1/d2a/f48 x:0 0 0 2023-12-16T07:40:18.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/283: sync 2023-12-16T07:40:18.876 INFO:tasks.workunit.client.0.smithi049.stdout:0/411: sync 2023-12-16T07:40:18.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/284: read d2/d26/f30 [473178,83076] 0 2023-12-16T07:40:18.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/285: write d2/d1d/d24/f2e [69314,30244] 0 2023-12-16T07:40:18.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/286: write d2/f4d [229542,95183] 0 2023-12-16T07:40:18.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/287: chown d2/de 25644 1 2023-12-16T07:40:18.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/334: rename d0/d39/d3b/f4f to d0/d39/d5b/d65/d4c/d4d/f6b 0 2023-12-16T07:40:18.878 INFO:tasks.workunit.client.0.smithi049.stdout:1/258: creat d20/d41/d4f/d55/d58/f5d x:0 0 0 2023-12-16T07:40:18.878 INFO:tasks.workunit.client.0.smithi049.stdout:5/269: dread d5/de/f1d [0,4194304] 0 2023-12-16T07:40:18.879 INFO:tasks.workunit.client.0.smithi049.stdout:8/335: creat d0/d1f/f65 x:0 0 0 2023-12-16T07:40:18.879 INFO:tasks.workunit.client.0.smithi049.stdout:9/264: sync 2023-12-16T07:40:18.880 INFO:tasks.workunit.client.0.smithi049.stdout:3/245: mknod d1/d2a/d37/c49 0 2023-12-16T07:40:18.881 INFO:tasks.workunit.client.0.smithi049.stdout:0/412: mknod d13/d39/d78/c8c 0 2023-12-16T07:40:18.881 INFO:tasks.workunit.client.0.smithi049.stdout:2/288: creat d2/d26/f59 x:0 0 0 2023-12-16T07:40:18.882 INFO:tasks.workunit.client.0.smithi049.stdout:6/335: mkdir d0/d39/d3b/d4a/d6c 0 2023-12-16T07:40:18.883 INFO:tasks.workunit.client.0.smithi049.stdout:5/270: rmdir d5/de/d1c 39 2023-12-16T07:40:18.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/265: link d4/f1f d4/d7/d11/d26/f52 0 2023-12-16T07:40:18.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/266: fdatasync d4/db/f39 0 2023-12-16T07:40:18.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/267: stat d4/d7/l1a 0 2023-12-16T07:40:18.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/268: dread - d4/db/f33 zero size 2023-12-16T07:40:18.888 INFO:tasks.workunit.client.0.smithi049.stdout:3/246: unlink d1/d2a/f2f 0 2023-12-16T07:40:18.890 INFO:tasks.workunit.client.0.smithi049.stdout:2/289: creat d2/d1d/d24/d55/f5a x:0 0 0 2023-12-16T07:40:18.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/336: mknod d0/d39/d5b/d65/d58/d33/c6d 0 2023-12-16T07:40:18.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/337: stat d0/d39/d5b/d65/d58/f42 0 2023-12-16T07:40:18.892 INFO:tasks.workunit.client.0.smithi049.stdout:1/259: dread f14 [0,4194304] 0 2023-12-16T07:40:18.892 INFO:tasks.workunit.client.0.smithi049.stdout:0/413: dread d13/d21/d2f/f52 [0,4194304] 0 2023-12-16T07:40:18.893 INFO:tasks.workunit.client.0.smithi049.stdout:0/414: write d13/f40 [2651373,18691] 0 2023-12-16T07:40:18.894 INFO:tasks.workunit.client.0.smithi049.stdout:0/415: chown d13/d21/d27/f86 3204137 1 2023-12-16T07:40:18.894 INFO:tasks.workunit.client.0.smithi049.stdout:0/416: readlink d13/d21/l76 0 2023-12-16T07:40:18.894 INFO:tasks.workunit.client.0.smithi049.stdout:0/417: getdents d13/d39/d78/d83 0 2023-12-16T07:40:18.894 INFO:tasks.workunit.client.0.smithi049.stdout:5/271: creat d5/d1e/d20/f60 x:0 0 0 2023-12-16T07:40:18.894 INFO:tasks.workunit.client.0.smithi049.stdout:5/272: fdatasync d5/de/d1c/f55 0 2023-12-16T07:40:18.897 INFO:tasks.workunit.client.0.smithi049.stdout:6/338: dread d0/f23 [0,4194304] 0 2023-12-16T07:40:18.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/247: creat d1/d2a/f4a x:0 0 0 2023-12-16T07:40:18.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/336: rename d0/d1f/d36/f64 to d0/d13/f66 0 2023-12-16T07:40:18.900 INFO:tasks.workunit.client.0.smithi049.stdout:1/260: link d20/f32 d20/d41/d52/f5e 0 2023-12-16T07:40:18.902 INFO:tasks.workunit.client.0.smithi049.stdout:0/418: creat d13/d21/d27/d2c/f8d x:0 0 0 2023-12-16T07:40:18.902 INFO:tasks.workunit.client.0.smithi049.stdout:0/419: chown d13/d39/f6b 1915839963 1 2023-12-16T07:40:18.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/273: unlink d5/d1e/c27 0 2023-12-16T07:40:18.905 INFO:tasks.workunit.client.0.smithi049.stdout:3/248: write d1/f16 [2351079,38167] 0 2023-12-16T07:40:18.907 INFO:tasks.workunit.client.0.smithi049.stdout:8/337: creat d0/d1f/f67 x:0 0 0 2023-12-16T07:40:18.907 INFO:tasks.workunit.client.0.smithi049.stdout:1/261: write d20/f32 [2704827,64181] 0 2023-12-16T07:40:18.908 INFO:tasks.workunit.client.0.smithi049.stdout:5/274: symlink d5/d1e/d20/l61 0 2023-12-16T07:40:18.908 INFO:tasks.workunit.client.0.smithi049.stdout:9/269: dwrite d4/db/f39 [0,4194304] 0 2023-12-16T07:40:18.910 INFO:tasks.workunit.client.0.smithi049.stdout:0/420: dread d13/d21/d27/d2c/f55 [0,4194304] 0 2023-12-16T07:40:18.911 INFO:tasks.workunit.client.0.smithi049.stdout:3/249: mknod d1/d2b/c4b 0 2023-12-16T07:40:18.911 INFO:tasks.workunit.client.0.smithi049.stdout:3/250: write d1/d2a/f47 [497286,67487] 0 2023-12-16T07:40:18.911 INFO:tasks.workunit.client.0.smithi049.stdout:1/262: creat d20/d40/f5f x:0 0 0 2023-12-16T07:40:18.911 INFO:tasks.workunit.client.0.smithi049.stdout:5/275: mkdir d5/de/d1c/d62 0 2023-12-16T07:40:18.912 INFO:tasks.workunit.client.0.smithi049.stdout:2/290: dwrite d2/f22 [0,4194304] 0 2023-12-16T07:40:18.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/421: unlink d13/d39/d38/l3a 0 2023-12-16T07:40:18.919 INFO:tasks.workunit.client.0.smithi049.stdout:3/251: mkdir d1/d2a/d37/d3f/d4c 0 2023-12-16T07:40:18.919 INFO:tasks.workunit.client.0.smithi049.stdout:3/252: stat d1/f24 0 2023-12-16T07:40:18.923 INFO:tasks.workunit.client.0.smithi049.stdout:2/291: symlink d2/d1d/d28/d56/d11/d47/l5b 0 2023-12-16T07:40:18.923 INFO:tasks.workunit.client.0.smithi049.stdout:2/292: fdatasync d2/d1d/d28/f52 0 2023-12-16T07:40:18.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/253: creat d1/d2a/d37/d3f/d4c/f4d x:0 0 0 2023-12-16T07:40:18.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/422: mknod d13/d15/d46/d65/c8e 0 2023-12-16T07:40:18.926 INFO:tasks.workunit.client.0.smithi049.stdout:1/263: dread f1b [0,4194304] 0 2023-12-16T07:40:18.931 INFO:tasks.workunit.client.0.smithi049.stdout:3/254: read d1/d2a/f47 [239189,79441] 0 2023-12-16T07:40:18.931 INFO:tasks.workunit.client.0.smithi049.stdout:3/255: truncate d1/d2a/f4a 41800 0 2023-12-16T07:40:18.931 INFO:tasks.workunit.client.0.smithi049.stdout:9/270: dread d4/d7/f38 [0,4194304] 0 2023-12-16T07:40:18.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/293: mknod d2/d1d/d28/d56/d11/d1c/c5c 0 2023-12-16T07:40:18.931 INFO:tasks.workunit.client.0.smithi049.stdout:0/423: creat d13/d21/d27/d2c/d62/d70/f8f x:0 0 0 2023-12-16T07:40:18.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/271: creat d4/d7/d11/d26/f53 x:0 0 0 2023-12-16T07:40:18.933 INFO:tasks.workunit.client.0.smithi049.stdout:1/264: dread f14 [0,4194304] 0 2023-12-16T07:40:18.936 INFO:tasks.workunit.client.0.smithi049.stdout:2/294: mkdir d2/d1d/d28/d56/d11/d1c/d5d 0 2023-12-16T07:40:18.942 INFO:tasks.workunit.client.0.smithi049.stdout:5/276: dread d5/de/d1c/f46 [0,4194304] 0 2023-12-16T07:40:18.942 INFO:tasks.workunit.client.0.smithi049.stdout:8/338: dwrite d0/d1f/d36/f45 [0,4194304] 0 2023-12-16T07:40:18.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/424: dwrite d13/d21/d27/d2c/d62/f84 [0,4194304] 0 2023-12-16T07:40:18.948 INFO:tasks.workunit.client.0.smithi049.stdout:9/272: creat d4/d7/d11/d3f/f54 x:0 0 0 2023-12-16T07:40:18.948 INFO:tasks.workunit.client.0.smithi049.stdout:2/295: creat d2/d1d/f5e x:0 0 0 2023-12-16T07:40:18.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/284: sync 2023-12-16T07:40:18.948 INFO:tasks.workunit.client.0.smithi049.stdout:7/291: sync 2023-12-16T07:40:18.949 INFO:tasks.workunit.client.0.smithi049.stdout:7/292: chown d7/dc/f25 554374144 1 2023-12-16T07:40:18.949 INFO:tasks.workunit.client.0.smithi049.stdout:7/293: write d7/dc/f25 [4685350,31980] 0 2023-12-16T07:40:18.949 INFO:tasks.workunit.client.0.smithi049.stdout:7/294: dread - d7/dc/dd/d27/f48 zero size 2023-12-16T07:40:18.950 INFO:tasks.workunit.client.0.smithi049.stdout:4/285: write d2/db/dd/d2a/f43 [97931,9923] 0 2023-12-16T07:40:18.950 INFO:tasks.workunit.client.0.smithi049.stdout:4/286: write d2/db/dd/de/d1e/d37/d4e/f56 [1138075,9147] 0 2023-12-16T07:40:18.950 INFO:tasks.workunit.client.0.smithi049.stdout:1/265: dwrite fe [0,4194304] 0 2023-12-16T07:40:18.950 INFO:tasks.workunit.client.0.smithi049.stdout:1/266: readlink d20/d45/d47/l4d 0 2023-12-16T07:40:18.950 INFO:tasks.workunit.client.0.smithi049.stdout:8/339: rmdir d0/d1f/d36 39 2023-12-16T07:40:18.953 INFO:tasks.workunit.client.0.smithi049.stdout:9/273: write d4/db/f22 [7907472,63800] 0 2023-12-16T07:40:18.953 INFO:tasks.workunit.client.0.smithi049.stdout:9/274: fsync f3 0 2023-12-16T07:40:18.959 INFO:tasks.workunit.client.0.smithi049.stdout:2/296: mknod d2/d1d/d28/d56/d11/d47/c5f 0 2023-12-16T07:40:18.959 INFO:tasks.workunit.client.0.smithi049.stdout:7/295: mkdir d7/dc/d6b 0 2023-12-16T07:40:18.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/287: link d2/db/f15 d2/db/dd/d2a/f5d 0 2023-12-16T07:40:18.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/288: chown d2/db/dd/d2a/f5d 3316 1 2023-12-16T07:40:18.959 INFO:tasks.workunit.client.0.smithi049.stdout:1/267: symlink d20/l60 0 2023-12-16T07:40:18.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/340: rmdir d0/d13/d42/d5b 39 2023-12-16T07:40:18.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/341: dread - d0/d1f/d1c/f52 zero size 2023-12-16T07:40:18.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/342: fsync d0/d1f/f67 0 2023-12-16T07:40:18.963 INFO:tasks.workunit.client.0.smithi049.stdout:2/297: rename d2/d1d/d28/d56/d11/d1c/c5c to d2/d1d/d28/c60 0 2023-12-16T07:40:18.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/298: creat d2/d1d/d28/d56/d11/f61 x:0 0 0 2023-12-16T07:40:18.968 INFO:tasks.workunit.client.0.smithi049.stdout:0/425: dwrite d13/d15/d46/d65/f73 [0,4194304] 0 2023-12-16T07:40:18.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/268: dread fe [4194304,4194304] 0 2023-12-16T07:40:18.969 INFO:tasks.workunit.client.0.smithi049.stdout:0/426: write d13/d15/f19 [843610,11856] 0 2023-12-16T07:40:18.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/289: dwrite d2/db/dd/de/d1e/d21/f4f [4194304,4194304] 0 2023-12-16T07:40:18.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/343: dread d0/d13/f31 [0,4194304] 0 2023-12-16T07:40:18.973 INFO:tasks.workunit.client.0.smithi049.stdout:0/427: mkdir d13/d21/d2f/d7d/d90 0 2023-12-16T07:40:18.976 INFO:tasks.workunit.client.0.smithi049.stdout:8/344: rmdir d0/d1f 39 2023-12-16T07:40:18.977 INFO:tasks.workunit.client.0.smithi049.stdout:8/345: write d0/f4f [1096708,70111] 0 2023-12-16T07:40:18.978 INFO:tasks.workunit.client.0.smithi049.stdout:0/428: symlink d13/d15/d46/l91 0 2023-12-16T07:40:18.980 INFO:tasks.workunit.client.0.smithi049.stdout:0/429: rename f12 to d13/d21/f92 0 2023-12-16T07:40:18.982 INFO:tasks.workunit.client.0.smithi049.stdout:0/430: rename d13/d21/c48 to d13/d39/d8a/c93 0 2023-12-16T07:40:18.985 INFO:tasks.workunit.client.0.smithi049.stdout:0/431: unlink d13/c30 0 2023-12-16T07:40:18.985 INFO:tasks.workunit.client.0.smithi049.stdout:0/432: write d13/d21/d27/d2c/f55 [4767534,15288] 0 2023-12-16T07:40:18.988 INFO:tasks.workunit.client.0.smithi049.stdout:0/433: unlink d13/d39/c72 0 2023-12-16T07:40:18.989 INFO:tasks.workunit.client.0.smithi049.stdout:0/434: creat d13/d21/d27/d2c/d62/f94 x:0 0 0 2023-12-16T07:40:18.990 INFO:tasks.workunit.client.0.smithi049.stdout:4/290: write d2/db/f15 [3360916,23018] 0 2023-12-16T07:40:18.990 INFO:tasks.workunit.client.0.smithi049.stdout:8/346: dread d0/d1f/d36/f47 [4194304,4194304] 0 2023-12-16T07:40:18.991 INFO:tasks.workunit.client.0.smithi049.stdout:0/435: truncate d13/f17 2234780 0 2023-12-16T07:40:18.991 INFO:tasks.workunit.client.0.smithi049.stdout:4/291: write d2/db/dd/d2a/f26 [3218918,43593] 0 2023-12-16T07:40:18.991 INFO:tasks.workunit.client.0.smithi049.stdout:0/436: write d13/d21/d27/d2c/d62/d70/f8f [1035405,6735] 0 2023-12-16T07:40:18.992 INFO:tasks.workunit.client.0.smithi049.stdout:4/292: rmdir d2/db 39 2023-12-16T07:40:18.992 INFO:tasks.workunit.client.0.smithi049.stdout:4/293: chown d2/f28 14 1 2023-12-16T07:40:18.994 INFO:tasks.workunit.client.0.smithi049.stdout:8/347: dread d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:18.994 INFO:tasks.workunit.client.0.smithi049.stdout:8/348: write d0/d13/d42/d5b/f61 [285601,5775] 0 2023-12-16T07:40:18.999 INFO:tasks.workunit.client.0.smithi049.stdout:2/299: dwrite d2/de/f46 [0,4194304] 0 2023-12-16T07:40:18.999 INFO:tasks.workunit.client.0.smithi049.stdout:0/437: fsync d13/d39/d78/f7f 0 2023-12-16T07:40:19.002 INFO:tasks.workunit.client.0.smithi049.stdout:2/300: symlink d2/d26/l62 0 2023-12-16T07:40:19.004 INFO:tasks.workunit.client.0.smithi049.stdout:0/438: creat d13/d15/d46/f95 x:0 0 0 2023-12-16T07:40:19.004 INFO:tasks.workunit.client.0.smithi049.stdout:0/439: write d13/d39/d38/f54 [1705889,38605] 0 2023-12-16T07:40:19.005 INFO:tasks.workunit.client.0.smithi049.stdout:0/440: write d13/d21/d27/f4d [4121283,27067] 0 2023-12-16T07:40:19.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/269: dwrite d20/d41/d4f/f53 [0,4194304] 0 2023-12-16T07:40:19.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/270: read d20/f33 [160709,56923] 0 2023-12-16T07:40:19.008 INFO:tasks.workunit.client.0.smithi049.stdout:2/301: creat d2/d1d/d28/d56/d11/d1c/f63 x:0 0 0 2023-12-16T07:40:19.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/294: dwrite d2/f28 [0,4194304] 0 2023-12-16T07:40:19.017 INFO:tasks.workunit.client.0.smithi049.stdout:8/349: dwrite d0/d13/f55 [0,4194304] 0 2023-12-16T07:40:19.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/441: symlink d13/d21/d2f/d7d/l96 0 2023-12-16T07:40:19.021 INFO:tasks.workunit.client.0.smithi049.stdout:2/302: mknod d2/c64 0 2023-12-16T07:40:19.021 INFO:tasks.workunit.client.0.smithi049.stdout:2/303: truncate d2/d1d/d28/d56/d11/d1c/f63 111639 0 2023-12-16T07:40:19.024 INFO:tasks.workunit.client.0.smithi049.stdout:8/350: mkdir d0/d13/d42/d5b/d68 0 2023-12-16T07:40:19.025 INFO:tasks.workunit.client.0.smithi049.stdout:8/351: chown d0/d13/c32 7007856 1 2023-12-16T07:40:19.026 INFO:tasks.workunit.client.0.smithi049.stdout:2/304: getdents d2/d1d/d28 0 2023-12-16T07:40:19.026 INFO:tasks.workunit.client.0.smithi049.stdout:2/305: write d2/d1d/d28/d56/d11/f25 [1672040,35205] 0 2023-12-16T07:40:19.026 INFO:tasks.workunit.client.0.smithi049.stdout:2/306: stat d2/d1d/d24/l53 0 2023-12-16T07:40:19.028 INFO:tasks.workunit.client.0.smithi049.stdout:8/352: mknod d0/d13/d42/c69 0 2023-12-16T07:40:19.030 INFO:tasks.workunit.client.0.smithi049.stdout:2/307: mknod d2/d26/d43/c65 0 2023-12-16T07:40:19.031 INFO:tasks.workunit.client.0.smithi049.stdout:8/353: mkdir d0/d6a 0 2023-12-16T07:40:19.032 INFO:tasks.workunit.client.0.smithi049.stdout:2/308: mkdir d2/d1d/d28/d56/d66 0 2023-12-16T07:40:19.033 INFO:tasks.workunit.client.0.smithi049.stdout:2/309: write d2/ff [532789,72434] 0 2023-12-16T07:40:19.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/354: mkdir d0/d13/d42/d5b/d68/d6b 0 2023-12-16T07:40:19.034 INFO:tasks.workunit.client.0.smithi049.stdout:8/355: write d0/f58 [1553370,58061] 0 2023-12-16T07:40:19.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/310: creat d2/d1d/d28/d56/d11/f67 x:0 0 0 2023-12-16T07:40:19.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/271: dwrite fc [0,4194304] 0 2023-12-16T07:40:19.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/272: fsync f18 0 2023-12-16T07:40:19.050 INFO:tasks.workunit.client.0.smithi049.stdout:1/273: getdents d20 0 2023-12-16T07:40:19.051 INFO:tasks.workunit.client.0.smithi049.stdout:1/274: truncate f1d 3269181 0 2023-12-16T07:40:19.052 INFO:tasks.workunit.client.0.smithi049.stdout:0/442: dwrite d13/d21/d27/f5f [0,4194304] 0 2023-12-16T07:40:19.053 INFO:tasks.workunit.client.0.smithi049.stdout:6/339: sync 2023-12-16T07:40:19.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/340: mknod d0/d2/df/c6e 0 2023-12-16T07:40:19.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/341: rmdir d0/d39/d5b/d65/d58 39 2023-12-16T07:40:19.058 INFO:tasks.workunit.client.0.smithi049.stdout:6/342: rename d0/d39/d3b to d0/d2/df/d4e/d5d/d6f 0 2023-12-16T07:40:19.060 INFO:tasks.workunit.client.0.smithi049.stdout:6/343: rename d0/d2/df/d4e/d5d/d6f/f55 to d0/d39/d5b/d65/d58/d33/f70 0 2023-12-16T07:40:19.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/344: write d0/f23 [2728641,61747] 0 2023-12-16T07:40:19.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/345: unlink d0/d2/df/d4e/d5d/d6f/d4a/l57 0 2023-12-16T07:40:19.063 INFO:tasks.workunit.client.0.smithi049.stdout:6/346: chown d0/d2/df/f24 172 1 2023-12-16T07:40:19.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/443: dread d13/f40 [0,4194304] 0 2023-12-16T07:40:19.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/444: rmdir d13/d39/d8a 39 2023-12-16T07:40:19.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/445: truncate d13/f1c 4337526 0 2023-12-16T07:40:19.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/446: truncate d13/d39/d38/f89 6324 0 2023-12-16T07:40:19.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/356: dwrite d0/d13/f2f [0,4194304] 0 2023-12-16T07:40:19.069 INFO:tasks.workunit.client.0.smithi049.stdout:0/447: creat d13/d21/d27/f97 x:0 0 0 2023-12-16T07:40:19.070 INFO:tasks.workunit.client.0.smithi049.stdout:8/357: symlink d0/d1f/d36/l6c 0 2023-12-16T07:40:19.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/448: creat d13/d21/d27/d2c/f98 x:0 0 0 2023-12-16T07:40:19.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/449: write d13/d39/d38/f54 [2619584,5991] 0 2023-12-16T07:40:19.072 INFO:tasks.workunit.client.0.smithi049.stdout:1/275: dwrite d20/d45/d47/f56 [0,4194304] 0 2023-12-16T07:40:19.072 INFO:tasks.workunit.client.0.smithi049.stdout:1/276: dread - d20/d40/f5f zero size 2023-12-16T07:40:19.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/358: rename d0/d13/lb to d0/l6d 0 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/311: dwrite d2/d26/f30 [0,4194304] 0 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/312: chown d2/ld 58497525 1 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/313: write d2/d26/f59 [514801,7421] 0 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/314: chown d2/de/f46 2152301 1 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/315: chown d2/d1d/d28/d56/d11/d47 30154162 1 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:8/359: rename d0/d1f/f5f to d0/f6e 0 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:8/360: truncate d0/d13/fd 5232459 0 2023-12-16T07:40:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:8/361: chown d0/f41 48650 1 2023-12-16T07:40:19.085 INFO:tasks.workunit.client.0.smithi049.stdout:2/316: creat d2/d1d/f68 x:0 0 0 2023-12-16T07:40:19.086 INFO:tasks.workunit.client.0.smithi049.stdout:8/362: dread d0/d13/f55 [0,4194304] 0 2023-12-16T07:40:19.086 INFO:tasks.workunit.client.0.smithi049.stdout:8/363: chown d0/d13/d42/d5b/d68/d6b 50008 1 2023-12-16T07:40:19.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/317: creat d2/d26/f69 x:0 0 0 2023-12-16T07:40:19.087 INFO:tasks.workunit.client.0.smithi049.stdout:8/364: mknod d0/d13/d42/d5b/d68/d6b/c6f 0 2023-12-16T07:40:19.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/318: rmdir d2/d1d/d28/d56/d11/d1c/d5d 0 2023-12-16T07:40:19.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/319: chown d2/d1d/d28/d56/d11/f67 0 1 2023-12-16T07:40:19.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/320: chown d2/d1d/d24/d55/f5a 2 1 2023-12-16T07:40:19.090 INFO:tasks.workunit.client.0.smithi049.stdout:8/365: rename d0/d1f/d36/l6c to d0/d13/l70 0 2023-12-16T07:40:19.091 INFO:tasks.workunit.client.0.smithi049.stdout:2/321: mknod d2/d1d/d28/d56/d11/d47/c6a 0 2023-12-16T07:40:19.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/347: dwrite d0/d39/d5b/d65/f26 [0,4194304] 0 2023-12-16T07:40:19.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/322: mkdir d2/d1d/d28/d56/d66/d6b 0 2023-12-16T07:40:19.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/323: read d2/de/f46 [900439,39425] 0 2023-12-16T07:40:19.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/324: write d2/d1d/f5e [154304,84268] 0 2023-12-16T07:40:19.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/450: dwrite d13/f17 [0,4194304] 0 2023-12-16T07:40:19.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/451: chown d13/d15/d46/f63 1688428 1 2023-12-16T07:40:19.097 INFO:tasks.workunit.client.0.smithi049.stdout:6/348: rename d0/d2/df/d4e/f56 to d0/d39/d5b/d65/d32/f71 0 2023-12-16T07:40:19.098 INFO:tasks.workunit.client.0.smithi049.stdout:1/277: dwrite fa [0,4194304] 0 2023-12-16T07:40:19.098 INFO:tasks.workunit.client.0.smithi049.stdout:1/278: fdatasync d20/d41/d52/f5e 0 2023-12-16T07:40:19.100 INFO:tasks.workunit.client.0.smithi049.stdout:2/325: rename d2/d26/f39 to d2/d1d/d24/f6c 0 2023-12-16T07:40:19.102 INFO:tasks.workunit.client.0.smithi049.stdout:6/349: creat d0/d39/d5b/d65/d32/f72 x:0 0 0 2023-12-16T07:40:19.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/350: dread d0/d2/df/f24 [0,4194304] 0 2023-12-16T07:40:19.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/366: getdents d0/d1f/d36 0 2023-12-16T07:40:19.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/279: creat d20/f61 x:0 0 0 2023-12-16T07:40:19.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/280: dread - d20/f28 zero size 2023-12-16T07:40:19.118 INFO:tasks.workunit.client.0.smithi049.stdout:0/452: rename d13/d15 to d13/d21/d99 0 2023-12-16T07:40:19.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/326: truncate d2/d1d/d24/f33 3394313 0 2023-12-16T07:40:19.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/351: symlink d0/d2/l73 0 2023-12-16T07:40:19.123 INFO:tasks.workunit.client.0.smithi049.stdout:8/367: symlink d0/d1f/d56/l71 0 2023-12-16T07:40:19.124 INFO:tasks.workunit.client.0.smithi049.stdout:1/281: creat d20/f62 x:0 0 0 2023-12-16T07:40:19.125 INFO:tasks.workunit.client.0.smithi049.stdout:0/453: creat d13/d39/d38/d7e/d8b/f9a x:0 0 0 2023-12-16T07:40:19.126 INFO:tasks.workunit.client.0.smithi049.stdout:6/352: getdents d0/d2/df/d4e/d5d 0 2023-12-16T07:40:19.127 INFO:tasks.workunit.client.0.smithi049.stdout:6/353: chown d0/d39/d5b/l69 1469 1 2023-12-16T07:40:19.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/368: creat d0/d1f/d56/f72 x:0 0 0 2023-12-16T07:40:19.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/369: chown d0/f43 458 1 2023-12-16T07:40:19.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/370: truncate d0/f58 4816917 0 2023-12-16T07:40:19.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/371: dread - d0/d1f/d56/f72 zero size 2023-12-16T07:40:19.130 INFO:tasks.workunit.client.0.smithi049.stdout:0/454: dread f3 [0,4194304] 0 2023-12-16T07:40:19.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/455: read d13/d21/d27/f4d [1676322,66565] 0 2023-12-16T07:40:19.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/372: symlink d0/l73 0 2023-12-16T07:40:19.135 INFO:tasks.workunit.client.0.smithi049.stdout:2/327: dwrite d2/d1d/d28/d56/d11/f3d [0,4194304] 0 2023-12-16T07:40:19.136 INFO:tasks.workunit.client.0.smithi049.stdout:1/282: dread ff [0,4194304] 0 2023-12-16T07:40:19.137 INFO:tasks.workunit.client.0.smithi049.stdout:0/456: truncate f4 863658 0 2023-12-16T07:40:19.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/373: link d0/f43 d0/d1f/d56/f74 0 2023-12-16T07:40:19.141 INFO:tasks.workunit.client.0.smithi049.stdout:2/328: link d2/d1d/d28/d56/d11/f2c d2/d1d/f6d 0 2023-12-16T07:40:19.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/283: creat d20/d41/d4f/d55/d58/f63 x:0 0 0 2023-12-16T07:40:19.144 INFO:tasks.workunit.client.0.smithi049.stdout:3/256: sync 2023-12-16T07:40:19.144 INFO:tasks.workunit.client.0.smithi049.stdout:5/277: sync 2023-12-16T07:40:19.144 INFO:tasks.workunit.client.0.smithi049.stdout:3/257: chown d1/l8 754500039 1 2023-12-16T07:40:19.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/374: stat d0/d1f/c33 0 2023-12-16T07:40:19.146 INFO:tasks.workunit.client.0.smithi049.stdout:5/278: getdents d5/de/d54/d57 0 2023-12-16T07:40:19.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/375: mkdir d0/d13/d42/d5b/d68/d75 0 2023-12-16T07:40:19.148 INFO:tasks.workunit.client.0.smithi049.stdout:3/258: mknod d1/c4e 0 2023-12-16T07:40:19.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/279: rename d5/d1e/d20/c48 to d5/d1e/d21/d5a/c63 0 2023-12-16T07:40:19.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/280: getdents d5/de/d54/d57 0 2023-12-16T07:40:19.151 INFO:tasks.workunit.client.0.smithi049.stdout:8/376: symlink d0/d1f/d56/l76 0 2023-12-16T07:40:19.151 INFO:tasks.workunit.client.0.smithi049.stdout:1/284: write d20/d40/f54 [1140894,19739] 0 2023-12-16T07:40:19.152 INFO:tasks.workunit.client.0.smithi049.stdout:1/285: chown f18 7241051 1 2023-12-16T07:40:19.152 INFO:tasks.workunit.client.0.smithi049.stdout:1/286: dread - d20/f35 zero size 2023-12-16T07:40:19.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/354: dwrite d0/d39/d5b/d65/d58/d2c/f36 [0,4194304] 0 2023-12-16T07:40:19.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/355: chown d0/d39/f54 6576 1 2023-12-16T07:40:19.152 INFO:tasks.workunit.client.0.smithi049.stdout:3/259: creat d1/d2b/f4f x:0 0 0 2023-12-16T07:40:19.152 INFO:tasks.workunit.client.0.smithi049.stdout:3/260: fsync d1/d2a/f32 0 2023-12-16T07:40:19.153 INFO:tasks.workunit.client.0.smithi049.stdout:5/281: link d5/de/c3a d5/de/d54/d5c/c64 0 2023-12-16T07:40:19.156 INFO:tasks.workunit.client.0.smithi049.stdout:1/287: rename d20/f29 to d20/d41/f64 0 2023-12-16T07:40:19.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/356: unlink d0/f23 0 2023-12-16T07:40:19.161 INFO:tasks.workunit.client.0.smithi049.stdout:1/288: creat d20/d45/d47/f65 x:0 0 0 2023-12-16T07:40:19.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/289: mkdir d20/d41/d52/d66 0 2023-12-16T07:40:19.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/290: chown d20/d41 42 1 2023-12-16T07:40:19.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/291: fdatasync d20/d45/d47/f56 0 2023-12-16T07:40:19.165 INFO:tasks.workunit.client.0.smithi049.stdout:2/329: dwrite d2/d26/f30 [0,4194304] 0 2023-12-16T07:40:19.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/457: dwrite d13/d21/d2f/f52 [4194304,4194304] 0 2023-12-16T07:40:19.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/458: stat d13/d21/d2f/f80 0 2023-12-16T07:40:19.167 INFO:tasks.workunit.client.0.smithi049.stdout:1/292: mknod d20/d41/d4f/c67 0 2023-12-16T07:40:19.167 INFO:tasks.workunit.client.0.smithi049.stdout:7/296: sync 2023-12-16T07:40:19.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/275: sync 2023-12-16T07:40:19.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/276: readlink l2 0 2023-12-16T07:40:19.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/277: write d4/db/f33 [915945,59358] 0 2023-12-16T07:40:19.170 INFO:tasks.workunit.client.0.smithi049.stdout:2/330: rename d2/d1d/d28/d56/d11/d47 to d2/d26/d6e 0 2023-12-16T07:40:19.177 INFO:tasks.workunit.client.0.smithi049.stdout:0/459: creat d13/d21/d99/d46/d65/f9b x:0 0 0 2023-12-16T07:40:19.178 INFO:tasks.workunit.client.0.smithi049.stdout:1/293: getdents d20/d41/d49 0 2023-12-16T07:40:19.180 INFO:tasks.workunit.client.0.smithi049.stdout:3/261: dwrite d1/d2a/d37/d3f/d4c/f4d [0,4194304] 0 2023-12-16T07:40:19.181 INFO:tasks.workunit.client.0.smithi049.stdout:7/297: symlink d7/dc/dd/d37/l6c 0 2023-12-16T07:40:19.181 INFO:tasks.workunit.client.0.smithi049.stdout:7/298: dread - d7/d2b/d59/f5e zero size 2023-12-16T07:40:19.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/278: mknod d4/d7/d11/d26/d47/c55 0 2023-12-16T07:40:19.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/279: chown d4/db/c23 231175 1 2023-12-16T07:40:19.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/357: dwrite d0/f64 [0,4194304] 0 2023-12-16T07:40:19.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/358: stat d0/d39/d5b/d65/d58/l3c 0 2023-12-16T07:40:19.183 INFO:tasks.workunit.client.0.smithi049.stdout:2/331: mknod d2/c6f 0 2023-12-16T07:40:19.184 INFO:tasks.workunit.client.0.smithi049.stdout:5/282: rmdir d5/de 39 2023-12-16T07:40:19.184 INFO:tasks.workunit.client.0.smithi049.stdout:5/283: dread - d5/de/d54/f42 zero size 2023-12-16T07:40:19.186 INFO:tasks.workunit.client.0.smithi049.stdout:1/294: creat d20/d41/d52/f68 x:0 0 0 2023-12-16T07:40:19.196 INFO:tasks.workunit.client.0.smithi049.stdout:9/280: mkdir d4/d7/d11/d56 0 2023-12-16T07:40:19.198 INFO:tasks.workunit.client.0.smithi049.stdout:1/295: dread d20/d41/d52/f5e [0,4194304] 0 2023-12-16T07:40:19.200 INFO:tasks.workunit.client.0.smithi049.stdout:6/359: link d0/d39/d5b/d65/f1f d0/d39/d5b/f74 0 2023-12-16T07:40:19.201 INFO:tasks.workunit.client.0.smithi049.stdout:2/332: creat d2/d1d/d28/d56/d66/d6b/f70 x:0 0 0 2023-12-16T07:40:19.201 INFO:tasks.workunit.client.0.smithi049.stdout:2/333: chown d2/d1d/d28/d56/d11/f67 32005 1 2023-12-16T07:40:19.203 INFO:tasks.workunit.client.0.smithi049.stdout:9/281: symlink d4/d7/d11/d1d/l57 0 2023-12-16T07:40:19.203 INFO:tasks.workunit.client.0.smithi049.stdout:3/262: dwrite d1/fc [0,4194304] 0 2023-12-16T07:40:19.204 INFO:tasks.workunit.client.0.smithi049.stdout:1/296: rename d20/f38 to d20/d41/d4f/f69 0 2023-12-16T07:40:19.205 INFO:tasks.workunit.client.0.smithi049.stdout:4/295: sync 2023-12-16T07:40:19.206 INFO:tasks.workunit.client.0.smithi049.stdout:6/360: creat d0/d2/df/d4e/d5d/d6f/f75 x:0 0 0 2023-12-16T07:40:19.207 INFO:tasks.workunit.client.0.smithi049.stdout:2/334: mkdir d2/d1d/d28/d56/d71 0 2023-12-16T07:40:19.209 INFO:tasks.workunit.client.0.smithi049.stdout:9/282: read d4/fd [689056,70320] 0 2023-12-16T07:40:19.211 INFO:tasks.workunit.client.0.smithi049.stdout:7/299: dwrite d7/fa [0,4194304] 0 2023-12-16T07:40:19.211 INFO:tasks.workunit.client.0.smithi049.stdout:7/300: dread - d7/dc/dd/d14/f52 zero size 2023-12-16T07:40:19.211 INFO:tasks.workunit.client.0.smithi049.stdout:5/284: dwrite d5/f8 [0,4194304] 0 2023-12-16T07:40:19.211 INFO:tasks.workunit.client.0.smithi049.stdout:3/263: creat d1/d2a/d37/d3f/f50 x:0 0 0 2023-12-16T07:40:19.211 INFO:tasks.workunit.client.0.smithi049.stdout:3/264: write d1/f44 [608019,7540] 0 2023-12-16T07:40:19.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/283: write d4/d7/d11/d26/f37 [6240501,16496] 0 2023-12-16T07:40:19.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/296: creat d2/db/dd/d52/f5e x:0 0 0 2023-12-16T07:40:19.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/297: write d2/db/dd/f4b [3987157,5165] 0 2023-12-16T07:40:19.218 INFO:tasks.workunit.client.0.smithi049.stdout:4/298: dread d2/db/dd/de/d1e/f3b [0,4194304] 0 2023-12-16T07:40:19.219 INFO:tasks.workunit.client.0.smithi049.stdout:2/335: symlink d2/d26/l72 0 2023-12-16T07:40:19.220 INFO:tasks.workunit.client.0.smithi049.stdout:7/301: creat d7/dc/dd/f6d x:0 0 0 2023-12-16T07:40:19.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/265: link d1/f26 d1/d2a/d37/d3f/d4c/f51 0 2023-12-16T07:40:19.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/266: fdatasync d1/d2a/f40 0 2023-12-16T07:40:19.225 INFO:tasks.workunit.client.0.smithi049.stdout:3/267: dread d1/f26 [0,4194304] 0 2023-12-16T07:40:19.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/284: getdents d4/db 0 2023-12-16T07:40:19.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/299: fsync d2/db/dd/de/d1e/d21/f4f 0 2023-12-16T07:40:19.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/302: unlink d7/dc/d2f/l39 0 2023-12-16T07:40:19.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/303: write d7/dc/d2f/f60 [5366561,41637] 0 2023-12-16T07:40:19.230 INFO:tasks.workunit.client.0.smithi049.stdout:1/297: dwrite d20/d41/f4b [0,4194304] 0 2023-12-16T07:40:19.230 INFO:tasks.workunit.client.0.smithi049.stdout:5/285: dread d5/d1e/d21/f44 [0,4194304] 0 2023-12-16T07:40:19.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/268: unlink d1/f24 0 2023-12-16T07:40:19.232 INFO:tasks.workunit.client.0.smithi049.stdout:9/285: symlink d4/l58 0 2023-12-16T07:40:19.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/300: creat d2/db/dd/de/d1e/d37/d4e/f5f x:0 0 0 2023-12-16T07:40:19.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/304: link d7/dc/dd/d35/d36/f5f d7/dc/d2f/f6e 0 2023-12-16T07:40:19.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/336: dwrite d2/f36 [0,4194304] 0 2023-12-16T07:40:19.237 INFO:tasks.workunit.client.0.smithi049.stdout:1/298: rename d20/c25 to d20/d45/c6a 0 2023-12-16T07:40:19.238 INFO:tasks.workunit.client.0.smithi049.stdout:5/286: mkdir d5/d1e/d21/d58/d65 0 2023-12-16T07:40:19.238 INFO:tasks.workunit.client.0.smithi049.stdout:5/287: truncate d5/de/d54/d57/d2f/f49 36045 0 2023-12-16T07:40:19.238 INFO:tasks.workunit.client.0.smithi049.stdout:5/288: readlink d5/de/d54/d57/d2f/l4c 0 2023-12-16T07:40:19.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/269: mknod d1/d2a/d37/d3f/c52 0 2023-12-16T07:40:19.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/270: chown d1/f18 2530 1 2023-12-16T07:40:19.240 INFO:tasks.workunit.client.0.smithi049.stdout:9/286: mkdir d4/d7/d11/d26/d47/d59 0 2023-12-16T07:40:19.240 INFO:tasks.workunit.client.0.smithi049.stdout:3/271: write d1/fc [520987,119095] 0 2023-12-16T07:40:19.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/301: mknod d2/db/dd/de/d1e/c60 0 2023-12-16T07:40:19.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/302: truncate d2/db/dd/de/d1e/d21/f25 4827701 0 2023-12-16T07:40:19.241 INFO:tasks.workunit.client.0.smithi049.stdout:7/305: creat d7/dc/f6f x:0 0 0 2023-12-16T07:40:19.243 INFO:tasks.workunit.client.0.smithi049.stdout:1/299: read d20/d41/d4f/f69 [234367,49988] 0 2023-12-16T07:40:19.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/361: dwrite d0/d39/d5b/d65/d58/f42 [0,4194304] 0 2023-12-16T07:40:19.243 INFO:tasks.workunit.client.0.smithi049.stdout:1/300: fdatasync d20/f5b 0 2023-12-16T07:40:19.245 INFO:tasks.workunit.client.0.smithi049.stdout:5/289: dread d5/f9 [0,4194304] 0 2023-12-16T07:40:19.245 INFO:tasks.workunit.client.0.smithi049.stdout:2/337: mknod d2/d1d/d28/d56/d66/c73 0 2023-12-16T07:40:19.246 INFO:tasks.workunit.client.0.smithi049.stdout:4/303: dread d2/db/dd/d2a/f1c [0,4194304] 0 2023-12-16T07:40:19.247 INFO:tasks.workunit.client.0.smithi049.stdout:9/287: creat d4/d45/f5a x:0 0 0 2023-12-16T07:40:19.249 INFO:tasks.workunit.client.0.smithi049.stdout:3/272: link d1/f2c d1/d2b/f53 0 2023-12-16T07:40:19.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/306: dread d7/dc/f25 [0,4194304] 0 2023-12-16T07:40:19.259 INFO:tasks.workunit.client.0.smithi049.stdout:6/362: mknod d0/d39/c76 0 2023-12-16T07:40:19.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/290: symlink d5/de/d54/d5c/l66 0 2023-12-16T07:40:19.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/291: stat d5/de/c1b 0 2023-12-16T07:40:19.262 INFO:tasks.workunit.client.0.smithi049.stdout:1/301: dwrite d20/d41/d52/f68 [0,4194304] 0 2023-12-16T07:40:19.262 INFO:tasks.workunit.client.0.smithi049.stdout:2/338: rename d2/d1d/d28/d56/d11/f2c to d2/d1d/d24/d55/f74 0 2023-12-16T07:40:19.263 INFO:tasks.workunit.client.0.smithi049.stdout:4/304: creat d2/f61 x:0 0 0 2023-12-16T07:40:19.263 INFO:tasks.workunit.client.0.smithi049.stdout:4/305: chown d2/db/dd/de/d1e/d37/f3c 27784517 1 2023-12-16T07:40:19.263 INFO:tasks.workunit.client.0.smithi049.stdout:4/306: chown d2/db/dd/d52/f5e 73251 1 2023-12-16T07:40:19.263 INFO:tasks.workunit.client.0.smithi049.stdout:4/307: chown d2/db/dd/c4a 1540 1 2023-12-16T07:40:19.264 INFO:tasks.workunit.client.0.smithi049.stdout:4/308: write d2/db/dd/de/d1e/f55 [5152250,102630] 0 2023-12-16T07:40:19.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/288: mkdir d4/d7/d11/d1d/d5b 0 2023-12-16T07:40:19.266 INFO:tasks.workunit.client.0.smithi049.stdout:3/273: dwrite d1/f25 [0,4194304] 0 2023-12-16T07:40:19.266 INFO:tasks.workunit.client.0.smithi049.stdout:3/274: fdatasync d1/d2a/d37/d3f/f41 0 2023-12-16T07:40:19.267 INFO:tasks.workunit.client.0.smithi049.stdout:5/292: unlink d5/f26 0 2023-12-16T07:40:19.267 INFO:tasks.workunit.client.0.smithi049.stdout:5/293: fdatasync d5/de/f16 0 2023-12-16T07:40:19.267 INFO:tasks.workunit.client.0.smithi049.stdout:5/294: chown f3 67 1 2023-12-16T07:40:19.267 INFO:tasks.workunit.client.0.smithi049.stdout:5/295: stat d5/de/f14 0 2023-12-16T07:40:19.270 INFO:tasks.workunit.client.0.smithi049.stdout:1/302: read f1f [2493238,113656] 0 2023-12-16T07:40:19.271 INFO:tasks.workunit.client.0.smithi049.stdout:2/339: symlink d2/d26/d43/l75 0 2023-12-16T07:40:19.273 INFO:tasks.workunit.client.0.smithi049.stdout:3/275: symlink d1/d2a/d37/l54 0 2023-12-16T07:40:19.273 INFO:tasks.workunit.client.0.smithi049.stdout:3/276: stat d1/ff 0 2023-12-16T07:40:19.274 INFO:tasks.workunit.client.0.smithi049.stdout:4/309: dread d2/db/dd/fa [0,4194304] 0 2023-12-16T07:40:19.276 INFO:tasks.workunit.client.0.smithi049.stdout:4/310: fdatasync d2/db/dd/de/d1e/d21/f39 0 2023-12-16T07:40:19.276 INFO:tasks.workunit.client.0.smithi049.stdout:4/311: stat d2/l7 0 2023-12-16T07:40:19.278 INFO:tasks.workunit.client.0.smithi049.stdout:1/303: truncate d20/d41/f5a 356990 0 2023-12-16T07:40:19.278 INFO:tasks.workunit.client.0.smithi049.stdout:2/340: getdents d2/d1d 0 2023-12-16T07:40:19.278 INFO:tasks.workunit.client.0.smithi049.stdout:3/277: creat d1/d2a/d37/f55 x:0 0 0 2023-12-16T07:40:19.283 INFO:tasks.workunit.client.0.smithi049.stdout:6/363: dwrite d0/d39/d5b/d65/d53/f5f [0,4194304] 0 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:4/312: unlink d2/c24 0 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:0/460: sync 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:8/377: sync 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:0/461: stat d13/d39/d78/c8c 0 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:4/313: fsync d2/f18 0 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/304: symlink d20/d41/d4f/l6b 0 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/305: dread - d20/f3d zero size 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/306: read - d20/d41/d4f/d55/d58/f63 zero size 2023-12-16T07:40:19.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/341: mkdir d2/d1d/d24/d55/d76 0 2023-12-16T07:40:19.285 INFO:tasks.workunit.client.0.smithi049.stdout:3/278: creat d1/d2a/f56 x:0 0 0 2023-12-16T07:40:19.285 INFO:tasks.workunit.client.0.smithi049.stdout:3/279: dread - d1/d2a/f48 zero size 2023-12-16T07:40:19.285 INFO:tasks.workunit.client.0.smithi049.stdout:6/364: mkdir d0/d39/d5b/d65/d53/d77 0 2023-12-16T07:40:19.285 INFO:tasks.workunit.client.0.smithi049.stdout:6/365: getdents d0/d2/df/d4e/d5d/d6f/d4a/d6c 0 2023-12-16T07:40:19.286 INFO:tasks.workunit.client.0.smithi049.stdout:8/378: truncate d0/d13/f55 2406565 0 2023-12-16T07:40:19.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/379: fdatasync d0/f19 0 2023-12-16T07:40:19.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/462: symlink d13/d39/d8a/l9c 0 2023-12-16T07:40:19.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/463: fsync d13/f7c 0 2023-12-16T07:40:19.290 INFO:tasks.workunit.client.0.smithi049.stdout:4/314: mkdir d2/db/dd/d52/d62 0 2023-12-16T07:40:19.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/280: creat d1/d2b/f57 x:0 0 0 2023-12-16T07:40:19.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/281: fsync d1/d2b/f2d 0 2023-12-16T07:40:19.294 INFO:tasks.workunit.client.0.smithi049.stdout:6/366: mknod d0/d39/d5b/d65/d32/c78 0 2023-12-16T07:40:19.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/464: creat d13/d21/d99/d46/f9d x:0 0 0 2023-12-16T07:40:19.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/465: dread - d13/d21/d99/d46/f95 zero size 2023-12-16T07:40:19.297 INFO:tasks.workunit.client.0.smithi049.stdout:9/289: dwrite d4/f34 [0,4194304] 0 2023-12-16T07:40:19.303 INFO:tasks.workunit.client.0.smithi049.stdout:6/367: rename d0/d39/d5b/d65/f1f to d0/d39/d5b/d65/d4c/d4d/f79 0 2023-12-16T07:40:19.303 INFO:tasks.workunit.client.0.smithi049.stdout:0/466: creat d13/d39/d8a/f9e x:0 0 0 2023-12-16T07:40:19.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/290: creat d4/d7/d11/d1d/f5c x:0 0 0 2023-12-16T07:40:19.304 INFO:tasks.workunit.client.0.smithi049.stdout:6/368: creat d0/d2/df/f7a x:0 0 0 2023-12-16T07:40:19.305 INFO:tasks.workunit.client.0.smithi049.stdout:6/369: fdatasync d0/d2/f8 0 2023-12-16T07:40:19.306 INFO:tasks.workunit.client.0.smithi049.stdout:6/370: symlink d0/d39/d5b/d65/d53/l7b 0 2023-12-16T07:40:19.315 INFO:tasks.workunit.client.0.smithi049.stdout:5/296: dwrite d5/de/d1c/f46 [0,4194304] 0 2023-12-16T07:40:19.317 INFO:tasks.workunit.client.0.smithi049.stdout:5/297: mkdir d5/de/d54/d67 0 2023-12-16T07:40:19.317 INFO:tasks.workunit.client.0.smithi049.stdout:5/298: dread - d5/d1e/d20/f56 zero size 2023-12-16T07:40:19.317 INFO:tasks.workunit.client.0.smithi049.stdout:5/299: write d5/d1e/d20/f36 [321577,98956] 0 2023-12-16T07:40:19.322 INFO:tasks.workunit.client.0.smithi049.stdout:5/300: creat d5/de/f68 x:0 0 0 2023-12-16T07:40:19.322 INFO:tasks.workunit.client.0.smithi049.stdout:1/307: dwrite d20/f3c [0,4194304] 0 2023-12-16T07:40:19.323 INFO:tasks.workunit.client.0.smithi049.stdout:1/308: truncate d20/f35 205309 0 2023-12-16T07:40:19.329 INFO:tasks.workunit.client.0.smithi049.stdout:4/315: dwrite d2/f28 [0,4194304] 0 2023-12-16T07:40:19.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/316: truncate d2/db/dd/d2a/f43 1623186 0 2023-12-16T07:40:19.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/317: write d2/db/dd/d2a/f5d [5218784,75137] 0 2023-12-16T07:40:19.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/318: fdatasync d2/db/dd/de/d1e/d21/f39 0 2023-12-16T07:40:19.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/319: chown d2/db/dd/de/l14 143347724 1 2023-12-16T07:40:19.332 INFO:tasks.workunit.client.0.smithi049.stdout:4/320: creat d2/db/dd/de/f63 x:0 0 0 2023-12-16T07:40:19.333 INFO:tasks.workunit.client.0.smithi049.stdout:4/321: creat d2/db/dd/de/d1e/f64 x:0 0 0 2023-12-16T07:40:19.333 INFO:tasks.workunit.client.0.smithi049.stdout:4/322: write d2/db/dd/de/f63 [765162,120162] 0 2023-12-16T07:40:19.334 INFO:tasks.workunit.client.0.smithi049.stdout:4/323: mknod d2/db/dd/d52/d62/c65 0 2023-12-16T07:40:19.336 INFO:tasks.workunit.client.0.smithi049.stdout:4/324: symlink d2/db/dd/d2a/l66 0 2023-12-16T07:40:19.337 INFO:tasks.workunit.client.0.smithi049.stdout:4/325: symlink d2/db/dd/d52/d62/l67 0 2023-12-16T07:40:19.338 INFO:tasks.workunit.client.0.smithi049.stdout:4/326: chown d2/db/dd/de/d1e/d37/c42 52 1 2023-12-16T07:40:19.338 INFO:tasks.workunit.client.0.smithi049.stdout:4/327: symlink d2/db/dd/de/d1e/d37/l68 0 2023-12-16T07:40:19.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/342: dwrite d2/d1d/f6d [0,4194304] 0 2023-12-16T07:40:19.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/343: chown d2/d1d/d24/l57 0 1 2023-12-16T07:40:19.345 INFO:tasks.workunit.client.0.smithi049.stdout:8/380: dwrite d0/d1f/f40 [0,4194304] 0 2023-12-16T07:40:19.356 INFO:tasks.workunit.client.0.smithi049.stdout:3/282: dwrite d1/d2a/d37/f42 [0,4194304] 0 2023-12-16T07:40:19.356 INFO:tasks.workunit.client.0.smithi049.stdout:8/381: dread d0/f19 [0,4194304] 0 2023-12-16T07:40:19.356 INFO:tasks.workunit.client.0.smithi049.stdout:3/283: truncate d1/f16 3995988 0 2023-12-16T07:40:19.357 INFO:tasks.workunit.client.0.smithi049.stdout:3/284: dread d1/f26 [0,4194304] 0 2023-12-16T07:40:19.357 INFO:tasks.workunit.client.0.smithi049.stdout:0/467: dwrite d13/f1c [0,4194304] 0 2023-12-16T07:40:19.358 INFO:tasks.workunit.client.0.smithi049.stdout:8/382: mknod d0/d1f/d56/c77 0 2023-12-16T07:40:19.360 INFO:tasks.workunit.client.0.smithi049.stdout:9/291: dwrite d4/d7/d11/d26/f37 [8388608,4194304] 0 2023-12-16T07:40:19.361 INFO:tasks.workunit.client.0.smithi049.stdout:3/285: unlink d1/d2a/d37/f42 0 2023-12-16T07:40:19.361 INFO:tasks.workunit.client.0.smithi049.stdout:8/383: dread d0/d1f/f17 [0,4194304] 0 2023-12-16T07:40:19.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/468: link d13/d21/d27/d2c/c68 d13/d39/d38/d7e/c9f 0 2023-12-16T07:40:19.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/292: creat d4/db/f5d x:0 0 0 2023-12-16T07:40:19.366 INFO:tasks.workunit.client.0.smithi049.stdout:3/286: rename d1/d2a/f56 to d1/d2b/f58 0 2023-12-16T07:40:19.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/293: mknod d4/d7/d11/d26/c5e 0 2023-12-16T07:40:19.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/294: readlink d4/d7/d11/d26/l27 0 2023-12-16T07:40:19.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/295: fdatasync d4/d7/d11/d3f/f51 0 2023-12-16T07:40:19.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/287: creat d1/d2a/d37/d3f/f59 x:0 0 0 2023-12-16T07:40:19.370 INFO:tasks.workunit.client.0.smithi049.stdout:6/371: dwrite d0/d39/d5b/d65/d58/f3d [0,4194304] 0 2023-12-16T07:40:19.370 INFO:tasks.workunit.client.0.smithi049.stdout:6/372: chown d0/d39/d5b/d65/d58/l3c 24429872 1 2023-12-16T07:40:19.370 INFO:tasks.workunit.client.0.smithi049.stdout:6/373: readlink d0/d2/l63 0 2023-12-16T07:40:19.370 INFO:tasks.workunit.client.0.smithi049.stdout:5/301: dwrite d5/de/f31 [0,4194304] 0 2023-12-16T07:40:19.371 INFO:tasks.workunit.client.0.smithi049.stdout:3/288: mkdir d1/d2a/d37/d3f/d5a 0 2023-12-16T07:40:19.372 INFO:tasks.workunit.client.0.smithi049.stdout:1/309: dwrite d20/d41/d4f/f53 [0,4194304] 0 2023-12-16T07:40:19.372 INFO:tasks.workunit.client.0.smithi049.stdout:2/344: dwrite d2/d1d/d28/d56/d66/d6b/f70 [0,4194304] 0 2023-12-16T07:40:19.379 INFO:tasks.workunit.client.0.smithi049.stdout:8/384: dread d0/f28 [0,4194304] 0 2023-12-16T07:40:19.389 INFO:tasks.workunit.client.0.smithi049.stdout:5/302: rmdir d5/d1e/d21/d5a 39 2023-12-16T07:40:19.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/374: write d0/d39/d5b/d65/d58/f2b [1659426,94782] 0 2023-12-16T07:40:19.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/375: write d0/d39/d5b/d65/d32/f71 [356638,128549] 0 2023-12-16T07:40:19.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/345: mkdir d2/de/d77 0 2023-12-16T07:40:19.394 INFO:tasks.workunit.client.0.smithi049.stdout:6/376: read d0/d2/f3e [2354162,127485] 0 2023-12-16T07:40:19.394 INFO:tasks.workunit.client.0.smithi049.stdout:4/328: truncate d2/db/dd/de/d1e/f55 3604468 0 2023-12-16T07:40:19.394 INFO:tasks.workunit.client.0.smithi049.stdout:4/329: write d2/db/dd/de/d1e/d37/f38 [409196,23617] 0 2023-12-16T07:40:19.394 INFO:tasks.workunit.client.0.smithi049.stdout:3/289: dwrite d1/d2b/f58 [0,4194304] 0 2023-12-16T07:40:19.395 INFO:tasks.workunit.client.0.smithi049.stdout:8/385: symlink d0/d1f/d36/l78 0 2023-12-16T07:40:19.395 INFO:tasks.workunit.client.0.smithi049.stdout:8/386: read - d0/d1f/d56/f74 zero size 2023-12-16T07:40:19.395 INFO:tasks.workunit.client.0.smithi049.stdout:1/310: dwrite d20/d41/d4f/f69 [0,4194304] 0 2023-12-16T07:40:19.395 INFO:tasks.workunit.client.0.smithi049.stdout:5/303: dread d5/f8 [0,4194304] 0 2023-12-16T07:40:19.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/377: dread d0/d2/df/f24 [0,4194304] 0 2023-12-16T07:40:19.397 INFO:tasks.workunit.client.0.smithi049.stdout:2/346: mkdir d2/de/d78 0 2023-12-16T07:40:19.398 INFO:tasks.workunit.client.0.smithi049.stdout:4/330: mknod d2/db/dd/d2a/c69 0 2023-12-16T07:40:19.402 INFO:tasks.workunit.client.0.smithi049.stdout:3/290: mkdir d1/d2a/d37/d3f/d5a/d5b 0 2023-12-16T07:40:19.402 INFO:tasks.workunit.client.0.smithi049.stdout:3/291: fsync d1/f44 0 2023-12-16T07:40:19.402 INFO:tasks.workunit.client.0.smithi049.stdout:3/292: write d1/f2c [221218,61446] 0 2023-12-16T07:40:19.403 INFO:tasks.workunit.client.0.smithi049.stdout:8/387: link d0/d13/d42/l5c d0/d1f/d4e/l79 0 2023-12-16T07:40:19.403 INFO:tasks.workunit.client.0.smithi049.stdout:3/293: dread d1/d2a/d37/d3f/d4c/f51 [0,4194304] 0 2023-12-16T07:40:19.404 INFO:tasks.workunit.client.0.smithi049.stdout:3/294: write d1/d2b/f58 [223713,52769] 0 2023-12-16T07:40:19.406 INFO:tasks.workunit.client.0.smithi049.stdout:1/311: symlink d20/d41/d4f/d55/l6c 0 2023-12-16T07:40:19.406 INFO:tasks.workunit.client.0.smithi049.stdout:1/312: chown d20/d45/c6a 664 1 2023-12-16T07:40:19.407 INFO:tasks.workunit.client.0.smithi049.stdout:5/304: symlink d5/d1e/d21/d58/l69 0 2023-12-16T07:40:19.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/388: dread d0/f3d [0,4194304] 0 2023-12-16T07:40:19.409 INFO:tasks.workunit.client.0.smithi049.stdout:2/347: rename d2/d1d/d28/f2b to d2/d1d/d28/d56/d66/d6b/f79 0 2023-12-16T07:40:19.411 INFO:tasks.workunit.client.0.smithi049.stdout:1/313: creat d20/d45/d47/f6d x:0 0 0 2023-12-16T07:40:19.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/305: creat d5/de/d1c/d62/f6a x:0 0 0 2023-12-16T07:40:19.416 INFO:tasks.workunit.client.0.smithi049.stdout:8/389: link d0/d1f/f40 d0/d1f/d36/f7a 0 2023-12-16T07:40:19.417 INFO:tasks.workunit.client.0.smithi049.stdout:8/390: dread - d0/d1f/d36/f54 zero size 2023-12-16T07:40:19.417 INFO:tasks.workunit.client.0.smithi049.stdout:8/391: write d0/d13/f3e [5046260,41786] 0 2023-12-16T07:40:19.419 INFO:tasks.workunit.client.0.smithi049.stdout:4/331: rename d2/f18 to d2/db/dd/d52/f6a 0 2023-12-16T07:40:19.420 INFO:tasks.workunit.client.0.smithi049.stdout:1/314: link d20/d41/c4a d20/d45/c6e 0 2023-12-16T07:40:19.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/295: dwrite d1/d2b/f53 [0,4194304] 0 2023-12-16T07:40:19.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/296: chown d1/d2a/f3b 199 1 2023-12-16T07:40:19.426 INFO:tasks.workunit.client.0.smithi049.stdout:1/315: mkdir d20/d40/d6f 0 2023-12-16T07:40:19.426 INFO:tasks.workunit.client.0.smithi049.stdout:7/307: sync 2023-12-16T07:40:19.426 INFO:tasks.workunit.client.0.smithi049.stdout:7/308: chown d7/dc/d2f/l4f 358469 1 2023-12-16T07:40:19.428 INFO:tasks.workunit.client.0.smithi049.stdout:4/332: mkdir d2/db/d6b 0 2023-12-16T07:40:19.429 INFO:tasks.workunit.client.0.smithi049.stdout:6/378: truncate d0/d39/d5b/d65/d58/f2b 3490905 0 2023-12-16T07:40:19.431 INFO:tasks.workunit.client.0.smithi049.stdout:3/297: creat d1/d2a/d37/f5c x:0 0 0 2023-12-16T07:40:19.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/316: rename d20/c23 to d20/d40/d6f/c70 0 2023-12-16T07:40:19.436 INFO:tasks.workunit.client.0.smithi049.stdout:7/309: mkdir d7/dc/d6b/d70 0 2023-12-16T07:40:19.436 INFO:tasks.workunit.client.0.smithi049.stdout:4/333: mknod d2/db/dd/c6c 0 2023-12-16T07:40:19.436 INFO:tasks.workunit.client.0.smithi049.stdout:7/310: stat d7/dc/dd/d14/l55 0 2023-12-16T07:40:19.436 INFO:tasks.workunit.client.0.smithi049.stdout:7/311: dread - d7/dc/dd/d27/f48 zero size 2023-12-16T07:40:19.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/379: rmdir d0/d39/d5b/d65/d53/d77 0 2023-12-16T07:40:19.439 INFO:tasks.workunit.client.0.smithi049.stdout:3/298: creat d1/d2a/d37/d3f/f5d x:0 0 0 2023-12-16T07:40:19.441 INFO:tasks.workunit.client.0.smithi049.stdout:1/317: mkdir d20/d41/d49/d71 0 2023-12-16T07:40:19.442 INFO:tasks.workunit.client.0.smithi049.stdout:4/334: creat d2/f6d x:0 0 0 2023-12-16T07:40:19.442 INFO:tasks.workunit.client.0.smithi049.stdout:4/335: write d2/db/dd/de/d1e/d37/f3c [631855,51443] 0 2023-12-16T07:40:19.443 INFO:tasks.workunit.client.0.smithi049.stdout:4/336: write d2/db/dd/d2a/f1c [1642571,73895] 0 2023-12-16T07:40:19.443 INFO:tasks.workunit.client.0.smithi049.stdout:4/337: fsync d2/db/dd/de/f58 0 2023-12-16T07:40:19.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/312: symlink d7/dc/dd/d35/l71 0 2023-12-16T07:40:19.445 INFO:tasks.workunit.client.0.smithi049.stdout:2/348: dwrite d2/d1d/d24/f33 [0,4194304] 0 2023-12-16T07:40:19.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/306: dwrite d5/f18 [0,4194304] 0 2023-12-16T07:40:19.445 INFO:tasks.workunit.client.0.smithi049.stdout:8/392: dwrite d0/d1f/d36/f54 [0,4194304] 0 2023-12-16T07:40:19.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/380: symlink d0/d39/d5b/d65/d58/d33/l7c 0 2023-12-16T07:40:19.446 INFO:tasks.workunit.client.0.smithi049.stdout:3/299: mkdir d1/d2a/d37/d3f/d5a/d5b/d5e 0 2023-12-16T07:40:19.447 INFO:tasks.workunit.client.0.smithi049.stdout:1/318: symlink d20/d43/l72 0 2023-12-16T07:40:19.448 INFO:tasks.workunit.client.0.smithi049.stdout:5/307: write f3 [1398260,34960] 0 2023-12-16T07:40:19.448 INFO:tasks.workunit.client.0.smithi049.stdout:5/308: fdatasync d5/f15 0 2023-12-16T07:40:19.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/338: rename d2/db/dd/de/d1e/d4d/c53 to d2/db/dd/de/d1e/d21/c6e 0 2023-12-16T07:40:19.452 INFO:tasks.workunit.client.0.smithi049.stdout:7/313: unlink f6 0 2023-12-16T07:40:19.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/349: dread d2/d1d/d28/d56/d11/f3d [0,4194304] 0 2023-12-16T07:40:19.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/350: fsync d2/d1d/d28/d56/d66/d6b/f70 0 2023-12-16T07:40:19.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/351: write d2/f4d [1247714,18067] 0 2023-12-16T07:40:19.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/393: getdents d0/d13/d42/d5b 0 2023-12-16T07:40:19.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/394: truncate d0/f43 769689 0 2023-12-16T07:40:19.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/381: creat d0/d2/f7d x:0 0 0 2023-12-16T07:40:19.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/309: dwrite d5/f9 [0,4194304] 0 2023-12-16T07:40:19.473 INFO:tasks.workunit.client.0.smithi049.stdout:3/300: creat d1/d2a/d37/d3f/d5a/d5b/d5e/f5f x:0 0 0 2023-12-16T07:40:19.473 INFO:tasks.workunit.client.0.smithi049.stdout:3/301: chown d1/d2b/l35 6618 1 2023-12-16T07:40:19.478 INFO:tasks.workunit.client.0.smithi049.stdout:1/319: mknod d20/d41/d52/c73 0 2023-12-16T07:40:19.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/382: creat d0/d39/d5b/d65/d4c/f7e x:0 0 0 2023-12-16T07:40:19.478 INFO:tasks.workunit.client.0.smithi049.stdout:1/320: write d20/f21 [5189457,8556] 0 2023-12-16T07:40:19.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/310: creat d5/de/d54/d67/f6b x:0 0 0 2023-12-16T07:40:19.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/311: read d5/de/d1c/f25 [2973198,20653] 0 2023-12-16T07:40:19.479 INFO:tasks.workunit.client.0.smithi049.stdout:5/312: write d5/d1e/f51 [429218,117373] 0 2023-12-16T07:40:19.479 INFO:tasks.workunit.client.0.smithi049.stdout:3/302: mknod d1/d2b/c60 0 2023-12-16T07:40:19.481 INFO:tasks.workunit.client.0.smithi049.stdout:6/383: unlink d0/d39/d5b/d65/d58/d33/f49 0 2023-12-16T07:40:19.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/321: creat d20/d43/f74 x:0 0 0 2023-12-16T07:40:19.482 INFO:tasks.workunit.client.0.smithi049.stdout:3/303: mkdir d1/d2a/d37/d3f/d5a/d61 0 2023-12-16T07:40:19.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/384: symlink d0/d39/d5b/d65/d53/l7f 0 2023-12-16T07:40:19.484 INFO:tasks.workunit.client.0.smithi049.stdout:3/304: dread d1/f44 [0,4194304] 0 2023-12-16T07:40:19.484 INFO:tasks.workunit.client.0.smithi049.stdout:3/305: chown d1 5859 1 2023-12-16T07:40:19.484 INFO:tasks.workunit.client.0.smithi049.stdout:3/306: chown d1/f16 2021681 1 2023-12-16T07:40:19.484 INFO:tasks.workunit.client.0.smithi049.stdout:1/322: rename d20/f61 to d20/d43/f75 0 2023-12-16T07:40:19.488 INFO:tasks.workunit.client.0.smithi049.stdout:7/314: dwrite d7/fb [0,4194304] 0 2023-12-16T07:40:19.488 INFO:tasks.workunit.client.0.smithi049.stdout:4/339: dwrite d2/db/dd/fa [0,4194304] 0 2023-12-16T07:40:19.488 INFO:tasks.workunit.client.0.smithi049.stdout:6/385: rename d0/d39/d5b/d65/d4c/d4d/f6b to d0/d39/d5b/d65/d58/f80 0 2023-12-16T07:40:19.488 INFO:tasks.workunit.client.0.smithi049.stdout:6/386: chown d0/c14 354 1 2023-12-16T07:40:19.489 INFO:tasks.workunit.client.0.smithi049.stdout:7/315: write d7/dc/dd/f1e [2189709,81790] 0 2023-12-16T07:40:19.492 INFO:tasks.workunit.client.0.smithi049.stdout:1/323: rename f18 to d20/d41/d4f/f76 0 2023-12-16T07:40:19.492 INFO:tasks.workunit.client.0.smithi049.stdout:6/387: mkdir d0/d2/df/d81 0 2023-12-16T07:40:19.493 INFO:tasks.workunit.client.0.smithi049.stdout:6/388: write d0/d39/d5b/d65/d58/f3d [4295530,69164] 0 2023-12-16T07:40:19.493 INFO:tasks.workunit.client.0.smithi049.stdout:1/324: mkdir d20/d45/d77 0 2023-12-16T07:40:19.494 INFO:tasks.workunit.client.0.smithi049.stdout:1/325: creat d20/d41/f78 x:0 0 0 2023-12-16T07:40:19.495 INFO:tasks.workunit.client.0.smithi049.stdout:4/340: dread f1 [0,4194304] 0 2023-12-16T07:40:19.495 INFO:tasks.workunit.client.0.smithi049.stdout:4/341: dread - d2/db/dd/d52/f5e zero size 2023-12-16T07:40:19.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/389: write d0/d2/f47 [73704,13558] 0 2023-12-16T07:40:19.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/390: write d0/d39/d5b/d65/d58/d33/f70 [42363,82630] 0 2023-12-16T07:40:19.496 INFO:tasks.workunit.client.0.smithi049.stdout:1/326: creat d20/f79 x:0 0 0 2023-12-16T07:40:19.496 INFO:tasks.workunit.client.0.smithi049.stdout:1/327: dread - d20/d45/f48 zero size 2023-12-16T07:40:19.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/391: creat d0/d2/f82 x:0 0 0 2023-12-16T07:40:19.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/392: truncate d0/d2/f82 730890 0 2023-12-16T07:40:19.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/393: read - d0/d39/d5b/d65/d58/f80 zero size 2023-12-16T07:40:19.498 INFO:tasks.workunit.client.0.smithi049.stdout:1/328: write fe [1540735,124932] 0 2023-12-16T07:40:19.498 INFO:tasks.workunit.client.0.smithi049.stdout:7/316: dread d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:19.499 INFO:tasks.workunit.client.0.smithi049.stdout:2/352: dwrite d2/d1d/d28/d56/d11/f25 [0,4194304] 0 2023-12-16T07:40:19.499 INFO:tasks.workunit.client.0.smithi049.stdout:5/313: dwrite d5/f8 [4194304,4194304] 0 2023-12-16T07:40:19.499 INFO:tasks.workunit.client.0.smithi049.stdout:6/394: stat d0/d39/d5b/d65/d27/l37 0 2023-12-16T07:40:19.500 INFO:tasks.workunit.client.0.smithi049.stdout:1/329: link l16 d20/d41/d4f/d55/l7a 0 2023-12-16T07:40:19.500 INFO:tasks.workunit.client.0.smithi049.stdout:1/330: stat d20/d40/l50 0 2023-12-16T07:40:19.500 INFO:tasks.workunit.client.0.smithi049.stdout:1/331: fsync d20/d41/d52/f68 0 2023-12-16T07:40:19.501 INFO:tasks.workunit.client.0.smithi049.stdout:6/395: write d0/d2/f3e [434905,38178] 0 2023-12-16T07:40:19.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/317: rename d7/dc/c53 to d7/dc/d15/d66/c72 0 2023-12-16T07:40:19.506 INFO:tasks.workunit.client.0.smithi049.stdout:2/353: symlink d2/d26/l7a 0 2023-12-16T07:40:19.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/314: rmdir d5/de/d1c/d62 39 2023-12-16T07:40:19.515 INFO:tasks.workunit.client.0.smithi049.stdout:0/469: sync 2023-12-16T07:40:19.515 INFO:tasks.workunit.client.0.smithi049.stdout:9/296: sync 2023-12-16T07:40:19.515 INFO:tasks.workunit.client.0.smithi049.stdout:0/470: chown d13/d21/d27/d2c/l81 71969 1 2023-12-16T07:40:19.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/354: dread d2/d26/f30 [0,4194304] 0 2023-12-16T07:40:19.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/332: rmdir d20/d41/d49 39 2023-12-16T07:40:19.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/333: chown d20/f21 0 1 2023-12-16T07:40:19.523 INFO:tasks.workunit.client.0.smithi049.stdout:6/396: dwrite d0/d2/f8 [0,4194304] 0 2023-12-16T07:40:19.525 INFO:tasks.workunit.client.0.smithi049.stdout:5/315: link d5/de/f16 d5/de/d1c/d62/f6c 0 2023-12-16T07:40:19.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/318: dwrite d7/fa [0,4194304] 0 2023-12-16T07:40:19.527 INFO:tasks.workunit.client.0.smithi049.stdout:5/316: creat d5/d1e/d20/f6d x:0 0 0 2023-12-16T07:40:19.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/297: dwrite d4/db/f22 [0,4194304] 0 2023-12-16T07:40:19.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/298: chown d4/d7/d11/d3f/f51 189182 1 2023-12-16T07:40:19.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/299: chown d4/d7/f9 309159 1 2023-12-16T07:40:19.537 INFO:tasks.workunit.client.0.smithi049.stdout:7/319: rename d7/dc/dd/d35/d36/c5b to d7/dc/c73 0 2023-12-16T07:40:19.537 INFO:tasks.workunit.client.0.smithi049.stdout:3/307: rmdir d1/d2a/d37 39 2023-12-16T07:40:19.541 INFO:tasks.workunit.client.0.smithi049.stdout:5/317: getdents d5/de/d54/d67 0 2023-12-16T07:40:19.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/320: creat d7/dc/d2f/d40/f74 x:0 0 0 2023-12-16T07:40:19.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/321: chown d7/dc/d2f 203 1 2023-12-16T07:40:19.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/322: readlink d7/dc/dd/d37/l6c 0 2023-12-16T07:40:19.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/323: read - d7/f67 zero size 2023-12-16T07:40:19.546 INFO:tasks.workunit.client.0.smithi049.stdout:3/308: rename d1/d2a/f4a to d1/d2b/f62 0 2023-12-16T07:40:19.546 INFO:tasks.workunit.client.0.smithi049.stdout:3/309: write d1/f26 [729247,112920] 0 2023-12-16T07:40:19.548 INFO:tasks.workunit.client.0.smithi049.stdout:7/324: read d7/fa [3034517,77685] 0 2023-12-16T07:40:19.548 INFO:tasks.workunit.client.0.smithi049.stdout:3/310: mkdir d1/d2a/d37/d63 0 2023-12-16T07:40:19.549 INFO:tasks.workunit.client.0.smithi049.stdout:7/325: mknod d7/d2b/c75 0 2023-12-16T07:40:19.549 INFO:tasks.workunit.client.0.smithi049.stdout:7/326: truncate d7/d2b/d59/f5e 265690 0 2023-12-16T07:40:19.549 INFO:tasks.workunit.client.0.smithi049.stdout:7/327: truncate d7/dc/dd/d14/f52 306238 0 2023-12-16T07:40:19.550 INFO:tasks.workunit.client.0.smithi049.stdout:3/311: mknod d1/d2a/d37/d3f/d5a/d5b/d5e/c64 0 2023-12-16T07:40:19.550 INFO:tasks.workunit.client.0.smithi049.stdout:6/397: truncate d0/d39/d5b/d65/d58/f3d 1565584 0 2023-12-16T07:40:19.551 INFO:tasks.workunit.client.0.smithi049.stdout:2/355: dwrite d2/d1d/d28/f52 [0,4194304] 0 2023-12-16T07:40:19.552 INFO:tasks.workunit.client.0.smithi049.stdout:7/328: mknod d7/dc/dd/d27/c76 0 2023-12-16T07:40:19.552 INFO:tasks.workunit.client.0.smithi049.stdout:0/471: dwrite d13/d39/d78/f7f [0,4194304] 0 2023-12-16T07:40:19.552 INFO:tasks.workunit.client.0.smithi049.stdout:1/334: dwrite d20/f21 [0,4194304] 0 2023-12-16T07:40:19.553 INFO:tasks.workunit.client.0.smithi049.stdout:3/312: rename d1/f3c to d1/d2b/f65 0 2023-12-16T07:40:19.555 INFO:tasks.workunit.client.0.smithi049.stdout:6/398: mknod d0/d39/c83 0 2023-12-16T07:40:19.555 INFO:tasks.workunit.client.0.smithi049.stdout:6/399: write d0/d39/d5b/d65/d53/f66 [617223,3613] 0 2023-12-16T07:40:19.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/472: mkdir d13/d21/d2f/d7d/da0 0 2023-12-16T07:40:19.559 INFO:tasks.workunit.client.0.smithi049.stdout:9/300: dwrite d4/db/f41 [0,4194304] 0 2023-12-16T07:40:19.559 INFO:tasks.workunit.client.0.smithi049.stdout:9/301: truncate d4/d7/d11/d1d/f5c 389115 0 2023-12-16T07:40:19.559 INFO:tasks.workunit.client.0.smithi049.stdout:5/318: dwrite d5/f9 [0,4194304] 0 2023-12-16T07:40:19.560 INFO:tasks.workunit.client.0.smithi049.stdout:2/356: dread d2/d1d/d28/d56/d66/d6b/f70 [0,4194304] 0 2023-12-16T07:40:19.560 INFO:tasks.workunit.client.0.smithi049.stdout:2/357: readlink d2/l5 0 2023-12-16T07:40:19.562 INFO:tasks.workunit.client.0.smithi049.stdout:1/335: rename d20/d41/d49 to d20/d7b 0 2023-12-16T07:40:19.563 INFO:tasks.workunit.client.0.smithi049.stdout:6/400: creat d0/d39/f84 x:0 0 0 2023-12-16T07:40:19.568 INFO:tasks.workunit.client.0.smithi049.stdout:0/473: truncate fa 3885718 0 2023-12-16T07:40:19.568 INFO:tasks.workunit.client.0.smithi049.stdout:0/474: write d13/d39/d38/d7e/d8b/f9a [957341,116969] 0 2023-12-16T07:40:19.569 INFO:tasks.workunit.client.0.smithi049.stdout:9/302: truncate d4/d7/f21 803059 0 2023-12-16T07:40:19.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/319: mknod d5/c6e 0 2023-12-16T07:40:19.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/320: stat d5/de/d1c 0 2023-12-16T07:40:19.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/321: readlink d5/d1e/d21/d58/l69 0 2023-12-16T07:40:19.574 INFO:tasks.workunit.client.0.smithi049.stdout:2/358: creat d2/d26/d6e/f7b x:0 0 0 2023-12-16T07:40:19.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/401: creat d0/d39/d5b/d65/d27/f85 x:0 0 0 2023-12-16T07:40:19.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/402: getdents d0/d2/df/d81 0 2023-12-16T07:40:19.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/403: fdatasync d0/d2/f7d 0 2023-12-16T07:40:19.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/336: dwrite d20/f33 [0,4194304] 0 2023-12-16T07:40:19.581 INFO:tasks.workunit.client.0.smithi049.stdout:3/313: dwrite d1/d2a/d37/d3f/d4c/f4d [0,4194304] 0 2023-12-16T07:40:19.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/303: mknod d4/d7/d11/d1d/d5b/c5f 0 2023-12-16T07:40:19.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/304: stat d4/d7/d11/d56 0 2023-12-16T07:40:19.584 INFO:tasks.workunit.client.0.smithi049.stdout:5/322: unlink d5/de/c2c 0 2023-12-16T07:40:19.584 INFO:tasks.workunit.client.0.smithi049.stdout:5/323: read - d5/de/d54/d67/f6b zero size 2023-12-16T07:40:19.585 INFO:tasks.workunit.client.0.smithi049.stdout:2/359: mkdir d2/d1d/d24/d55/d7c 0 2023-12-16T07:40:19.585 INFO:tasks.workunit.client.0.smithi049.stdout:2/360: chown d2/d1d/d28/d56/d11/d1c 211474 1 2023-12-16T07:40:19.586 INFO:tasks.workunit.client.0.smithi049.stdout:2/361: chown d2/d1d/d28/d56/d66/d6b 98 1 2023-12-16T07:40:19.586 INFO:tasks.workunit.client.0.smithi049.stdout:2/362: chown d2/ff 885741 1 2023-12-16T07:40:19.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/404: unlink d0/d2/c6 0 2023-12-16T07:40:19.591 INFO:tasks.workunit.client.0.smithi049.stdout:0/475: dread d13/d21/d99/d46/d65/f73 [0,4194304] 0 2023-12-16T07:40:19.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/305: truncate d4/db/f39 1950898 0 2023-12-16T07:40:19.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/324: creat d5/de/d1c/d62/f6f x:0 0 0 2023-12-16T07:40:19.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/363: rmdir d2/d1d/d28/d56 39 2023-12-16T07:40:19.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/306: mknod d4/d7/d11/d26/d47/d59/c60 0 2023-12-16T07:40:19.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/307: fsync d4/d7/d11/d26/f53 0 2023-12-16T07:40:19.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/308: dread - d4/d3e/f4a zero size 2023-12-16T07:40:19.602 INFO:tasks.workunit.client.0.smithi049.stdout:5/325: symlink d5/de/d54/d67/l70 0 2023-12-16T07:40:19.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/364: mknod d2/d1d/d24/d55/d7c/c7d 0 2023-12-16T07:40:19.606 INFO:tasks.workunit.client.0.smithi049.stdout:5/326: mknod d5/de/d54/d57/d2f/c71 0 2023-12-16T07:40:19.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/365: write d2/d26/d6e/f7b [1022898,73591] 0 2023-12-16T07:40:19.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/327: getdents d5/d1e/d21/d5a 0 2023-12-16T07:40:19.610 INFO:tasks.workunit.client.0.smithi049.stdout:2/366: creat d2/d1d/d28/d56/d66/f7e x:0 0 0 2023-12-16T07:40:19.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/328: write d5/f18 [4130391,29087] 0 2023-12-16T07:40:19.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/329: fdatasync d5/f8 0 2023-12-16T07:40:19.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/330: write d5/d1e/d21/d4e/f59 [688879,111445] 0 2023-12-16T07:40:19.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/331: chown d5/f13 10 1 2023-12-16T07:40:19.617 INFO:tasks.workunit.client.0.smithi049.stdout:3/314: dwrite d1/d2b/f2d [0,4194304] 0 2023-12-16T07:40:19.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/337: dwrite f1b [0,4194304] 0 2023-12-16T07:40:19.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/338: stat c1a 0 2023-12-16T07:40:19.619 INFO:tasks.workunit.client.0.smithi049.stdout:6/405: dwrite d0/d39/d5b/d65/d32/f72 [0,4194304] 0 2023-12-16T07:40:19.619 INFO:tasks.workunit.client.0.smithi049.stdout:9/309: dwrite d4/db/f22 [0,4194304] 0 2023-12-16T07:40:19.619 INFO:tasks.workunit.client.0.smithi049.stdout:6/406: write d0/d39/d5b/d65/f1d [431912,61737] 0 2023-12-16T07:40:19.621 INFO:tasks.workunit.client.0.smithi049.stdout:3/315: creat d1/d2a/d37/d3f/d5a/d61/f66 x:0 0 0 2023-12-16T07:40:19.621 INFO:tasks.workunit.client.0.smithi049.stdout:4/342: sync 2023-12-16T07:40:19.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/395: sync 2023-12-16T07:40:19.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/396: write d0/f41 [3127749,6013] 0 2023-12-16T07:40:19.622 INFO:tasks.workunit.client.0.smithi049.stdout:5/332: dread d5/d1e/d21/d4e/f59 [0,4194304] 0 2023-12-16T07:40:19.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/339: rename d20/d41/d52/d66 to d20/d41/d4f/d7c 0 2023-12-16T07:40:19.626 INFO:tasks.workunit.client.0.smithi049.stdout:9/310: creat d4/d45/f61 x:0 0 0 2023-12-16T07:40:19.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/407: creat d0/d2/f86 x:0 0 0 2023-12-16T07:40:19.633 INFO:tasks.workunit.client.0.smithi049.stdout:2/367: rmdir d2 39 2023-12-16T07:40:19.633 INFO:tasks.workunit.client.0.smithi049.stdout:2/368: readlink d2/d1d/d28/d56/d11/d1c/l3a 0 2023-12-16T07:40:19.633 INFO:tasks.workunit.client.0.smithi049.stdout:2/369: stat d2 0 2023-12-16T07:40:19.634 INFO:tasks.workunit.client.0.smithi049.stdout:2/370: fsync d2/ff 0 2023-12-16T07:40:19.634 INFO:tasks.workunit.client.0.smithi049.stdout:4/343: mkdir d2/db/dd/de/d1e/d37/d6f 0 2023-12-16T07:40:19.635 INFO:tasks.workunit.client.0.smithi049.stdout:8/397: mknod d0/d13/d42/c7b 0 2023-12-16T07:40:19.638 INFO:tasks.workunit.client.0.smithi049.stdout:5/333: unlink d5/d1e/d21/f44 0 2023-12-16T07:40:19.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/340: creat d20/d43/f7d x:0 0 0 2023-12-16T07:40:19.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/311: rmdir d4/db 39 2023-12-16T07:40:19.643 INFO:tasks.workunit.client.0.smithi049.stdout:6/408: mknod d0/d39/d5b/d65/d4c/d4d/d6a/c87 0 2023-12-16T07:40:19.645 INFO:tasks.workunit.client.0.smithi049.stdout:3/316: truncate d1/d2a/d37/d3f/d4c/f4d 2149351 0 2023-12-16T07:40:19.645 INFO:tasks.workunit.client.0.smithi049.stdout:3/317: chown d1/d2a/d37/d3f/c43 31532 1 2023-12-16T07:40:19.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/371: getdents d2/d1d/d24/d55 0 2023-12-16T07:40:19.653 INFO:tasks.workunit.client.0.smithi049.stdout:1/341: unlink d20/f36 0 2023-12-16T07:40:19.656 INFO:tasks.workunit.client.0.smithi049.stdout:8/398: dwrite d0/f43 [0,4194304] 0 2023-12-16T07:40:19.656 INFO:tasks.workunit.client.0.smithi049.stdout:8/399: chown d0/d1f/d36/f7a 880 1 2023-12-16T07:40:19.656 INFO:tasks.workunit.client.0.smithi049.stdout:9/312: dread f3 [0,4194304] 0 2023-12-16T07:40:19.658 INFO:tasks.workunit.client.0.smithi049.stdout:6/409: rename d0/d39/d5b/d65/d4c/f7e to d0/d39/d5b/d65/d27/f88 0 2023-12-16T07:40:19.662 INFO:tasks.workunit.client.0.smithi049.stdout:5/334: dwrite d5/d1e/d20/f6d [0,4194304] 0 2023-12-16T07:40:19.662 INFO:tasks.workunit.client.0.smithi049.stdout:5/335: truncate d5/de/d1c/d62/f6a 398502 0 2023-12-16T07:40:19.663 INFO:tasks.workunit.client.0.smithi049.stdout:5/336: truncate d5/de/d54/d57/d3c/f5d 625704 0 2023-12-16T07:40:19.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/372: creat d2/d1d/d24/d55/d76/f7f x:0 0 0 2023-12-16T07:40:19.663 INFO:tasks.workunit.client.0.smithi049.stdout:9/313: dread d4/d7/f21 [0,4194304] 0 2023-12-16T07:40:19.663 INFO:tasks.workunit.client.0.smithi049.stdout:9/314: truncate d4/d3e/f4e 799615 0 2023-12-16T07:40:19.665 INFO:tasks.workunit.client.0.smithi049.stdout:1/342: creat d20/d41/d4f/d55/d58/f7e x:0 0 0 2023-12-16T07:40:19.668 INFO:tasks.workunit.client.0.smithi049.stdout:3/318: symlink d1/l67 0 2023-12-16T07:40:19.673 INFO:tasks.workunit.client.0.smithi049.stdout:5/337: creat d5/de/d54/d57/f72 x:0 0 0 2023-12-16T07:40:19.673 INFO:tasks.workunit.client.0.smithi049.stdout:4/344: rmdir d2/db/dd/de/d1e/d4d 0 2023-12-16T07:40:19.674 INFO:tasks.workunit.client.0.smithi049.stdout:7/329: sync 2023-12-16T07:40:19.676 INFO:tasks.workunit.client.0.smithi049.stdout:8/400: dwrite d0/d1f/d56/f74 [0,4194304] 0 2023-12-16T07:40:19.676 INFO:tasks.workunit.client.0.smithi049.stdout:2/373: creat d2/d1d/d28/d56/d71/f80 x:0 0 0 2023-12-16T07:40:19.676 INFO:tasks.workunit.client.0.smithi049.stdout:2/374: getdents d2/d1d 0 2023-12-16T07:40:19.679 INFO:tasks.workunit.client.0.smithi049.stdout:5/338: symlink d5/de/d54/d67/l73 0 2023-12-16T07:40:19.679 INFO:tasks.workunit.client.0.smithi049.stdout:5/339: chown d5/de 33406435 1 2023-12-16T07:40:19.679 INFO:tasks.workunit.client.0.smithi049.stdout:5/340: truncate d5/de/d1c/d62/f6a 568417 0 2023-12-16T07:40:19.679 INFO:tasks.workunit.client.0.smithi049.stdout:1/343: write d20/f37 [1515162,11423] 0 2023-12-16T07:40:19.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/341: fdatasync d5/de/d54/d57/d3c/f5d 0 2023-12-16T07:40:19.680 INFO:tasks.workunit.client.0.smithi049.stdout:1/344: dread - d20/d41/d4f/d55/d58/f7e zero size 2023-12-16T07:40:19.680 INFO:tasks.workunit.client.0.smithi049.stdout:1/345: chown d20/l2c 0 1 2023-12-16T07:40:19.681 INFO:tasks.workunit.client.0.smithi049.stdout:7/330: creat d7/dc/dd/d35/f77 x:0 0 0 2023-12-16T07:40:19.681 INFO:tasks.workunit.client.0.smithi049.stdout:7/331: chown d7/l24 62927 1 2023-12-16T07:40:19.682 INFO:tasks.workunit.client.0.smithi049.stdout:7/332: write d7/dc/d2f/d38/f63 [810633,106532] 0 2023-12-16T07:40:19.684 INFO:tasks.workunit.client.0.smithi049.stdout:6/410: dwrite d0/d39/d5b/f74 [0,4194304] 0 2023-12-16T07:40:19.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/401: rename d0/d13/c57 to d0/d13/d42/d5b/d68/c7c 0 2023-12-16T07:40:19.685 INFO:tasks.workunit.client.0.smithi049.stdout:6/411: write d0/f35 [5507475,32679] 0 2023-12-16T07:40:19.685 INFO:tasks.workunit.client.0.smithi049.stdout:6/412: write d0/d39/d5b/d65/d32/f72 [4298561,37853] 0 2023-12-16T07:40:19.685 INFO:tasks.workunit.client.0.smithi049.stdout:3/319: unlink d1/l19 0 2023-12-16T07:40:19.688 INFO:tasks.workunit.client.0.smithi049.stdout:1/346: mkdir d20/d41/d4f/d55/d7f 0 2023-12-16T07:40:19.689 INFO:tasks.workunit.client.0.smithi049.stdout:4/345: symlink d2/db/l70 0 2023-12-16T07:40:19.691 INFO:tasks.workunit.client.0.smithi049.stdout:7/333: creat d7/dc/d2f/d40/d5d/f78 x:0 0 0 2023-12-16T07:40:19.692 INFO:tasks.workunit.client.0.smithi049.stdout:0/476: sync 2023-12-16T07:40:19.694 INFO:tasks.workunit.client.0.smithi049.stdout:0/477: dread d13/d21/d99/f1a [0,4194304] 0 2023-12-16T07:40:19.695 INFO:tasks.workunit.client.0.smithi049.stdout:8/402: mkdir d0/d6a/d7d 0 2023-12-16T07:40:19.695 INFO:tasks.workunit.client.0.smithi049.stdout:6/413: creat d0/d39/d5b/d65/d27/f89 x:0 0 0 2023-12-16T07:40:19.696 INFO:tasks.workunit.client.0.smithi049.stdout:3/320: creat d1/d2a/f68 x:0 0 0 2023-12-16T07:40:19.696 INFO:tasks.workunit.client.0.smithi049.stdout:1/347: creat d20/d41/d4f/d55/d7f/f80 x:0 0 0 2023-12-16T07:40:19.697 INFO:tasks.workunit.client.0.smithi049.stdout:1/348: chown f1d 11 1 2023-12-16T07:40:19.697 INFO:tasks.workunit.client.0.smithi049.stdout:4/346: getdents d2/db/dd/d52 0 2023-12-16T07:40:19.698 INFO:tasks.workunit.client.0.smithi049.stdout:7/334: symlink d7/dc/d2f/d40/d5d/l79 0 2023-12-16T07:40:19.699 INFO:tasks.workunit.client.0.smithi049.stdout:2/375: dwrite d2/f22 [4194304,4194304] 0 2023-12-16T07:40:19.700 INFO:tasks.workunit.client.0.smithi049.stdout:0/478: creat d13/fa1 x:0 0 0 2023-12-16T07:40:19.700 INFO:tasks.workunit.client.0.smithi049.stdout:0/479: fdatasync d13/d21/d27/f97 0 2023-12-16T07:40:19.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/342: rename d5/de/d54/d57/f72 to d5/de/d54/d5c/f74 0 2023-12-16T07:40:19.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/315: dwrite d4/d7/f9 [0,4194304] 0 2023-12-16T07:40:19.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/316: fsync d4/fd 0 2023-12-16T07:40:19.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/403: creat d0/d1f/f7e x:0 0 0 2023-12-16T07:40:19.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/414: truncate d0/d39/d5b/d65/f1d 3604383 0 2023-12-16T07:40:19.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/415: fdatasync d0/f40 0 2023-12-16T07:40:19.704 INFO:tasks.workunit.client.0.smithi049.stdout:4/347: read d2/db/dd/fa [4243901,122306] 0 2023-12-16T07:40:19.706 INFO:tasks.workunit.client.0.smithi049.stdout:3/321: mknod d1/d2b/c69 0 2023-12-16T07:40:19.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/335: getdents d7/dc/d2f 0 2023-12-16T07:40:19.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/336: stat d7/dc/dd/f1e 0 2023-12-16T07:40:19.712 INFO:tasks.workunit.client.0.smithi049.stdout:2/376: creat d2/d1d/d38/f81 x:0 0 0 2023-12-16T07:40:19.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/480: rmdir d13/d21/d2f/d7d 39 2023-12-16T07:40:19.714 INFO:tasks.workunit.client.0.smithi049.stdout:5/343: symlink d5/l75 0 2023-12-16T07:40:19.714 INFO:tasks.workunit.client.0.smithi049.stdout:1/349: dwrite d20/d45/d47/f56 [0,4194304] 0 2023-12-16T07:40:19.714 INFO:tasks.workunit.client.0.smithi049.stdout:5/344: read d5/de/d54/d57/d3c/f5d [497064,52498] 0 2023-12-16T07:40:19.715 INFO:tasks.workunit.client.0.smithi049.stdout:9/317: creat d4/d7/d11/d1d/d48/f62 x:0 0 0 2023-12-16T07:40:19.716 INFO:tasks.workunit.client.0.smithi049.stdout:8/404: creat d0/d13/d42/f7f x:0 0 0 2023-12-16T07:40:19.717 INFO:tasks.workunit.client.0.smithi049.stdout:6/416: creat d0/d39/f8a x:0 0 0 2023-12-16T07:40:19.718 INFO:tasks.workunit.client.0.smithi049.stdout:2/377: dread d2/d1d/d24/f42 [0,4194304] 0 2023-12-16T07:40:19.718 INFO:tasks.workunit.client.0.smithi049.stdout:2/378: stat d2/d26/d6e/f7b 0 2023-12-16T07:40:19.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/337: mknod d7/dc/dd/d37/c7a 0 2023-12-16T07:40:19.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/338: dread - d7/dc/d2f/d40/d5d/f78 zero size 2023-12-16T07:40:19.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/339: chown d7/dc/dd/d27/c76 127294495 1 2023-12-16T07:40:19.728 INFO:tasks.workunit.client.0.smithi049.stdout:0/481: symlink d13/d21/d27/d2c/d62/d70/la2 0 2023-12-16T07:40:19.728 INFO:tasks.workunit.client.0.smithi049.stdout:1/350: creat d20/d40/f81 x:0 0 0 2023-12-16T07:40:19.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/345: rename d5/d1e/d20/f60 to d5/de/f76 0 2023-12-16T07:40:19.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/346: chown d5/d1e 9 1 2023-12-16T07:40:19.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/347: readlink d5/de/l4d 0 2023-12-16T07:40:19.730 INFO:tasks.workunit.client.0.smithi049.stdout:9/318: symlink d4/l63 0 2023-12-16T07:40:19.731 INFO:tasks.workunit.client.0.smithi049.stdout:8/405: symlink d0/d13/d42/d5b/l80 0 2023-12-16T07:40:19.736 INFO:tasks.workunit.client.0.smithi049.stdout:3/322: unlink d1/l28 0 2023-12-16T07:40:19.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/482: creat d13/d21/d99/fa3 x:0 0 0 2023-12-16T07:40:19.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/417: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:19.739 INFO:tasks.workunit.client.0.smithi049.stdout:2/379: dwrite d2/f17 [0,4194304] 0 2023-12-16T07:40:19.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/351: mkdir d20/d41/d4f/d55/d82 0 2023-12-16T07:40:19.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/352: readlink d20/l2c 0 2023-12-16T07:40:19.742 INFO:tasks.workunit.client.0.smithi049.stdout:7/340: rename d7/dc/dd/d14/f47 to d7/d2b/f7b 0 2023-12-16T07:40:19.745 INFO:tasks.workunit.client.0.smithi049.stdout:3/323: unlink d1/d2b/l34 0 2023-12-16T07:40:19.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/353: creat d20/d41/d4f/d55/f83 x:0 0 0 2023-12-16T07:40:19.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/354: truncate d20/d45/d47/f6d 91963 0 2023-12-16T07:40:19.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/355: truncate d20/d45/f48 345997 0 2023-12-16T07:40:19.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/356: stat d20/d41/d4f/d55/d58/f5d 0 2023-12-16T07:40:19.748 INFO:tasks.workunit.client.0.smithi049.stdout:2/380: dread d2/d1d/d28/d56/fb [0,4194304] 0 2023-12-16T07:40:19.752 INFO:tasks.workunit.client.0.smithi049.stdout:1/357: write d20/d41/f64 [261263,80177] 0 2023-12-16T07:40:19.752 INFO:tasks.workunit.client.0.smithi049.stdout:5/348: rename d5/de/c3a to d5/d1e/d21/d58/c77 0 2023-12-16T07:40:19.752 INFO:tasks.workunit.client.0.smithi049.stdout:7/341: mkdir d7/dc/d7c 0 2023-12-16T07:40:19.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/324: getdents d1/d2a 0 2023-12-16T07:40:19.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/325: write d1/d2a/d37/d3f/f59 [712771,52688] 0 2023-12-16T07:40:19.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/326: write d1/d2a/d37/d3f/d5a/d5b/d5e/f5f [656962,16536] 0 2023-12-16T07:40:19.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/483: rename d13/c7b to d13/d39/d38/d7e/d8b/ca4 0 2023-12-16T07:40:19.761 INFO:tasks.workunit.client.0.smithi049.stdout:7/342: read d7/d2b/d59/f5e [176354,59449] 0 2023-12-16T07:40:19.761 INFO:tasks.workunit.client.0.smithi049.stdout:7/343: truncate f2 1570098 0 2023-12-16T07:40:19.761 INFO:tasks.workunit.client.0.smithi049.stdout:6/418: dwrite d0/d39/d5b/d65/d53/f61 [0,4194304] 0 2023-12-16T07:40:19.761 INFO:tasks.workunit.client.0.smithi049.stdout:1/358: dread ff [0,4194304] 0 2023-12-16T07:40:19.761 INFO:tasks.workunit.client.0.smithi049.stdout:6/419: dread - d0/d39/f84 zero size 2023-12-16T07:40:19.762 INFO:tasks.workunit.client.0.smithi049.stdout:1/359: write fe [8873502,48291] 0 2023-12-16T07:40:19.762 INFO:tasks.workunit.client.0.smithi049.stdout:6/420: write d0/f40 [331930,118972] 0 2023-12-16T07:40:19.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/344: unlink d7/dc/d2f/d38/c4a 0 2023-12-16T07:40:19.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/345: truncate d7/dc/dd/d35/d36/f5f 406761 0 2023-12-16T07:40:19.768 INFO:tasks.workunit.client.0.smithi049.stdout:2/381: dread d2/d1d/f6d [0,4194304] 0 2023-12-16T07:40:19.771 INFO:tasks.workunit.client.0.smithi049.stdout:5/349: dwrite d5/de/f76 [0,4194304] 0 2023-12-16T07:40:19.771 INFO:tasks.workunit.client.0.smithi049.stdout:1/360: dread f14 [0,4194304] 0 2023-12-16T07:40:19.771 INFO:tasks.workunit.client.0.smithi049.stdout:1/361: chown d20/d41/c4a 363 1 2023-12-16T07:40:19.771 INFO:tasks.workunit.client.0.smithi049.stdout:1/362: chown d20/d41/f78 0 1 2023-12-16T07:40:19.771 INFO:tasks.workunit.client.0.smithi049.stdout:6/421: truncate d0/d39/d5b/d65/d58/f3d 997521 0 2023-12-16T07:40:19.772 INFO:tasks.workunit.client.0.smithi049.stdout:7/346: creat d7/dc/dd/d35/d36/f7d x:0 0 0 2023-12-16T07:40:19.776 INFO:tasks.workunit.client.0.smithi049.stdout:5/350: mkdir d5/de/d54/d78 0 2023-12-16T07:40:19.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/363: rmdir d20/d40/d6f 39 2023-12-16T07:40:19.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/364: write f19 [387872,99280] 0 2023-12-16T07:40:19.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/365: chown d20/f79 55380087 1 2023-12-16T07:40:19.778 INFO:tasks.workunit.client.0.smithi049.stdout:3/327: dwrite d1/d2a/f32 [0,4194304] 0 2023-12-16T07:40:19.778 INFO:tasks.workunit.client.0.smithi049.stdout:3/328: readlink d1/d2b/l35 0 2023-12-16T07:40:19.778 INFO:tasks.workunit.client.0.smithi049.stdout:0/484: dwrite f3 [0,4194304] 0 2023-12-16T07:40:19.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/351: creat d5/d1e/d21/d58/f79 x:0 0 0 2023-12-16T07:40:19.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/366: mkdir d20/d41/d4f/d55/d7f/d84 0 2023-12-16T07:40:19.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/329: mknod d1/d2a/d37/d3f/d5a/d5b/c6a 0 2023-12-16T07:40:19.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/382: dwrite d2/d1d/d24/d55/f5a [0,4194304] 0 2023-12-16T07:40:19.804 INFO:tasks.workunit.client.0.smithi049.stdout:0/485: creat d13/d21/d2f/d7d/d90/fa5 x:0 0 0 2023-12-16T07:40:19.805 INFO:tasks.workunit.client.0.smithi049.stdout:1/367: rename l17 to d20/d41/l85 0 2023-12-16T07:40:19.805 INFO:tasks.workunit.client.0.smithi049.stdout:1/368: chown d20/d45/d77 22300219 1 2023-12-16T07:40:19.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/330: mkdir d1/d2a/d37/d3f/d5a/d61/d6b 0 2023-12-16T07:40:19.808 INFO:tasks.workunit.client.0.smithi049.stdout:2/383: mknod d2/d26/d6e/c82 0 2023-12-16T07:40:19.808 INFO:tasks.workunit.client.0.smithi049.stdout:6/422: dwrite d0/d39/d5b/d65/d27/f88 [0,4194304] 0 2023-12-16T07:40:19.808 INFO:tasks.workunit.client.0.smithi049.stdout:6/423: chown d0/f1b 7 1 2023-12-16T07:40:19.808 INFO:tasks.workunit.client.0.smithi049.stdout:5/352: dwrite d5/de/f16 [0,4194304] 0 2023-12-16T07:40:19.808 INFO:tasks.workunit.client.0.smithi049.stdout:5/353: write d5/d1e/d20/f36 [1001602,79309] 0 2023-12-16T07:40:19.809 INFO:tasks.workunit.client.0.smithi049.stdout:1/369: mkdir d20/d41/d52/d86 0 2023-12-16T07:40:19.809 INFO:tasks.workunit.client.0.smithi049.stdout:1/370: truncate d20/d45/d47/f65 582169 0 2023-12-16T07:40:19.810 INFO:tasks.workunit.client.0.smithi049.stdout:5/354: write d5/d1e/f51 [870740,42370] 0 2023-12-16T07:40:19.810 INFO:tasks.workunit.client.0.smithi049.stdout:5/355: fdatasync d5/de/f31 0 2023-12-16T07:40:19.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/347: dwrite d7/d2b/d59/f5e [0,4194304] 0 2023-12-16T07:40:19.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/348: fdatasync d7/fb 0 2023-12-16T07:40:19.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/349: dread - d7/dc/f6f zero size 2023-12-16T07:40:19.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/350: fsync d7/dc/f61 0 2023-12-16T07:40:19.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/351: dread - d7/dc/dd/d35/d36/f7d zero size 2023-12-16T07:40:19.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/384: mknod d2/d1d/d28/d56/d71/c83 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/352: dread d7/dc/d2f/d38/f3d [4194304,4194304] 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/353: write d7/dc/dd/d14/f32 [5742126,56036] 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/424: truncate d0/d39/d5b/d65/d53/f5f 3733874 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/425: truncate d0/d39/d5b/d65/d27/f45 848527 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/426: write d0/d2/f82 [1205306,24479] 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/427: chown d0/l10 209 1 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/428: write d0/d39/f54 [272832,65528] 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:1/371: symlink d20/d41/d4f/d55/d7f/d84/l87 0 2023-12-16T07:40:19.821 INFO:tasks.workunit.client.0.smithi049.stdout:5/356: mknod d5/d1e/c7a 0 2023-12-16T07:40:19.822 INFO:tasks.workunit.client.0.smithi049.stdout:0/486: dwrite d13/d21/d27/d2c/d62/d70/f8f [0,4194304] 0 2023-12-16T07:40:19.823 INFO:tasks.workunit.client.0.smithi049.stdout:6/429: dread d0/d2/f47 [0,4194304] 0 2023-12-16T07:40:19.825 INFO:tasks.workunit.client.0.smithi049.stdout:2/385: symlink d2/d26/d43/l84 0 2023-12-16T07:40:19.829 INFO:tasks.workunit.client.0.smithi049.stdout:3/331: dwrite d1/d2a/f68 [0,4194304] 0 2023-12-16T07:40:19.829 INFO:tasks.workunit.client.0.smithi049.stdout:1/372: truncate fa 1719844 0 2023-12-16T07:40:19.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/348: sync 2023-12-16T07:40:19.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/357: unlink d5/de/d54/d67/f6b 0 2023-12-16T07:40:19.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/386: link d2/d1d/d28/c41 d2/de/d77/c85 0 2023-12-16T07:40:19.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/354: dread d7/dc/dd/d14/f52 [0,4194304] 0 2023-12-16T07:40:19.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/355: write d7/dc/dd/d14/f2a [1690790,83916] 0 2023-12-16T07:40:19.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/487: dwrite d13/d21/d27/d2c/f55 [4194304,4194304] 0 2023-12-16T07:40:19.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/488: write d13/d3c/f4c [163958,75484] 0 2023-12-16T07:40:19.841 INFO:tasks.workunit.client.0.smithi049.stdout:3/332: mknod d1/d2a/d37/d3f/d4c/c6c 0 2023-12-16T07:40:19.841 INFO:tasks.workunit.client.0.smithi049.stdout:5/358: dread d5/de/f16 [0,4194304] 0 2023-12-16T07:40:19.841 INFO:tasks.workunit.client.0.smithi049.stdout:1/373: mkdir d20/d7b/d88 0 2023-12-16T07:40:19.844 INFO:tasks.workunit.client.0.smithi049.stdout:4/349: unlink d2/db/dd/d2a/f26 0 2023-12-16T07:40:19.847 INFO:tasks.workunit.client.0.smithi049.stdout:7/356: creat d7/d2b/d59/f7e x:0 0 0 2023-12-16T07:40:19.847 INFO:tasks.workunit.client.0.smithi049.stdout:7/357: chown d7/dc/d2f/l4f 0 1 2023-12-16T07:40:19.848 INFO:tasks.workunit.client.0.smithi049.stdout:6/430: dwrite d0/d39/d5b/d65/d4c/d4d/f79 [0,4194304] 0 2023-12-16T07:40:19.849 INFO:tasks.workunit.client.0.smithi049.stdout:0/489: rmdir d13/d21/d2f 39 2023-12-16T07:40:19.852 INFO:tasks.workunit.client.0.smithi049.stdout:5/359: unlink c1 0 2023-12-16T07:40:19.852 INFO:tasks.workunit.client.0.smithi049.stdout:1/374: write f1d [177464,12156] 0 2023-12-16T07:40:19.854 INFO:tasks.workunit.client.0.smithi049.stdout:4/350: rename d2/db/l1a to d2/db/dd/d52/d62/l71 0 2023-12-16T07:40:19.856 INFO:tasks.workunit.client.0.smithi049.stdout:6/431: mkdir d0/d39/d8b 0 2023-12-16T07:40:19.857 INFO:tasks.workunit.client.0.smithi049.stdout:0/490: truncate d13/d21/d99/d46/f6f 1833014 0 2023-12-16T07:40:19.860 INFO:tasks.workunit.client.0.smithi049.stdout:0/491: write d13/d3c/f4c [113377,64091] 0 2023-12-16T07:40:19.860 INFO:tasks.workunit.client.0.smithi049.stdout:7/358: rename d7/dc/d2f/d40/d5d/l79 to d7/dc/l7f 0 2023-12-16T07:40:19.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/406: sync 2023-12-16T07:40:19.860 INFO:tasks.workunit.client.0.smithi049.stdout:9/319: sync 2023-12-16T07:40:19.860 INFO:tasks.workunit.client.0.smithi049.stdout:9/320: write d4/d7/d11/d1d/d48/f62 [894891,110373] 0 2023-12-16T07:40:19.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/351: rmdir d2/db/dd/de/d1e/d37 39 2023-12-16T07:40:19.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/352: chown d2/db/dd/d2a/f43 32376 1 2023-12-16T07:40:19.862 INFO:tasks.workunit.client.0.smithi049.stdout:6/432: creat d0/d2/df/d4e/d5d/d6f/f8c x:0 0 0 2023-12-16T07:40:19.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/492: rename d13/d21/d27/f4d to d13/d21/d2f/fa6 0 2023-12-16T07:40:19.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/360: dread d5/de/d1c/f46 [0,4194304] 0 2023-12-16T07:40:19.865 INFO:tasks.workunit.client.0.smithi049.stdout:7/359: unlink d7/dc/d2f/f6e 0 2023-12-16T07:40:19.865 INFO:tasks.workunit.client.0.smithi049.stdout:2/387: dwrite d2/d1d/d28/d56/d11/f61 [0,4194304] 0 2023-12-16T07:40:19.865 INFO:tasks.workunit.client.0.smithi049.stdout:2/388: fdatasync d2/d1d/f5e 0 2023-12-16T07:40:19.867 INFO:tasks.workunit.client.0.smithi049.stdout:8/407: creat d0/d1f/d36/f81 x:0 0 0 2023-12-16T07:40:19.868 INFO:tasks.workunit.client.0.smithi049.stdout:9/321: creat d4/d7/d11/d1d/f64 x:0 0 0 2023-12-16T07:40:19.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/375: dwrite d20/f21 [0,4194304] 0 2023-12-16T07:40:19.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/376: write d20/d40/f54 [2521941,52878] 0 2023-12-16T07:40:19.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/433: write d0/f35 [2895407,42601] 0 2023-12-16T07:40:19.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/434: readlink d0/d2/l2a 0 2023-12-16T07:40:19.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/435: write d0/d39/d5b/d65/d58/f3d [1633805,71791] 0 2023-12-16T07:40:19.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/436: chown d0/d39/d8b 16 1 2023-12-16T07:40:19.870 INFO:tasks.workunit.client.0.smithi049.stdout:4/353: mknod d2/db/dd/de/d1e/d37/c72 0 2023-12-16T07:40:19.872 INFO:tasks.workunit.client.0.smithi049.stdout:0/493: mkdir d13/d39/d38/da7 0 2023-12-16T07:40:19.873 INFO:tasks.workunit.client.0.smithi049.stdout:0/494: write d13/f1d [1815021,11571] 0 2023-12-16T07:40:19.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/361: creat d5/de/d54/d67/f7b x:0 0 0 2023-12-16T07:40:19.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/389: creat d2/de/f86 x:0 0 0 2023-12-16T07:40:19.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/322: creat d4/d3e/f65 x:0 0 0 2023-12-16T07:40:19.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/323: dread - d4/db/f5d zero size 2023-12-16T07:40:19.887 INFO:tasks.workunit.client.0.smithi049.stdout:7/360: dwrite d7/dc/d2f/d40/f74 [0,4194304] 0 2023-12-16T07:40:19.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/377: dwrite d20/d45/f48 [0,4194304] 0 2023-12-16T07:40:19.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:19 smithi049 ceph-mon[111939]: pgmap v6: 65 pgs: 65 active+clean; 461 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 34 MiB/s rd, 55 MiB/s wr, 66 op/s 2023-12-16T07:40:19.888 INFO:tasks.workunit.client.0.smithi049.stdout:6/437: mknod d0/d2/df/d4e/d5d/d6f/c8d 0 2023-12-16T07:40:19.888 INFO:tasks.workunit.client.0.smithi049.stdout:6/438: fsync d0/d39/d5b/d65/d58/f5c 0 2023-12-16T07:40:19.888 INFO:tasks.workunit.client.0.smithi049.stdout:9/324: write d4/f34 [4154885,94038] 0 2023-12-16T07:40:19.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/325: stat d4/d7/f10 0 2023-12-16T07:40:19.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/354: symlink d2/l73 0 2023-12-16T07:40:19.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/355: chown d2/db/dd/de/d1e/d37/l68 50415143 1 2023-12-16T07:40:19.892 INFO:tasks.workunit.client.0.smithi049.stdout:0/495: symlink d13/d39/d38/la8 0 2023-12-16T07:40:19.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/362: creat d5/f7c x:0 0 0 2023-12-16T07:40:19.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/390: rename d2/la to d2/de/l87 0 2023-12-16T07:40:19.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/391: dread - d2/d1d/d28/d56/d66/f7e zero size 2023-12-16T07:40:19.901 INFO:tasks.workunit.client.0.smithi049.stdout:8/408: fsync d0/d1f/d36/f81 0 2023-12-16T07:40:19.904 INFO:tasks.workunit.client.0.smithi049.stdout:1/378: symlink d20/d41/d4f/d55/d82/l89 0 2023-12-16T07:40:19.906 INFO:tasks.workunit.client.0.smithi049.stdout:9/326: dread d4/d7/d11/d26/d47/f4f [0,4194304] 0 2023-12-16T07:40:19.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/439: creat d0/d39/d5b/d65/d4c/f8e x:0 0 0 2023-12-16T07:40:19.915 INFO:tasks.workunit.client.0.smithi049.stdout:5/363: mknod d5/c7d 0 2023-12-16T07:40:19.915 INFO:tasks.workunit.client.0.smithi049.stdout:5/364: chown d5/c28 72297 1 2023-12-16T07:40:19.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/327: write d4/d7/d11/d26/f52 [665850,122077] 0 2023-12-16T07:40:19.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/361: dwrite d7/dc/dd/d35/f41 [0,4194304] 0 2023-12-16T07:40:19.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/362: stat d7/dc/dd/d37/d5c 0 2023-12-16T07:40:19.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/392: link d2/de/f46 d2/d1d/d28/d56/d66/f88 0 2023-12-16T07:40:19.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/393: truncate d2/d26/f59 1187252 0 2023-12-16T07:40:19.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/394: fsync d2/d1d/d28/d56/d11/f1e 0 2023-12-16T07:40:19.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/496: creat d13/d39/d53/fa9 x:0 0 0 2023-12-16T07:40:19.917 INFO:tasks.workunit.client.0.smithi049.stdout:4/356: dwrite d2/db/dd/fa [0,4194304] 0 2023-12-16T07:40:19.917 INFO:tasks.workunit.client.0.smithi049.stdout:1/379: mkdir d20/d41/d4f/d55/d7f/d8a 0 2023-12-16T07:40:19.918 INFO:tasks.workunit.client.0.smithi049.stdout:6/440: creat d0/d39/d5b/d65/d58/f8f x:0 0 0 2023-12-16T07:40:19.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/365: rename d5/de/d1c/d62/f6f to d5/de/d54/d67/f7e 0 2023-12-16T07:40:19.925 INFO:tasks.workunit.client.0.smithi049.stdout:7/363: creat d7/dc/d15/d57/f80 x:0 0 0 2023-12-16T07:40:19.929 INFO:tasks.workunit.client.0.smithi049.stdout:4/357: mknod d2/db/dd/d52/d62/c74 0 2023-12-16T07:40:19.930 INFO:tasks.workunit.client.0.smithi049.stdout:1/380: creat d20/d7b/f8b x:0 0 0 2023-12-16T07:40:19.931 INFO:tasks.workunit.client.0.smithi049.stdout:6/441: mknod d0/d2/c90 0 2023-12-16T07:40:19.931 INFO:tasks.workunit.client.0.smithi049.stdout:6/442: stat d0/d39/d5b/d65/d32/c3a 0 2023-12-16T07:40:19.935 INFO:tasks.workunit.client.0.smithi049.stdout:9/328: rename d4/d7/d11/d1d/d48/f62 to d4/db/f66 0 2023-12-16T07:40:19.937 INFO:tasks.workunit.client.0.smithi049.stdout:5/366: symlink d5/d1e/d21/d58/l7f 0 2023-12-16T07:40:19.938 INFO:tasks.workunit.client.0.smithi049.stdout:4/358: unlink d2/db/dd/f4b 0 2023-12-16T07:40:19.940 INFO:tasks.workunit.client.0.smithi049.stdout:6/443: mkdir d0/d39/d5b/d65/d27/d91 0 2023-12-16T07:40:19.941 INFO:tasks.workunit.client.0.smithi049.stdout:7/364: rename d7/dc/f6f to d7/f81 0 2023-12-16T07:40:19.942 INFO:tasks.workunit.client.0.smithi049.stdout:7/365: fsync d7/dc/dd/d35/d36/f7d 0 2023-12-16T07:40:19.943 INFO:tasks.workunit.client.0.smithi049.stdout:5/367: symlink d5/l80 0 2023-12-16T07:40:19.943 INFO:tasks.workunit.client.0.smithi049.stdout:5/368: chown d5/de/f68 26 1 2023-12-16T07:40:19.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/359: truncate d2/f9 10970609 0 2023-12-16T07:40:19.945 INFO:tasks.workunit.client.0.smithi049.stdout:0/497: getdents d13/d39/d53 0 2023-12-16T07:40:19.946 INFO:tasks.workunit.client.0.smithi049.stdout:0/498: dread - d13/d21/d27/d2c/d62/f94 zero size 2023-12-16T07:40:19.946 INFO:tasks.workunit.client.0.smithi049.stdout:0/499: dread - d13/d21/d99/d46/f95 zero size 2023-12-16T07:40:19.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/381: dwrite d20/d41/d4f/d55/d58/f7e [0,4194304] 0 2023-12-16T07:40:19.947 INFO:tasks.workunit.client.0.smithi049.stdout:7/366: mknod d7/dc/d6b/c82 0 2023-12-16T07:40:19.949 INFO:tasks.workunit.client.0.smithi049.stdout:5/369: mkdir d5/de/d1c/d62/d81 0 2023-12-16T07:40:19.949 INFO:tasks.workunit.client.0.smithi049.stdout:5/370: write d5/de/d1c/f35 [887176,12222] 0 2023-12-16T07:40:19.949 INFO:tasks.workunit.client.0.smithi049.stdout:5/371: chown d5/f15 28869 1 2023-12-16T07:40:19.950 INFO:tasks.workunit.client.0.smithi049.stdout:0/500: mkdir d13/d21/d27/d2c/d62/daa 0 2023-12-16T07:40:19.952 INFO:tasks.workunit.client.0.smithi049.stdout:0/501: write d13/d21/d99/f19 [806880,88687] 0 2023-12-16T07:40:19.958 INFO:tasks.workunit.client.0.smithi049.stdout:9/329: dwrite d4/db/f66 [0,4194304] 0 2023-12-16T07:40:19.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/367: getdents d7/dc/dd/d35/d36 0 2023-12-16T07:40:19.960 INFO:tasks.workunit.client.0.smithi049.stdout:5/372: mkdir d5/de/d54/d57/d3c/d82 0 2023-12-16T07:40:19.961 INFO:tasks.workunit.client.0.smithi049.stdout:0/502: mkdir d13/dab 0 2023-12-16T07:40:19.961 INFO:tasks.workunit.client.0.smithi049.stdout:0/503: chown d13/f2b 6341 1 2023-12-16T07:40:19.966 INFO:tasks.workunit.client.0.smithi049.stdout:4/360: dwrite d2/db/dd/de/d1e/f55 [4194304,4194304] 0 2023-12-16T07:40:19.966 INFO:tasks.workunit.client.0.smithi049.stdout:7/368: dread d7/dc/d2f/d38/f3d [0,4194304] 0 2023-12-16T07:40:19.966 INFO:tasks.workunit.client.0.smithi049.stdout:7/369: fdatasync d7/dc/dd/d27/f48 0 2023-12-16T07:40:19.970 INFO:tasks.workunit.client.0.smithi049.stdout:4/361: dread d2/db/dd/d2a/f43 [0,4194304] 0 2023-12-16T07:40:19.971 INFO:tasks.workunit.client.0.smithi049.stdout:0/504: rename d13/d39/d78/f7f to d13/d21/d99/d46/fac 0 2023-12-16T07:40:19.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/382: rmdir d20 39 2023-12-16T07:40:19.971 INFO:tasks.workunit.client.0.smithi049.stdout:9/330: creat d4/d7/d11/f67 x:0 0 0 2023-12-16T07:40:19.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/362: write d2/f28 [1803472,26503] 0 2023-12-16T07:40:19.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/363: chown d2/db/dd/d52/d62/c65 953936225 1 2023-12-16T07:40:19.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/364: fsync d2/db/dd/de/d1e/f55 0 2023-12-16T07:40:19.973 INFO:tasks.workunit.client.0.smithi049.stdout:4/365: write d2/db/dd/de/f63 [916399,119167] 0 2023-12-16T07:40:19.973 INFO:tasks.workunit.client.0.smithi049.stdout:0/505: write d13/d21/d99/f1a [767522,83229] 0 2023-12-16T07:40:19.974 INFO:tasks.workunit.client.0.smithi049.stdout:0/506: chown d13/d21/c2e 1368 1 2023-12-16T07:40:19.976 INFO:tasks.workunit.client.0.smithi049.stdout:7/370: rename d7/dc/dd/f1e to d7/dc/d2f/d38/f83 0 2023-12-16T07:40:19.977 INFO:tasks.workunit.client.0.smithi049.stdout:9/331: getdents d4/d7/d11/d26 0 2023-12-16T07:40:19.978 INFO:tasks.workunit.client.0.smithi049.stdout:5/373: dwrite d5/de/d1c/f46 [0,4194304] 0 2023-12-16T07:40:19.981 INFO:tasks.workunit.client.0.smithi049.stdout:1/383: rename d20/d43/f7d to d20/d43/f8c 0 2023-12-16T07:40:19.988 INFO:tasks.workunit.client.0.smithi049.stdout:7/371: creat d7/dc/d6b/f84 x:0 0 0 2023-12-16T07:40:19.997 INFO:tasks.workunit.client.0.smithi049.stdout:3/333: sync 2023-12-16T07:40:20.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/374: dwrite d5/de/d1c/f46 [0,4194304] 0 2023-12-16T07:40:20.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/366: dwrite d2/db/dd/de/d1e/d21/f39 [0,4194304] 0 2023-12-16T07:40:20.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/375: chown d5/de/l12 247 1 2023-12-16T07:40:20.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/367: write d2/f61 [624960,128103] 0 2023-12-16T07:40:20.032 INFO:tasks.workunit.client.0.smithi049.stdout:0/507: dwrite d13/f2b [0,4194304] 0 2023-12-16T07:40:20.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/376: dread d5/de/d1c/f35 [0,4194304] 0 2023-12-16T07:40:20.033 INFO:tasks.workunit.client.0.smithi049.stdout:7/372: dwrite d7/d2b/d59/f7e [0,4194304] 0 2023-12-16T07:40:20.034 INFO:tasks.workunit.client.0.smithi049.stdout:1/384: dwrite d20/f28 [0,4194304] 0 2023-12-16T07:40:20.034 INFO:tasks.workunit.client.0.smithi049.stdout:4/368: mknod d2/db/dd/d52/c75 0 2023-12-16T07:40:20.039 INFO:tasks.workunit.client.0.smithi049.stdout:0/508: creat d13/d21/d99/d46/d65/d82/fad x:0 0 0 2023-12-16T07:40:20.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/377: rmdir d5/de/d1c 39 2023-12-16T07:40:20.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/378: write d5/de/d54/d57/f33 [2549673,105090] 0 2023-12-16T07:40:20.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/379: fdatasync d5/de/f40 0 2023-12-16T07:40:20.042 INFO:tasks.workunit.client.0.smithi049.stdout:5/380: chown d5/de/f16 247 1 2023-12-16T07:40:20.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/385: dread d20/d41/d4f/d55/d58/f7e [0,4194304] 0 2023-12-16T07:40:20.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/386: stat c12 0 2023-12-16T07:40:20.050 INFO:tasks.workunit.client.0.smithi049.stdout:7/373: rename d7/d2b/d59/f64 to d7/dc/d15/d66/f85 0 2023-12-16T07:40:20.050 INFO:tasks.workunit.client.0.smithi049.stdout:7/374: stat d7/dc/d15/d57/l68 0 2023-12-16T07:40:20.050 INFO:tasks.workunit.client.0.smithi049.stdout:4/369: symlink d2/db/dd/l76 0 2023-12-16T07:40:20.053 INFO:tasks.workunit.client.0.smithi049.stdout:0/509: creat d13/d39/d38/d7e/fae x:0 0 0 2023-12-16T07:40:20.053 INFO:tasks.workunit.client.0.smithi049.stdout:0/510: fdatasync d13/d39/d8a/f9e 0 2023-12-16T07:40:20.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/381: creat d5/f83 x:0 0 0 2023-12-16T07:40:20.054 INFO:tasks.workunit.client.0.smithi049.stdout:5/382: stat d5/d1e/d20/f6d 0 2023-12-16T07:40:20.054 INFO:tasks.workunit.client.0.smithi049.stdout:5/383: fsync d5/de/d1c/d62/f6a 0 2023-12-16T07:40:20.055 INFO:tasks.workunit.client.0.smithi049.stdout:1/387: dread fe [4194304,4194304] 0 2023-12-16T07:40:20.055 INFO:tasks.workunit.client.0.smithi049.stdout:7/375: getdents d7 0 2023-12-16T07:40:20.055 INFO:tasks.workunit.client.0.smithi049.stdout:7/376: fdatasync d7/dc/d2f/d40/d5d/f78 0 2023-12-16T07:40:20.056 INFO:tasks.workunit.client.0.smithi049.stdout:7/377: fsync d7/dc/d2f/d40/f4b 0 2023-12-16T07:40:20.056 INFO:tasks.workunit.client.0.smithi049.stdout:4/370: symlink d2/db/dd/de/d1e/d21/l77 0 2023-12-16T07:40:20.056 INFO:tasks.workunit.client.0.smithi049.stdout:1/388: read d20/d41/d4f/d55/d58/f7e [1156341,98527] 0 2023-12-16T07:40:20.058 INFO:tasks.workunit.client.0.smithi049.stdout:5/384: rename d5/de/f16 to d5/de/d54/d57/d3c/d82/f84 0 2023-12-16T07:40:20.058 INFO:tasks.workunit.client.0.smithi049.stdout:5/385: fsync d5/de/d54/d67/f7e 0 2023-12-16T07:40:20.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/378: mkdir d7/dc/d6b/d70/d86 0 2023-12-16T07:40:20.059 INFO:tasks.workunit.client.0.smithi049.stdout:5/386: write f3 [1584273,23730] 0 2023-12-16T07:40:20.060 INFO:tasks.workunit.client.0.smithi049.stdout:4/371: creat d2/db/dd/d52/d62/f78 x:0 0 0 2023-12-16T07:40:20.060 INFO:tasks.workunit.client.0.smithi049.stdout:4/372: write d2/db/dd/de/d1e/d37/d4e/f5a [404637,28864] 0 2023-12-16T07:40:20.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/389: creat d20/d41/f8d x:0 0 0 2023-12-16T07:40:20.062 INFO:tasks.workunit.client.0.smithi049.stdout:4/373: dread d2/db/dd/de/d1e/d37/f3c [0,4194304] 0 2023-12-16T07:40:20.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/379: rename d7/dc/dd/d14/c62 to d7/dc/c87 0 2023-12-16T07:40:20.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/380: write d7/f67 [499649,35412] 0 2023-12-16T07:40:20.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/381: chown d7/dc/d6b/c82 5654993 1 2023-12-16T07:40:20.064 INFO:tasks.workunit.client.0.smithi049.stdout:7/382: fsync d7/dc/f1b 0 2023-12-16T07:40:20.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/387: mkdir d5/de/d54/d85 0 2023-12-16T07:40:20.067 INFO:tasks.workunit.client.0.smithi049.stdout:1/390: getdents d20/d43 0 2023-12-16T07:40:20.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/383: creat d7/dc/d6b/d70/d86/f88 x:0 0 0 2023-12-16T07:40:20.068 INFO:tasks.workunit.client.0.smithi049.stdout:8/409: sync 2023-12-16T07:40:20.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/410: stat d0/d13/d42/d5b/l5d 0 2023-12-16T07:40:20.070 INFO:tasks.workunit.client.0.smithi049.stdout:5/388: symlink d5/d1e/d21/d58/l86 0 2023-12-16T07:40:20.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/374: dread d2/f28 [0,4194304] 0 2023-12-16T07:40:20.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/375: getdents d2/db/d6b 0 2023-12-16T07:40:20.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/376: chown d2/db/dd/de/d1e/c60 3754462 1 2023-12-16T07:40:20.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/384: write d7/dc/f17 [4193530,108609] 0 2023-12-16T07:40:20.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/511: dwrite d13/d21/d99/d46/f63 [0,4194304] 0 2023-12-16T07:40:20.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/512: dread - d13/d21/d27/f88 zero size 2023-12-16T07:40:20.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/411: unlink d0/d13/d42/d5b/d68/c7c 0 2023-12-16T07:40:20.076 INFO:tasks.workunit.client.0.smithi049.stdout:7/385: symlink d7/dc/d2f/l89 0 2023-12-16T07:40:20.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/513: creat d13/d21/d99/d46/d65/faf x:0 0 0 2023-12-16T07:40:20.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/514: dread - d13/d39/f87 zero size 2023-12-16T07:40:20.078 INFO:tasks.workunit.client.0.smithi049.stdout:0/515: mknod d13/d39/d38/d7e/d8b/cb0 0 2023-12-16T07:40:20.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/516: mknod d13/d39/d38/d7e/d8b/cb1 0 2023-12-16T07:40:20.091 INFO:tasks.workunit.client.0.smithi049.stdout:7/386: dread d7/dc/dd/d14/f2a [0,4194304] 0 2023-12-16T07:40:20.093 INFO:tasks.workunit.client.0.smithi049.stdout:7/387: write d7/dc/d2f/d38/f83 [3688461,38521] 0 2023-12-16T07:40:20.095 INFO:tasks.workunit.client.0.smithi049.stdout:7/388: creat d7/dc/d6b/d70/d86/f8a x:0 0 0 2023-12-16T07:40:20.096 INFO:tasks.workunit.client.0.smithi049.stdout:7/389: unlink d7/f81 0 2023-12-16T07:40:20.097 INFO:tasks.workunit.client.0.smithi049.stdout:7/390: fsync d7/dc/dd/d35/d36/f5f 0 2023-12-16T07:40:20.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/377: dwrite d2/db/f15 [0,4194304] 0 2023-12-16T07:40:20.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/378: rename d2/db/dd/d52/d62 to d2/db/dd/d52/d62/d79 22 2023-12-16T07:40:20.110 INFO:tasks.workunit.client.0.smithi049.stdout:4/379: symlink d2/db/dd/de/l7a 0 2023-12-16T07:40:20.110 INFO:tasks.workunit.client.0.smithi049.stdout:4/380: fsync d2/db/dd/de/d1e/f3b 0 2023-12-16T07:40:20.111 INFO:tasks.workunit.client.0.smithi049.stdout:4/381: truncate d2/db/dd/f13 2600010 0 2023-12-16T07:40:20.111 INFO:tasks.workunit.client.0.smithi049.stdout:4/382: dread - d2/db/dd/de/d1e/f64 zero size 2023-12-16T07:40:20.111 INFO:tasks.workunit.client.0.smithi049.stdout:4/383: chown d2/db/dd/d52/f5e 0 1 2023-12-16T07:40:20.112 INFO:tasks.workunit.client.0.smithi049.stdout:4/384: dread d2/db/dd/d2a/f43 [0,4194304] 0 2023-12-16T07:40:20.112 INFO:tasks.workunit.client.0.smithi049.stdout:4/385: write d2/db/dd/de/d1e/d37/f5c [148703,82807] 0 2023-12-16T07:40:20.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/412: dwrite d0/d1f/f18 [0,4194304] 0 2023-12-16T07:40:20.113 INFO:tasks.workunit.client.0.smithi049.stdout:0/517: dwrite d13/d39/d38/f67 [0,4194304] 0 2023-12-16T07:40:20.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/413: write d0/d1f/f22 [422899,93526] 0 2023-12-16T07:40:20.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/414: truncate d0/d13/d42/d5b/f61 362670 0 2023-12-16T07:40:20.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/391: dwrite d7/dc/f61 [0,4194304] 0 2023-12-16T07:40:20.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:19 smithi133 ceph-mon[120445]: pgmap v6: 65 pgs: 65 active+clean; 461 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 34 MiB/s rd, 55 MiB/s wr, 66 op/s 2023-12-16T07:40:20.124 INFO:tasks.workunit.client.0.smithi049.stdout:8/415: creat d0/d1f/f82 x:0 0 0 2023-12-16T07:40:20.125 INFO:tasks.workunit.client.0.smithi049.stdout:8/416: read d0/d1f/d36/f54 [2667997,43296] 0 2023-12-16T07:40:20.126 INFO:tasks.workunit.client.0.smithi049.stdout:8/417: chown d0/d13/f3e 228955970 1 2023-12-16T07:40:20.128 INFO:tasks.workunit.client.0.smithi049.stdout:6/444: sync 2023-12-16T07:40:20.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/395: sync 2023-12-16T07:40:20.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/396: write d2/ff [405972,19369] 0 2023-12-16T07:40:20.136 INFO:tasks.workunit.client.0.smithi049.stdout:8/418: dread d0/f28 [0,4194304] 0 2023-12-16T07:40:20.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/445: write d0/d39/d5b/d65/d58/d2c/f36 [4041438,40998] 0 2023-12-16T07:40:20.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/419: mknod d0/d1f/d56/c83 0 2023-12-16T07:40:20.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/420: chown d0/d1f/d1c 3547 1 2023-12-16T07:40:20.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/421: chown d0/d1f/d56/l76 6142826 1 2023-12-16T07:40:20.140 INFO:tasks.workunit.client.0.smithi049.stdout:6/446: rename d0/d2/df/f31 to d0/d2/df/d4e/d5d/d6f/d4a/f92 0 2023-12-16T07:40:20.140 INFO:tasks.workunit.client.0.smithi049.stdout:6/447: chown d0/d39/d5b/d65/d58/f3d 29109560 1 2023-12-16T07:40:20.142 INFO:tasks.workunit.client.0.smithi049.stdout:8/422: truncate d0/f58 2777918 0 2023-12-16T07:40:20.144 INFO:tasks.workunit.client.0.smithi049.stdout:0/518: dwrite d13/d21/d27/d2c/f8d [0,4194304] 0 2023-12-16T07:40:20.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/423: link d0/d1f/d36/c46 d0/d6a/c84 0 2023-12-16T07:40:20.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/424: chown d0/f4f 57 1 2023-12-16T07:40:20.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/425: chown d0/d13/l2a 2198 1 2023-12-16T07:40:20.144 INFO:tasks.workunit.client.0.smithi049.stdout:0/519: write d13/d39/f61 [727678,83422] 0 2023-12-16T07:40:20.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/426: write d0/d1f/d1c/f52 [595406,115482] 0 2023-12-16T07:40:20.146 INFO:tasks.workunit.client.0.smithi049.stdout:0/520: mkdir d13/d39/d78/d83/db2 0 2023-12-16T07:40:20.146 INFO:tasks.workunit.client.0.smithi049.stdout:0/521: dread - d13/d21/d27/d2c/f98 zero size 2023-12-16T07:40:20.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/427: truncate d0/f12 625573 0 2023-12-16T07:40:20.148 INFO:tasks.workunit.client.0.smithi049.stdout:0/522: mknod d13/cb3 0 2023-12-16T07:40:20.149 INFO:tasks.workunit.client.0.smithi049.stdout:8/428: unlink d0/d13/f55 0 2023-12-16T07:40:20.151 INFO:tasks.workunit.client.0.smithi049.stdout:0/523: symlink d13/d21/d27/lb4 0 2023-12-16T07:40:20.151 INFO:tasks.workunit.client.0.smithi049.stdout:0/524: fsync d13/f40 0 2023-12-16T07:40:20.151 INFO:tasks.workunit.client.0.smithi049.stdout:0/525: chown d13/d39/d78/d83/db2 0 1 2023-12-16T07:40:20.157 INFO:tasks.workunit.client.0.smithi049.stdout:0/526: unlink d13/d21/d99/d46/f6f 0 2023-12-16T07:40:20.158 INFO:tasks.workunit.client.0.smithi049.stdout:7/392: dwrite d7/dc/dd/f6d [0,4194304] 0 2023-12-16T07:40:20.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/448: dwrite d0/d39/f54 [0,4194304] 0 2023-12-16T07:40:20.159 INFO:tasks.workunit.client.0.smithi049.stdout:0/527: creat d13/fb5 x:0 0 0 2023-12-16T07:40:20.165 INFO:tasks.workunit.client.0.smithi049.stdout:4/386: dwrite d2/db/dd/f13 [0,4194304] 0 2023-12-16T07:40:20.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/528: mkdir d13/d39/d8a/db6 0 2023-12-16T07:40:20.168 INFO:tasks.workunit.client.0.smithi049.stdout:8/429: dwrite d0/d1f/d1c/f39 [4194304,4194304] 0 2023-12-16T07:40:20.168 INFO:tasks.workunit.client.0.smithi049.stdout:8/430: chown d0/d1f/f18 10647903 1 2023-12-16T07:40:20.168 INFO:tasks.workunit.client.0.smithi049.stdout:6/449: rmdir d0/d2/df/d4e/d5d/d6f/d4a/d6c 0 2023-12-16T07:40:20.169 INFO:tasks.workunit.client.0.smithi049.stdout:6/450: read d0/d39/d5b/d65/f1d [910800,124677] 0 2023-12-16T07:40:20.171 INFO:tasks.workunit.client.0.smithi049.stdout:0/529: rename d13/f1d to d13/d3c/fb7 0 2023-12-16T07:40:20.176 INFO:tasks.workunit.client.0.smithi049.stdout:8/431: mknod d0/d6a/c85 0 2023-12-16T07:40:20.178 INFO:tasks.workunit.client.0.smithi049.stdout:6/451: creat d0/d39/d5b/d65/d58/d2c/f93 x:0 0 0 2023-12-16T07:40:20.179 INFO:tasks.workunit.client.0.smithi049.stdout:6/452: write d0/d39/d5b/d65/d27/f85 [440641,112641] 0 2023-12-16T07:40:20.179 INFO:tasks.workunit.client.0.smithi049.stdout:0/530: dread d13/d21/d99/f19 [0,4194304] 0 2023-12-16T07:40:20.181 INFO:tasks.workunit.client.0.smithi049.stdout:8/432: mknod d0/d1f/d36/c86 0 2023-12-16T07:40:20.182 INFO:tasks.workunit.client.0.smithi049.stdout:6/453: mkdir d0/d39/d5b/d65/d27/d91/d94 0 2023-12-16T07:40:20.184 INFO:tasks.workunit.client.0.smithi049.stdout:0/531: rename d13/d21/d2f/f52 to d13/d21/fb8 0 2023-12-16T07:40:20.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/433: truncate d0/f43 435600 0 2023-12-16T07:40:20.188 INFO:tasks.workunit.client.0.smithi049.stdout:6/454: rmdir d0/d39/d5b/d65/d4c 39 2023-12-16T07:40:20.190 INFO:tasks.workunit.client.0.smithi049.stdout:0/532: link d13/d39/f61 d13/d21/d27/d2c/d62/d70/fb9 0 2023-12-16T07:40:20.190 INFO:tasks.workunit.client.0.smithi049.stdout:0/533: chown d13 12982799 1 2023-12-16T07:40:20.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/434: symlink d0/d13/d42/l87 0 2023-12-16T07:40:20.192 INFO:tasks.workunit.client.0.smithi049.stdout:7/393: dwrite f2 [0,4194304] 0 2023-12-16T07:40:20.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/455: mkdir d0/d39/d5b/d65/d27/d91/d94/d95 0 2023-12-16T07:40:20.192 INFO:tasks.workunit.client.0.smithi049.stdout:4/387: dwrite d2/db/dd/d52/f59 [0,4194304] 0 2023-12-16T07:40:20.192 INFO:tasks.workunit.client.0.smithi049.stdout:4/388: truncate d2/db/dd/de/d1e/f2d 551813 0 2023-12-16T07:40:20.193 INFO:tasks.workunit.client.0.smithi049.stdout:6/456: write d0/f35 [158600,23064] 0 2023-12-16T07:40:20.193 INFO:tasks.workunit.client.0.smithi049.stdout:6/457: write d0/f40 [597040,112944] 0 2023-12-16T07:40:20.193 INFO:tasks.workunit.client.0.smithi049.stdout:6/458: stat d0/d39/d5b/d65/d58/d2c 0 2023-12-16T07:40:20.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/534: unlink d13/d21/d27/d2c/f55 0 2023-12-16T07:40:20.195 INFO:tasks.workunit.client.0.smithi049.stdout:8/435: rename d0/d13/l24 to d0/d1f/d36/l88 0 2023-12-16T07:40:20.195 INFO:tasks.workunit.client.0.smithi049.stdout:8/436: dread - d0/d1f/f65 zero size 2023-12-16T07:40:20.196 INFO:tasks.workunit.client.0.smithi049.stdout:7/394: getdents d7/dc/d15/d66 0 2023-12-16T07:40:20.203 INFO:tasks.workunit.client.0.smithi049.stdout:0/535: rename d13/d39/d38/f89 to d13/d39/d78/d83/db2/fba 0 2023-12-16T07:40:20.203 INFO:tasks.workunit.client.0.smithi049.stdout:0/536: write d13/d21/d99/d46/d65/d82/fad [86424,35156] 0 2023-12-16T07:40:20.204 INFO:tasks.workunit.client.0.smithi049.stdout:0/537: write d13/f1b [956579,74066] 0 2023-12-16T07:40:20.204 INFO:tasks.workunit.client.0.smithi049.stdout:0/538: chown d13/d21/d27/d2c/f41 11 1 2023-12-16T07:40:20.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/332: sync 2023-12-16T07:40:20.204 INFO:tasks.workunit.client.0.smithi049.stdout:4/389: truncate d2/db/dd/de/d1e/d21/f4f 4487859 0 2023-12-16T07:40:20.204 INFO:tasks.workunit.client.0.smithi049.stdout:3/334: sync 2023-12-16T07:40:20.210 INFO:tasks.workunit.client.0.smithi049.stdout:5/389: sync 2023-12-16T07:40:20.210 INFO:tasks.workunit.client.0.smithi049.stdout:1/391: sync 2023-12-16T07:40:20.210 INFO:tasks.workunit.client.0.smithi049.stdout:1/392: write d20/d45/d47/f65 [1209843,47698] 0 2023-12-16T07:40:20.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/333: creat d4/d7/d11/d26/f68 x:0 0 0 2023-12-16T07:40:20.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/335: mkdir d1/d2a/d37/d3f/d5a/d6d 0 2023-12-16T07:40:20.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/393: rename d20/d41/d4f/d55/d58/f63 to d20/f8e 0 2023-12-16T07:40:20.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/394: read - d20/f62 zero size 2023-12-16T07:40:20.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/395: chown d20/d40/c42 232057 1 2023-12-16T07:40:20.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/396: chown d20/d41/d4f/d55 385 1 2023-12-16T07:40:20.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/397: write d20/d41/d4f/d55/f83 [548461,115764] 0 2023-12-16T07:40:20.223 INFO:tasks.workunit.client.0.smithi049.stdout:4/390: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:20.223 INFO:tasks.workunit.client.0.smithi049.stdout:4/391: truncate d2/db/dd/de/d1e/d37/f5c 1220845 0 2023-12-16T07:40:20.223 INFO:tasks.workunit.client.0.smithi049.stdout:9/334: mkdir d4/d7/d11/d1d/d69 0 2023-12-16T07:40:20.226 INFO:tasks.workunit.client.0.smithi049.stdout:3/336: mknod d1/d2a/d37/d63/c6e 0 2023-12-16T07:40:20.226 INFO:tasks.workunit.client.0.smithi049.stdout:3/337: readlink d1/d2b/l35 0 2023-12-16T07:40:20.228 INFO:tasks.workunit.client.0.smithi049.stdout:1/398: creat d20/d43/f8f x:0 0 0 2023-12-16T07:40:20.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/437: dwrite d0/d1f/d36/f45 [4194304,4194304] 0 2023-12-16T07:40:20.231 INFO:tasks.workunit.client.0.smithi049.stdout:8/438: stat d0/d1f/f40 0 2023-12-16T07:40:20.231 INFO:tasks.workunit.client.0.smithi049.stdout:8/439: dread - d0/d13/f66 zero size 2023-12-16T07:40:20.231 INFO:tasks.workunit.client.0.smithi049.stdout:9/335: link d4/l63 d4/d7/d11/d1d/d5b/l6a 0 2023-12-16T07:40:20.232 INFO:tasks.workunit.client.0.smithi049.stdout:6/459: dwrite d0/d2/df/f7a [0,4194304] 0 2023-12-16T07:40:20.233 INFO:tasks.workunit.client.0.smithi049.stdout:7/395: dwrite d7/dc/dd/d35/f41 [0,4194304] 0 2023-12-16T07:40:20.233 INFO:tasks.workunit.client.0.smithi049.stdout:0/539: dwrite d13/d21/d99/d46/fac [0,4194304] 0 2023-12-16T07:40:20.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/338: creat d1/d2a/d37/d3f/d5a/f6f x:0 0 0 2023-12-16T07:40:20.241 INFO:tasks.workunit.client.0.smithi049.stdout:1/399: mknod d20/d45/d77/c90 0 2023-12-16T07:40:20.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/440: getdents d0/d1f/d4e 0 2023-12-16T07:40:20.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/441: chown d0/d13 3503 1 2023-12-16T07:40:20.241 INFO:tasks.workunit.client.0.smithi049.stdout:9/336: stat d4/d45/c4d 0 2023-12-16T07:40:20.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/339: read d1/d2a/d37/d3f/f59 [287901,10644] 0 2023-12-16T07:40:20.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/392: dwrite d2/db/dd/d52/d62/f78 [0,4194304] 0 2023-12-16T07:40:20.245 INFO:tasks.workunit.client.0.smithi049.stdout:6/460: rename d0/d39/d5b/d65/d4c/d4d/f79 to d0/d39/d5b/d65/d27/f96 0 2023-12-16T07:40:20.259 INFO:tasks.workunit.client.0.smithi049.stdout:0/540: creat d13/fbb x:0 0 0 2023-12-16T07:40:20.259 INFO:tasks.workunit.client.0.smithi049.stdout:7/396: creat d7/d2b/f8b x:0 0 0 2023-12-16T07:40:20.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/442: mkdir d0/d13/d42/d5b/d68/d75/d89 0 2023-12-16T07:40:20.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/337: mknod d4/c6b 0 2023-12-16T07:40:20.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/338: dread - d4/d7/d11/d1d/f64 zero size 2023-12-16T07:40:20.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/339: truncate d4/d7/d11/d26/f68 521705 0 2023-12-16T07:40:20.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/340: chown d4/c18 15 1 2023-12-16T07:40:20.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/341: chown d4/d7/d11/f20 4442060 1 2023-12-16T07:40:20.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/342: stat d4/d7/d11/d1d/d5b/c5f 0 2023-12-16T07:40:20.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/343: dread - d4/d7/d11/d1d/f64 zero size 2023-12-16T07:40:20.264 INFO:tasks.workunit.client.0.smithi049.stdout:3/340: link d1/d2b/c69 d1/d2a/d37/d3f/d5a/d5b/d5e/c70 0 2023-12-16T07:40:20.266 INFO:tasks.workunit.client.0.smithi049.stdout:4/393: rmdir d2/db/dd/d52 39 2023-12-16T07:40:20.267 INFO:tasks.workunit.client.0.smithi049.stdout:1/400: dwrite f2 [4194304,4194304] 0 2023-12-16T07:40:20.267 INFO:tasks.workunit.client.0.smithi049.stdout:1/401: chown f1c 8152 1 2023-12-16T07:40:20.267 INFO:tasks.workunit.client.0.smithi049.stdout:4/394: write d2/f12 [3819745,6769] 0 2023-12-16T07:40:20.267 INFO:tasks.workunit.client.0.smithi049.stdout:0/541: creat d13/fbc x:0 0 0 2023-12-16T07:40:20.268 INFO:tasks.workunit.client.0.smithi049.stdout:6/461: dwrite d0/d2/f5 [0,4194304] 0 2023-12-16T07:40:20.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/397: rename d7/dc/dd/d14/f2a to d7/dc/dd/d27/f8c 0 2023-12-16T07:40:20.271 INFO:tasks.workunit.client.0.smithi049.stdout:9/344: mknod d4/d7/d11/d26/c6c 0 2023-12-16T07:40:20.271 INFO:tasks.workunit.client.0.smithi049.stdout:9/345: chown d4/db/f66 63733 1 2023-12-16T07:40:20.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/398: dread d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:20.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/402: creat d20/d7b/f91 x:0 0 0 2023-12-16T07:40:20.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/395: rename d2/db/dd/d2a/f20 to d2/db/dd/d52/d62/f7b 0 2023-12-16T07:40:20.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/396: write d2/db/dd/d52/f5e [91560,31663] 0 2023-12-16T07:40:20.278 INFO:tasks.workunit.client.0.smithi049.stdout:4/397: chown d2/db/dd/de/d1e/d44/l46 693973410 1 2023-12-16T07:40:20.278 INFO:tasks.workunit.client.0.smithi049.stdout:4/398: fsync d2/db/dd/d2a/f1c 0 2023-12-16T07:40:20.282 INFO:tasks.workunit.client.0.smithi049.stdout:3/341: symlink d1/l71 0 2023-12-16T07:40:20.283 INFO:tasks.workunit.client.0.smithi049.stdout:7/399: creat d7/dc/dd/d37/f8d x:0 0 0 2023-12-16T07:40:20.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/403: truncate d20/d41/d4f/f76 2056480 0 2023-12-16T07:40:20.287 INFO:tasks.workunit.client.0.smithi049.stdout:1/404: creat d20/d40/f92 x:0 0 0 2023-12-16T07:40:20.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/443: dread d0/d13/f3e [0,4194304] 0 2023-12-16T07:40:20.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/444: truncate d0/d1f/d56/f72 923772 0 2023-12-16T07:40:20.287 INFO:tasks.workunit.client.0.smithi049.stdout:2/397: sync 2023-12-16T07:40:20.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/400: read d7/dc/d2f/d40/f74 [1136395,65562] 0 2023-12-16T07:40:20.288 INFO:tasks.workunit.client.0.smithi049.stdout:8/445: creat d0/d13/d42/d5b/f8a x:0 0 0 2023-12-16T07:40:20.289 INFO:tasks.workunit.client.0.smithi049.stdout:2/398: creat d2/d1d/f89 x:0 0 0 2023-12-16T07:40:20.289 INFO:tasks.workunit.client.0.smithi049.stdout:2/399: write d2/d1d/d24/f42 [1059379,119305] 0 2023-12-16T07:40:20.290 INFO:tasks.workunit.client.0.smithi049.stdout:8/446: truncate d0/f19 611153 0 2023-12-16T07:40:20.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/342: dread d1/d2a/f47 [0,4194304] 0 2023-12-16T07:40:20.294 INFO:tasks.workunit.client.0.smithi049.stdout:2/400: mknod d2/d1d/d28/d56/d11/c8a 0 2023-12-16T07:40:20.298 INFO:tasks.workunit.client.0.smithi049.stdout:8/447: creat d0/d1f/d4e/f8b x:0 0 0 2023-12-16T07:40:20.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/542: dwrite d13/d21/d99/fa3 [0,4194304] 0 2023-12-16T07:40:20.298 INFO:tasks.workunit.client.0.smithi049.stdout:8/448: write d0/d1f/d1c/f39 [5879071,18322] 0 2023-12-16T07:40:20.298 INFO:tasks.workunit.client.0.smithi049.stdout:3/343: creat d1/d2a/d37/d3f/d5a/d61/d6b/f72 x:0 0 0 2023-12-16T07:40:20.300 INFO:tasks.workunit.client.0.smithi049.stdout:2/401: mkdir d2/d1d/d28/d8b 0 2023-12-16T07:40:20.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/346: dwrite d4/db/f66 [4194304,4194304] 0 2023-12-16T07:40:20.301 INFO:tasks.workunit.client.0.smithi049.stdout:7/401: write d7/dc/f61 [18734,24812] 0 2023-12-16T07:40:20.302 INFO:tasks.workunit.client.0.smithi049.stdout:4/399: dwrite d2/db/dd/de/d1e/d21/f39 [0,4194304] 0 2023-12-16T07:40:20.312 INFO:tasks.workunit.client.0.smithi049.stdout:3/344: truncate d1/f2c 1999349 0 2023-12-16T07:40:20.312 INFO:tasks.workunit.client.0.smithi049.stdout:2/402: creat d2/d26/d43/f8c x:0 0 0 2023-12-16T07:40:20.312 INFO:tasks.workunit.client.0.smithi049.stdout:0/543: creat d13/d21/d27/d2c/d62/daa/fbd x:0 0 0 2023-12-16T07:40:20.313 INFO:tasks.workunit.client.0.smithi049.stdout:1/405: dwrite d20/d7b/f91 [0,4194304] 0 2023-12-16T07:40:20.315 INFO:tasks.workunit.client.0.smithi049.stdout:2/403: dread d2/ff [0,4194304] 0 2023-12-16T07:40:20.322 INFO:tasks.workunit.client.0.smithi049.stdout:3/345: creat d1/d2a/d37/d3f/d4c/f73 x:0 0 0 2023-12-16T07:40:20.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/347: unlink d4/l3a 0 2023-12-16T07:40:20.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/348: chown d4/d7/d11/d26/d47/f4f 359224588 1 2023-12-16T07:40:20.323 INFO:tasks.workunit.client.0.smithi049.stdout:0/544: mkdir d13/d39/dbe 0 2023-12-16T07:40:20.324 INFO:tasks.workunit.client.0.smithi049.stdout:8/449: dwrite d0/f28 [4194304,4194304] 0 2023-12-16T07:40:20.326 INFO:tasks.workunit.client.0.smithi049.stdout:1/406: mkdir d20/d41/d4f/d55/d82/d93 0 2023-12-16T07:40:20.330 INFO:tasks.workunit.client.0.smithi049.stdout:7/402: dwrite d7/fa [0,4194304] 0 2023-12-16T07:40:20.331 INFO:tasks.workunit.client.0.smithi049.stdout:0/545: mkdir d13/d39/dbe/dbf 0 2023-12-16T07:40:20.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/349: getdents d4/d7/d11/d26 0 2023-12-16T07:40:20.333 INFO:tasks.workunit.client.0.smithi049.stdout:8/450: symlink d0/d1f/d4e/l8c 0 2023-12-16T07:40:20.335 INFO:tasks.workunit.client.0.smithi049.stdout:7/403: mkdir d7/dc/dd/d27/d8e 0 2023-12-16T07:40:20.335 INFO:tasks.workunit.client.0.smithi049.stdout:7/404: write d7/dc/d2f/d40/f4b [429248,70929] 0 2023-12-16T07:40:20.335 INFO:tasks.workunit.client.0.smithi049.stdout:8/451: creat d0/d13/d42/d5b/f8d x:0 0 0 2023-12-16T07:40:20.335 INFO:tasks.workunit.client.0.smithi049.stdout:8/452: chown d0/d1f/d1c/f52 185 1 2023-12-16T07:40:20.336 INFO:tasks.workunit.client.0.smithi049.stdout:8/453: write d0/d1f/f82 [317574,71694] 0 2023-12-16T07:40:20.336 INFO:tasks.workunit.client.0.smithi049.stdout:4/400: dwrite d2/db/dd/d52/f59 [4194304,4194304] 0 2023-12-16T07:40:20.337 INFO:tasks.workunit.client.0.smithi049.stdout:0/546: creat d13/d21/d99/d46/d65/d82/fc0 x:0 0 0 2023-12-16T07:40:20.339 INFO:tasks.workunit.client.0.smithi049.stdout:8/454: creat d0/d13/d42/d5b/d68/f8e x:0 0 0 2023-12-16T07:40:20.342 INFO:tasks.workunit.client.0.smithi049.stdout:9/350: dread d4/db/f41 [0,4194304] 0 2023-12-16T07:40:20.344 INFO:tasks.workunit.client.0.smithi049.stdout:0/547: mknod d13/d39/d78/d83/db2/cc1 0 2023-12-16T07:40:20.344 INFO:tasks.workunit.client.0.smithi049.stdout:0/548: truncate d13/d21/d27/d2c/d62/f94 951310 0 2023-12-16T07:40:20.344 INFO:tasks.workunit.client.0.smithi049.stdout:0/549: dread - d13/d21/d99/d46/d65/d82/fc0 zero size 2023-12-16T07:40:20.345 INFO:tasks.workunit.client.0.smithi049.stdout:8/455: truncate d0/d1f/d36/f54 1580913 0 2023-12-16T07:40:20.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/407: dread d20/d41/f4b [0,4194304] 0 2023-12-16T07:40:20.346 INFO:tasks.workunit.client.0.smithi049.stdout:4/401: symlink d2/db/dd/de/l7c 0 2023-12-16T07:40:20.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/404: dwrite d2/d1d/d38/f4b [0,4194304] 0 2023-12-16T07:40:20.347 INFO:tasks.workunit.client.0.smithi049.stdout:4/402: read d2/db/dd/de/d1e/d37/d4e/f5a [653996,53930] 0 2023-12-16T07:40:20.349 INFO:tasks.workunit.client.0.smithi049.stdout:1/408: write fe [8717839,91433] 0 2023-12-16T07:40:20.349 INFO:tasks.workunit.client.0.smithi049.stdout:1/409: write d20/f22 [4616763,63582] 0 2023-12-16T07:40:20.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/410: dread - d20/d41/d4f/d55/d7f/f80 zero size 2023-12-16T07:40:20.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/411: stat f1c 0 2023-12-16T07:40:20.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/412: write d20/d40/f5f [979454,10069] 0 2023-12-16T07:40:20.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/413: dread - d20/d40/f81 zero size 2023-12-16T07:40:20.353 INFO:tasks.workunit.client.0.smithi049.stdout:9/351: creat d4/d7/d11/d26/d47/d59/f6d x:0 0 0 2023-12-16T07:40:20.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/346: dwrite d1/d2a/f40 [0,4194304] 0 2023-12-16T07:40:20.362 INFO:tasks.workunit.client.0.smithi049.stdout:1/414: link d20/d45/d47/f56 d20/d7b/d71/f94 0 2023-12-16T07:40:20.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/352: link d4/d7/d11/d1d/f25 d4/d3e/f6e 0 2023-12-16T07:40:20.366 INFO:tasks.workunit.client.0.smithi049.stdout:7/405: dwrite f4 [0,4194304] 0 2023-12-16T07:40:20.367 INFO:tasks.workunit.client.0.smithi049.stdout:1/415: rmdir d20/d41/d4f/d55/d82/d93 0 2023-12-16T07:40:20.367 INFO:tasks.workunit.client.0.smithi049.stdout:1/416: chown d20/d41/d4f/l6b 1017378071 1 2023-12-16T07:40:20.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/353: rename d4/d7/l1a to d4/d45/l6f 0 2023-12-16T07:40:20.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/354: write d4/db/f39 [2408316,123076] 0 2023-12-16T07:40:20.369 INFO:tasks.workunit.client.0.smithi049.stdout:9/355: getdents d4/d7/d11/d56 0 2023-12-16T07:40:20.369 INFO:tasks.workunit.client.0.smithi049.stdout:7/406: read d7/dc/dd/d35/f41 [2578504,16436] 0 2023-12-16T07:40:20.371 INFO:tasks.workunit.client.0.smithi049.stdout:8/456: rmdir d0/d1f 39 2023-12-16T07:40:20.373 INFO:tasks.workunit.client.0.smithi049.stdout:1/417: write d20/f3e [546820,52292] 0 2023-12-16T07:40:20.373 INFO:tasks.workunit.client.0.smithi049.stdout:1/418: read - d20/f62 zero size 2023-12-16T07:40:20.376 INFO:tasks.workunit.client.0.smithi049.stdout:1/419: link d20/d45/c6a d20/c95 0 2023-12-16T07:40:20.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/403: dwrite d2/db/dd/de/d1e/d21/f25 [4194304,4194304] 0 2023-12-16T07:40:20.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/404: truncate d2/db/dd/d2a/f43 1746827 0 2023-12-16T07:40:20.378 INFO:tasks.workunit.client.0.smithi049.stdout:1/420: symlink d20/d41/d4f/d7c/l96 0 2023-12-16T07:40:20.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/405: dwrite d2/d26/f59 [0,4194304] 0 2023-12-16T07:40:20.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/406: stat d2/d26/d43/l84 0 2023-12-16T07:40:20.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/347: dwrite d1/d2a/f68 [0,4194304] 0 2023-12-16T07:40:20.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/348: fsync d1/d2b/f65 0 2023-12-16T07:40:20.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/349: read - d1/d2a/d37/d3f/f41 zero size 2023-12-16T07:40:20.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/421: dread d20/d40/f5f [0,4194304] 0 2023-12-16T07:40:20.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/422: readlink d20/d41/d4f/d55/l7a 0 2023-12-16T07:40:20.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/405: creat d2/db/dd/de/f7d x:0 0 0 2023-12-16T07:40:20.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/406: chown d2/db/dd/d52/d62/f7b 3156 1 2023-12-16T07:40:20.385 INFO:tasks.workunit.client.0.smithi049.stdout:3/350: dread d1/f25 [0,4194304] 0 2023-12-16T07:40:20.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/407: truncate d2/d1d/d28/d56/d66/d6b/f79 3357359 0 2023-12-16T07:40:20.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/408: mknod d2/d1d/d28/d56/d66/c8d 0 2023-12-16T07:40:20.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/409: creat d2/d1d/f8e x:0 0 0 2023-12-16T07:40:20.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/410: creat d2/d26/d6e/f8f x:0 0 0 2023-12-16T07:40:20.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/411: write d2/de/f86 [8733,59565] 0 2023-12-16T07:40:20.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/412: creat d2/de/d77/f90 x:0 0 0 2023-12-16T07:40:20.397 INFO:tasks.workunit.client.0.smithi049.stdout:2/413: symlink d2/d1d/d28/d56/d11/l91 0 2023-12-16T07:40:20.397 INFO:tasks.workunit.client.0.smithi049.stdout:2/414: stat d2/de/f46 0 2023-12-16T07:40:20.399 INFO:tasks.workunit.client.0.smithi049.stdout:4/407: dread d2/db/f15 [0,4194304] 0 2023-12-16T07:40:20.400 INFO:tasks.workunit.client.0.smithi049.stdout:4/408: truncate d2/db/dd/d52/f6a 3395742 0 2023-12-16T07:40:20.401 INFO:tasks.workunit.client.0.smithi049.stdout:4/409: dread d2/db/dd/de/d1e/d37/f3c [0,4194304] 0 2023-12-16T07:40:20.402 INFO:tasks.workunit.client.0.smithi049.stdout:4/410: creat d2/db/d6b/f7e x:0 0 0 2023-12-16T07:40:20.403 INFO:tasks.workunit.client.0.smithi049.stdout:4/411: mknod d2/db/dd/de/d1e/d37/d6f/c7f 0 2023-12-16T07:40:20.404 INFO:tasks.workunit.client.0.smithi049.stdout:4/412: symlink d2/db/dd/de/d1e/d37/d4e/l80 0 2023-12-16T07:40:20.405 INFO:tasks.workunit.client.0.smithi049.stdout:7/407: dwrite d7/dc/dd/d27/f8c [0,4194304] 0 2023-12-16T07:40:20.405 INFO:tasks.workunit.client.0.smithi049.stdout:7/408: read f5 [2898927,120284] 0 2023-12-16T07:40:20.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/457: dwrite d0/f6e [0,4194304] 0 2023-12-16T07:40:20.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/458: stat d0/d13/d42/d5b/d68/f8e 0 2023-12-16T07:40:20.408 INFO:tasks.workunit.client.0.smithi049.stdout:7/409: rename d7/dc/dd/d35/d36/f3f to d7/dc/d2f/d38/f8f 0 2023-12-16T07:40:20.408 INFO:tasks.workunit.client.0.smithi049.stdout:3/351: dwrite d1/d2a/d37/d3f/f41 [0,4194304] 0 2023-12-16T07:40:20.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/352: chown d1 9 1 2023-12-16T07:40:20.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/353: fdatasync d1/d2b/f4f 0 2023-12-16T07:40:20.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/354: write d1/d2a/f68 [4377347,15204] 0 2023-12-16T07:40:20.409 INFO:tasks.workunit.client.0.smithi049.stdout:7/410: read d7/dc/f61 [1943471,125855] 0 2023-12-16T07:40:20.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/459: creat d0/d13/d42/d5b/d68/f8f x:0 0 0 2023-12-16T07:40:20.417 INFO:tasks.workunit.client.0.smithi049.stdout:3/355: creat d1/d2a/f74 x:0 0 0 2023-12-16T07:40:20.419 INFO:tasks.workunit.client.0.smithi049.stdout:8/460: mknod d0/d13/d42/d5b/d68/c90 0 2023-12-16T07:40:20.419 INFO:tasks.workunit.client.0.smithi049.stdout:8/461: chown d0/d6a 1 1 2023-12-16T07:40:20.419 INFO:tasks.workunit.client.0.smithi049.stdout:8/462: truncate d0/d1f/f7e 127888 0 2023-12-16T07:40:20.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/356: mkdir d1/d2a/d37/d3f/d5a/d61/d75 0 2023-12-16T07:40:20.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/463: link d0/l51 d0/d1f/l91 0 2023-12-16T07:40:20.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/464: write d0/d13/d42/d5b/f61 [158627,42869] 0 2023-12-16T07:40:20.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/357: mkdir d1/d2a/d37/d63/d76 0 2023-12-16T07:40:20.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/358: stat d1/d2a/d37/d3f/c43 0 2023-12-16T07:40:20.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/359: write d1/d2a/d37/d3f/d5a/d5b/d5e/f5f [785419,80427] 0 2023-12-16T07:40:20.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/465: mknod d0/d13/d42/d5b/c92 0 2023-12-16T07:40:20.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/466: creat d0/d1f/d56/f93 x:0 0 0 2023-12-16T07:40:20.435 INFO:tasks.workunit.client.0.smithi049.stdout:8/467: dread d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:20.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/468: readlink d0/d1f/l35 0 2023-12-16T07:40:20.437 INFO:tasks.workunit.client.0.smithi049.stdout:8/469: write d0/f3d [1765982,30591] 0 2023-12-16T07:40:20.438 INFO:tasks.workunit.client.0.smithi049.stdout:4/413: dwrite d2/db/dd/d2a/f43 [0,4194304] 0 2023-12-16T07:40:20.438 INFO:tasks.workunit.client.0.smithi049.stdout:4/414: fsync d2/db/dd/de/d1e/d21/f39 0 2023-12-16T07:40:20.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/470: creat d0/d13/d42/d5b/d68/d75/d89/f94 x:0 0 0 2023-12-16T07:40:20.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/415: dread d2/db/dd/de/d1e/d37/f3c [0,4194304] 0 2023-12-16T07:40:20.440 INFO:tasks.workunit.client.0.smithi049.stdout:4/416: dread d2/db/dd/d52/f5e [0,4194304] 0 2023-12-16T07:40:20.442 INFO:tasks.workunit.client.0.smithi049.stdout:4/417: unlink d2/db/dd/d52/f5e 0 2023-12-16T07:40:20.443 INFO:tasks.workunit.client.0.smithi049.stdout:8/471: dread d0/d1f/d56/f74 [0,4194304] 0 2023-12-16T07:40:20.444 INFO:tasks.workunit.client.0.smithi049.stdout:4/418: mknod d2/db/dd/de/d1e/d37/d6f/c81 0 2023-12-16T07:40:20.444 INFO:tasks.workunit.client.0.smithi049.stdout:4/419: chown d2/db/dd/de/d1e/d37/f5c 491391 1 2023-12-16T07:40:20.444 INFO:tasks.workunit.client.0.smithi049.stdout:4/420: stat d2/db/dd/de/d1e 0 2023-12-16T07:40:20.445 INFO:tasks.workunit.client.0.smithi049.stdout:7/411: dwrite d7/dc/f61 [0,4194304] 0 2023-12-16T07:40:20.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/360: dread d1/f16 [0,4194304] 0 2023-12-16T07:40:20.448 INFO:tasks.workunit.client.0.smithi049.stdout:8/472: unlink d0/d1f/d36/c86 0 2023-12-16T07:40:20.449 INFO:tasks.workunit.client.0.smithi049.stdout:4/421: rmdir d2/db/dd/de/d1e/d37/d4e 39 2023-12-16T07:40:20.453 INFO:tasks.workunit.client.0.smithi049.stdout:3/361: readlink d1/l11 0 2023-12-16T07:40:20.455 INFO:tasks.workunit.client.0.smithi049.stdout:7/412: rename d7/dc/dd/f6d to d7/dc/dd/d27/d8e/f90 0 2023-12-16T07:40:20.455 INFO:tasks.workunit.client.0.smithi049.stdout:7/413: dread - d7/dc/d15/d66/f85 zero size 2023-12-16T07:40:20.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/414: fsync d7/dc/d2f/d40/d5d/f78 0 2023-12-16T07:40:20.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/415: dread - d7/dc/d2f/d40/d5d/f78 zero size 2023-12-16T07:40:20.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/416: dread - d7/dc/d15/d57/f80 zero size 2023-12-16T07:40:20.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/473: symlink d0/l95 0 2023-12-16T07:40:20.458 INFO:tasks.workunit.client.0.smithi049.stdout:3/362: truncate d1/d2a/f68 2451673 0 2023-12-16T07:40:20.458 INFO:tasks.workunit.client.0.smithi049.stdout:3/363: chown d1/d2a/d37/d3f/d5a/d61/f66 21 1 2023-12-16T07:40:20.460 INFO:tasks.workunit.client.0.smithi049.stdout:3/364: mkdir d1/d2a/d37/d3f/d5a/d5b/d77 0 2023-12-16T07:40:20.460 INFO:tasks.workunit.client.0.smithi049.stdout:3/365: fsync d1/d2a/d37/d3f/f59 0 2023-12-16T07:40:20.463 INFO:tasks.workunit.client.0.smithi049.stdout:4/422: dwrite d2/f61 [0,4194304] 0 2023-12-16T07:40:20.463 INFO:tasks.workunit.client.0.smithi049.stdout:4/423: fdatasync d2/db/dd/de/d1e/d37/d4e/f5f 0 2023-12-16T07:40:20.464 INFO:tasks.workunit.client.0.smithi049.stdout:5/390: sync 2023-12-16T07:40:20.464 INFO:tasks.workunit.client.0.smithi049.stdout:6/462: sync 2023-12-16T07:40:20.466 INFO:tasks.workunit.client.0.smithi049.stdout:8/474: dread d0/f12 [0,4194304] 0 2023-12-16T07:40:20.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/424: unlink d2/db/dd/de/d1e/d44/c4c 0 2023-12-16T07:40:20.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/391: rename d5/de/d1c/c32 to d5/de/d54/d57/d2f/c87 0 2023-12-16T07:40:20.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/475: creat d0/d1f/d4e/f96 x:0 0 0 2023-12-16T07:40:20.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/476: stat d0/d1f/d56/f72 0 2023-12-16T07:40:20.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/477: write d0/f58 [699419,62562] 0 2023-12-16T07:40:20.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/425: mkdir d2/db/dd/de/d1e/d37/d82 0 2023-12-16T07:40:20.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/426: chown d2/db/dd/de/d1e/d21/f25 104540 1 2023-12-16T07:40:20.476 INFO:tasks.workunit.client.0.smithi049.stdout:8/478: link d0/d6a/c84 d0/d1f/c97 0 2023-12-16T07:40:20.477 INFO:tasks.workunit.client.0.smithi049.stdout:4/427: symlink d2/db/dd/d52/d62/l83 0 2023-12-16T07:40:20.480 INFO:tasks.workunit.client.0.smithi049.stdout:7/417: dwrite d7/d2b/d59/f7e [0,4194304] 0 2023-12-16T07:40:20.480 INFO:tasks.workunit.client.0.smithi049.stdout:8/479: dread d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:20.482 INFO:tasks.workunit.client.0.smithi049.stdout:7/418: dread d7/dc/d2f/d40/f4b [0,4194304] 0 2023-12-16T07:40:20.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/480: unlink d0/d1f/f17 0 2023-12-16T07:40:20.486 INFO:tasks.workunit.client.0.smithi049.stdout:8/481: unlink d0/d1f/d4e/l79 0 2023-12-16T07:40:20.490 INFO:tasks.workunit.client.0.smithi049.stdout:3/366: dwrite d1/d2b/f65 [0,4194304] 0 2023-12-16T07:40:20.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/463: dwrite d0/d39/d5b/d65/d58/f51 [0,4194304] 0 2023-12-16T07:40:20.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/464: chown d0/f40 440443091 1 2023-12-16T07:40:20.497 INFO:tasks.workunit.client.0.smithi049.stdout:5/392: dwrite d5/f13 [0,4194304] 0 2023-12-16T07:40:20.497 INFO:tasks.workunit.client.0.smithi049.stdout:4/428: dwrite d2/db/dd/d52/d62/f7b [0,4194304] 0 2023-12-16T07:40:20.502 INFO:tasks.workunit.client.0.smithi049.stdout:6/465: unlink d0/d2/f3e 0 2023-12-16T07:40:20.502 INFO:tasks.workunit.client.0.smithi049.stdout:5/393: creat d5/de/d1c/d62/f88 x:0 0 0 2023-12-16T07:40:20.503 INFO:tasks.workunit.client.0.smithi049.stdout:4/429: mknod d2/db/dd/d52/d62/c84 0 2023-12-16T07:40:20.503 INFO:tasks.workunit.client.0.smithi049.stdout:6/466: mknod d0/d39/d5b/d65/d53/c97 0 2023-12-16T07:40:20.503 INFO:tasks.workunit.client.0.smithi049.stdout:8/482: dwrite d0/d1f/f59 [0,4194304] 0 2023-12-16T07:40:20.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/430: creat d2/db/dd/de/d1e/d37/d6f/f85 x:0 0 0 2023-12-16T07:40:20.508 INFO:tasks.workunit.client.0.smithi049.stdout:6/467: unlink d0/d39/d5b/d65/d32/f72 0 2023-12-16T07:40:20.508 INFO:tasks.workunit.client.0.smithi049.stdout:6/468: chown d0/d39/d5b/d65/l21 75 1 2023-12-16T07:40:20.508 INFO:tasks.workunit.client.0.smithi049.stdout:3/367: dwrite d1/d2a/d37/d3f/d4c/f73 [0,4194304] 0 2023-12-16T07:40:20.511 INFO:tasks.workunit.client.0.smithi049.stdout:8/483: symlink d0/d13/d42/d5b/d68/d75/d89/l98 0 2023-12-16T07:40:20.512 INFO:tasks.workunit.client.0.smithi049.stdout:4/431: dread d2/ff [0,4194304] 0 2023-12-16T07:40:20.512 INFO:tasks.workunit.client.0.smithi049.stdout:4/432: write d2/db/dd/d2a/f5d [4044130,58661] 0 2023-12-16T07:40:20.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/433: chown d2/db/c1b 1060 1 2023-12-16T07:40:20.514 INFO:tasks.workunit.client.0.smithi049.stdout:6/469: dread d0/f30 [0,4194304] 0 2023-12-16T07:40:20.527 INFO:tasks.workunit.client.0.smithi049.stdout:3/368: dread d1/f2c [0,4194304] 0 2023-12-16T07:40:20.527 INFO:tasks.workunit.client.0.smithi049.stdout:3/369: getdents d1/d2a/d37/d3f/d5a/d6d 0 2023-12-16T07:40:20.528 INFO:tasks.workunit.client.0.smithi049.stdout:3/370: mknod d1/d2a/d37/d3f/d5a/c78 0 2023-12-16T07:40:20.529 INFO:tasks.workunit.client.0.smithi049.stdout:3/371: creat d1/d2a/d37/d3f/d4c/f79 x:0 0 0 2023-12-16T07:40:20.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/394: dwrite d5/de/d1c/f46 [4194304,4194304] 0 2023-12-16T07:40:20.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/395: stat d5/fb 0 2023-12-16T07:40:20.535 INFO:tasks.workunit.client.0.smithi049.stdout:8/484: dread d0/d13/f2f [0,4194304] 0 2023-12-16T07:40:20.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/396: mkdir d5/d1e/d21/d4e/d89 0 2023-12-16T07:40:20.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/397: readlink d5/d1e/d21/d58/l69 0 2023-12-16T07:40:20.536 INFO:tasks.workunit.client.0.smithi049.stdout:0/550: sync 2023-12-16T07:40:20.537 INFO:tasks.workunit.client.0.smithi049.stdout:8/485: rename d0/f58 to d0/d13/d42/d5b/d68/d6b/f99 0 2023-12-16T07:40:20.538 INFO:tasks.workunit.client.0.smithi049.stdout:0/551: mkdir d13/d39/d78/dc2 0 2023-12-16T07:40:20.538 INFO:tasks.workunit.client.0.smithi049.stdout:0/552: truncate d13/d21/f2a 2185433 0 2023-12-16T07:40:20.539 INFO:tasks.workunit.client.0.smithi049.stdout:3/372: dread d1/d2b/f65 [0,4194304] 0 2023-12-16T07:40:20.539 INFO:tasks.workunit.client.0.smithi049.stdout:6/470: dwrite d0/d2/f86 [0,4194304] 0 2023-12-16T07:40:20.539 INFO:tasks.workunit.client.0.smithi049.stdout:6/471: chown d0/f40 405 1 2023-12-16T07:40:20.540 INFO:tasks.workunit.client.0.smithi049.stdout:0/553: rename d13/f1b to d13/d39/dbe/fc3 0 2023-12-16T07:40:20.540 INFO:tasks.workunit.client.0.smithi049.stdout:8/486: dread d0/d1f/d56/f72 [0,4194304] 0 2023-12-16T07:40:20.541 INFO:tasks.workunit.client.0.smithi049.stdout:3/373: rename d1/d2a/d37/d3f/d5a/c78 to d1/d2a/d37/d3f/d5a/c7a 0 2023-12-16T07:40:20.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/487: dread d0/f41 [0,4194304] 0 2023-12-16T07:40:20.547 INFO:tasks.workunit.client.0.smithi049.stdout:6/472: truncate d0/f35 429841 0 2023-12-16T07:40:20.549 INFO:tasks.workunit.client.0.smithi049.stdout:0/554: creat d13/d21/d27/d2c/fc4 x:0 0 0 2023-12-16T07:40:20.549 INFO:tasks.workunit.client.0.smithi049.stdout:3/374: symlink d1/d2a/d37/d3f/d5a/d5b/d5e/l7b 0 2023-12-16T07:40:20.549 INFO:tasks.workunit.client.0.smithi049.stdout:3/375: fdatasync d1/d2a/d37/d3f/d5a/d61/f66 0 2023-12-16T07:40:20.550 INFO:tasks.workunit.client.0.smithi049.stdout:8/488: symlink d0/d1f/d36/l9a 0 2023-12-16T07:40:20.550 INFO:tasks.workunit.client.0.smithi049.stdout:3/376: creat d1/d2a/d37/d3f/d5a/d61/f7c x:0 0 0 2023-12-16T07:40:20.552 INFO:tasks.workunit.client.0.smithi049.stdout:8/489: rename d0/d13/c32 to d0/d13/d42/d5b/d68/c9b 0 2023-12-16T07:40:20.553 INFO:tasks.workunit.client.0.smithi049.stdout:6/473: write d0/d39/d5b/d65/f1d [1929730,106219] 0 2023-12-16T07:40:20.565 INFO:tasks.workunit.client.0.smithi049.stdout:5/398: dwrite d5/de/d1c/f46 [0,4194304] 0 2023-12-16T07:40:20.565 INFO:tasks.workunit.client.0.smithi049.stdout:3/377: dread d1/fc [0,4194304] 0 2023-12-16T07:40:20.565 INFO:tasks.workunit.client.0.smithi049.stdout:0/555: dwrite d13/f7c [0,4194304] 0 2023-12-16T07:40:20.566 INFO:tasks.workunit.client.0.smithi049.stdout:5/399: rename d5/de/d54/d57/d2f/l4c to d5/de/d54/d78/l8a 0 2023-12-16T07:40:20.567 INFO:tasks.workunit.client.0.smithi049.stdout:8/490: dread d0/d1f/f40 [0,4194304] 0 2023-12-16T07:40:20.567 INFO:tasks.workunit.client.0.smithi049.stdout:3/378: symlink d1/d2a/l7d 0 2023-12-16T07:40:20.567 INFO:tasks.workunit.client.0.smithi049.stdout:3/379: chown d1/d2a/d37/d3f/d4c/f73 3601 1 2023-12-16T07:40:20.569 INFO:tasks.workunit.client.0.smithi049.stdout:5/400: getdents d5/de/d54/d57/d3c 0 2023-12-16T07:40:20.569 INFO:tasks.workunit.client.0.smithi049.stdout:3/380: symlink d1/d2a/d37/d3f/d5a/d5b/l7e 0 2023-12-16T07:40:20.569 INFO:tasks.workunit.client.0.smithi049.stdout:8/491: write d0/d1f/f59 [4035022,26874] 0 2023-12-16T07:40:20.570 INFO:tasks.workunit.client.0.smithi049.stdout:3/381: write d1/f25 [3444342,92884] 0 2023-12-16T07:40:20.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/492: truncate d0/d13/fe 2719143 0 2023-12-16T07:40:20.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/493: dread - d0/d1f/d56/f93 zero size 2023-12-16T07:40:20.573 INFO:tasks.workunit.client.0.smithi049.stdout:8/494: write d0/d1f/d1c/f39 [416287,8455] 0 2023-12-16T07:40:20.573 INFO:tasks.workunit.client.0.smithi049.stdout:3/382: rmdir d1/d2a/d37/d3f/d5a/d5b/d5e 39 2023-12-16T07:40:20.573 INFO:tasks.workunit.client.0.smithi049.stdout:8/495: dread - d0/d13/d42/f7f zero size 2023-12-16T07:40:20.573 INFO:tasks.workunit.client.0.smithi049.stdout:8/496: chown d0/d1f/c44 2 1 2023-12-16T07:40:20.573 INFO:tasks.workunit.client.0.smithi049.stdout:8/497: truncate d0/f41 4022337 0 2023-12-16T07:40:20.573 INFO:tasks.workunit.client.0.smithi049.stdout:8/498: truncate d0/d1f/d56/f72 1965733 0 2023-12-16T07:40:20.574 INFO:tasks.workunit.client.0.smithi049.stdout:8/499: write d0/d1f/f82 [1182539,36896] 0 2023-12-16T07:40:20.575 INFO:tasks.workunit.client.0.smithi049.stdout:3/383: symlink d1/d2a/l7f 0 2023-12-16T07:40:20.578 INFO:tasks.workunit.client.0.smithi049.stdout:3/384: symlink d1/d2a/d37/d3f/d5a/l80 0 2023-12-16T07:40:20.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/385: rmdir d1/d2b 39 2023-12-16T07:40:20.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/386: truncate d1/f26 1058555 0 2023-12-16T07:40:20.587 INFO:tasks.workunit.client.0.smithi049.stdout:3/387: rename d1/l27 to d1/d2a/d37/d3f/d5a/d5b/d5e/l81 0 2023-12-16T07:40:20.588 INFO:tasks.workunit.client.0.smithi049.stdout:3/388: creat d1/d2a/d37/d3f/d5a/d6d/f82 x:0 0 0 2023-12-16T07:40:20.589 INFO:tasks.workunit.client.0.smithi049.stdout:3/389: read d1/d2b/f62 [24729,120437] 0 2023-12-16T07:40:20.589 INFO:tasks.workunit.client.0.smithi049.stdout:3/390: fsync d1/d2a/f3b 0 2023-12-16T07:40:20.591 INFO:tasks.workunit.client.0.smithi049.stdout:3/391: link d1/d2b/f65 d1/d2a/d37/d3f/d5a/d61/d75/f83 0 2023-12-16T07:40:20.591 INFO:tasks.workunit.client.0.smithi049.stdout:3/392: fdatasync d1/d2a/d37/d3f/f59 0 2023-12-16T07:40:20.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/556: dwrite d13/d21/f92 [0,4194304] 0 2023-12-16T07:40:20.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/557: chown d13/fa1 200 1 2023-12-16T07:40:20.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/558: dread - d13/fb5 zero size 2023-12-16T07:40:20.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/559: readlink d13/d21/d27/d2c/l31 0 2023-12-16T07:40:20.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/560: fsync d13/d3c/f4c 0 2023-12-16T07:40:20.596 INFO:tasks.workunit.client.0.smithi049.stdout:5/401: dwrite d5/f11 [0,4194304] 0 2023-12-16T07:40:20.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/561: read d13/f17 [1856402,8513] 0 2023-12-16T07:40:20.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/393: dread d1/d2a/d37/d3f/d5a/d5b/d5e/f5f [0,4194304] 0 2023-12-16T07:40:20.600 INFO:tasks.workunit.client.0.smithi049.stdout:5/402: symlink d5/de/l8b 0 2023-12-16T07:40:20.602 INFO:tasks.workunit.client.0.smithi049.stdout:5/403: unlink d5/de/d54/d57/d2f/f49 0 2023-12-16T07:40:20.602 INFO:tasks.workunit.client.0.smithi049.stdout:5/404: readlink d5/l17 0 2023-12-16T07:40:20.602 INFO:tasks.workunit.client.0.smithi049.stdout:5/405: stat d5/d1e/f51 0 2023-12-16T07:40:20.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/406: symlink d5/d1e/d21/d5a/l8c 0 2023-12-16T07:40:20.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/415: sync 2023-12-16T07:40:20.607 INFO:tasks.workunit.client.0.smithi049.stdout:9/356: sync 2023-12-16T07:40:20.607 INFO:tasks.workunit.client.0.smithi049.stdout:1/423: sync 2023-12-16T07:40:20.607 INFO:tasks.workunit.client.0.smithi049.stdout:2/416: fdatasync d2/d1d/f6d 0 2023-12-16T07:40:20.607 INFO:tasks.workunit.client.0.smithi049.stdout:1/424: fsync d20/d41/d4f/f51 0 2023-12-16T07:40:20.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/357: creat d4/d7/d11/d26/d47/d59/f70 x:0 0 0 2023-12-16T07:40:20.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/358: dread d4/db/f31 [0,4194304] 0 2023-12-16T07:40:20.619 INFO:tasks.workunit.client.0.smithi049.stdout:5/407: dwrite d5/de/d54/d67/f7b [0,4194304] 0 2023-12-16T07:40:20.620 INFO:tasks.workunit.client.0.smithi049.stdout:5/408: write d5/de/d54/d67/f7e [377726,61925] 0 2023-12-16T07:40:20.620 INFO:tasks.workunit.client.0.smithi049.stdout:2/417: dread d2/d1d/d28/f52 [0,4194304] 0 2023-12-16T07:40:20.620 INFO:tasks.workunit.client.0.smithi049.stdout:2/418: chown d2/d1d/d24/d55 3869192 1 2023-12-16T07:40:20.620 INFO:tasks.workunit.client.0.smithi049.stdout:2/419: chown d2/de/c44 21649 1 2023-12-16T07:40:20.620 INFO:tasks.workunit.client.0.smithi049.stdout:2/420: write d2/d1d/d28/d56/d66/f7e [667908,91093] 0 2023-12-16T07:40:20.621 INFO:tasks.workunit.client.0.smithi049.stdout:5/409: stat d5/d1e/d21/d58/c77 0 2023-12-16T07:40:20.622 INFO:tasks.workunit.client.0.smithi049.stdout:2/421: mkdir d2/d1d/d92 0 2023-12-16T07:40:20.623 INFO:tasks.workunit.client.0.smithi049.stdout:5/410: mknod d5/c8d 0 2023-12-16T07:40:20.623 INFO:tasks.workunit.client.0.smithi049.stdout:2/422: mkdir d2/de/d93 0 2023-12-16T07:40:20.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/411: getdents d5/de/d54 0 2023-12-16T07:40:20.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/412: chown d5/de 7 1 2023-12-16T07:40:20.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/413: readlink d5/de/l5f 0 2023-12-16T07:40:20.635 INFO:tasks.workunit.client.0.smithi049.stdout:9/359: dwrite d4/d7/d11/d26/f37 [4194304,4194304] 0 2023-12-16T07:40:20.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/360: symlink d4/d7/d11/d56/l71 0 2023-12-16T07:40:20.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/361: write d4/d7/d11/f67 [537424,34886] 0 2023-12-16T07:40:20.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/362: readlink d4/d7/d11/l43 0 2023-12-16T07:40:20.653 INFO:tasks.workunit.client.0.smithi049.stdout:2/423: dwrite d2/d26/f69 [0,4194304] 0 2023-12-16T07:40:20.653 INFO:tasks.workunit.client.0.smithi049.stdout:5/414: dwrite d5/de/d1c/d62/f6c [0,4194304] 0 2023-12-16T07:40:20.661 INFO:tasks.workunit.client.0.smithi049.stdout:5/415: rename d5/c37 to d5/d1e/d21/d58/c8e 0 2023-12-16T07:40:20.663 INFO:tasks.workunit.client.0.smithi049.stdout:5/416: link d5/de/d54/f42 d5/f8f 0 2023-12-16T07:40:20.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/424: dwrite d2/f22 [4194304,4194304] 0 2023-12-16T07:40:20.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/425: write d2/d1d/d28/d56/d11/d1c/f63 [474341,10035] 0 2023-12-16T07:40:20.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/426: dread - d2/d1d/f89 zero size 2023-12-16T07:40:20.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/427: fdatasync d2/f36 0 2023-12-16T07:40:20.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/428: fsync d2/d1d/d28/d56/fb 0 2023-12-16T07:40:20.678 INFO:tasks.workunit.client.0.smithi049.stdout:2/429: creat d2/d1d/d28/d56/d66/d6b/f94 x:0 0 0 2023-12-16T07:40:20.679 INFO:tasks.workunit.client.0.smithi049.stdout:2/430: truncate d2/d1d/d24/d55/f5a 3613645 0 2023-12-16T07:40:20.679 INFO:tasks.workunit.client.0.smithi049.stdout:2/431: fsync d2/d26/d6e/f7b 0 2023-12-16T07:40:20.680 INFO:tasks.workunit.client.0.smithi049.stdout:2/432: creat d2/d1d/d28/d56/d11/f95 x:0 0 0 2023-12-16T07:40:20.681 INFO:tasks.workunit.client.0.smithi049.stdout:2/433: rmdir d2/d1d/d28 39 2023-12-16T07:40:20.681 INFO:tasks.workunit.client.0.smithi049.stdout:2/434: chown d2/de/c4f 736117 1 2023-12-16T07:40:20.681 INFO:tasks.workunit.client.0.smithi049.stdout:2/435: chown d2/d1d/d24/d55/d7c 86 1 2023-12-16T07:40:20.681 INFO:tasks.workunit.client.0.smithi049.stdout:2/436: readlink d2/d1d/d28/d56/d11/d1c/l3a 0 2023-12-16T07:40:20.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/417: dwrite d5/d1e/d21/d58/f79 [0,4194304] 0 2023-12-16T07:40:20.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/418: chown d5/de/d54/d78/l8a 520 1 2023-12-16T07:40:20.683 INFO:tasks.workunit.client.0.smithi049.stdout:2/437: rename d2/d1d/d24/l57 to d2/d26/d43/l96 0 2023-12-16T07:40:20.687 INFO:tasks.workunit.client.0.smithi049.stdout:5/419: symlink d5/d1e/d21/d4e/l90 0 2023-12-16T07:40:20.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/438: rename d2/de/c15 to d2/d1d/d24/d55/d76/c97 0 2023-12-16T07:40:20.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/439: fdatasync d2/d1d/d28/d56/d66/d6b/f94 0 2023-12-16T07:40:20.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/419: sync 2023-12-16T07:40:20.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/420: dread d5/de/d1c/d62/f6c [0,4194304] 0 2023-12-16T07:40:20.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:20 smithi049 ceph-mon[111939]: Standby manager daemon smithi049.rqlvwo started 2023-12-16T07:40:20.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:20 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/crt"}]: dispatch 2023-12-16T07:40:20.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:20 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:40:20.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:20 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/key"}]: dispatch 2023-12-16T07:40:20.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:20 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:40:20.718 INFO:tasks.workunit.client.0.smithi049.stdout:2/440: dwrite d2/d1d/f8e [0,4194304] 0 2023-12-16T07:40:20.718 INFO:tasks.workunit.client.0.smithi049.stdout:7/420: dwrite d7/dc/d2f/f60 [4194304,4194304] 0 2023-12-16T07:40:20.718 INFO:tasks.workunit.client.0.smithi049.stdout:5/421: dwrite d5/de/d54/d5c/f74 [0,4194304] 0 2023-12-16T07:40:20.720 INFO:tasks.workunit.client.0.smithi049.stdout:2/441: mkdir d2/d1d/d24/d55/d7c/d98 0 2023-12-16T07:40:20.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/421: mknod d7/dc/dd/d35/c91 0 2023-12-16T07:40:20.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/422: write d7/dc/d6b/d70/d86/f88 [551616,17616] 0 2023-12-16T07:40:20.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/423: readlink d7/l24 0 2023-12-16T07:40:20.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/422: link d5/d1e/l47 d5/de/d54/d57/d3c/l91 0 2023-12-16T07:40:20.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/423: truncate d5/de/d54/f42 558923 0 2023-12-16T07:40:20.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/424: truncate d5/de/d1c/d62/f88 935083 0 2023-12-16T07:40:20.726 INFO:tasks.workunit.client.0.smithi049.stdout:7/424: mknod d7/dc/d15/d57/c92 0 2023-12-16T07:40:20.727 INFO:tasks.workunit.client.0.smithi049.stdout:7/425: write d7/dc/d2f/d38/f83 [1667476,99940] 0 2023-12-16T07:40:20.727 INFO:tasks.workunit.client.0.smithi049.stdout:5/425: unlink d5/de/l5f 0 2023-12-16T07:40:20.728 INFO:tasks.workunit.client.0.smithi049.stdout:5/426: truncate d5/de/d1c/f25 6516439 0 2023-12-16T07:40:20.730 INFO:tasks.workunit.client.0.smithi049.stdout:5/427: creat d5/de/d54/d57/d3c/f92 x:0 0 0 2023-12-16T07:40:20.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/428: rename d5/de/d54/d5c/l66 to d5/d1e/d21/d4e/l93 0 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:8/500: sync 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/434: sync 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:6/474: sync 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/435: readlink d2/db/l2e 0 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/436: chown d2/db/dd/de/d1e/f34 30304 1 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/437: dread - d2/db/dd/de/f58 zero size 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/438: dread - d2/db/dd/de/f7d zero size 2023-12-16T07:40:20.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/439: readlink d2/l73 0 2023-12-16T07:40:20.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/429: write d5/de/d1c/f46 [1273961,131019] 0 2023-12-16T07:40:20.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/430: truncate d5/de/d54/d57/d3c/f92 406702 0 2023-12-16T07:40:20.735 INFO:tasks.workunit.client.0.smithi049.stdout:4/440: creat d2/f86 x:0 0 0 2023-12-16T07:40:20.736 INFO:tasks.workunit.client.0.smithi049.stdout:5/431: rmdir d5/d1e/d20 39 2023-12-16T07:40:20.739 INFO:tasks.workunit.client.0.smithi049.stdout:5/432: rename d5/de/c41 to d5/de/d1c/d62/c94 0 2023-12-16T07:40:20.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/433: mkdir d5/d1e/d20/d95 0 2023-12-16T07:40:20.742 INFO:tasks.workunit.client.0.smithi049.stdout:2/442: dwrite d2/de/f46 [0,4194304] 0 2023-12-16T07:40:20.743 INFO:tasks.workunit.client.0.smithi049.stdout:7/426: dread d7/dc/d2f/d40/f74 [0,4194304] 0 2023-12-16T07:40:20.743 INFO:tasks.workunit.client.0.smithi049.stdout:7/427: chown d7/l45 1040235 1 2023-12-16T07:40:20.743 INFO:tasks.workunit.client.0.smithi049.stdout:7/428: write d7/dc/d6b/d70/d86/f88 [1309024,75636] 0 2023-12-16T07:40:20.744 INFO:tasks.workunit.client.0.smithi049.stdout:2/443: dread d2/de/f86 [0,4194304] 0 2023-12-16T07:40:20.745 INFO:tasks.workunit.client.0.smithi049.stdout:5/434: rename d5/c7d to d5/de/d54/d78/c96 0 2023-12-16T07:40:20.748 INFO:tasks.workunit.client.0.smithi049.stdout:7/429: read d7/dc/dd/d35/d36/f5f [340035,5608] 0 2023-12-16T07:40:20.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/430: dread d7/dc/f25 [0,4194304] 0 2023-12-16T07:40:20.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/431: dread - d7/dc/d15/d57/f80 zero size 2023-12-16T07:40:20.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/432: dread d7/dc/dd/d14/f52 [0,4194304] 0 2023-12-16T07:40:20.758 INFO:tasks.workunit.client.0.smithi049.stdout:7/433: rename d7/dc/f17 to d7/dc/dd/f93 0 2023-12-16T07:40:20.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/434: link d7/dc/d2f/d38/f8f d7/dc/dd/d35/f94 0 2023-12-16T07:40:20.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/435: write d7/dc/f61 [2661915,126508] 0 2023-12-16T07:40:20.767 INFO:tasks.workunit.client.0.smithi049.stdout:8/501: dwrite d0/f6e [4194304,4194304] 0 2023-12-16T07:40:20.767 INFO:tasks.workunit.client.0.smithi049.stdout:4/441: dwrite d2/f9 [8388608,4194304] 0 2023-12-16T07:40:20.767 INFO:tasks.workunit.client.0.smithi049.stdout:6/475: dwrite d0/f40 [0,4194304] 0 2023-12-16T07:40:20.767 INFO:tasks.workunit.client.0.smithi049.stdout:6/476: write d0/d2/f7d [297723,88446] 0 2023-12-16T07:40:20.767 INFO:tasks.workunit.client.0.smithi049.stdout:6/477: stat d0/d39/d5b/d65/d53 0 2023-12-16T07:40:20.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/436: write d7/dc/dd/d35/f41 [1042331,35791] 0 2023-12-16T07:40:20.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/437: fdatasync d7/dc/d15/d57/f80 0 2023-12-16T07:40:20.770 INFO:tasks.workunit.client.0.smithi049.stdout:8/502: rename d0/d13/d42/d5b/d68/d6b/f99 to d0/d13/d42/d5b/d68/d75/d89/f9c 0 2023-12-16T07:40:20.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/442: mknod d2/db/d6b/c87 0 2023-12-16T07:40:20.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/443: write d2/db/dd/fa [4868157,49200] 0 2023-12-16T07:40:20.774 INFO:tasks.workunit.client.0.smithi049.stdout:8/503: dread d0/f41 [0,4194304] 0 2023-12-16T07:40:20.774 INFO:tasks.workunit.client.0.smithi049.stdout:8/504: getdents d0/d6a/d7d 0 2023-12-16T07:40:20.774 INFO:tasks.workunit.client.0.smithi049.stdout:8/505: stat d0/l73 0 2023-12-16T07:40:20.775 INFO:tasks.workunit.client.0.smithi049.stdout:6/478: symlink d0/d2/df/d81/l98 0 2023-12-16T07:40:20.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/438: creat d7/dc/dd/d27/f95 x:0 0 0 2023-12-16T07:40:20.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/439: truncate d7/dc/d15/d66/f85 436149 0 2023-12-16T07:40:20.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/444: mknod d2/db/dd/de/d1e/d44/c88 0 2023-12-16T07:40:20.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/506: unlink d0/d6a/c85 0 2023-12-16T07:40:20.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/435: truncate d5/de/d1c/f25 879631 0 2023-12-16T07:40:20.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/436: write d5/de/d54/f42 [453358,103171] 0 2023-12-16T07:40:20.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/440: creat d7/dc/d2f/d40/d5d/f96 x:0 0 0 2023-12-16T07:40:20.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/441: chown l3 2069 1 2023-12-16T07:40:20.784 INFO:tasks.workunit.client.0.smithi049.stdout:4/445: creat d2/db/dd/de/d1e/d37/d4e/f89 x:0 0 0 2023-12-16T07:40:20.784 INFO:tasks.workunit.client.0.smithi049.stdout:4/446: truncate d2/db/dd/de/f7d 566895 0 2023-12-16T07:40:20.785 INFO:tasks.workunit.client.0.smithi049.stdout:8/507: symlink d0/d13/d42/d5b/l9d 0 2023-12-16T07:40:20.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/437: creat d5/de/d1c/d62/d81/f97 x:0 0 0 2023-12-16T07:40:20.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/438: truncate d5/de/d1c/d62/d81/f97 301454 0 2023-12-16T07:40:20.788 INFO:tasks.workunit.client.0.smithi049.stdout:4/447: mknod d2/db/dd/de/d1e/d37/d6f/c8a 0 2023-12-16T07:40:20.788 INFO:tasks.workunit.client.0.smithi049.stdout:4/448: write d2/db/dd/f13 [4702692,42255] 0 2023-12-16T07:40:20.788 INFO:tasks.workunit.client.0.smithi049.stdout:4/449: write d2/db/dd/de/d1e/f3b [990252,40588] 0 2023-12-16T07:40:20.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/508: symlink d0/d13/d42/d5b/d68/d6b/l9e 0 2023-12-16T07:40:20.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/509: fsync d0/d1f/d56/f72 0 2023-12-16T07:40:20.790 INFO:tasks.workunit.client.0.smithi049.stdout:6/479: dwrite d0/d2/df/f24 [0,4194304] 0 2023-12-16T07:40:20.790 INFO:tasks.workunit.client.0.smithi049.stdout:6/480: write d0/d39/d5b/d65/d58/d2c/f93 [485861,128007] 0 2023-12-16T07:40:20.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/439: getdents d5/d1e 0 2023-12-16T07:40:20.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/450: mknod d2/db/dd/de/d1e/d21/c8b 0 2023-12-16T07:40:20.794 INFO:tasks.workunit.client.0.smithi049.stdout:7/442: dread f2 [0,4194304] 0 2023-12-16T07:40:20.794 INFO:tasks.workunit.client.0.smithi049.stdout:7/443: write d7/f67 [1133941,86517] 0 2023-12-16T07:40:20.794 INFO:tasks.workunit.client.0.smithi049.stdout:8/510: rename d0/d13/d42/f7f to d0/d1f/f9f 0 2023-12-16T07:40:20.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/481: rmdir d0/d39/d5b/d65/d4c 39 2023-12-16T07:40:20.797 INFO:tasks.workunit.client.0.smithi049.stdout:6/482: getdents d0/d39/d8b 0 2023-12-16T07:40:20.798 INFO:tasks.workunit.client.0.smithi049.stdout:4/451: mkdir d2/db/dd/d52/d8c 0 2023-12-16T07:40:20.798 INFO:tasks.workunit.client.0.smithi049.stdout:5/440: creat d5/d1e/d20/f98 x:0 0 0 2023-12-16T07:40:20.798 INFO:tasks.workunit.client.0.smithi049.stdout:5/441: write d5/de/d54/d57/f50 [208133,112052] 0 2023-12-16T07:40:20.799 INFO:tasks.workunit.client.0.smithi049.stdout:7/444: creat d7/dc/dd/d35/f97 x:0 0 0 2023-12-16T07:40:20.799 INFO:tasks.workunit.client.0.smithi049.stdout:7/445: write d7/dc/d6b/d70/d86/f8a [228724,52231] 0 2023-12-16T07:40:20.804 INFO:tasks.workunit.client.0.smithi049.stdout:5/442: write d5/d1e/d21/d58/f79 [4114909,91496] 0 2023-12-16T07:40:20.807 INFO:tasks.workunit.client.0.smithi049.stdout:8/511: dread d0/d1f/f18 [0,4194304] 0 2023-12-16T07:40:20.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/483: dwrite d0/f30 [4194304,4194304] 0 2023-12-16T07:40:20.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/484: truncate d0/d2/f47 5154546 0 2023-12-16T07:40:20.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/485: chown d0/f64 112 1 2023-12-16T07:40:20.810 INFO:tasks.workunit.client.0.smithi049.stdout:6/486: chown d0/d2/df/d4e/d5d/d6f/d4a 111 1 2023-12-16T07:40:20.810 INFO:tasks.workunit.client.0.smithi049.stdout:7/446: dread d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:20.811 INFO:tasks.workunit.client.0.smithi049.stdout:4/452: link d2/db/dd/d2a/c29 d2/db/dd/de/d1e/c8d 0 2023-12-16T07:40:20.812 INFO:tasks.workunit.client.0.smithi049.stdout:5/443: rename d5/de/d54/d57/d3c/l91 to d5/de/d1c/d62/l99 0 2023-12-16T07:40:20.813 INFO:tasks.workunit.client.0.smithi049.stdout:5/444: write d5/de/f40 [833251,37549] 0 2023-12-16T07:40:20.813 INFO:tasks.workunit.client.0.smithi049.stdout:5/445: fsync d5/f15 0 2023-12-16T07:40:20.813 INFO:tasks.workunit.client.0.smithi049.stdout:8/512: truncate d0/f3d 1989320 0 2023-12-16T07:40:20.815 INFO:tasks.workunit.client.0.smithi049.stdout:6/487: symlink d0/d39/d5b/d65/d27/d91/l99 0 2023-12-16T07:40:20.816 INFO:tasks.workunit.client.0.smithi049.stdout:7/447: creat d7/dc/d15/d57/f98 x:0 0 0 2023-12-16T07:40:20.817 INFO:tasks.workunit.client.0.smithi049.stdout:4/453: mknod d2/db/dd/de/d1e/d37/c8e 0 2023-12-16T07:40:20.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/446: mknod d5/d1e/d21/d58/d65/c9a 0 2023-12-16T07:40:20.819 INFO:tasks.workunit.client.0.smithi049.stdout:6/488: symlink d0/d39/d5b/d65/d58/l9a 0 2023-12-16T07:40:20.820 INFO:tasks.workunit.client.0.smithi049.stdout:7/448: symlink d7/dc/d2f/d38/l99 0 2023-12-16T07:40:20.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/454: creat d2/db/d6b/f8f x:0 0 0 2023-12-16T07:40:20.825 INFO:tasks.workunit.client.0.smithi049.stdout:5/447: dread d5/d1e/d21/f3b [0,4194304] 0 2023-12-16T07:40:20.825 INFO:tasks.workunit.client.0.smithi049.stdout:5/448: truncate d5/de/d1c/f25 1525659 0 2023-12-16T07:40:20.826 INFO:tasks.workunit.client.0.smithi049.stdout:6/489: link d0/d39/d5b/d65/d58/d33/c6d d0/d2/c9b 0 2023-12-16T07:40:20.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/449: symlink d7/dc/dd/d37/l9a 0 2023-12-16T07:40:20.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/450: chown d7/dc/d15/d66/c72 2 1 2023-12-16T07:40:20.827 INFO:tasks.workunit.client.0.smithi049.stdout:4/455: symlink d2/db/dd/de/d1e/d21/l90 0 2023-12-16T07:40:20.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/451: write f4 [4380894,54373] 0 2023-12-16T07:40:20.828 INFO:tasks.workunit.client.0.smithi049.stdout:6/490: creat d0/d39/d5b/d65/d32/f9c x:0 0 0 2023-12-16T07:40:20.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/456: creat d2/db/dd/de/d1e/d37/f91 x:0 0 0 2023-12-16T07:40:20.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/457: write d2/db/dd/de/d1e/d37/d4e/f5f [437823,38202] 0 2023-12-16T07:40:20.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/458: readlink d2/db/dd/d52/d62/l71 0 2023-12-16T07:40:20.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/459: readlink d2/db/dd/l54 0 2023-12-16T07:40:20.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/449: write d5/de/d54/d67/f7b [972187,100385] 0 2023-12-16T07:40:20.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/450: truncate d5/f7c 555706 0 2023-12-16T07:40:20.830 INFO:tasks.workunit.client.0.smithi049.stdout:7/452: creat d7/dc/dd/d37/d5c/f9b x:0 0 0 2023-12-16T07:40:20.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/453: dread - d7/dc/d6b/f84 zero size 2023-12-16T07:40:20.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/513: dwrite d0/d1f/f40 [0,4194304] 0 2023-12-16T07:40:20.831 INFO:tasks.workunit.client.0.smithi049.stdout:4/460: mknod d2/db/dd/de/d1e/d37/d82/c92 0 2023-12-16T07:40:20.834 INFO:tasks.workunit.client.0.smithi049.stdout:5/451: truncate d5/fb 8211069 0 2023-12-16T07:40:20.835 INFO:tasks.workunit.client.0.smithi049.stdout:7/454: rmdir d7/dc/d15/d66 39 2023-12-16T07:40:20.836 INFO:tasks.workunit.client.0.smithi049.stdout:8/514: symlink d0/d1f/d36/la0 0 2023-12-16T07:40:20.842 INFO:tasks.workunit.client.0.smithi049.stdout:7/455: mknod d7/dc/d15/c9c 0 2023-12-16T07:40:20.843 INFO:tasks.workunit.client.0.smithi049.stdout:8/515: symlink d0/d1f/la1 0 2023-12-16T07:40:20.844 INFO:tasks.workunit.client.0.smithi049.stdout:4/461: mknod d2/db/c93 0 2023-12-16T07:40:20.844 INFO:tasks.workunit.client.0.smithi049.stdout:4/462: readlink d2/l7 0 2023-12-16T07:40:20.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/456: mknod d7/dc/d15/c9d 0 2023-12-16T07:40:20.846 INFO:tasks.workunit.client.0.smithi049.stdout:8/516: mkdir d0/d13/d42/d5b/d68/d6b/da2 0 2023-12-16T07:40:20.846 INFO:tasks.workunit.client.0.smithi049.stdout:8/517: write d0/d1f/d4e/f8b [338026,14759] 0 2023-12-16T07:40:20.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/463: mknod d2/db/dd/d52/d8c/c94 0 2023-12-16T07:40:20.849 INFO:tasks.workunit.client.0.smithi049.stdout:1/425: sync 2023-12-16T07:40:20.849 INFO:tasks.workunit.client.0.smithi049.stdout:9/363: sync 2023-12-16T07:40:20.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/394: sync 2023-12-16T07:40:20.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/562: sync 2023-12-16T07:40:20.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/563: chown d13/d21/c22 0 1 2023-12-16T07:40:20.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/395: fdatasync d1/d2a/d37/d3f/d4c/f79 0 2023-12-16T07:40:20.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/396: truncate d1/ff 3252529 0 2023-12-16T07:40:20.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/397: chown d1/f16 28032 1 2023-12-16T07:40:20.850 INFO:tasks.workunit.client.0.smithi049.stdout:7/457: symlink d7/dc/d15/l9e 0 2023-12-16T07:40:20.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/518: mknod d0/d1f/d56/ca3 0 2023-12-16T07:40:20.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/519: write d0/d1f/d36/f47 [9222317,14961] 0 2023-12-16T07:40:20.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/520: dread - d0/d1f/d56/f93 zero size 2023-12-16T07:40:20.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/521: readlink d0/l51 0 2023-12-16T07:40:20.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/522: stat d0/d1f/d36/f54 0 2023-12-16T07:40:20.854 INFO:tasks.workunit.client.0.smithi049.stdout:1/426: rename d20/f62 to d20/f97 0 2023-12-16T07:40:20.856 INFO:tasks.workunit.client.0.smithi049.stdout:0/564: link d13/d21/d27/d2c/d62/f94 d13/d21/d27/d2c/d62/daa/fc5 0 2023-12-16T07:40:20.856 INFO:tasks.workunit.client.0.smithi049.stdout:0/565: chown d13/d21/d99/f19 0 1 2023-12-16T07:40:20.856 INFO:tasks.workunit.client.0.smithi049.stdout:0/566: readlink d13/d21/l76 0 2023-12-16T07:40:20.856 INFO:tasks.workunit.client.0.smithi049.stdout:6/491: dwrite d0/f64 [0,4194304] 0 2023-12-16T07:40:20.860 INFO:tasks.workunit.client.0.smithi049.stdout:3/398: creat d1/d2a/d37/d3f/d5a/d6d/f84 x:0 0 0 2023-12-16T07:40:20.860 INFO:tasks.workunit.client.0.smithi049.stdout:7/458: getdents d7 0 2023-12-16T07:40:20.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/492: write d0/d39/d5b/d65/f1d [1712115,3212] 0 2023-12-16T07:40:20.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/493: fdatasync d0/d2/f8 0 2023-12-16T07:40:20.861 INFO:tasks.workunit.client.0.smithi049.stdout:8/523: rmdir d0/d6a 39 2023-12-16T07:40:20.861 INFO:tasks.workunit.client.0.smithi049.stdout:8/524: chown d0/f4f 14 1 2023-12-16T07:40:20.861 INFO:tasks.workunit.client.0.smithi049.stdout:8/525: chown d0/d1f 270933961 1 2023-12-16T07:40:20.861 INFO:tasks.workunit.client.0.smithi049.stdout:3/399: write d1/d2b/f58 [4119413,63281] 0 2023-12-16T07:40:20.861 INFO:tasks.workunit.client.0.smithi049.stdout:3/400: write d1/d2a/d37/d3f/d4c/f51 [918091,112290] 0 2023-12-16T07:40:20.862 INFO:tasks.workunit.client.0.smithi049.stdout:0/567: creat d13/d39/d78/d83/db2/fc6 x:0 0 0 2023-12-16T07:40:20.862 INFO:tasks.workunit.client.0.smithi049.stdout:0/568: truncate d13/d21/d27/d2c/fc4 353414 0 2023-12-16T07:40:20.863 INFO:tasks.workunit.client.0.smithi049.stdout:9/364: dread d4/d7/d11/d26/d47/f4f [0,4194304] 0 2023-12-16T07:40:20.863 INFO:tasks.workunit.client.0.smithi049.stdout:5/452: rmdir d5 39 2023-12-16T07:40:20.868 INFO:tasks.workunit.client.0.smithi049.stdout:6/494: mknod d0/d39/d5b/c9d 0 2023-12-16T07:40:20.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/459: dread f2 [0,4194304] 0 2023-12-16T07:40:20.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/460: stat d7/dc/c21 0 2023-12-16T07:40:20.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/461: fsync d7/d2b/f8b 0 2023-12-16T07:40:20.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/462: stat d7/dc/d2f/d38/l99 0 2023-12-16T07:40:20.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/526: creat d0/d6a/fa4 x:0 0 0 2023-12-16T07:40:20.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/427: dread fa [0,4194304] 0 2023-12-16T07:40:20.872 INFO:tasks.workunit.client.0.smithi049.stdout:3/401: mknod d1/d2a/d37/d3f/d5a/d5b/d77/c85 0 2023-12-16T07:40:20.873 INFO:tasks.workunit.client.0.smithi049.stdout:0/569: symlink d13/d39/dbe/lc7 0 2023-12-16T07:40:20.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/365: creat d4/db/f72 x:0 0 0 2023-12-16T07:40:20.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/366: truncate d4/fd 1956437 0 2023-12-16T07:40:20.878 INFO:tasks.workunit.client.0.smithi049.stdout:6/495: link d0/d39/d5b/d65/d58/d2c/l2d d0/d39/d5b/d65/l9e 0 2023-12-16T07:40:20.878 INFO:tasks.workunit.client.0.smithi049.stdout:6/496: truncate d0/d39/d5b/d65/d4c/f67 772048 0 2023-12-16T07:40:20.878 INFO:tasks.workunit.client.0.smithi049.stdout:6/497: chown d0/d39/d5b/d65/d53/l7b 1006989076 1 2023-12-16T07:40:20.878 INFO:tasks.workunit.client.0.smithi049.stdout:6/498: fdatasync d0/d2/f7d 0 2023-12-16T07:40:20.878 INFO:tasks.workunit.client.0.smithi049.stdout:6/499: fsync d0/d39/d5b/d65/d58/f2b 0 2023-12-16T07:40:20.878 INFO:tasks.workunit.client.0.smithi049.stdout:5/453: dwrite d5/de/d1c/d62/f88 [0,4194304] 0 2023-12-16T07:40:20.878 INFO:tasks.workunit.client.0.smithi049.stdout:7/463: creat d7/dc/d2f/f9f x:0 0 0 2023-12-16T07:40:20.884 INFO:tasks.workunit.client.0.smithi049.stdout:1/428: dread d20/d41/d52/f68 [0,4194304] 0 2023-12-16T07:40:20.885 INFO:tasks.workunit.client.0.smithi049.stdout:0/570: creat d13/d3c/fc8 x:0 0 0 2023-12-16T07:40:20.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/367: getdents d4/d7/d11 0 2023-12-16T07:40:20.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/368: read d4/db/f22 [11216052,56193] 0 2023-12-16T07:40:20.890 INFO:tasks.workunit.client.0.smithi049.stdout:6/500: rename d0/d39/d5b/d65/d58/l3c to d0/d39/d5b/d65/d53/l9f 0 2023-12-16T07:40:20.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/454: unlink d5/f11 0 2023-12-16T07:40:20.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/455: chown d5/de/d54/l5e 45252 1 2023-12-16T07:40:20.894 INFO:tasks.workunit.client.0.smithi049.stdout:1/429: dread d20/f3e [0,4194304] 0 2023-12-16T07:40:20.896 INFO:tasks.workunit.client.0.smithi049.stdout:0/571: mkdir d13/d21/d2f/d7d/da0/dc9 0 2023-12-16T07:40:20.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/369: symlink d4/db/l73 0 2023-12-16T07:40:20.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/370: truncate d4/d7/f38 5976529 0 2023-12-16T07:40:20.898 INFO:tasks.workunit.client.0.smithi049.stdout:6/501: unlink d0/d39/d5b/d65/l9e 0 2023-12-16T07:40:20.898 INFO:tasks.workunit.client.0.smithi049.stdout:6/502: chown d0/d39/d5b/d65/d58/d2c/f36 1904 1 2023-12-16T07:40:20.898 INFO:tasks.workunit.client.0.smithi049.stdout:5/456: dread d5/de/d1c/d62/f6c [0,4194304] 0 2023-12-16T07:40:20.899 INFO:tasks.workunit.client.0.smithi049.stdout:7/464: truncate f2 2258370 0 2023-12-16T07:40:20.899 INFO:tasks.workunit.client.0.smithi049.stdout:7/465: truncate d7/d2b/f8b 138991 0 2023-12-16T07:40:20.900 INFO:tasks.workunit.client.0.smithi049.stdout:7/466: write d7/dc/dd/d27/d8e/f90 [2309478,6101] 0 2023-12-16T07:40:20.900 INFO:tasks.workunit.client.0.smithi049.stdout:7/467: readlink d7/dc/dd/l26 0 2023-12-16T07:40:20.900 INFO:tasks.workunit.client.0.smithi049.stdout:1/430: symlink d20/d45/d47/l98 0 2023-12-16T07:40:20.901 INFO:tasks.workunit.client.0.smithi049.stdout:8/527: rmdir d0/d6a/d7d 0 2023-12-16T07:40:20.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/572: truncate d13/d3c/fb7 1612030 0 2023-12-16T07:40:20.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/573: read d13/d39/d38/f54 [567698,60273] 0 2023-12-16T07:40:20.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/574: write d13/d21/d27/d2c/d62/f94 [753368,52635] 0 2023-12-16T07:40:20.904 INFO:tasks.workunit.client.0.smithi049.stdout:9/371: creat d4/d7/d11/d26/f74 x:0 0 0 2023-12-16T07:40:20.905 INFO:tasks.workunit.client.0.smithi049.stdout:6/503: creat d0/d2/df/d4e/d5d/d6f/fa0 x:0 0 0 2023-12-16T07:40:20.905 INFO:tasks.workunit.client.0.smithi049.stdout:6/504: stat d0/d39/d5b/d65/l41 0 2023-12-16T07:40:20.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/505: fdatasync d0/d39/d5b/d65/d27/f88 0 2023-12-16T07:40:20.907 INFO:tasks.workunit.client.0.smithi049.stdout:7/468: link d7/dc/d15/d57/l5a d7/d2b/d59/la0 0 2023-12-16T07:40:20.907 INFO:tasks.workunit.client.0.smithi049.stdout:8/528: mkdir d0/d13/d42/d5b/d68/d6b/da2/da5 0 2023-12-16T07:40:20.908 INFO:tasks.workunit.client.0.smithi049.stdout:7/469: fdatasync d7/dc/dd/d27/d8e/f90 0 2023-12-16T07:40:20.909 INFO:tasks.workunit.client.0.smithi049.stdout:0/575: creat d13/d39/d78/fca x:0 0 0 2023-12-16T07:40:20.910 INFO:tasks.workunit.client.0.smithi049.stdout:9/372: symlink d4/d7/d11/d56/l75 0 2023-12-16T07:40:20.911 INFO:tasks.workunit.client.0.smithi049.stdout:6/506: getdents d0/d39/d5b/d65/d27/d91/d94 0 2023-12-16T07:40:20.915 INFO:tasks.workunit.client.0.smithi049.stdout:0/576: link d13/d21/d99/d46/d65/faf d13/fcb 0 2023-12-16T07:40:20.917 INFO:tasks.workunit.client.0.smithi049.stdout:9/373: unlink d4/d7/f9 0 2023-12-16T07:40:20.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/577: mknod d13/ccc 0 2023-12-16T07:40:20.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/578: readlink l9 0 2023-12-16T07:40:20.925 INFO:tasks.workunit.client.0.smithi049.stdout:9/374: mkdir d4/d7/d11/d1d/d69/d76 0 2023-12-16T07:40:20.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/375: read f3 [2378932,71050] 0 2023-12-16T07:40:20.926 INFO:tasks.workunit.client.0.smithi049.stdout:0/579: truncate d13/d39/f3b 1190169 0 2023-12-16T07:40:20.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/580: write d13/d21/d27/d2c/f8d [1383248,89758] 0 2023-12-16T07:40:20.948 INFO:tasks.workunit.client.0.smithi049.stdout:5/457: dread d5/f9 [0,4194304] 0 2023-12-16T07:40:20.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/458: rmdir d5/d1e/d21/d4e/d89 0 2023-12-16T07:40:20.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/459: write d5/de/f68 [320224,54471] 0 2023-12-16T07:40:20.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/402: dwrite d1/d2b/f58 [0,4194304] 0 2023-12-16T07:40:20.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/507: dwrite d0/d39/d5b/d65/d58/d2c/f93 [0,4194304] 0 2023-12-16T07:40:20.951 INFO:tasks.workunit.client.0.smithi049.stdout:8/529: dwrite d0/d1f/f67 [0,4194304] 0 2023-12-16T07:40:20.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/460: mkdir d5/de/d54/d78/d9b 0 2023-12-16T07:40:20.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/461: chown d5/f8f 655363557 1 2023-12-16T07:40:20.953 INFO:tasks.workunit.client.0.smithi049.stdout:3/403: stat d1/d2a/d37/d3f/d5a/c7a 0 2023-12-16T07:40:20.953 INFO:tasks.workunit.client.0.smithi049.stdout:3/404: chown d1/d2a/d37/d3f/d5a/d61/d6b/f72 937478 1 2023-12-16T07:40:20.954 INFO:tasks.workunit.client.0.smithi049.stdout:3/405: dread - d1/d2a/d37/d3f/d5a/d61/d6b/f72 zero size 2023-12-16T07:40:20.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/462: write d5/de/f14 [1669833,46099] 0 2023-12-16T07:40:20.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/463: stat d5/de/d54/d67/l73 0 2023-12-16T07:40:20.958 INFO:tasks.workunit.client.0.smithi049.stdout:6/508: symlink d0/d39/d5b/d65/d27/d91/la1 0 2023-12-16T07:40:20.958 INFO:tasks.workunit.client.0.smithi049.stdout:6/509: truncate d0/d39/d5b/d65/d58/d2c/f36 4361471 0 2023-12-16T07:40:20.959 INFO:tasks.workunit.client.0.smithi049.stdout:9/376: dwrite f3 [0,4194304] 0 2023-12-16T07:40:20.959 INFO:tasks.workunit.client.0.smithi049.stdout:7/470: dwrite d7/d2b/d59/f5e [0,4194304] 0 2023-12-16T07:40:20.962 INFO:tasks.workunit.client.0.smithi049.stdout:1/431: dwrite d20/d7b/f8b [0,4194304] 0 2023-12-16T07:40:20.962 INFO:tasks.workunit.client.0.smithi049.stdout:1/432: readlink d20/d41/d4f/l6b 0 2023-12-16T07:40:20.967 INFO:tasks.workunit.client.0.smithi049.stdout:8/530: dwrite d0/f12 [0,4194304] 0 2023-12-16T07:40:20.969 INFO:tasks.workunit.client.0.smithi049.stdout:8/531: write d0/d1f/f40 [2935405,77794] 0 2023-12-16T07:40:20.973 INFO:tasks.workunit.client.0.smithi049.stdout:3/406: symlink d1/d2b/l86 0 2023-12-16T07:40:20.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/464: unlink d5/de/l4d 0 2023-12-16T07:40:20.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/510: rmdir d0/d39/d5b/d65/d27/d91/d94/d95 0 2023-12-16T07:40:20.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/511: chown d0/d2/df/d81 4653043 1 2023-12-16T07:40:20.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/512: stat d0/d39/d5b/d65/d58/f80 0 2023-12-16T07:40:20.977 INFO:tasks.workunit.client.0.smithi049.stdout:9/377: creat d4/d7/d11/d26/d47/f77 x:0 0 0 2023-12-16T07:40:20.980 INFO:tasks.workunit.client.0.smithi049.stdout:1/433: symlink d20/d7b/d71/l99 0 2023-12-16T07:40:20.980 INFO:tasks.workunit.client.0.smithi049.stdout:0/581: dwrite d13/d39/f3b [0,4194304] 0 2023-12-16T07:40:20.985 INFO:tasks.workunit.client.0.smithi049.stdout:8/532: getdents d0/d13/d42/d5b 0 2023-12-16T07:40:20.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/465: mkdir d5/d1e/d20/d95/d9c 0 2023-12-16T07:40:20.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/466: write d5/de/d1c/f35 [1934902,52178] 0 2023-12-16T07:40:20.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/467: chown d5/de/d54/d78/c96 1495487983 1 2023-12-16T07:40:20.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/513: mknod d0/d2/df/d4e/ca2 0 2023-12-16T07:40:20.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/514: fdatasync d0/d2/df/d4e/d5d/d6f/f8c 0 2023-12-16T07:40:20.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/515: dread - d0/d39/d5b/d65/d58/d2c/f4b zero size 2023-12-16T07:40:20.988 INFO:tasks.workunit.client.0.smithi049.stdout:8/533: write d0/d1f/f59 [1522576,109790] 0 2023-12-16T07:40:20.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/378: rename d4/l3b to d4/d7/d11/d1d/d48/l78 0 2023-12-16T07:40:20.990 INFO:tasks.workunit.client.0.smithi049.stdout:1/434: creat d20/d43/f9a x:0 0 0 2023-12-16T07:40:20.991 INFO:tasks.workunit.client.0.smithi049.stdout:1/435: stat f7 0 2023-12-16T07:40:20.992 INFO:tasks.workunit.client.0.smithi049.stdout:0/582: symlink d13/d39/d38/lcd 0 2023-12-16T07:40:20.992 INFO:tasks.workunit.client.0.smithi049.stdout:0/583: fsync d13/d21/d99/d46/d65/d82/fc0 0 2023-12-16T07:40:20.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/468: creat d5/d1e/d21/d4e/f9d x:0 0 0 2023-12-16T07:40:20.997 INFO:tasks.workunit.client.0.smithi049.stdout:6/516: rmdir d0/d39/d5b/d65/d58 39 2023-12-16T07:40:20.997 INFO:tasks.workunit.client.0.smithi049.stdout:6/517: fsync d0/d39/d5b/d65/d53/f66 0 2023-12-16T07:40:20.999 INFO:tasks.workunit.client.0.smithi049.stdout:8/534: mknod d0/d13/d42/d5b/d68/ca6 0 2023-12-16T07:40:20.999 INFO:tasks.workunit.client.0.smithi049.stdout:8/535: chown d0/d1f/c29 108755 1 2023-12-16T07:40:21.000 INFO:tasks.workunit.client.0.smithi049.stdout:9/379: getdents d4/d7/d11/d56 0 2023-12-16T07:40:21.003 INFO:tasks.workunit.client.0.smithi049.stdout:1/436: rmdir d20/d41/d4f/d55/d82 39 2023-12-16T07:40:21.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/518: creat d0/d2/df/d4e/d5d/d6f/d4a/fa3 x:0 0 0 2023-12-16T07:40:21.006 INFO:tasks.workunit.client.0.smithi049.stdout:8/536: creat d0/fa7 x:0 0 0 2023-12-16T07:40:21.007 INFO:tasks.workunit.client.0.smithi049.stdout:9/380: creat d4/d7/d11/d1d/f79 x:0 0 0 2023-12-16T07:40:21.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/437: symlink d20/d41/d4f/d55/d7f/l9b 0 2023-12-16T07:40:21.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/438: fsync d20/d45/d47/f56 0 2023-12-16T07:40:21.009 INFO:tasks.workunit.client.0.smithi049.stdout:8/537: unlink d0/l6d 0 2023-12-16T07:40:21.010 INFO:tasks.workunit.client.0.smithi049.stdout:6/519: write d0/d39/d5b/d65/d58/f2b [1957635,14485] 0 2023-12-16T07:40:21.011 INFO:tasks.workunit.client.0.smithi049.stdout:9/381: creat d4/d7/f7a x:0 0 0 2023-12-16T07:40:21.011 INFO:tasks.workunit.client.0.smithi049.stdout:9/382: fsync d4/db/f5d 0 2023-12-16T07:40:21.012 INFO:tasks.workunit.client.0.smithi049.stdout:5/469: dwrite d5/d1e/d21/d4e/f59 [0,4194304] 0 2023-12-16T07:40:21.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/439: rename fa to d20/d43/f9c 0 2023-12-16T07:40:21.013 INFO:tasks.workunit.client.0.smithi049.stdout:6/520: read d0/d39/d5b/d65/d53/f61 [2214219,35635] 0 2023-12-16T07:40:21.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/440: write d20/d43/f75 [996218,50197] 0 2023-12-16T07:40:21.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/521: chown d0/f30 49 1 2023-12-16T07:40:21.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/522: write d0/d2/f5 [4604488,16554] 0 2023-12-16T07:40:21.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/523: chown d0/l10 47546 1 2023-12-16T07:40:21.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/524: readlink d0/d2/l2f 0 2023-12-16T07:40:21.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/525: write d0/d39/d5b/d65/d58/d2c/f4b [593648,99544] 0 2023-12-16T07:40:21.014 INFO:tasks.workunit.client.0.smithi049.stdout:5/470: dread d5/de/d54/d67/f7e [0,4194304] 0 2023-12-16T07:40:21.015 INFO:tasks.workunit.client.0.smithi049.stdout:8/538: unlink d0/f28 0 2023-12-16T07:40:21.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/383: link d4/d7/d11/d1d/l24 d4/db/l7b 0 2023-12-16T07:40:21.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/441: creat d20/d45/d47/f9d x:0 0 0 2023-12-16T07:40:21.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/539: rmdir d0/d1f/d1c 39 2023-12-16T07:40:21.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/540: readlink d0/d1f/l35 0 2023-12-16T07:40:21.020 INFO:tasks.workunit.client.0.smithi049.stdout:1/442: getdents d20/d40/d6f 0 2023-12-16T07:40:21.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/584: dwrite f2 [0,4194304] 0 2023-12-16T07:40:21.022 INFO:tasks.workunit.client.0.smithi049.stdout:8/541: link d0/d13/d42/d5b/d68/d75/d89/f94 d0/d13/d42/d5b/d68/d6b/da2/da5/fa8 0 2023-12-16T07:40:21.025 INFO:tasks.workunit.client.0.smithi049.stdout:2/444: sync 2023-12-16T07:40:21.026 INFO:tasks.workunit.client.0.smithi049.stdout:2/445: write d2/f22 [5344865,128821] 0 2023-12-16T07:40:21.028 INFO:tasks.workunit.client.0.smithi049.stdout:8/542: creat d0/d13/d42/d5b/d68/fa9 x:0 0 0 2023-12-16T07:40:21.029 INFO:tasks.workunit.client.0.smithi049.stdout:8/543: write d0/d1f/f67 [1353399,101236] 0 2023-12-16T07:40:21.029 INFO:tasks.workunit.client.0.smithi049.stdout:8/544: chown d0/d13/d42/d5b/d68 1 1 2023-12-16T07:40:21.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/446: rmdir d2/d1d/d28/d56/d66/d6b 39 2023-12-16T07:40:21.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/447: stat d2/d1d/d28/l2d 0 2023-12-16T07:40:21.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/448: chown d2/d1d/d28/d56 2 1 2023-12-16T07:40:21.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/449: fsync d2/d26/d43/f8c 0 2023-12-16T07:40:21.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/450: write d2/d26/d43/f8c [222383,11802] 0 2023-12-16T07:40:21.043 INFO:tasks.workunit.client.0.smithi049.stdout:8/545: write d0/d1f/d36/f54 [1280871,25196] 0 2023-12-16T07:40:21.043 INFO:tasks.workunit.client.0.smithi049.stdout:2/451: rename d2/d26/d43/f8c to d2/de/d77/f99 0 2023-12-16T07:40:21.045 INFO:tasks.workunit.client.0.smithi049.stdout:8/546: creat d0/d13/d42/d5b/d68/d75/faa x:0 0 0 2023-12-16T07:40:21.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/452: rmdir d2/d1d/d28/d56/d11 39 2023-12-16T07:40:21.047 INFO:tasks.workunit.client.0.smithi049.stdout:9/384: dwrite d4/d7/d11/d26/f53 [0,4194304] 0 2023-12-16T07:40:21.057 INFO:tasks.workunit.client.0.smithi049.stdout:1/443: dwrite f14 [0,4194304] 0 2023-12-16T07:40:21.060 INFO:tasks.workunit.client.0.smithi049.stdout:6/526: dwrite d0/d39/d5b/d65/d58/f2b [0,4194304] 0 2023-12-16T07:40:21.060 INFO:tasks.workunit.client.0.smithi049.stdout:0/585: dwrite d13/fbc [0,4194304] 0 2023-12-16T07:40:21.060 INFO:tasks.workunit.client.0.smithi049.stdout:1/444: creat d20/d45/d77/f9e x:0 0 0 2023-12-16T07:40:21.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/445: write d20/d7b/f8b [1766747,98050] 0 2023-12-16T07:40:21.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/446: dread - d20/d45/d47/f9d zero size 2023-12-16T07:40:21.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/447: chown d20/d43/c5c 0 1 2023-12-16T07:40:21.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/527: unlink d0/d39/d5b/d65/d53/l9f 0 2023-12-16T07:40:21.068 INFO:tasks.workunit.client.0.smithi049.stdout:1/448: creat d20/d7b/d88/f9f x:0 0 0 2023-12-16T07:40:21.069 INFO:tasks.workunit.client.0.smithi049.stdout:6/528: mkdir d0/d2/df/d4e/d5d/d6f/d4a/da4 0 2023-12-16T07:40:21.069 INFO:tasks.workunit.client.0.smithi049.stdout:6/529: write d0/f40 [4706606,120289] 0 2023-12-16T07:40:21.072 INFO:tasks.workunit.client.0.smithi049.stdout:1/449: getdents d20/d41/d4f/d55/d58 0 2023-12-16T07:40:21.072 INFO:tasks.workunit.client.0.smithi049.stdout:1/450: chown d20/d45/d47/f6d 6414799 1 2023-12-16T07:40:21.074 INFO:tasks.workunit.client.0.smithi049.stdout:8/547: rename d0/d13/d42/d5b/d68/d75 to d0/d13/d42/d5b/dab 0 2023-12-16T07:40:21.074 INFO:tasks.workunit.client.0.smithi049.stdout:6/530: getdents d0/d39/d5b/d65/d27/d91 0 2023-12-16T07:40:21.075 INFO:tasks.workunit.client.0.smithi049.stdout:1/451: truncate d20/f3f 2812494 0 2023-12-16T07:40:21.076 INFO:tasks.workunit.client.0.smithi049.stdout:0/586: dwrite d13/f1c [0,4194304] 0 2023-12-16T07:40:21.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/453: rename d2/d1d/d28/d56/d66/d6b/f70 to d2/d1d/f9a 0 2023-12-16T07:40:21.078 INFO:tasks.workunit.client.0.smithi049.stdout:8/548: creat d0/d1f/fac x:0 0 0 2023-12-16T07:40:21.083 INFO:tasks.workunit.client.0.smithi049.stdout:1/452: getdents d20/d41/d4f/d55/d7f/d84 0 2023-12-16T07:40:21.084 INFO:tasks.workunit.client.0.smithi049.stdout:0/587: link d13/l43 d13/d21/d2f/d7d/da0/dc9/lce 0 2023-12-16T07:40:21.084 INFO:tasks.workunit.client.0.smithi049.stdout:8/549: mknod d0/d13/d42/d5b/d68/d6b/da2/cad 0 2023-12-16T07:40:21.084 INFO:tasks.workunit.client.0.smithi049.stdout:6/531: truncate d0/d2/df/f7a 1369774 0 2023-12-16T07:40:21.085 INFO:tasks.workunit.client.0.smithi049.stdout:1/453: symlink d20/d41/d52/d86/la0 0 2023-12-16T07:40:21.086 INFO:tasks.workunit.client.0.smithi049.stdout:1/454: write d20/d45/d47/f6d [38983,104355] 0 2023-12-16T07:40:21.086 INFO:tasks.workunit.client.0.smithi049.stdout:0/588: getdents d13/d21/d2f 0 2023-12-16T07:40:21.088 INFO:tasks.workunit.client.0.smithi049.stdout:8/550: creat d0/d13/d42/d5b/d68/d6b/fae x:0 0 0 2023-12-16T07:40:21.088 INFO:tasks.workunit.client.0.smithi049.stdout:8/551: write d0/d13/d42/d5b/d68/f8f [502697,2702] 0 2023-12-16T07:40:21.089 INFO:tasks.workunit.client.0.smithi049.stdout:8/552: truncate d0/d13/d42/d5b/f8d 746378 0 2023-12-16T07:40:21.089 INFO:tasks.workunit.client.0.smithi049.stdout:6/532: rmdir d0/d39/d5b 39 2023-12-16T07:40:21.089 INFO:tasks.workunit.client.0.smithi049.stdout:6/533: fdatasync d0/d39/d5b/d65/d58/f3d 0 2023-12-16T07:40:21.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/455: creat d20/d41/d4f/d55/d7f/d8a/fa1 x:0 0 0 2023-12-16T07:40:21.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/456: chown d20/l34 2 1 2023-12-16T07:40:21.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/457: chown f1b 33223 1 2023-12-16T07:40:21.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/458: chown d20/d41/d4f/d55/d7f 11623 1 2023-12-16T07:40:21.092 INFO:tasks.workunit.client.0.smithi049.stdout:0/589: mknod d13/d21/d27/ccf 0 2023-12-16T07:40:21.092 INFO:tasks.workunit.client.0.smithi049.stdout:0/590: write d13/d21/d27/d2c/fc4 [577178,105384] 0 2023-12-16T07:40:21.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/454: dwrite d2/f36 [0,4194304] 0 2023-12-16T07:40:21.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/534: dread d0/d39/f54 [0,4194304] 0 2023-12-16T07:40:21.097 INFO:tasks.workunit.client.0.smithi049.stdout:1/459: truncate f6 811768 0 2023-12-16T07:40:21.097 INFO:tasks.workunit.client.0.smithi049.stdout:1/460: chown d20/f8e 3398 1 2023-12-16T07:40:21.098 INFO:tasks.workunit.client.0.smithi049.stdout:1/461: chown d20/d45/d77/c90 1 1 2023-12-16T07:40:21.098 INFO:tasks.workunit.client.0.smithi049.stdout:8/553: write d0/d1f/d36/f47 [7402204,34037] 0 2023-12-16T07:40:21.099 INFO:tasks.workunit.client.0.smithi049.stdout:0/591: stat d13/d3c/l4a 0 2023-12-16T07:40:21.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/535: creat d0/d39/d8b/fa5 x:0 0 0 2023-12-16T07:40:21.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/462: creat d20/d41/d4f/fa2 x:0 0 0 2023-12-16T07:40:21.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/554: mknod d0/d13/d42/d5b/dab/d89/caf 0 2023-12-16T07:40:21.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/555: fdatasync d0/d13/d42/d5b/f63 0 2023-12-16T07:40:21.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/592: symlink d13/d39/d78/dc2/ld0 0 2023-12-16T07:40:21.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/593: readlink d13/d39/d78/dc2/ld0 0 2023-12-16T07:40:21.108 INFO:tasks.workunit.client.0.smithi049.stdout:6/536: symlink d0/d2/df/d81/la6 0 2023-12-16T07:40:21.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/463: dread d20/d41/d52/f68 [0,4194304] 0 2023-12-16T07:40:21.110 INFO:tasks.workunit.client.0.smithi049.stdout:0/594: unlink d13/d39/d78/d83/db2/cc1 0 2023-12-16T07:40:21.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/537: mkdir d0/d39/d5b/d65/d27/d91/d94/da7 0 2023-12-16T07:40:21.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/538: chown d0/d39/d5b/d65/d32 124137906 1 2023-12-16T07:40:21.111 INFO:tasks.workunit.client.0.smithi049.stdout:8/556: symlink d0/d1f/d56/lb0 0 2023-12-16T07:40:21.112 INFO:tasks.workunit.client.0.smithi049.stdout:1/464: truncate d20/d41/f5a 212897 0 2023-12-16T07:40:21.112 INFO:tasks.workunit.client.0.smithi049.stdout:1/465: chown d20/d40/f5f 11 1 2023-12-16T07:40:21.112 INFO:tasks.workunit.client.0.smithi049.stdout:0/595: dread f0 [0,4194304] 0 2023-12-16T07:40:21.113 INFO:tasks.workunit.client.0.smithi049.stdout:6/539: symlink d0/d39/d5b/d65/d27/d91/la8 0 2023-12-16T07:40:21.113 INFO:tasks.workunit.client.0.smithi049.stdout:4/464: sync 2023-12-16T07:40:21.113 INFO:tasks.workunit.client.0.smithi049.stdout:4/465: chown d2/db/dd/d2a/f43 235 1 2023-12-16T07:40:21.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/557: unlink d0/d1f/d36/f7a 0 2023-12-16T07:40:21.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/540: write d0/d39/d5b/d65/d58/f51 [1586736,45894] 0 2023-12-16T07:40:21.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/466: symlink d20/d41/d4f/d55/d82/la3 0 2023-12-16T07:40:21.114 INFO:tasks.workunit.client.0.smithi049.stdout:4/466: write d2/db/dd/d52/f59 [7765246,35084] 0 2023-12-16T07:40:21.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/596: unlink d13/d21/d27/c34 0 2023-12-16T07:40:21.116 INFO:tasks.workunit.client.0.smithi049.stdout:6/541: write d0/d2/df/f24 [1298059,6348] 0 2023-12-16T07:40:21.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/467: mknod d20/d40/ca4 0 2023-12-16T07:40:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:20 smithi133 ceph-mon[120445]: Standby manager daemon smithi049.rqlvwo started 2023-12-16T07:40:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:20 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/crt"}]: dispatch 2023-12-16T07:40:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:20 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:40:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:20 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/key"}]: dispatch 2023-12-16T07:40:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:20 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.49:0/2382348069' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:40:21.118 INFO:tasks.workunit.client.0.smithi049.stdout:2/455: dwrite d2/d1d/f9a [0,4194304] 0 2023-12-16T07:40:21.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/597: rename d13/d21/d27/d2c/d62/daa/fbd to d13/d39/d38/da7/fd1 0 2023-12-16T07:40:21.120 INFO:tasks.workunit.client.0.smithi049.stdout:6/542: link d0/f1b d0/d2/df/d81/fa9 0 2023-12-16T07:40:21.121 INFO:tasks.workunit.client.0.smithi049.stdout:1/468: creat d20/d41/d52/fa5 x:0 0 0 2023-12-16T07:40:21.123 INFO:tasks.workunit.client.0.smithi049.stdout:2/456: getdents d2/d1d/d28/d56/d11 0 2023-12-16T07:40:21.124 INFO:tasks.workunit.client.0.smithi049.stdout:2/457: dread - d2/d26/d6e/f8f zero size 2023-12-16T07:40:21.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/469: dread d20/f3f [0,4194304] 0 2023-12-16T07:40:21.128 INFO:tasks.workunit.client.0.smithi049.stdout:0/598: truncate d13/d39/d38/f67 1643348 0 2023-12-16T07:40:21.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/458: getdents d2/d1d 0 2023-12-16T07:40:21.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/467: dwrite d2/db/dd/d2a/f5d [4194304,4194304] 0 2023-12-16T07:40:21.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/459: rmdir d2/d1d/d28/d56/d71 39 2023-12-16T07:40:21.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/460: truncate d2/d1d/d28/d56/d71/f80 222359 0 2023-12-16T07:40:21.131 INFO:tasks.workunit.client.0.smithi049.stdout:4/468: dread d2/db/dd/de/d1e/d37/d4e/f5a [0,4194304] 0 2023-12-16T07:40:21.131 INFO:tasks.workunit.client.0.smithi049.stdout:4/469: truncate d2/db/dd/de/d1e/d37/f5c 1522909 0 2023-12-16T07:40:21.134 INFO:tasks.workunit.client.0.smithi049.stdout:4/470: rename d2/db/dd/de/d1e/d37/d4e/f56 to d2/db/dd/de/d1e/d44/f95 0 2023-12-16T07:40:21.134 INFO:tasks.workunit.client.0.smithi049.stdout:4/471: write d2/f86 [936372,107031] 0 2023-12-16T07:40:21.134 INFO:tasks.workunit.client.0.smithi049.stdout:4/472: dread - d2/db/dd/de/d1e/d37/d4e/f89 zero size 2023-12-16T07:40:21.136 INFO:tasks.workunit.client.0.smithi049.stdout:6/543: dwrite d0/d2/f47 [4194304,4194304] 0 2023-12-16T07:40:21.136 INFO:tasks.workunit.client.0.smithi049.stdout:6/544: dread - d0/d39/f84 zero size 2023-12-16T07:40:21.136 INFO:tasks.workunit.client.0.smithi049.stdout:6/545: dread - d0/d39/f8a zero size 2023-12-16T07:40:21.136 INFO:tasks.workunit.client.0.smithi049.stdout:6/546: chown d0/d39/d5b/d65/d53 1 1 2023-12-16T07:40:21.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/547: mkdir d0/d39/d5b/d65/d58/d33/daa 0 2023-12-16T07:40:21.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/548: chown d0/d39/d5b/d65/d27/f89 869091291 1 2023-12-16T07:40:21.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/549: chown d0/d39/d5b/d65/d4c/d4d/d6a 14 1 2023-12-16T07:40:21.141 INFO:tasks.workunit.client.0.smithi049.stdout:6/550: truncate d0/d2/f9 173153 0 2023-12-16T07:40:21.141 INFO:tasks.workunit.client.0.smithi049.stdout:6/551: readlink d0/l34 0 2023-12-16T07:40:21.144 INFO:tasks.workunit.client.0.smithi049.stdout:6/552: mknod d0/d2/df/d4e/cab 0 2023-12-16T07:40:21.148 INFO:tasks.workunit.client.0.smithi049.stdout:0/599: dwrite d13/d21/d2f/d7d/d90/fa5 [0,4194304] 0 2023-12-16T07:40:21.148 INFO:tasks.workunit.client.0.smithi049.stdout:2/461: dwrite d2/d1d/d28/d56/d11/f61 [4194304,4194304] 0 2023-12-16T07:40:21.149 INFO:tasks.workunit.client.0.smithi049.stdout:2/462: read d2/d1d/d28/d56/d66/f88 [2792583,102677] 0 2023-12-16T07:40:21.150 INFO:tasks.workunit.client.0.smithi049.stdout:0/600: mknod d13/d39/d78/d83/db2/cd2 0 2023-12-16T07:40:21.151 INFO:tasks.workunit.client.0.smithi049.stdout:6/553: dread d0/d39/d5b/d65/d58/f51 [0,4194304] 0 2023-12-16T07:40:21.152 INFO:tasks.workunit.client.0.smithi049.stdout:0/601: mkdir d13/d21/d99/d46/dd3 0 2023-12-16T07:40:21.152 INFO:tasks.workunit.client.0.smithi049.stdout:0/602: truncate d13/f16 4643290 0 2023-12-16T07:40:21.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/473: dwrite d2/db/dd/de/d1e/d21/f25 [4194304,4194304] 0 2023-12-16T07:40:21.162 INFO:tasks.workunit.client.0.smithi049.stdout:4/474: creat d2/db/dd/de/f96 x:0 0 0 2023-12-16T07:40:21.165 INFO:tasks.workunit.client.0.smithi049.stdout:4/475: mkdir d2/db/dd/d52/d97 0 2023-12-16T07:40:21.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/476: write d2/db/dd/f13 [3422139,81487] 0 2023-12-16T07:40:21.172 INFO:tasks.workunit.client.0.smithi049.stdout:0/603: dwrite d13/d21/d99/d46/f60 [0,4194304] 0 2023-12-16T07:40:21.172 INFO:tasks.workunit.client.0.smithi049.stdout:0/604: truncate d13/d39/d78/d83/db2/fba 515192 0 2023-12-16T07:40:21.172 INFO:tasks.workunit.client.0.smithi049.stdout:0/605: chown d13/l6e 1069219 1 2023-12-16T07:40:21.173 INFO:tasks.workunit.client.0.smithi049.stdout:6/554: dwrite d0/d39/d5b/d65/d27/f89 [0,4194304] 0 2023-12-16T07:40:21.173 INFO:tasks.workunit.client.0.smithi049.stdout:6/555: truncate d0/d39/d8b/fa5 651309 0 2023-12-16T07:40:21.173 INFO:tasks.workunit.client.0.smithi049.stdout:6/556: truncate d0/d2/f82 2238924 0 2023-12-16T07:40:21.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/477: symlink d2/db/dd/de/l98 0 2023-12-16T07:40:21.175 INFO:tasks.workunit.client.0.smithi049.stdout:0/606: mknod d13/d39/d38/da7/cd4 0 2023-12-16T07:40:21.192 INFO:tasks.workunit.client.0.smithi049.stdout:0/607: dread d13/d21/d99/fa3 [0,4194304] 0 2023-12-16T07:40:21.192 INFO:tasks.workunit.client.0.smithi049.stdout:0/608: truncate d13/d3c/fc8 953488 0 2023-12-16T07:40:21.192 INFO:tasks.workunit.client.0.smithi049.stdout:0/609: dread - d13/d21/d27/f86 zero size 2023-12-16T07:40:21.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/610: creat d13/d39/d8a/fd5 x:0 0 0 2023-12-16T07:40:21.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/611: dread - d13/fcb zero size 2023-12-16T07:40:21.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/557: dwrite d0/d2/df/f7a [0,4194304] 0 2023-12-16T07:40:21.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/558: readlink d0/d39/d5b/d65/d58/d33/l7c 0 2023-12-16T07:40:21.208 INFO:tasks.workunit.client.0.smithi049.stdout:0/612: dwrite d13/fb5 [0,4194304] 0 2023-12-16T07:40:21.208 INFO:tasks.workunit.client.0.smithi049.stdout:0/613: chown d13/l43 92 1 2023-12-16T07:40:21.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/559: truncate d0/d2/df/f7a 1224375 0 2023-12-16T07:40:21.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/560: fsync d0/d39/d5b/d65/d58/f51 0 2023-12-16T07:40:21.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/561: write d0/d39/f84 [849749,59373] 0 2023-12-16T07:40:21.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/562: chown d0/d39/d5b/d65/d53/c97 70035 1 2023-12-16T07:40:21.214 INFO:tasks.workunit.client.0.smithi049.stdout:4/478: dwrite d2/db/dd/de/d1e/d37/f38 [0,4194304] 0 2023-12-16T07:40:21.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/563: creat d0/d39/d5b/d65/d58/d33/daa/fac x:0 0 0 2023-12-16T07:40:21.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/564: write d0/d39/d5b/d65/d58/f5c [603486,87009] 0 2023-12-16T07:40:21.216 INFO:tasks.workunit.client.0.smithi049.stdout:0/614: dread d13/fb5 [0,4194304] 0 2023-12-16T07:40:21.222 INFO:tasks.workunit.client.0.smithi049.stdout:4/479: rmdir d2/db/dd/d52/d8c 39 2023-12-16T07:40:21.223 INFO:tasks.workunit.client.0.smithi049.stdout:6/565: mknod d0/cad 0 2023-12-16T07:40:21.223 INFO:tasks.workunit.client.0.smithi049.stdout:6/566: chown d0/d2/df/d81/fa9 29557 1 2023-12-16T07:40:21.225 INFO:tasks.workunit.client.0.smithi049.stdout:0/615: rmdir d13/d39/d78 39 2023-12-16T07:40:21.225 INFO:tasks.workunit.client.0.smithi049.stdout:0/616: write d13/d21/d27/d2c/f98 [843881,28003] 0 2023-12-16T07:40:21.226 INFO:tasks.workunit.client.0.smithi049.stdout:4/480: creat d2/db/dd/d52/d8c/f99 x:0 0 0 2023-12-16T07:40:21.227 INFO:tasks.workunit.client.0.smithi049.stdout:6/567: symlink d0/d39/d5b/d65/d58/d2c/lae 0 2023-12-16T07:40:21.228 INFO:tasks.workunit.client.0.smithi049.stdout:0/617: getdents d13/d21/d27/d2c/d62/d70 0 2023-12-16T07:40:21.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/481: symlink d2/db/dd/de/d1e/d44/l9a 0 2023-12-16T07:40:21.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/618: read d13/d3c/fc8 [405779,11017] 0 2023-12-16T07:40:21.230 INFO:tasks.workunit.client.0.smithi049.stdout:0/619: dread - d13/d39/d38/da7/fd1 zero size 2023-12-16T07:40:21.231 INFO:tasks.workunit.client.0.smithi049.stdout:7/471: sync 2023-12-16T07:40:21.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/407: sync 2023-12-16T07:40:21.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/620: creat d13/d39/d38/da7/fd6 x:0 0 0 2023-12-16T07:40:21.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/621: truncate d13/d21/f56 719988 0 2023-12-16T07:40:21.233 INFO:tasks.workunit.client.0.smithi049.stdout:7/472: truncate d7/dc/dd/d14/f32 4418279 0 2023-12-16T07:40:21.234 INFO:tasks.workunit.client.0.smithi049.stdout:0/622: mkdir d13/d39/dbe/dd7 0 2023-12-16T07:40:21.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/473: symlink d7/dc/d15/d57/la1 0 2023-12-16T07:40:21.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/474: stat d7/c34 0 2023-12-16T07:40:21.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/475: stat d7/dc/d6b/d70/d86/f88 0 2023-12-16T07:40:21.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/476: write d7/dc/d2f/d40/f4b [1362961,73268] 0 2023-12-16T07:40:21.237 INFO:tasks.workunit.client.0.smithi049.stdout:0/623: mknod d13/d39/d78/d83/db2/cd8 0 2023-12-16T07:40:21.239 INFO:tasks.workunit.client.0.smithi049.stdout:4/482: rmdir d2/db/dd/de/d1e/d44 39 2023-12-16T07:40:21.242 INFO:tasks.workunit.client.0.smithi049.stdout:0/624: dread d13/d21/d2f/fa6 [0,4194304] 0 2023-12-16T07:40:21.242 INFO:tasks.workunit.client.0.smithi049.stdout:7/477: creat d7/dc/d15/d57/fa2 x:0 0 0 2023-12-16T07:40:21.243 INFO:tasks.workunit.client.0.smithi049.stdout:7/478: creat d7/dc/dd/d14/fa3 x:0 0 0 2023-12-16T07:40:21.246 INFO:tasks.workunit.client.0.smithi049.stdout:7/479: unlink d7/dc/l12 0 2023-12-16T07:40:21.246 INFO:tasks.workunit.client.0.smithi049.stdout:7/480: write d7/dc/d6b/d70/d86/f88 [94290,118156] 0 2023-12-16T07:40:21.248 INFO:tasks.workunit.client.0.smithi049.stdout:7/481: creat d7/dc/d6b/fa4 x:0 0 0 2023-12-16T07:40:21.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/482: mkdir d7/da5 0 2023-12-16T07:40:21.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/483: chown d7/dc/d15/d57/f98 1432864 1 2023-12-16T07:40:21.250 INFO:tasks.workunit.client.0.smithi049.stdout:7/484: write d7/dc/dd/d37/f8d [421824,18877] 0 2023-12-16T07:40:21.250 INFO:tasks.workunit.client.0.smithi049.stdout:0/625: dread d13/d21/f92 [0,4194304] 0 2023-12-16T07:40:21.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/485: symlink d7/dc/la6 0 2023-12-16T07:40:21.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/486: dread - d7/dc/d2f/d40/d5d/f78 zero size 2023-12-16T07:40:21.253 INFO:tasks.workunit.client.0.smithi049.stdout:0/626: rename d13/d39/c49 to d13/d21/d2f/d7d/da0/dc9/cd9 0 2023-12-16T07:40:21.253 INFO:tasks.workunit.client.0.smithi049.stdout:4/483: dread d2/db/dd/de/d1e/d37/f38 [0,4194304] 0 2023-12-16T07:40:21.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/568: dwrite d0/d39/f84 [0,4194304] 0 2023-12-16T07:40:21.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/487: creat d7/dc/d15/fa7 x:0 0 0 2023-12-16T07:40:21.254 INFO:tasks.workunit.client.0.smithi049.stdout:3/408: dwrite d1/d2a/d37/d3f/d5a/d61/d75/f83 [0,4194304] 0 2023-12-16T07:40:21.254 INFO:tasks.workunit.client.0.smithi049.stdout:0/627: mkdir d13/d39/dbe/dd7/dda 0 2023-12-16T07:40:21.255 INFO:tasks.workunit.client.0.smithi049.stdout:4/484: truncate d2/db/dd/de/d1e/d21/f4f 2103692 0 2023-12-16T07:40:21.257 INFO:tasks.workunit.client.0.smithi049.stdout:6/569: creat d0/d2/df/d4e/faf x:0 0 0 2023-12-16T07:40:21.262 INFO:tasks.workunit.client.0.smithi049.stdout:4/485: dread d2/db/f15 [4194304,4194304] 0 2023-12-16T07:40:21.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/488: rename d7/dc/d2f/l4f to d7/dc/d15/d66/la8 0 2023-12-16T07:40:21.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/489: chown d7/dc/dd/d27/d8e 376613634 1 2023-12-16T07:40:21.263 INFO:tasks.workunit.client.0.smithi049.stdout:3/409: mknod d1/d2a/d37/d3f/d5a/d61/d75/c87 0 2023-12-16T07:40:21.263 INFO:tasks.workunit.client.0.smithi049.stdout:3/410: truncate d1/d2a/d37/f5c 463525 0 2023-12-16T07:40:21.267 INFO:tasks.workunit.client.0.smithi049.stdout:0/628: mkdir d13/d21/d99/d46/d65/d82/ddb 0 2023-12-16T07:40:21.268 INFO:tasks.workunit.client.0.smithi049.stdout:6/570: getdents d0/d39/d5b/d65/d58/d2c 0 2023-12-16T07:40:21.270 INFO:tasks.workunit.client.0.smithi049.stdout:4/486: creat d2/db/dd/de/d1e/d37/d4e/f9b x:0 0 0 2023-12-16T07:40:21.270 INFO:tasks.workunit.client.0.smithi049.stdout:7/490: creat d7/d2b/fa9 x:0 0 0 2023-12-16T07:40:21.272 INFO:tasks.workunit.client.0.smithi049.stdout:4/487: dread d2/db/dd/de/d1e/d44/f95 [0,4194304] 0 2023-12-16T07:40:21.272 INFO:tasks.workunit.client.0.smithi049.stdout:4/488: dread - d2/db/dd/de/f96 zero size 2023-12-16T07:40:21.272 INFO:tasks.workunit.client.0.smithi049.stdout:4/489: chown d2/db/dd/de/d1e/f3b 109330 1 2023-12-16T07:40:21.272 INFO:tasks.workunit.client.0.smithi049.stdout:0/629: symlink d13/d21/d99/d46/d65/d82/ddb/ldc 0 2023-12-16T07:40:21.272 INFO:tasks.workunit.client.0.smithi049.stdout:0/630: read - d13/d21/d99/d46/d65/faf zero size 2023-12-16T07:40:21.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/491: symlink d7/dc/dd/d27/laa 0 2023-12-16T07:40:21.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/492: write d7/dc/f69 [263279,37892] 0 2023-12-16T07:40:21.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/493: readlink d7/l24 0 2023-12-16T07:40:21.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/494: truncate d7/dc/dd/d14/f52 1268338 0 2023-12-16T07:40:21.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/495: fdatasync d7/dc/d6b/f84 0 2023-12-16T07:40:21.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/631: creat d13/d21/d99/d46/d65/d82/ddb/fdd x:0 0 0 2023-12-16T07:40:21.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/632: read d13/d21/d27/d2c/d62/daa/fc5 [74771,84204] 0 2023-12-16T07:40:21.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/633: chown d13/d21/d2f/l77 5 1 2023-12-16T07:40:21.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/496: creat d7/dc/dd/d27/fab x:0 0 0 2023-12-16T07:40:21.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/497: creat d7/dc/d6b/d70/fac x:0 0 0 2023-12-16T07:40:21.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/498: read d7/dc/d6b/d70/d86/f88 [614576,118566] 0 2023-12-16T07:40:21.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/499: truncate d7/dc/d2f/d38/f83 1514627 0 2023-12-16T07:40:21.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/411: dwrite d1/d2b/f65 [0,4194304] 0 2023-12-16T07:40:21.287 INFO:tasks.workunit.client.0.smithi049.stdout:0/634: truncate d13/d21/f56 467983 0 2023-12-16T07:40:21.288 INFO:tasks.workunit.client.0.smithi049.stdout:3/412: mkdir d1/d2a/d37/d63/d88 0 2023-12-16T07:40:21.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/635: creat d13/d3c/fde x:0 0 0 2023-12-16T07:40:21.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/636: fdatasync d13/d39/f61 0 2023-12-16T07:40:21.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/637: write d13/d21/d99/d46/d65/f9b [620394,70648] 0 2023-12-16T07:40:21.289 INFO:tasks.workunit.client.0.smithi049.stdout:7/500: write d7/dc/dd/f93 [306642,90291] 0 2023-12-16T07:40:21.290 INFO:tasks.workunit.client.0.smithi049.stdout:0/638: rename d13/d39/d78/d83/db2/fba to d13/d21/d99/d46/fdf 0 2023-12-16T07:40:21.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/571: dwrite d0/d39/d5b/d65/d53/f5f [0,4194304] 0 2023-12-16T07:40:21.296 INFO:tasks.workunit.client.0.smithi049.stdout:4/490: dwrite d2/f6d [0,4194304] 0 2023-12-16T07:40:21.300 INFO:tasks.workunit.client.0.smithi049.stdout:5/471: sync 2023-12-16T07:40:21.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/385: sync 2023-12-16T07:40:21.305 INFO:tasks.workunit.client.0.smithi049.stdout:6/572: creat d0/d39/d5b/d65/d58/fb0 x:0 0 0 2023-12-16T07:40:21.305 INFO:tasks.workunit.client.0.smithi049.stdout:6/573: write d0/d39/d5b/d65/d32/f71 [813798,112958] 0 2023-12-16T07:40:21.306 INFO:tasks.workunit.client.0.smithi049.stdout:4/491: creat d2/db/dd/de/d1e/d37/d82/f9c x:0 0 0 2023-12-16T07:40:21.309 INFO:tasks.workunit.client.0.smithi049.stdout:5/472: mkdir d5/de/d54/d67/d9e 0 2023-12-16T07:40:21.309 INFO:tasks.workunit.client.0.smithi049.stdout:5/473: write d5/de/f40 [173391,79407] 0 2023-12-16T07:40:21.310 INFO:tasks.workunit.client.0.smithi049.stdout:9/386: symlink d4/l7c 0 2023-12-16T07:40:21.310 INFO:tasks.workunit.client.0.smithi049.stdout:9/387: chown d4/d7/d11/c1e 14 1 2023-12-16T07:40:21.310 INFO:tasks.workunit.client.0.smithi049.stdout:9/388: write d4/d7/d11/d1d/f79 [1003449,37351] 0 2023-12-16T07:40:21.311 INFO:tasks.workunit.client.0.smithi049.stdout:5/474: write d5/d1e/d20/f36 [501576,110554] 0 2023-12-16T07:40:21.313 INFO:tasks.workunit.client.0.smithi049.stdout:4/492: mknod d2/db/dd/de/d1e/d44/c9d 0 2023-12-16T07:40:21.314 INFO:tasks.workunit.client.0.smithi049.stdout:7/501: rename d7/dc/d2f/d38/f83 to d7/dc/d6b/d70/fad 0 2023-12-16T07:40:21.315 INFO:tasks.workunit.client.0.smithi049.stdout:9/389: creat d4/d7/d11/d26/d47/d59/f7d x:0 0 0 2023-12-16T07:40:21.315 INFO:tasks.workunit.client.0.smithi049.stdout:9/390: write d4/d7/d11/d1d/f5c [567809,8686] 0 2023-12-16T07:40:21.316 INFO:tasks.workunit.client.0.smithi049.stdout:6/574: dread d0/d39/d5b/d65/d53/f61 [0,4194304] 0 2023-12-16T07:40:21.316 INFO:tasks.workunit.client.0.smithi049.stdout:3/413: dwrite d1/f16 [0,4194304] 0 2023-12-16T07:40:21.316 INFO:tasks.workunit.client.0.smithi049.stdout:5/475: symlink d5/de/d1c/d62/d81/l9f 0 2023-12-16T07:40:21.318 INFO:tasks.workunit.client.0.smithi049.stdout:4/493: dread d2/db/dd/de/d1e/d21/f40 [0,4194304] 0 2023-12-16T07:40:21.321 INFO:tasks.workunit.client.0.smithi049.stdout:0/639: rename d13/d21/d99/d46/dd3 to d13/d39/de0 0 2023-12-16T07:40:21.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/494: creat d2/db/dd/de/d1e/d21/f9e x:0 0 0 2023-12-16T07:40:21.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/495: fsync d2/db/dd/f13 0 2023-12-16T07:40:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:0/640: mkdir d13/de1 0 2023-12-16T07:40:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:9/391: write f0 [5661388,73384] 0 2023-12-16T07:40:21.325 INFO:tasks.workunit.client.0.smithi049.stdout:0/641: dread - d13/d21/d99/d46/d65/d82/ddb/fdd zero size 2023-12-16T07:40:21.326 INFO:tasks.workunit.client.0.smithi049.stdout:5/476: mkdir d5/de/d54/d67/da0 0 2023-12-16T07:40:21.326 INFO:tasks.workunit.client.0.smithi049.stdout:5/477: chown d5/de/f40 27350942 1 2023-12-16T07:40:21.327 INFO:tasks.workunit.client.0.smithi049.stdout:0/642: truncate d13/d21/f92 3922606 0 2023-12-16T07:40:21.329 INFO:tasks.workunit.client.0.smithi049.stdout:0/643: mkdir d13/d21/d27/de2 0 2023-12-16T07:40:21.329 INFO:tasks.workunit.client.0.smithi049.stdout:0/644: chown d13/d21/d27/d2c 54323307 1 2023-12-16T07:40:21.330 INFO:tasks.workunit.client.0.smithi049.stdout:9/392: mknod d4/d7/d11/d1d/d5b/c7e 0 2023-12-16T07:40:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:0/645: mknod d13/d39/dbe/dbf/ce3 0 2023-12-16T07:40:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:0/646: chown d13/d39/f3b 2050670 1 2023-12-16T07:40:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/393: mkdir d4/d7/d11/d56/d7f 0 2023-12-16T07:40:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/394: chown d4/d7/d11/d26/d47/d59/f6d 679709392 1 2023-12-16T07:40:21.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/395: chown d4/c1c 56107887 1 2023-12-16T07:40:21.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/478: fsync d5/d1e/d20/f36 0 2023-12-16T07:40:21.341 INFO:tasks.workunit.client.0.smithi049.stdout:1/470: sync 2023-12-16T07:40:21.342 INFO:tasks.workunit.client.0.smithi049.stdout:9/396: dread d4/d7/d11/f16 [0,4194304] 0 2023-12-16T07:40:21.342 INFO:tasks.workunit.client.0.smithi049.stdout:8/558: sync 2023-12-16T07:40:21.343 INFO:tasks.workunit.client.0.smithi049.stdout:2/463: sync 2023-12-16T07:40:21.343 INFO:tasks.workunit.client.0.smithi049.stdout:2/464: readlink d2/d1d/d28/d56/d11/d1c/l3a 0 2023-12-16T07:40:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:1/471: symlink d20/d41/d4f/d55/la6 0 2023-12-16T07:40:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:1/472: chown d20/d40 204 1 2023-12-16T07:40:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:1/473: read - d20/d40/f81 zero size 2023-12-16T07:40:21.344 INFO:tasks.workunit.client.0.smithi049.stdout:9/397: mkdir d4/d7/d11/d26/d80 0 2023-12-16T07:40:21.345 INFO:tasks.workunit.client.0.smithi049.stdout:9/398: fdatasync d4/d7/f38 0 2023-12-16T07:40:21.345 INFO:tasks.workunit.client.0.smithi049.stdout:1/474: write d20/d41/d52/f68 [3627210,115636] 0 2023-12-16T07:40:21.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/559: rename d0/d13/f3e to d0/d1f/d56/fb1 0 2023-12-16T07:40:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/399: truncate d4/d7/f21 141977 0 2023-12-16T07:40:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/400: fsync d4/db/f66 0 2023-12-16T07:40:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/401: write d4/db/f72 [772299,25595] 0 2023-12-16T07:40:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/402: chown d4/d7/d11/d26/d47/f77 358 1 2023-12-16T07:40:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/403: dread - d4/d45/f61 zero size 2023-12-16T07:40:21.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/496: dwrite d2/db/dd/de/d1e/f2d [0,4194304] 0 2023-12-16T07:40:21.349 INFO:tasks.workunit.client.0.smithi049.stdout:2/465: dread d2/f22 [0,4194304] 0 2023-12-16T07:40:21.349 INFO:tasks.workunit.client.0.smithi049.stdout:1/475: rename d20/d43/c44 to d20/d7b/ca7 0 2023-12-16T07:40:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/560: creat d0/fb2 x:0 0 0 2023-12-16T07:40:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:6/575: dwrite d0/d39/d5b/d65/d27/f96 [0,4194304] 0 2023-12-16T07:40:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:6/576: chown d0/d2/f5 133 1 2023-12-16T07:40:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:6/577: fdatasync d0/d2/f5 0 2023-12-16T07:40:21.351 INFO:tasks.workunit.client.0.smithi049.stdout:7/502: dwrite d7/dc/d2f/d38/f3d [0,4194304] 0 2023-12-16T07:40:21.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/404: unlink d4/db/f44 0 2023-12-16T07:40:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/466: symlink d2/d1d/d28/d56/d11/d1c/l9b 0 2023-12-16T07:40:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:4/497: mkdir d2/db/dd/d9f 0 2023-12-16T07:40:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/467: chown d2/c64 1859801 1 2023-12-16T07:40:21.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/468: truncate d2/d1d/d24/f42 1441807 0 2023-12-16T07:40:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:1/476: creat d20/d41/d52/d86/fa8 x:0 0 0 2023-12-16T07:40:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:1/477: truncate f19 1516229 0 2023-12-16T07:40:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:6/578: getdents d0/d39/d5b/d65/d58/d33 0 2023-12-16T07:40:21.359 INFO:tasks.workunit.client.0.smithi049.stdout:6/579: dread - d0/d39/d5b/d65/d4c/f8e zero size 2023-12-16T07:40:21.360 INFO:tasks.workunit.client.0.smithi049.stdout:3/414: dwrite d1/ff [0,4194304] 0 2023-12-16T07:40:21.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/405: mknod d4/d3e/c81 0 2023-12-16T07:40:21.363 INFO:tasks.workunit.client.0.smithi049.stdout:9/406: chown d4/d7/d11/d1d/l57 11 1 2023-12-16T07:40:21.363 INFO:tasks.workunit.client.0.smithi049.stdout:5/479: dwrite d5/d1e/d21/f45 [0,4194304] 0 2023-12-16T07:40:21.366 INFO:tasks.workunit.client.0.smithi049.stdout:4/498: rename d2/db/dd/de/d1e/d37/d4e/f5a to d2/db/dd/d52/fa0 0 2023-12-16T07:40:21.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/480: link f3 d5/de/d54/d57/fa1 0 2023-12-16T07:40:21.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/469: rename d2/d26/l62 to d2/d26/d43/l9c 0 2023-12-16T07:40:21.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/470: stat d2/d1d/d28/d8b 0 2023-12-16T07:40:21.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/499: rmdir d2/db/dd/de/d1e/d44 39 2023-12-16T07:40:21.383 INFO:tasks.workunit.client.0.smithi049.stdout:1/478: rename f1d to d20/d7b/d71/fa9 0 2023-12-16T07:40:21.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/471: unlink d2/f36 0 2023-12-16T07:40:21.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/472: write d2/d1d/d28/d56/d66/d6b/f94 [956668,14500] 0 2023-12-16T07:40:21.385 INFO:tasks.workunit.client.0.smithi049.stdout:4/500: rename d2/db/dd/de/f58 to d2/db/dd/de/fa1 0 2023-12-16T07:40:21.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/481: rename d5/de/c1b to d5/de/d54/d67/da0/ca2 0 2023-12-16T07:40:21.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/482: stat d5/de/d54/d57/d3c 0 2023-12-16T07:40:21.386 INFO:tasks.workunit.client.0.smithi049.stdout:1/479: rmdir d20/d41/d4f/d55/d7f 39 2023-12-16T07:40:21.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/473: rmdir d2/d1d/d24 39 2023-12-16T07:40:21.389 INFO:tasks.workunit.client.0.smithi049.stdout:4/501: mknod d2/db/dd/de/d1e/ca2 0 2023-12-16T07:40:21.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/502: chown d2/db/d6b 254453278 1 2023-12-16T07:40:21.390 INFO:tasks.workunit.client.0.smithi049.stdout:8/561: dwrite d0/d13/f2f [0,4194304] 0 2023-12-16T07:40:21.390 INFO:tasks.workunit.client.0.smithi049.stdout:2/474: creat d2/d1d/d24/d55/d7c/d98/f9d x:0 0 0 2023-12-16T07:40:21.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/503: dwrite d7/dc/dd/d27/f8c [4194304,4194304] 0 2023-12-16T07:40:21.395 INFO:tasks.workunit.client.0.smithi049.stdout:9/407: dwrite d4/db/f41 [0,4194304] 0 2023-12-16T07:40:21.396 INFO:tasks.workunit.client.0.smithi049.stdout:4/503: symlink d2/db/dd/de/la3 0 2023-12-16T07:40:21.396 INFO:tasks.workunit.client.0.smithi049.stdout:8/562: symlink d0/d13/d42/d5b/d68/lb3 0 2023-12-16T07:40:21.397 INFO:tasks.workunit.client.0.smithi049.stdout:3/415: dwrite d1/d2a/d37/d3f/f5d [0,4194304] 0 2023-12-16T07:40:21.397 INFO:tasks.workunit.client.0.smithi049.stdout:3/416: fsync d1/f16 0 2023-12-16T07:40:21.397 INFO:tasks.workunit.client.0.smithi049.stdout:2/475: mknod d2/d1d/d38/c9e 0 2023-12-16T07:40:21.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/580: dwrite d0/d2/f7d [0,4194304] 0 2023-12-16T07:40:21.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/504: getdents d7/dc/d15/d66 0 2023-12-16T07:40:21.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/505: truncate d7/dc/dd/d35/f77 930028 0 2023-12-16T07:40:21.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/408: mkdir d4/d7/d11/d1d/d82 0 2023-12-16T07:40:21.405 INFO:tasks.workunit.client.0.smithi049.stdout:4/504: rename d2/db/dd/d52/d62 to d2/db/dd/de/d1e/d37/da4 0 2023-12-16T07:40:21.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/563: dread d0/d1f/f67 [0,4194304] 0 2023-12-16T07:40:21.414 INFO:tasks.workunit.client.0.smithi049.stdout:1/480: dwrite d20/f8e [0,4194304] 0 2023-12-16T07:40:21.414 INFO:tasks.workunit.client.0.smithi049.stdout:1/481: truncate d20/d45/d47/f9d 186324 0 2023-12-16T07:40:21.415 INFO:tasks.workunit.client.0.smithi049.stdout:5/483: dwrite d5/de/d1c/f46 [4194304,4194304] 0 2023-12-16T07:40:21.423 INFO:tasks.workunit.client.0.smithi049.stdout:1/482: write d20/f37 [2155247,29086] 0 2023-12-16T07:40:21.440 INFO:tasks.workunit.client.0.smithi049.stdout:5/484: dwrite d5/d1e/d21/d4e/f9d [0,4194304] 0 2023-12-16T07:40:21.440 INFO:tasks.workunit.client.0.smithi049.stdout:9/409: dwrite d4/db/f72 [0,4194304] 0 2023-12-16T07:40:21.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/564: dwrite d0/d1f/d56/f74 [0,4194304] 0 2023-12-16T07:40:21.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/565: fsync d0/d13/fe 0 2023-12-16T07:40:21.442 INFO:tasks.workunit.client.0.smithi049.stdout:3/417: link d1/c4e d1/d2a/d37/d3f/c89 0 2023-12-16T07:40:21.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/581: mkdir d0/d39/d5b/d65/d27/db1 0 2023-12-16T07:40:21.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/582: dread - d0/d2/df/d4e/d5d/d6f/d4a/fa3 zero size 2023-12-16T07:40:21.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/476: rename d2/d1d/d28/d56/d11/d1c/f63 to d2/d1d/d28/d56/d71/f9f 0 2023-12-16T07:40:21.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/477: fsync d2/d1d/d24/f50 0 2023-12-16T07:40:21.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/478: write d2/d1d/d28/d56/d11/f67 [523928,83318] 0 2023-12-16T07:40:21.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/505: mknod d2/db/d6b/ca5 0 2023-12-16T07:40:21.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/506: readlink d2/db/dd/de/d1e/d37/da4/l71 0 2023-12-16T07:40:21.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/507: chown d2/db/l70 34 1 2023-12-16T07:40:21.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/508: chown d2/db/dd/de/d1e/ca2 83717067 1 2023-12-16T07:40:21.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/509: readlink d2/db/dd/l11 0 2023-12-16T07:40:21.452 INFO:tasks.workunit.client.0.smithi049.stdout:7/506: rmdir d7/dc/dd/d35 39 2023-12-16T07:40:21.461 INFO:tasks.workunit.client.0.smithi049.stdout:1/483: creat d20/d40/d6f/faa x:0 0 0 2023-12-16T07:40:21.462 INFO:tasks.workunit.client.0.smithi049.stdout:1/484: write d20/d41/d52/f5e [2010983,4819] 0 2023-12-16T07:40:21.462 INFO:tasks.workunit.client.0.smithi049.stdout:9/410: dwrite d4/f34 [0,4194304] 0 2023-12-16T07:40:21.463 INFO:tasks.workunit.client.0.smithi049.stdout:3/418: dwrite d1/d2a/d37/d3f/d5a/d6d/f82 [0,4194304] 0 2023-12-16T07:40:21.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/485: creat d5/de/d54/d57/d2f/fa3 x:0 0 0 2023-12-16T07:40:21.467 INFO:tasks.workunit.client.0.smithi049.stdout:5/486: write d5/d1e/d21/d4e/f9d [3008430,81778] 0 2023-12-16T07:40:21.467 INFO:tasks.workunit.client.0.smithi049.stdout:8/566: mknod d0/d13/d42/d5b/dab/cb4 0 2023-12-16T07:40:21.468 INFO:tasks.workunit.client.0.smithi049.stdout:8/567: write d0/f6e [2440841,60341] 0 2023-12-16T07:40:21.469 INFO:tasks.workunit.client.0.smithi049.stdout:6/583: mknod d0/d39/d5b/d65/d58/cb2 0 2023-12-16T07:40:21.469 INFO:tasks.workunit.client.0.smithi049.stdout:6/584: write d0/d39/d5b/d65/d58/f8f [184344,56566] 0 2023-12-16T07:40:21.469 INFO:tasks.workunit.client.0.smithi049.stdout:9/411: write d4/db/f72 [773333,106091] 0 2023-12-16T07:40:21.470 INFO:tasks.workunit.client.0.smithi049.stdout:6/585: write d0/d39/d5b/d65/d27/f88 [2284498,88225] 0 2023-12-16T07:40:21.471 INFO:tasks.workunit.client.0.smithi049.stdout:2/479: rename d2/d1d/d28/f52 to d2/d1d/d28/d8b/fa0 0 2023-12-16T07:40:21.471 INFO:tasks.workunit.client.0.smithi049.stdout:2/480: chown d2/de/d77/f90 30 1 2023-12-16T07:40:21.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/510: creat d2/db/dd/de/d1e/d44/fa6 x:0 0 0 2023-12-16T07:40:21.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/511: fsync f1 0 2023-12-16T07:40:21.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/512: fdatasync d2/db/dd/de/d1e/f64 0 2023-12-16T07:40:21.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/487: rmdir d5/d1e/d21/d4e 39 2023-12-16T07:40:21.481 INFO:tasks.workunit.client.0.smithi049.stdout:9/412: mkdir d4/d7/d11/d1d/d69/d76/d83 0 2023-12-16T07:40:21.482 INFO:tasks.workunit.client.0.smithi049.stdout:1/485: dwrite d20/d41/f64 [0,4194304] 0 2023-12-16T07:40:21.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/413: dread d4/d7/f21 [0,4194304] 0 2023-12-16T07:40:21.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/507: rename d7/dc/dd/d35/f77 to d7/dc/dd/fae 0 2023-12-16T07:40:21.485 INFO:tasks.workunit.client.0.smithi049.stdout:3/419: rename d1 to d1/d2a/d8a 22 2023-12-16T07:40:21.486 INFO:tasks.workunit.client.0.smithi049.stdout:2/481: mkdir d2/d1d/d24/d55/d7c/d98/da1 0 2023-12-16T07:40:21.486 INFO:tasks.workunit.client.0.smithi049.stdout:6/586: dwrite d0/d2/df/d4e/d5d/d6f/fa0 [0,4194304] 0 2023-12-16T07:40:21.486 INFO:tasks.workunit.client.0.smithi049.stdout:6/587: truncate d0/d39/d5b/d65/d58/f80 447400 0 2023-12-16T07:40:21.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/513: rmdir d2/db/dd/de/d1e/d37/d82 39 2023-12-16T07:40:21.494 INFO:tasks.workunit.client.0.smithi049.stdout:5/488: creat d5/de/d54/d67/fa4 x:0 0 0 2023-12-16T07:40:21.497 INFO:tasks.workunit.client.0.smithi049.stdout:1/486: rmdir d20/d7b/d88 39 2023-12-16T07:40:21.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/414: symlink d4/d7/d11/d1d/d69/d76/d83/l84 0 2023-12-16T07:40:21.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/415: readlink d4/d7/d11/d1d/l57 0 2023-12-16T07:40:21.501 INFO:tasks.workunit.client.0.smithi049.stdout:7/508: rename d7/dc/d15/d66/f85 to d7/dc/d2f/d40/d5d/faf 0 2023-12-16T07:40:21.502 INFO:tasks.workunit.client.0.smithi049.stdout:7/509: write d7/f67 [2027140,72490] 0 2023-12-16T07:40:21.502 INFO:tasks.workunit.client.0.smithi049.stdout:3/420: mknod d1/d2a/d37/d3f/d5a/c8b 0 2023-12-16T07:40:21.503 INFO:tasks.workunit.client.0.smithi049.stdout:3/421: fdatasync d1/d2a/d37/d3f/d5a/d61/d6b/f72 0 2023-12-16T07:40:21.504 INFO:tasks.workunit.client.0.smithi049.stdout:2/482: creat d2/d1d/d24/d55/d76/fa2 x:0 0 0 2023-12-16T07:40:21.511 INFO:tasks.workunit.client.0.smithi049.stdout:6/588: symlink d0/lb3 0 2023-12-16T07:40:21.512 INFO:tasks.workunit.client.0.smithi049.stdout:5/489: symlink d5/d1e/la5 0 2023-12-16T07:40:21.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/487: mkdir d20/d41/dab 0 2023-12-16T07:40:21.515 INFO:tasks.workunit.client.0.smithi049.stdout:4/514: rename d2/db/dd/d52/d8c/f99 to d2/db/dd/de/d1e/d37/d6f/fa7 0 2023-12-16T07:40:21.517 INFO:tasks.workunit.client.0.smithi049.stdout:7/510: creat d7/dc/d2f/d40/d5d/fb0 x:0 0 0 2023-12-16T07:40:21.517 INFO:tasks.workunit.client.0.smithi049.stdout:9/416: dwrite d4/d7/f7a [0,4194304] 0 2023-12-16T07:40:21.517 INFO:tasks.workunit.client.0.smithi049.stdout:6/589: link d0/d39/d5b/d65/d27/f85 d0/d39/d8b/fb4 0 2023-12-16T07:40:21.518 INFO:tasks.workunit.client.0.smithi049.stdout:7/511: write d7/dc/d2f/f60 [4071128,70967] 0 2023-12-16T07:40:21.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/590: write d0/d2/df/d4e/d5d/d6f/fa0 [77945,69593] 0 2023-12-16T07:40:21.521 INFO:tasks.workunit.client.0.smithi049.stdout:1/488: mkdir d20/d40/d6f/dac 0 2023-12-16T07:40:21.523 INFO:tasks.workunit.client.0.smithi049.stdout:3/422: rename d1/d2a/d37/d3f/d5a/c8b to d1/d2a/d37/d3f/c8c 0 2023-12-16T07:40:21.523 INFO:tasks.workunit.client.0.smithi049.stdout:4/515: creat d2/db/dd/d52/fa8 x:0 0 0 2023-12-16T07:40:21.528 INFO:tasks.workunit.client.0.smithi049.stdout:6/591: creat d0/d2/df/d4e/d5d/d6f/d4a/fb5 x:0 0 0 2023-12-16T07:40:21.530 INFO:tasks.workunit.client.0.smithi049.stdout:5/490: creat d5/d1e/d21/d58/d65/fa6 x:0 0 0 2023-12-16T07:40:21.531 INFO:tasks.workunit.client.0.smithi049.stdout:5/491: write d5/de/f31 [2641107,86138] 0 2023-12-16T07:40:21.532 INFO:tasks.workunit.client.0.smithi049.stdout:5/492: chown d5/de/d54/d67/d9e 608 1 2023-12-16T07:40:21.533 INFO:tasks.workunit.client.0.smithi049.stdout:3/423: symlink d1/d2a/d37/d63/l8d 0 2023-12-16T07:40:21.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/493: link d5/c8d d5/d1e/d20/ca7 0 2023-12-16T07:40:21.536 INFO:tasks.workunit.client.0.smithi049.stdout:3/424: mkdir d1/d2a/d37/d63/d88/d8e 0 2023-12-16T07:40:21.538 INFO:tasks.workunit.client.0.smithi049.stdout:5/494: chown d5/d1e/d21/c24 58075879 1 2023-12-16T07:40:21.551 INFO:tasks.workunit.client.0.smithi049.stdout:0/647: sync 2023-12-16T07:40:21.552 INFO:tasks.workunit.client.0.smithi049.stdout:0/648: creat d13/d39/dbe/dd7/dda/fe4 x:0 0 0 2023-12-16T07:40:21.565 INFO:tasks.workunit.client.0.smithi049.stdout:0/649: dwrite d13/d21/d27/f97 [0,4194304] 0 2023-12-16T07:40:21.565 INFO:tasks.workunit.client.0.smithi049.stdout:0/650: write d13/d39/f87 [19201,95718] 0 2023-12-16T07:40:21.568 INFO:tasks.workunit.client.0.smithi049.stdout:0/651: creat d13/d21/d99/d46/d65/fe5 x:0 0 0 2023-12-16T07:40:21.569 INFO:tasks.workunit.client.0.smithi049.stdout:8/568: truncate d0/d1f/d56/f74 3951587 0 2023-12-16T07:40:21.570 INFO:tasks.workunit.client.0.smithi049.stdout:0/652: mknod d13/d39/d78/ce6 0 2023-12-16T07:40:21.570 INFO:tasks.workunit.client.0.smithi049.stdout:0/653: chown d13/d39/de0 57 1 2023-12-16T07:40:21.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/569: creat d0/d13/d42/d5b/d68/d6b/da2/fb5 x:0 0 0 2023-12-16T07:40:21.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/654: mkdir d13/d39/d8a/de7 0 2023-12-16T07:40:21.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/655: stat d13/d21/d99/d46/d65/d82/fc0 0 2023-12-16T07:40:21.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/656: write d13/d21/d99/d46/f63 [4885742,38613] 0 2023-12-16T07:40:21.574 INFO:tasks.workunit.client.0.smithi049.stdout:8/570: rmdir d0/d13/d42/d5b/d68/d6b/da2/da5 39 2023-12-16T07:40:21.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/571: creat d0/d13/d42/d5b/dab/fb6 x:0 0 0 2023-12-16T07:40:21.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/572: fdatasync d0/d1f/d36/f81 0 2023-12-16T07:40:21.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/573: fsync d0/d6a/fa4 0 2023-12-16T07:40:21.578 INFO:tasks.workunit.client.0.smithi049.stdout:8/574: mkdir d0/d1f/db7 0 2023-12-16T07:40:21.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/575: chown d0/d13/d42/d5b/dab/d89 38 1 2023-12-16T07:40:21.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/576: truncate d0/d13/f66 1030139 0 2023-12-16T07:40:21.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/577: write d0/d13/d42/d5b/dab/d89/f94 [390773,46613] 0 2023-12-16T07:40:21.592 INFO:tasks.workunit.client.0.smithi049.stdout:4/516: creat d2/fa9 x:0 0 0 2023-12-16T07:40:21.593 INFO:tasks.workunit.client.0.smithi049.stdout:4/517: getdents d2/db/dd/de/d1e/d21 0 2023-12-16T07:40:21.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/512: rename l3 to d7/dc/d2f/d38/lb1 0 2023-12-16T07:40:21.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/518: creat d2/db/dd/de/d1e/d37/faa x:0 0 0 2023-12-16T07:40:21.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/489: rename d20/l60 to d20/d41/dab/lad 0 2023-12-16T07:40:21.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/495: rename d5/c8d to d5/d1e/d21/ca8 0 2023-12-16T07:40:21.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/657: rename d13/fa1 to d13/d39/d38/d7e/d8b/fe8 0 2023-12-16T07:40:21.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/417: rename d4/fd to d4/f85 0 2023-12-16T07:40:21.607 INFO:tasks.workunit.client.0.smithi049.stdout:5/496: mkdir d5/de/d54/da9 0 2023-12-16T07:40:21.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/418: unlink d4/db/f2a 0 2023-12-16T07:40:21.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/497: mknod d5/d1e/d20/d95/d9c/caa 0 2023-12-16T07:40:21.611 INFO:tasks.workunit.client.0.smithi049.stdout:4/519: rename d2/db/dd/d2a/f5d to d2/db/fab 0 2023-12-16T07:40:21.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/658: rename d13/d3c/l4a to d13/d39/d8a/de7/le9 0 2023-12-16T07:40:21.614 INFO:tasks.workunit.client.0.smithi049.stdout:0/659: rename d13/d21 to d13/d21/d27/d2c/dea 22 2023-12-16T07:40:21.615 INFO:tasks.workunit.client.0.smithi049.stdout:4/520: rmdir d2/db/dd/d52/d97 0 2023-12-16T07:40:21.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/490: dread ff [0,4194304] 0 2023-12-16T07:40:21.618 INFO:tasks.workunit.client.0.smithi049.stdout:7/513: dwrite d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:21.618 INFO:tasks.workunit.client.0.smithi049.stdout:4/521: creat d2/fac x:0 0 0 2023-12-16T07:40:21.618 INFO:tasks.workunit.client.0.smithi049.stdout:7/514: write f4 [3256380,32611] 0 2023-12-16T07:40:21.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/522: mkdir d2/db/d6b/dad 0 2023-12-16T07:40:21.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/491: symlink d20/d40/d6f/lae 0 2023-12-16T07:40:21.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/492: fsync d20/f2d 0 2023-12-16T07:40:21.626 INFO:tasks.workunit.client.0.smithi049.stdout:9/419: dread d4/d7/d11/d26/f37 [4194304,4194304] 0 2023-12-16T07:40:21.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/523: creat d2/db/dd/de/d1e/d37/d82/fae x:0 0 0 2023-12-16T07:40:21.628 INFO:tasks.workunit.client.0.smithi049.stdout:4/524: truncate d2/db/dd/de/fa1 388504 0 2023-12-16T07:40:21.628 INFO:tasks.workunit.client.0.smithi049.stdout:4/525: read - d2/db/dd/de/d1e/d37/d82/fae zero size 2023-12-16T07:40:21.629 INFO:tasks.workunit.client.0.smithi049.stdout:1/493: creat d20/d41/d4f/d55/faf x:0 0 0 2023-12-16T07:40:21.629 INFO:tasks.workunit.client.0.smithi049.stdout:1/494: chown f2 451963868 1 2023-12-16T07:40:21.630 INFO:tasks.workunit.client.0.smithi049.stdout:8/578: dread d0/f43 [0,4194304] 0 2023-12-16T07:40:21.630 INFO:tasks.workunit.client.0.smithi049.stdout:1/495: write d20/d41/d4f/d55/d58/f7e [4320964,129421] 0 2023-12-16T07:40:21.630 INFO:tasks.workunit.client.0.smithi049.stdout:9/420: symlink d4/d7/d11/d26/d47/d59/l86 0 2023-12-16T07:40:21.631 INFO:tasks.workunit.client.0.smithi049.stdout:9/421: truncate d4/d7/d11/d1d/f5c 1389748 0 2023-12-16T07:40:21.633 INFO:tasks.workunit.client.0.smithi049.stdout:1/496: mknod d20/d45/d77/cb0 0 2023-12-16T07:40:21.634 INFO:tasks.workunit.client.0.smithi049.stdout:5/498: dwrite d5/d1e/d20/f56 [0,4194304] 0 2023-12-16T07:40:21.635 INFO:tasks.workunit.client.0.smithi049.stdout:8/579: getdents d0/d1f/d4e 0 2023-12-16T07:40:21.635 INFO:tasks.workunit.client.0.smithi049.stdout:8/580: dread - d0/d13/d42/d5b/d68/fa9 zero size 2023-12-16T07:40:21.635 INFO:tasks.workunit.client.0.smithi049.stdout:4/526: write d2/db/dd/de/d1e/d21/f25 [5629689,41000] 0 2023-12-16T07:40:21.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/499: dread d5/de/f68 [0,4194304] 0 2023-12-16T07:40:21.635 INFO:tasks.workunit.client.0.smithi049.stdout:1/497: unlink d20/d41/d52/f68 0 2023-12-16T07:40:21.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/581: truncate d0/d1f/f65 636520 0 2023-12-16T07:40:21.638 INFO:tasks.workunit.client.0.smithi049.stdout:4/527: creat d2/db/d6b/faf x:0 0 0 2023-12-16T07:40:21.638 INFO:tasks.workunit.client.0.smithi049.stdout:9/422: dread d4/ff [0,4194304] 0 2023-12-16T07:40:21.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/498: mkdir d20/d41/d52/d86/db1 0 2023-12-16T07:40:21.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/499: write d20/d45/d47/f6d [157449,62616] 0 2023-12-16T07:40:21.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/500: truncate f1f 4398325 0 2023-12-16T07:40:21.639 INFO:tasks.workunit.client.0.smithi049.stdout:4/528: write d2/db/f15 [2089358,48099] 0 2023-12-16T07:40:21.639 INFO:tasks.workunit.client.0.smithi049.stdout:8/582: mkdir d0/d1f/d36/db8 0 2023-12-16T07:40:21.640 INFO:tasks.workunit.client.0.smithi049.stdout:1/501: mknod d20/d43/cb2 0 2023-12-16T07:40:21.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/529: symlink d2/db/dd/de/d1e/d37/da4/lb0 0 2023-12-16T07:40:21.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/530: write d2/db/d6b/faf [186641,115215] 0 2023-12-16T07:40:21.642 INFO:tasks.workunit.client.0.smithi049.stdout:8/583: mkdir d0/d13/d42/d5b/d68/d6b/da2/db9 0 2023-12-16T07:40:21.643 INFO:tasks.workunit.client.0.smithi049.stdout:0/660: dwrite d13/d21/d99/d46/fac [0,4194304] 0 2023-12-16T07:40:21.645 INFO:tasks.workunit.client.0.smithi049.stdout:4/531: creat d2/db/dd/de/d1e/d37/d6f/fb1 x:0 0 0 2023-12-16T07:40:21.645 INFO:tasks.workunit.client.0.smithi049.stdout:7/515: dwrite d7/dc/dd/d35/f97 [0,4194304] 0 2023-12-16T07:40:21.645 INFO:tasks.workunit.client.0.smithi049.stdout:8/584: chown d0/d1f/d1c/f39 4482657 1 2023-12-16T07:40:21.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/500: dread d5/de/d1c/f46 [4194304,4194304] 0 2023-12-16T07:40:21.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/501: readlink d5/de/l12 0 2023-12-16T07:40:21.668 INFO:tasks.workunit.client.0.smithi049.stdout:7/516: mkdir d7/dc/dd/d37/d5c/db2 0 2023-12-16T07:40:21.669 INFO:tasks.workunit.client.0.smithi049.stdout:1/502: dwrite f14 [0,4194304] 0 2023-12-16T07:40:21.669 INFO:tasks.workunit.client.0.smithi049.stdout:8/585: creat d0/d13/d42/d5b/d68/fba x:0 0 0 2023-12-16T07:40:21.670 INFO:tasks.workunit.client.0.smithi049.stdout:5/502: getdents d5/de/d1c 0 2023-12-16T07:40:21.672 INFO:tasks.workunit.client.0.smithi049.stdout:1/503: rename d20/d7b/d71/f94 to d20/d45/d47/fb3 0 2023-12-16T07:40:21.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/586: mkdir d0/d1f/d4e/dbb 0 2023-12-16T07:40:21.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/587: chown d0/d6a/c84 25 1 2023-12-16T07:40:21.674 INFO:tasks.workunit.client.0.smithi049.stdout:0/661: dwrite d13/fbb [0,4194304] 0 2023-12-16T07:40:21.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/588: write d0/f4f [1793389,102229] 0 2023-12-16T07:40:21.675 INFO:tasks.workunit.client.0.smithi049.stdout:7/517: dread d7/dc/d2f/d40/d5d/faf [0,4194304] 0 2023-12-16T07:40:21.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/504: creat d20/d40/d6f/fb4 x:0 0 0 2023-12-16T07:40:21.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/505: chown d20/d41/dab 1568 1 2023-12-16T07:40:21.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/506: chown d20/d41/d4f/d55/d58 156 1 2023-12-16T07:40:21.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/507: stat d20/d40/l50 0 2023-12-16T07:40:21.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/508: fsync d20/d7b/d71/fa9 0 2023-12-16T07:40:21.679 INFO:tasks.workunit.client.0.smithi049.stdout:5/503: dread d5/d1e/d21/f3b [0,4194304] 0 2023-12-16T07:40:21.679 INFO:tasks.workunit.client.0.smithi049.stdout:4/532: dwrite d2/fac [0,4194304] 0 2023-12-16T07:40:21.679 INFO:tasks.workunit.client.0.smithi049.stdout:5/504: readlink d5/de/l12 0 2023-12-16T07:40:21.680 INFO:tasks.workunit.client.0.smithi049.stdout:7/518: getdents d7/dc/d2f/d40 0 2023-12-16T07:40:21.680 INFO:tasks.workunit.client.0.smithi049.stdout:1/509: write d20/f22 [4146804,31162] 0 2023-12-16T07:40:21.681 INFO:tasks.workunit.client.0.smithi049.stdout:1/510: chown d20/d45/d47/f65 488108128 1 2023-12-16T07:40:21.684 INFO:tasks.workunit.client.0.smithi049.stdout:4/533: symlink d2/db/dd/lb2 0 2023-12-16T07:40:21.686 INFO:tasks.workunit.client.0.smithi049.stdout:8/589: dread d0/d1f/d36/f45 [0,4194304] 0 2023-12-16T07:40:21.686 INFO:tasks.workunit.client.0.smithi049.stdout:8/590: chown d0/d13/d42/d5b/d68/f8f 25 1 2023-12-16T07:40:21.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/519: unlink d7/dc/dd/d37/l50 0 2023-12-16T07:40:21.688 INFO:tasks.workunit.client.0.smithi049.stdout:0/662: dwrite d13/f17 [0,4194304] 0 2023-12-16T07:40:21.688 INFO:tasks.workunit.client.0.smithi049.stdout:4/534: write d2/db/dd/d52/f6a [1166398,18489] 0 2023-12-16T07:40:21.689 INFO:tasks.workunit.client.0.smithi049.stdout:5/505: dread d5/f7c [0,4194304] 0 2023-12-16T07:40:21.690 INFO:tasks.workunit.client.0.smithi049.stdout:8/591: rename d0/d13/d42/d5b/d68/d6b/da2/fb5 to d0/d13/d42/fbc 0 2023-12-16T07:40:21.691 INFO:tasks.workunit.client.0.smithi049.stdout:7/520: creat d7/dc/fb3 x:0 0 0 2023-12-16T07:40:21.693 INFO:tasks.workunit.client.0.smithi049.stdout:8/592: creat d0/d13/d42/d5b/d68/d6b/da2/db9/fbd x:0 0 0 2023-12-16T07:40:21.694 INFO:tasks.workunit.client.0.smithi049.stdout:7/521: mkdir d7/db4 0 2023-12-16T07:40:21.694 INFO:tasks.workunit.client.0.smithi049.stdout:7/522: fdatasync d7/dc/d2f/d40/d5d/f96 0 2023-12-16T07:40:21.696 INFO:tasks.workunit.client.0.smithi049.stdout:8/593: mkdir d0/d1f/db7/dbe 0 2023-12-16T07:40:21.696 INFO:tasks.workunit.client.0.smithi049.stdout:8/594: dread - d0/d1f/d56/f93 zero size 2023-12-16T07:40:21.698 INFO:tasks.workunit.client.0.smithi049.stdout:7/523: getdents d7/dc/d15 0 2023-12-16T07:40:21.700 INFO:tasks.workunit.client.0.smithi049.stdout:8/595: mkdir d0/d1f/d36/dbf 0 2023-12-16T07:40:21.701 INFO:tasks.workunit.client.0.smithi049.stdout:7/524: creat d7/dc/dd/d27/fb5 x:0 0 0 2023-12-16T07:40:21.702 INFO:tasks.workunit.client.0.smithi049.stdout:0/663: dwrite d13/d21/d27/f97 [0,4194304] 0 2023-12-16T07:40:21.702 INFO:tasks.workunit.client.0.smithi049.stdout:1/511: dwrite d20/d45/d47/f6d [0,4194304] 0 2023-12-16T07:40:21.702 INFO:tasks.workunit.client.0.smithi049.stdout:4/535: dread d2/db/dd/de/d1e/d37/da4/f78 [0,4194304] 0 2023-12-16T07:40:21.702 INFO:tasks.workunit.client.0.smithi049.stdout:4/536: fsync d2/fac 0 2023-12-16T07:40:21.703 INFO:tasks.workunit.client.0.smithi049.stdout:8/596: creat d0/d1f/d36/db8/fc0 x:0 0 0 2023-12-16T07:40:21.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/664: mknod d13/d39/ceb 0 2023-12-16T07:40:21.707 INFO:tasks.workunit.client.0.smithi049.stdout:4/537: creat d2/db/dd/de/d1e/d21/fb3 x:0 0 0 2023-12-16T07:40:21.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/665: unlink d13/d21/f56 0 2023-12-16T07:40:21.714 INFO:tasks.workunit.client.0.smithi049.stdout:0/666: rmdir d13/d21/d99/d46 39 2023-12-16T07:40:21.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/667: rename d13/d21/d99/fa3 to d13/d21/d27/d2c/d62/daa/fec 0 2023-12-16T07:40:21.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/668: write d13/d21/d27/f88 [773714,88994] 0 2023-12-16T07:40:21.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/669: fsync d13/d21/d27/d2c/d62/d70/f8f 0 2023-12-16T07:40:21.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/670: rmdir d13/d21/d99/d46/d65/d82/ddb 39 2023-12-16T07:40:21.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/671: chown d13/d39/d78/d83/db2 2044331 1 2023-12-16T07:40:21.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/672: dread - d13/d21/d99/d46/d65/faf zero size 2023-12-16T07:40:21.718 INFO:tasks.workunit.client.0.smithi049.stdout:0/673: dread - d13/d39/d8a/fd5 zero size 2023-12-16T07:40:21.718 INFO:tasks.workunit.client.0.smithi049.stdout:0/674: creat d13/d21/d99/d46/d65/d82/ddb/fed x:0 0 0 2023-12-16T07:40:21.719 INFO:tasks.workunit.client.0.smithi049.stdout:0/675: mknod d13/de1/cee 0 2023-12-16T07:40:21.719 INFO:tasks.workunit.client.0.smithi049.stdout:0/676: chown d13/d21/d99/d46/d65/f9b 8 1 2023-12-16T07:40:21.719 INFO:tasks.workunit.client.0.smithi049.stdout:0/677: chown d13/d21/d27/d2c/d62 834 1 2023-12-16T07:40:21.719 INFO:tasks.workunit.client.0.smithi049.stdout:0/678: write d13/d21/d27/d2c/f98 [1651334,104033] 0 2023-12-16T07:40:21.724 INFO:tasks.workunit.client.0.smithi049.stdout:7/525: dwrite f4 [0,4194304] 0 2023-12-16T07:40:21.724 INFO:tasks.workunit.client.0.smithi049.stdout:7/526: truncate d7/dc/dd/ff 4792157 0 2023-12-16T07:40:21.729 INFO:tasks.workunit.client.0.smithi049.stdout:8/597: dwrite d0/d1f/fac [0,4194304] 0 2023-12-16T07:40:21.729 INFO:tasks.workunit.client.0.smithi049.stdout:7/527: mknod d7/dc/dd/d35/cb6 0 2023-12-16T07:40:21.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/679: dwrite d13/d21/d99/d46/d65/faf [0,4194304] 0 2023-12-16T07:40:21.737 INFO:tasks.workunit.client.0.smithi049.stdout:7/528: dread d7/dc/f25 [0,4194304] 0 2023-12-16T07:40:21.742 INFO:tasks.workunit.client.0.smithi049.stdout:0/680: creat d13/d39/dbe/dd7/fef x:0 0 0 2023-12-16T07:40:21.742 INFO:tasks.workunit.client.0.smithi049.stdout:6/592: sync 2023-12-16T07:40:21.742 INFO:tasks.workunit.client.0.smithi049.stdout:6/593: write d0/d39/d5b/d65/d58/f5c [1688350,97545] 0 2023-12-16T07:40:21.742 INFO:tasks.workunit.client.0.smithi049.stdout:6/594: fdatasync d0/d39/f54 0 2023-12-16T07:40:21.743 INFO:tasks.workunit.client.0.smithi049.stdout:2/483: sync 2023-12-16T07:40:21.744 INFO:tasks.workunit.client.0.smithi049.stdout:6/595: write d0/d2/df/f24 [60766,64291] 0 2023-12-16T07:40:21.744 INFO:tasks.workunit.client.0.smithi049.stdout:6/596: chown d0/d39/d5b/d65/d58/l9a 173 1 2023-12-16T07:40:21.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/681: link ce d13/d21/d27/de2/cf0 0 2023-12-16T07:40:21.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/682: stat d13/d21/d2f/f80 0 2023-12-16T07:40:21.752 INFO:tasks.workunit.client.0.smithi049.stdout:2/484: link d2/d26/d6e/f7b d2/fa3 0 2023-12-16T07:40:21.754 INFO:tasks.workunit.client.0.smithi049.stdout:2/485: creat d2/d1d/d28/d56/d71/fa4 x:0 0 0 2023-12-16T07:40:21.755 INFO:tasks.workunit.client.0.smithi049.stdout:2/486: write d2/d1d/d28/d56/d71/f9f [850153,35616] 0 2023-12-16T07:40:21.755 INFO:tasks.workunit.client.0.smithi049.stdout:0/683: dread fa [0,4194304] 0 2023-12-16T07:40:21.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/529: dwrite d7/dc/fb3 [0,4194304] 0 2023-12-16T07:40:21.757 INFO:tasks.workunit.client.0.smithi049.stdout:2/487: rmdir d2/d1d/d92 0 2023-12-16T07:40:21.758 INFO:tasks.workunit.client.0.smithi049.stdout:0/684: creat d13/d39/d78/dc2/ff1 x:0 0 0 2023-12-16T07:40:21.765 INFO:tasks.workunit.client.0.smithi049.stdout:7/530: creat d7/dc/dd/d14/fb7 x:0 0 0 2023-12-16T07:40:21.768 INFO:tasks.workunit.client.0.smithi049.stdout:2/488: symlink d2/d1d/d24/d55/d7c/la5 0 2023-12-16T07:40:21.771 INFO:tasks.workunit.client.0.smithi049.stdout:0/685: mkdir d13/d39/d8a/de7/df2 0 2023-12-16T07:40:21.772 INFO:tasks.workunit.client.0.smithi049.stdout:7/531: creat d7/dc/d6b/d70/fb8 x:0 0 0 2023-12-16T07:40:21.772 INFO:tasks.workunit.client.0.smithi049.stdout:2/489: rmdir d2/d1d/d28/d56/d11 39 2023-12-16T07:40:21.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/598: rmdir d0/d13/d42/d5b/d68 39 2023-12-16T07:40:21.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/490: dread d2/d26/f30 [0,4194304] 0 2023-12-16T07:40:21.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/491: symlink d2/de/d77/la6 0 2023-12-16T07:40:21.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/492: write d2/de/f1b [617727,22658] 0 2023-12-16T07:40:21.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/493: readlink d2/d1d/d28/d56/l54 0 2023-12-16T07:40:21.788 INFO:tasks.workunit.client.0.smithi049.stdout:2/494: unlink d2/d1d/d28/c60 0 2023-12-16T07:40:21.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/495: creat d2/d1d/d24/d55/d7c/d98/da1/fa7 x:0 0 0 2023-12-16T07:40:21.794 INFO:tasks.workunit.client.0.smithi049.stdout:0/686: rmdir d13/d21/d99/d46/d65/d82/ddb 39 2023-12-16T07:40:21.795 INFO:tasks.workunit.client.0.smithi049.stdout:0/687: mkdir d13/d39/df3 0 2023-12-16T07:40:21.795 INFO:tasks.workunit.client.0.smithi049.stdout:0/688: write d13/d39/dbe/dd7/dda/fe4 [624798,123270] 0 2023-12-16T07:40:21.813 INFO:tasks.workunit.client.0.smithi049.stdout:0/689: dwrite d13/d21/d27/d2c/f41 [0,4194304] 0 2023-12-16T07:40:21.878 INFO:tasks.workunit.client.0.smithi049.stdout:2/496: dwrite d2/d1d/d28/d56/d66/f7e [0,4194304] 0 2023-12-16T07:40:21.878 INFO:tasks.workunit.client.0.smithi049.stdout:2/497: write d2/d26/f58 [226034,126299] 0 2023-12-16T07:40:21.882 INFO:tasks.workunit.client.0.smithi049.stdout:0/690: dwrite d13/d3c/fc8 [0,4194304] 0 2023-12-16T07:40:21.882 INFO:tasks.workunit.client.0.smithi049.stdout:0/691: write d13/d21/d99/d46/d65/d82/ddb/fed [462098,111706] 0 2023-12-16T07:40:21.882 INFO:tasks.workunit.client.0.smithi049.stdout:2/498: truncate d2/d26/f69 3303080 0 2023-12-16T07:40:21.889 INFO:tasks.workunit.client.0.smithi049.stdout:0/692: symlink d13/d21/d99/d46/d65/lf4 0 2023-12-16T07:40:21.891 INFO:tasks.workunit.client.0.smithi049.stdout:0/693: rename d13/d21/d99/f1a to d13/d39/d38/ff5 0 2023-12-16T07:40:21.891 INFO:tasks.workunit.client.0.smithi049.stdout:0/694: readlink d13/d21/d2f/l77 0 2023-12-16T07:40:21.893 INFO:tasks.workunit.client.0.smithi049.stdout:0/695: symlink d13/d39/lf6 0 2023-12-16T07:40:21.895 INFO:tasks.workunit.client.0.smithi049.stdout:0/696: rename d13/d21/d99/d46/d65/faf to d13/d21/d99/d46/d65/d82/ddb/ff7 0 2023-12-16T07:40:21.897 INFO:tasks.workunit.client.0.smithi049.stdout:0/697: unlink d13/d21/d27/d2c/c4f 0 2023-12-16T07:40:21.897 INFO:tasks.workunit.client.0.smithi049.stdout:0/698: write d13/d39/d78/dc2/ff1 [515652,65373] 0 2023-12-16T07:40:21.897 INFO:tasks.workunit.client.0.smithi049.stdout:0/699: read d13/d21/d99/d46/d65/d82/ddb/fed [396153,42024] 0 2023-12-16T07:40:21.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/700: truncate d13/d39/f6b 431948 0 2023-12-16T07:40:21.899 INFO:tasks.workunit.client.0.smithi049.stdout:0/701: creat d13/dab/ff8 x:0 0 0 2023-12-16T07:40:21.901 INFO:tasks.workunit.client.0.smithi049.stdout:0/702: rename d13/d39/de0 to d13/d39/dbe/dd7/df9 0 2023-12-16T07:40:21.902 INFO:tasks.workunit.client.0.smithi049.stdout:0/703: rmdir d13/d3c 39 2023-12-16T07:40:21.904 INFO:tasks.workunit.client.0.smithi049.stdout:0/704: creat d13/d3c/ffa x:0 0 0 2023-12-16T07:40:21.905 INFO:tasks.workunit.client.0.smithi049.stdout:0/705: creat d13/d21/d99/ffb x:0 0 0 2023-12-16T07:40:21.905 INFO:tasks.workunit.client.0.smithi049.stdout:0/706: write d13/d21/d99/d46/f60 [4550481,100225] 0 2023-12-16T07:40:21.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/707: dwrite d13/fbc [0,4194304] 0 2023-12-16T07:40:21.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/708: mkdir d13/d39/d78/d83/dfc 0 2023-12-16T07:40:21.926 INFO:tasks.workunit.client.0.smithi049.stdout:0/709: rename d13/d21/d99/c32 to d13/d39/d8a/de7/cfd 0 2023-12-16T07:40:21.927 INFO:tasks.workunit.client.0.smithi049.stdout:0/710: mkdir d13/d39/dfe 0 2023-12-16T07:40:21.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/425: sync 2023-12-16T07:40:21.928 INFO:tasks.workunit.client.0.smithi049.stdout:9/423: sync 2023-12-16T07:40:21.928 INFO:tasks.workunit.client.0.smithi049.stdout:9/424: write d4/db/f5d [758252,74332] 0 2023-12-16T07:40:21.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/711: mkdir d13/d21/d27/d2c/d62/d70/dff 0 2023-12-16T07:40:21.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/712: chown d13/ccc 67012708 1 2023-12-16T07:40:21.929 INFO:tasks.workunit.client.0.smithi049.stdout:3/426: mknod d1/d2a/d37/d3f/d5a/d5b/d5e/c8f 0 2023-12-16T07:40:21.952 INFO:tasks.workunit.client.0.smithi049.stdout:3/427: dwrite d1/d2a/f30 [0,4194304] 0 2023-12-16T07:40:21.952 INFO:tasks.workunit.client.0.smithi049.stdout:3/428: dread - d1/d2a/d37/d3f/d5a/d6d/f84 zero size 2023-12-16T07:40:21.952 INFO:tasks.workunit.client.0.smithi049.stdout:0/713: dwrite f3 [0,4194304] 0 2023-12-16T07:40:21.952 INFO:tasks.workunit.client.0.smithi049.stdout:0/714: chown d13/l6e 235435 1 2023-12-16T07:40:21.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/715: symlink d13/d39/dbe/dd7/dda/l100 0 2023-12-16T07:40:21.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/716: truncate d13/d21/d99/d46/d65/d82/ddb/fdd 352266 0 2023-12-16T07:40:21.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/717: mkdir d13/d21/d99/d101 0 2023-12-16T07:40:21.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/718: chown d13/d39/d8a/de7 1 1 2023-12-16T07:40:21.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/719: readlink d13/d21/d2f/l77 0 2023-12-16T07:40:21.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/720: truncate d13/d21/d99/d46/d65/f73 2832271 0 2023-12-16T07:40:21.956 INFO:tasks.workunit.client.0.smithi049.stdout:0/721: creat d13/d39/dbe/dbf/f102 x:0 0 0 2023-12-16T07:40:21.957 INFO:tasks.workunit.client.0.smithi049.stdout:0/722: dread d13/d21/d99/d46/d65/d82/fad [0,4194304] 0 2023-12-16T07:40:21.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:21 smithi049 ceph-mon[111939]: pgmap v7: 65 pgs: 65 active+clean; 837 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 66 MiB/s rd, 132 MiB/s wr, 249 op/s 2023-12-16T07:40:21.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:21 smithi049 ceph-mon[111939]: mgrmap e25: smithi133.wbiduk(active, since 8s), standbys: smithi049.rqlvwo 2023-12-16T07:40:21.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:21 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:40:21.961 INFO:tasks.workunit.client.0.smithi049.stdout:3/429: dread d1/f18 [0,4194304] 0 2023-12-16T07:40:21.961 INFO:tasks.workunit.client.0.smithi049.stdout:3/430: creat d1/d2a/d37/d3f/d4c/f90 x:0 0 0 2023-12-16T07:40:21.962 INFO:tasks.workunit.client.0.smithi049.stdout:3/431: creat d1/d2a/d37/d3f/d5a/d5b/d5e/f91 x:0 0 0 2023-12-16T07:40:22.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/506: sync 2023-12-16T07:40:22.020 INFO:tasks.workunit.client.0.smithi049.stdout:1/512: sync 2023-12-16T07:40:22.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/507: getdents d5/de/d54/d57/d3c/d82 0 2023-12-16T07:40:22.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/508: write d5/de/f40 [1021625,87337] 0 2023-12-16T07:40:22.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/509: truncate d5/de/d54/d5c/f74 1221477 0 2023-12-16T07:40:22.021 INFO:tasks.workunit.client.0.smithi049.stdout:1/513: dread d20/f35 [0,4194304] 0 2023-12-16T07:40:22.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/514: getdents d20/d45/d77 0 2023-12-16T07:40:22.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/515: chown d20/d41/f64 415819506 1 2023-12-16T07:40:22.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/516: creat d20/d7b/d71/fb5 x:0 0 0 2023-12-16T07:40:22.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/517: chown d20/d43/f8c 108 1 2023-12-16T07:40:22.029 INFO:tasks.workunit.client.0.smithi049.stdout:5/510: dread d5/de/d54/d5c/f74 [0,4194304] 0 2023-12-16T07:40:22.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/511: creat d5/d1e/d20/d95/fab x:0 0 0 2023-12-16T07:40:22.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/512: rename d5/de/f31 to d5/de/d54/d67/da0/fac 0 2023-12-16T07:40:22.034 INFO:tasks.workunit.client.0.smithi049.stdout:5/513: rmdir d5/de/d54 39 2023-12-16T07:40:22.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/514: creat d5/d1e/d21/fad x:0 0 0 2023-12-16T07:40:22.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/515: chown d5/de/d54/d67/l70 2 1 2023-12-16T07:40:22.040 INFO:tasks.workunit.client.0.smithi049.stdout:1/518: dwrite fc [0,4194304] 0 2023-12-16T07:40:22.040 INFO:tasks.workunit.client.0.smithi049.stdout:1/519: write d20/d41/f5a [890843,2069] 0 2023-12-16T07:40:22.042 INFO:tasks.workunit.client.0.smithi049.stdout:1/520: write f2 [7364033,19914] 0 2023-12-16T07:40:22.042 INFO:tasks.workunit.client.0.smithi049.stdout:1/521: fsync d20/d41/d4f/f69 0 2023-12-16T07:40:22.044 INFO:tasks.workunit.client.0.smithi049.stdout:1/522: creat d20/d41/d4f/d7c/fb6 x:0 0 0 2023-12-16T07:40:22.044 INFO:tasks.workunit.client.0.smithi049.stdout:1/523: fsync d20/d41/d4f/d55/f59 0 2023-12-16T07:40:22.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/524: dread d20/d45/d47/f65 [0,4194304] 0 2023-12-16T07:40:22.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/525: truncate d20/d41/d4f/f51 671484 0 2023-12-16T07:40:22.049 INFO:tasks.workunit.client.0.smithi049.stdout:5/516: dwrite d5/de/f68 [0,4194304] 0 2023-12-16T07:40:22.049 INFO:tasks.workunit.client.0.smithi049.stdout:1/526: write d20/d45/d47/f6d [3427040,86278] 0 2023-12-16T07:40:22.049 INFO:tasks.workunit.client.0.smithi049.stdout:1/527: fdatasync f1b 0 2023-12-16T07:40:22.049 INFO:tasks.workunit.client.0.smithi049.stdout:5/517: chown d5/de/d54/d57/d2f 254 1 2023-12-16T07:40:22.071 INFO:tasks.workunit.client.0.smithi049.stdout:1/528: dwrite d20/d41/d4f/d55/d58/f5d [0,4194304] 0 2023-12-16T07:40:22.071 INFO:tasks.workunit.client.0.smithi049.stdout:5/518: dwrite d5/de/d54/d67/fa4 [0,4194304] 0 2023-12-16T07:40:22.073 INFO:tasks.workunit.client.0.smithi049.stdout:1/529: unlink d20/d41/d4f/d55/la6 0 2023-12-16T07:40:22.074 INFO:tasks.workunit.client.0.smithi049.stdout:1/530: write d20/d41/d52/f5e [2522473,72186] 0 2023-12-16T07:40:22.076 INFO:tasks.workunit.client.0.smithi049.stdout:5/519: rename d5/d1e/d20/d95/d9c to d5/d1e/d21/d58/d65/dae 0 2023-12-16T07:40:22.077 INFO:tasks.workunit.client.0.smithi049.stdout:1/531: creat d20/d41/d4f/d7c/fb7 x:0 0 0 2023-12-16T07:40:22.078 INFO:tasks.workunit.client.0.smithi049.stdout:5/520: creat d5/de/d54/d57/faf x:0 0 0 2023-12-16T07:40:22.078 INFO:tasks.workunit.client.0.smithi049.stdout:1/532: creat d20/d40/d6f/fb8 x:0 0 0 2023-12-16T07:40:22.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/521: unlink d5/de/d1c/d62/f6c 0 2023-12-16T07:40:22.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/522: fsync d5/f8f 0 2023-12-16T07:40:22.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/533: creat d20/d45/d47/fb9 x:0 0 0 2023-12-16T07:40:22.081 INFO:tasks.workunit.client.0.smithi049.stdout:1/534: dread - d20/d41/f8d zero size 2023-12-16T07:40:22.081 INFO:tasks.workunit.client.0.smithi049.stdout:1/535: truncate d20/d41/f8d 108682 0 2023-12-16T07:40:22.081 INFO:tasks.workunit.client.0.smithi049.stdout:1/536: dread - d20/d41/d4f/d55/f59 zero size 2023-12-16T07:40:22.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/523: dread d5/f18 [0,4194304] 0 2023-12-16T07:40:22.093 INFO:tasks.workunit.client.0.smithi049.stdout:5/524: creat d5/d1e/d21/d58/fb0 x:0 0 0 2023-12-16T07:40:22.099 INFO:tasks.workunit.client.0.smithi049.stdout:1/537: dwrite d20/d41/d4f/d55/d58/f5d [0,4194304] 0 2023-12-16T07:40:22.099 INFO:tasks.workunit.client.0.smithi049.stdout:1/538: fdatasync d20/d41/d4f/d55/d58/f5d 0 2023-12-16T07:40:22.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/539: creat d20/d7b/fba x:0 0 0 2023-12-16T07:40:22.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/540: dwrite d20/f21 [0,4194304] 0 2023-12-16T07:40:22.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/541: symlink d20/d45/d77/lbb 0 2023-12-16T07:40:22.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/542: rename d20/d41/c4a to d20/d41/d52/cbc 0 2023-12-16T07:40:22.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/543: chown d20/d41/f64 434190 1 2023-12-16T07:40:22.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/544: symlink d20/d7b/lbd 0 2023-12-16T07:40:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:21 smithi133 ceph-mon[120445]: pgmap v7: 65 pgs: 65 active+clean; 837 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 66 MiB/s rd, 132 MiB/s wr, 249 op/s 2023-12-16T07:40:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:21 smithi133 ceph-mon[120445]: mgrmap e25: smithi133.wbiduk(active, since 8s), standbys: smithi049.rqlvwo 2023-12-16T07:40:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:21 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:40:22.117 INFO:tasks.workunit.client.0.smithi049.stdout:1/545: symlink d20/d41/dab/lbe 0 2023-12-16T07:40:22.118 INFO:tasks.workunit.client.0.smithi049.stdout:1/546: getdents d20/d41/d52/d86 0 2023-12-16T07:40:22.119 INFO:tasks.workunit.client.0.smithi049.stdout:1/547: fsync d20/d41/f8d 0 2023-12-16T07:40:22.124 INFO:tasks.workunit.client.0.smithi049.stdout:1/548: dread d20/d45/d47/fb3 [0,4194304] 0 2023-12-16T07:40:22.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/549: creat d20/d41/d4f/d55/d7f/d84/fbf x:0 0 0 2023-12-16T07:40:22.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/550: symlink d20/d41/d52/d86/db1/lc0 0 2023-12-16T07:40:22.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/551: chown d20/d41/d52/d86/db1 3 1 2023-12-16T07:40:22.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/552: dread - d20/d43/f8c zero size 2023-12-16T07:40:22.128 INFO:tasks.workunit.client.0.smithi049.stdout:9/425: sync 2023-12-16T07:40:22.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/599: sync 2023-12-16T07:40:22.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/499: sync 2023-12-16T07:40:22.129 INFO:tasks.workunit.client.0.smithi049.stdout:7/532: sync 2023-12-16T07:40:22.129 INFO:tasks.workunit.client.0.smithi049.stdout:6/597: sync 2023-12-16T07:40:22.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/538: sync 2023-12-16T07:40:22.129 INFO:tasks.workunit.client.0.smithi049.stdout:2/500: chown d2/d1d/d28/d56/d66/f7e 7 1 2023-12-16T07:40:22.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/600: write d0/d13/d42/d5b/dab/fb6 [527273,7949] 0 2023-12-16T07:40:22.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/601: write d0/d1f/d4e/f96 [999121,1084] 0 2023-12-16T07:40:22.129 INFO:tasks.workunit.client.0.smithi049.stdout:9/426: mknod d4/d7/d11/d1d/d5b/c87 0 2023-12-16T07:40:22.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/501: dread d2/ff [0,4194304] 0 2023-12-16T07:40:22.131 INFO:tasks.workunit.client.0.smithi049.stdout:6/598: creat d0/d2/df/d4e/fb6 x:0 0 0 2023-12-16T07:40:22.131 INFO:tasks.workunit.client.0.smithi049.stdout:8/602: stat d0/d1f/f18 0 2023-12-16T07:40:22.132 INFO:tasks.workunit.client.0.smithi049.stdout:9/427: rmdir d4/d7/d11/d1d/d69/d76/d83 39 2023-12-16T07:40:22.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/502: write d2/d1d/d28/d56/d11/f1e [1523383,126223] 0 2023-12-16T07:40:22.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/503: truncate d2/d26/f59 4645074 0 2023-12-16T07:40:22.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/504: stat d2/d1d/d28/d56/d71 0 2023-12-16T07:40:22.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/599: creat d0/d39/d5b/d65/d4c/fb7 x:0 0 0 2023-12-16T07:40:22.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/603: fsync d0/d1f/f82 0 2023-12-16T07:40:22.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/600: write d0/d39/f54 [3784346,22270] 0 2023-12-16T07:40:22.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/601: fdatasync d0/d2/df/f7a 0 2023-12-16T07:40:22.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/553: dread f2 [0,4194304] 0 2023-12-16T07:40:22.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/604: creat d0/d13/fc1 x:0 0 0 2023-12-16T07:40:22.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/605: readlink d0/d1f/d56/lb0 0 2023-12-16T07:40:22.141 INFO:tasks.workunit.client.0.smithi049.stdout:6/602: truncate d0/d39/d5b/d65/d32/f71 598311 0 2023-12-16T07:40:22.141 INFO:tasks.workunit.client.0.smithi049.stdout:9/428: write d4/db/f66 [6444471,13209] 0 2023-12-16T07:40:22.145 INFO:tasks.workunit.client.0.smithi049.stdout:6/603: rename d0/d2/df/d81/l98 to d0/d39/d5b/d65/d4c/d4d/d6a/lb8 0 2023-12-16T07:40:22.145 INFO:tasks.workunit.client.0.smithi049.stdout:6/604: chown d0/d39/d5b/d65/l21 490 1 2023-12-16T07:40:22.145 INFO:tasks.workunit.client.0.smithi049.stdout:6/605: write d0/d2/f9 [448751,36555] 0 2023-12-16T07:40:22.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/429: mknod d4/db/c88 0 2023-12-16T07:40:22.147 INFO:tasks.workunit.client.0.smithi049.stdout:7/533: dwrite d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:22.147 INFO:tasks.workunit.client.0.smithi049.stdout:9/430: creat d4/d45/f89 x:0 0 0 2023-12-16T07:40:22.155 INFO:tasks.workunit.client.0.smithi049.stdout:7/534: dread d7/dc/f1d [0,4194304] 0 2023-12-16T07:40:22.156 INFO:tasks.workunit.client.0.smithi049.stdout:7/535: write d7/dc/f1d [4040789,84268] 0 2023-12-16T07:40:22.156 INFO:tasks.workunit.client.0.smithi049.stdout:7/536: write d7/dc/d2f/d40/d5d/f96 [33801,5958] 0 2023-12-16T07:40:22.162 INFO:tasks.workunit.client.0.smithi049.stdout:1/554: dwrite d20/d41/f64 [0,4194304] 0 2023-12-16T07:40:22.162 INFO:tasks.workunit.client.0.smithi049.stdout:6/606: dwrite d0/d39/d5b/d65/d27/f85 [0,4194304] 0 2023-12-16T07:40:22.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/431: dread d4/d7/f7a [0,4194304] 0 2023-12-16T07:40:22.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/432: fdatasync d4/d45/f61 0 2023-12-16T07:40:22.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/433: readlink d4/d3e/l42 0 2023-12-16T07:40:22.165 INFO:tasks.workunit.client.0.smithi049.stdout:6/607: creat d0/d39/d5b/d65/d27/d91/fb9 x:0 0 0 2023-12-16T07:40:22.168 INFO:tasks.workunit.client.0.smithi049.stdout:6/608: unlink d0/d2/l63 0 2023-12-16T07:40:22.170 INFO:tasks.workunit.client.0.smithi049.stdout:6/609: mknod d0/d39/d5b/d65/d4c/cba 0 2023-12-16T07:40:22.170 INFO:tasks.workunit.client.0.smithi049.stdout:7/537: dwrite d7/dc/d2f/d40/d5d/fb0 [0,4194304] 0 2023-12-16T07:40:22.171 INFO:tasks.workunit.client.0.smithi049.stdout:6/610: unlink d0/d39/f84 0 2023-12-16T07:40:22.172 INFO:tasks.workunit.client.0.smithi049.stdout:9/434: rename d4/d45 to d4/d7/d11/d26/d47/d8a 0 2023-12-16T07:40:22.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/435: dread d4/d7/d11/d1d/f79 [0,4194304] 0 2023-12-16T07:40:22.175 INFO:tasks.workunit.client.0.smithi049.stdout:7/538: rename d7/dc/l7f to d7/db4/lb9 0 2023-12-16T07:40:22.175 INFO:tasks.workunit.client.0.smithi049.stdout:6/611: dread d0/d39/f54 [0,4194304] 0 2023-12-16T07:40:22.175 INFO:tasks.workunit.client.0.smithi049.stdout:6/612: fdatasync d0/f40 0 2023-12-16T07:40:22.175 INFO:tasks.workunit.client.0.smithi049.stdout:6/613: write d0/d39/d5b/d65/d58/f80 [951579,31152] 0 2023-12-16T07:40:22.176 INFO:tasks.workunit.client.0.smithi049.stdout:7/539: mkdir d7/dc/dd/d27/dba 0 2023-12-16T07:40:22.182 INFO:tasks.workunit.client.0.smithi049.stdout:6/614: write d0/d39/d5b/d65/d58/f2b [2017311,92617] 0 2023-12-16T07:40:22.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/615: truncate d0/d39/d8b/fa5 1223968 0 2023-12-16T07:40:22.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/616: chown d0/l10 46774048 1 2023-12-16T07:40:22.184 INFO:tasks.workunit.client.0.smithi049.stdout:6/617: mknod d0/d39/d5b/d65/d4c/d4d/d6a/cbb 0 2023-12-16T07:40:22.186 INFO:tasks.workunit.client.0.smithi049.stdout:6/618: symlink d0/d39/d5b/d65/d58/d33/daa/lbc 0 2023-12-16T07:40:22.186 INFO:tasks.workunit.client.0.smithi049.stdout:6/619: chown d0/d2/f47 21090272 1 2023-12-16T07:40:22.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/540: dwrite d7/dc/dd/d27/f95 [0,4194304] 0 2023-12-16T07:40:22.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/620: write d0/d39/d5b/d65/d53/f5f [1178976,33995] 0 2023-12-16T07:40:22.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/621: stat d0/d39/d5b/d65/d32 0 2023-12-16T07:40:22.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/622: stat d0/d39/d5b/d65/l16 0 2023-12-16T07:40:22.193 INFO:tasks.workunit.client.0.smithi049.stdout:9/436: dwrite d4/d7/d11/d26/d47/f4f [0,4194304] 0 2023-12-16T07:40:22.194 INFO:tasks.workunit.client.0.smithi049.stdout:7/541: getdents d7/dc/dd/d35/d36 0 2023-12-16T07:40:22.194 INFO:tasks.workunit.client.0.smithi049.stdout:6/623: creat d0/d39/d5b/d65/fbd x:0 0 0 2023-12-16T07:40:22.203 INFO:tasks.workunit.client.0.smithi049.stdout:9/437: mkdir d4/d7/d11/d1d/d5b/d8b 0 2023-12-16T07:40:22.204 INFO:tasks.workunit.client.0.smithi049.stdout:7/542: mknod d7/dc/dd/d27/cbb 0 2023-12-16T07:40:22.204 INFO:tasks.workunit.client.0.smithi049.stdout:7/543: stat d7/c51 0 2023-12-16T07:40:22.204 INFO:tasks.workunit.client.0.smithi049.stdout:7/544: dread - d7/dc/d2f/d40/d5d/f78 zero size 2023-12-16T07:40:22.205 INFO:tasks.workunit.client.0.smithi049.stdout:7/545: fdatasync d7/dc/dd/fae 0 2023-12-16T07:40:22.205 INFO:tasks.workunit.client.0.smithi049.stdout:6/624: symlink d0/d2/df/lbe 0 2023-12-16T07:40:22.205 INFO:tasks.workunit.client.0.smithi049.stdout:7/546: read d7/dc/d2f/d40/f74 [1437619,8242] 0 2023-12-16T07:40:22.206 INFO:tasks.workunit.client.0.smithi049.stdout:6/625: read - d0/d2/df/d4e/d5d/d6f/f75 zero size 2023-12-16T07:40:22.206 INFO:tasks.workunit.client.0.smithi049.stdout:7/547: read d7/dc/d2f/d40/f74 [3329455,103152] 0 2023-12-16T07:40:22.206 INFO:tasks.workunit.client.0.smithi049.stdout:6/626: symlink d0/d39/d5b/d65/d27/db1/lbf 0 2023-12-16T07:40:22.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/723: sync 2023-12-16T07:40:22.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/525: sync 2023-12-16T07:40:22.214 INFO:tasks.workunit.client.0.smithi049.stdout:3/432: sync 2023-12-16T07:40:22.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/526: chown d5/de/d1c/d62/c94 610778 1 2023-12-16T07:40:22.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/724: getdents d13/d21/d2f/d7d 0 2023-12-16T07:40:22.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/527: mkdir d5/de/d1c/db1 0 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/433: symlink d1/d2a/d37/d3f/d5a/d61/l92 0 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/725: symlink d13/d21/d2f/d7d/da0/dc9/l103 0 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/726: chown d13/d39/d38/d7e/d8b/cb0 577079 1 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/528: rename d5/de/f68 to d5/d1e/d21/d58/fb2 0 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/434: creat d1/d2a/d37/d3f/f93 x:0 0 0 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/727: mknod d13/d39/dbe/dbf/c104 0 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/728: fdatasync d13/d39/d38/d7e/d8b/f9a 0 2023-12-16T07:40:22.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/529: rename d5/d1e/l5b to d5/de/d54/d5c/lb3 0 2023-12-16T07:40:22.216 INFO:tasks.workunit.client.0.smithi049.stdout:3/435: rename d1/d2a/d37/d3f/d5a/d5b/d5e/c70 to d1/d2a/d37/d63/c94 0 2023-12-16T07:40:22.216 INFO:tasks.workunit.client.0.smithi049.stdout:3/436: readlink d1/d2b/l86 0 2023-12-16T07:40:22.217 INFO:tasks.workunit.client.0.smithi049.stdout:5/530: truncate d5/d1e/d21/f45 4087851 0 2023-12-16T07:40:22.219 INFO:tasks.workunit.client.0.smithi049.stdout:5/531: link d5/de/d54/d57/d2f/c87 d5/de/d54/d67/cb4 0 2023-12-16T07:40:22.220 INFO:tasks.workunit.client.0.smithi049.stdout:6/627: getdents d0/d2/df 0 2023-12-16T07:40:22.222 INFO:tasks.workunit.client.0.smithi049.stdout:6/628: creat d0/d39/d5b/d65/d58/d2c/fc0 x:0 0 0 2023-12-16T07:40:22.222 INFO:tasks.workunit.client.0.smithi049.stdout:6/629: write d0/d2/f82 [2295915,126517] 0 2023-12-16T07:40:22.223 INFO:tasks.workunit.client.0.smithi049.stdout:6/630: mkdir d0/d39/d5b/d65/dc1 0 2023-12-16T07:40:22.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/532: dread d5/de/f76 [0,4194304] 0 2023-12-16T07:40:22.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/533: chown d5/d1e/d21/f45 559148 1 2023-12-16T07:40:22.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/534: stat d5/de/d54/d57/d3c/d82 0 2023-12-16T07:40:22.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/535: stat d5/de/d54/d57/d2f 0 2023-12-16T07:40:22.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/536: fdatasync d5/f8f 0 2023-12-16T07:40:22.235 INFO:tasks.workunit.client.0.smithi049.stdout:9/438: dwrite d4/d7/d11/d26/d47/d59/f70 [0,4194304] 0 2023-12-16T07:40:22.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/548: dwrite d7/d2b/d59/f7e [0,4194304] 0 2023-12-16T07:40:22.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/549: dread - d7/dc/d6b/d70/fb8 zero size 2023-12-16T07:40:22.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/550: chown d7/db4/lb9 10584 1 2023-12-16T07:40:22.236 INFO:tasks.workunit.client.0.smithi049.stdout:0/729: dwrite d13/fbb [0,4194304] 0 2023-12-16T07:40:22.237 INFO:tasks.workunit.client.0.smithi049.stdout:7/551: link d7/dc/d2f/d38/f8f d7/dc/dd/d27/dba/fbc 0 2023-12-16T07:40:22.260 INFO:tasks.workunit.client.0.smithi049.stdout:6/631: dwrite d0/d39/d5b/d65/d53/f61 [0,4194304] 0 2023-12-16T07:40:22.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/537: dwrite d5/de/d54/d57/d3c/f5d [0,4194304] 0 2023-12-16T07:40:22.266 INFO:tasks.workunit.client.0.smithi049.stdout:0/730: dwrite d13/d39/d38/da7/fd6 [0,4194304] 0 2023-12-16T07:40:22.266 INFO:tasks.workunit.client.0.smithi049.stdout:0/731: dread - d13/d21/d99/d46/f95 zero size 2023-12-16T07:40:22.266 INFO:tasks.workunit.client.0.smithi049.stdout:9/439: dwrite d4/f1f [0,4194304] 0 2023-12-16T07:40:22.266 INFO:tasks.workunit.client.0.smithi049.stdout:7/552: rmdir d7/dc/d2f/d38 39 2023-12-16T07:40:22.266 INFO:tasks.workunit.client.0.smithi049.stdout:7/553: readlink d7/dc/d15/l18 0 2023-12-16T07:40:22.266 INFO:tasks.workunit.client.0.smithi049.stdout:7/554: write d7/dc/d6b/d70/fac [416741,27353] 0 2023-12-16T07:40:22.266 INFO:tasks.workunit.client.0.smithi049.stdout:0/732: creat d13/d21/f105 x:0 0 0 2023-12-16T07:40:22.267 INFO:tasks.workunit.client.0.smithi049.stdout:0/733: write d13/d21/d2f/f80 [101921,6971] 0 2023-12-16T07:40:22.273 INFO:tasks.workunit.client.0.smithi049.stdout:9/440: creat d4/d7/d11/d26/f8c x:0 0 0 2023-12-16T07:40:22.273 INFO:tasks.workunit.client.0.smithi049.stdout:7/555: truncate d7/d2b/d59/f7e 1466526 0 2023-12-16T07:40:22.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/556: write d7/dc/dd/d27/f48 [330828,93836] 0 2023-12-16T07:40:22.275 INFO:tasks.workunit.client.0.smithi049.stdout:7/557: mknod d7/dc/d15/cbd 0 2023-12-16T07:40:22.275 INFO:tasks.workunit.client.0.smithi049.stdout:7/558: write d7/dc/d6b/d70/fac [1065091,49671] 0 2023-12-16T07:40:22.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/441: write d4/d7/f7a [3660654,84370] 0 2023-12-16T07:40:22.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/442: read d4/d7/f7a [3301701,77077] 0 2023-12-16T07:40:22.281 INFO:tasks.workunit.client.0.smithi049.stdout:9/443: chown d4/db/c17 934 1 2023-12-16T07:40:22.281 INFO:tasks.workunit.client.0.smithi049.stdout:9/444: stat d4/d3e/f6e 0 2023-12-16T07:40:22.281 INFO:tasks.workunit.client.0.smithi049.stdout:9/445: readlink d4/db/l73 0 2023-12-16T07:40:22.282 INFO:tasks.workunit.client.0.smithi049.stdout:9/446: mknod d4/d3e/c8d 0 2023-12-16T07:40:22.283 INFO:tasks.workunit.client.0.smithi049.stdout:9/447: symlink d4/l8e 0 2023-12-16T07:40:22.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/559: dread d7/dc/dd/d27/f8c [4194304,4194304] 0 2023-12-16T07:40:22.285 INFO:tasks.workunit.client.0.smithi049.stdout:9/448: rename d4/d3e/f4a to d4/d3e/f8f 0 2023-12-16T07:40:22.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/560: truncate d7/d2b/d59/f5e 2528196 0 2023-12-16T07:40:22.286 INFO:tasks.workunit.client.0.smithi049.stdout:9/449: symlink d4/d7/d11/d26/l90 0 2023-12-16T07:40:22.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/561: link d7/dc/d2f/d38/lb1 d7/dc/d2f/d38/lbe 0 2023-12-16T07:40:22.288 INFO:tasks.workunit.client.0.smithi049.stdout:9/450: read d4/d7/d11/d26/f37 [11927736,35426] 0 2023-12-16T07:40:22.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/562: mkdir d7/dc/d6b/dbf 0 2023-12-16T07:40:22.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/563: write d7/dc/d6b/d70/fb8 [677973,18190] 0 2023-12-16T07:40:22.290 INFO:tasks.workunit.client.0.smithi049.stdout:9/451: creat d4/d7/d11/d26/d80/f91 x:0 0 0 2023-12-16T07:40:22.290 INFO:tasks.workunit.client.0.smithi049.stdout:9/452: fdatasync d4/d7/d11/d26/d47/d59/f6d 0 2023-12-16T07:40:22.302 INFO:tasks.workunit.client.0.smithi049.stdout:0/734: dwrite f4 [0,4194304] 0 2023-12-16T07:40:22.303 INFO:tasks.workunit.client.0.smithi049.stdout:0/735: truncate d13/d21/d2f/f80 643501 0 2023-12-16T07:40:22.303 INFO:tasks.workunit.client.0.smithi049.stdout:0/736: stat d13/d21/d2f/d7d/d90/fa5 0 2023-12-16T07:40:22.303 INFO:tasks.workunit.client.0.smithi049.stdout:6/632: dwrite d0/d2/df/d4e/d5d/d6f/f75 [0,4194304] 0 2023-12-16T07:40:22.303 INFO:tasks.workunit.client.0.smithi049.stdout:5/538: dwrite d5/de/d54/d5c/f74 [0,4194304] 0 2023-12-16T07:40:22.303 INFO:tasks.workunit.client.0.smithi049.stdout:0/737: link d13/d39/lf6 d13/d39/d78/d83/l106 0 2023-12-16T07:40:22.303 INFO:tasks.workunit.client.0.smithi049.stdout:7/564: dread d7/dc/fb3 [0,4194304] 0 2023-12-16T07:40:22.304 INFO:tasks.workunit.client.0.smithi049.stdout:5/539: symlink d5/d1e/d21/d58/d65/lb5 0 2023-12-16T07:40:22.307 INFO:tasks.workunit.client.0.smithi049.stdout:0/738: rename d13/d21/d27/de2 to d13/d21/d27/d2c/d62/d70/d107 0 2023-12-16T07:40:22.309 INFO:tasks.workunit.client.0.smithi049.stdout:0/739: rmdir d13/d39/dbe/dbf 39 2023-12-16T07:40:22.311 INFO:tasks.workunit.client.0.smithi049.stdout:0/740: symlink d13/d39/d38/da7/l108 0 2023-12-16T07:40:22.312 INFO:tasks.workunit.client.0.smithi049.stdout:0/741: stat d13/d21/d2f/d7d 0 2023-12-16T07:40:22.312 INFO:tasks.workunit.client.0.smithi049.stdout:0/742: write d13/d3c/fb7 [2631717,87929] 0 2023-12-16T07:40:22.312 INFO:tasks.workunit.client.0.smithi049.stdout:0/743: chown d13/d39/dbe/dbf/ce3 29203689 1 2023-12-16T07:40:22.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/744: symlink d13/d39/d53/l109 0 2023-12-16T07:40:22.314 INFO:tasks.workunit.client.0.smithi049.stdout:5/540: dread d5/de/d54/d67/fa4 [0,4194304] 0 2023-12-16T07:40:22.318 INFO:tasks.workunit.client.0.smithi049.stdout:5/541: rename d5/f18 to d5/d1e/d21/fb6 0 2023-12-16T07:40:22.318 INFO:tasks.workunit.client.0.smithi049.stdout:5/542: fdatasync d5/de/d54/d67/fa4 0 2023-12-16T07:40:22.319 INFO:tasks.workunit.client.0.smithi049.stdout:5/543: rmdir d5/de/d1c/d62 39 2023-12-16T07:40:22.320 INFO:tasks.workunit.client.0.smithi049.stdout:1/555: sync 2023-12-16T07:40:22.320 INFO:tasks.workunit.client.0.smithi049.stdout:4/539: sync 2023-12-16T07:40:22.320 INFO:tasks.workunit.client.0.smithi049.stdout:2/505: sync 2023-12-16T07:40:22.320 INFO:tasks.workunit.client.0.smithi049.stdout:8/606: sync 2023-12-16T07:40:22.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/437: sync 2023-12-16T07:40:22.321 INFO:tasks.workunit.client.0.smithi049.stdout:7/565: dwrite d7/dc/dd/d35/f97 [0,4194304] 0 2023-12-16T07:40:22.321 INFO:tasks.workunit.client.0.smithi049.stdout:5/544: dread d5/de/d1c/f25 [0,4194304] 0 2023-12-16T07:40:22.321 INFO:tasks.workunit.client.0.smithi049.stdout:4/540: truncate d2/db/fab 6308192 0 2023-12-16T07:40:22.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/541: write d2/f28 [2434933,121620] 0 2023-12-16T07:40:22.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/542: getdents d2/db/dd/d9f 0 2023-12-16T07:40:22.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/543: chown d2/db/dd/de/d1e/d44/l46 28341 1 2023-12-16T07:40:22.323 INFO:tasks.workunit.client.0.smithi049.stdout:2/506: mkdir d2/d1d/d28/d56/d11/da8 0 2023-12-16T07:40:22.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/607: mknod d0/d13/cc2 0 2023-12-16T07:40:22.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/507: write d2/d1d/d24/f33 [1557775,11612] 0 2023-12-16T07:40:22.325 INFO:tasks.workunit.client.0.smithi049.stdout:1/556: creat d20/d41/d4f/d55/fc1 x:0 0 0 2023-12-16T07:40:22.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/608: dread d0/d13/d42/d5b/dab/fb6 [0,4194304] 0 2023-12-16T07:40:22.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/566: rmdir d7/dc/dd/d35/d36 39 2023-12-16T07:40:22.329 INFO:tasks.workunit.client.0.smithi049.stdout:5/545: chown d5/d1e/d21/d4e/f9d 50 1 2023-12-16T07:40:22.330 INFO:tasks.workunit.client.0.smithi049.stdout:4/544: truncate d2/db/dd/de/d1e/d37/da4/f7b 127799 0 2023-12-16T07:40:22.335 INFO:tasks.workunit.client.0.smithi049.stdout:2/508: mkdir d2/d1d/d28/d56/d66/da9 0 2023-12-16T07:40:22.335 INFO:tasks.workunit.client.0.smithi049.stdout:1/557: symlink d20/d45/lc2 0 2023-12-16T07:40:22.335 INFO:tasks.workunit.client.0.smithi049.stdout:2/509: fdatasync d2/d1d/f68 0 2023-12-16T07:40:22.335 INFO:tasks.workunit.client.0.smithi049.stdout:8/609: truncate d0/d1f/d4e/f8b 330589 0 2023-12-16T07:40:22.336 INFO:tasks.workunit.client.0.smithi049.stdout:8/610: chown d0/d13/l60 4 1 2023-12-16T07:40:22.336 INFO:tasks.workunit.client.0.smithi049.stdout:2/510: write d2/d1d/d24/f42 [2312115,103909] 0 2023-12-16T07:40:22.336 INFO:tasks.workunit.client.0.smithi049.stdout:2/511: readlink d2/d1d/d28/d56/l54 0 2023-12-16T07:40:22.337 INFO:tasks.workunit.client.0.smithi049.stdout:7/567: truncate d7/dc/d2f/d40/d5d/faf 221604 0 2023-12-16T07:40:22.337 INFO:tasks.workunit.client.0.smithi049.stdout:5/546: mknod d5/de/d54/d78/d9b/cb7 0 2023-12-16T07:40:22.337 INFO:tasks.workunit.client.0.smithi049.stdout:1/558: rmdir d20/d41/d4f/d55/d7f/d8a 39 2023-12-16T07:40:22.342 INFO:tasks.workunit.client.0.smithi049.stdout:4/545: write d2/db/dd/de/d1e/f55 [5521716,71588] 0 2023-12-16T07:40:22.342 INFO:tasks.workunit.client.0.smithi049.stdout:4/546: read d2/db/dd/de/d1e/f3b [694229,31295] 0 2023-12-16T07:40:22.342 INFO:tasks.workunit.client.0.smithi049.stdout:5/547: symlink d5/de/d1c/d62/d81/lb8 0 2023-12-16T07:40:22.346 INFO:tasks.workunit.client.0.smithi049.stdout:4/547: creat d2/db/d6b/fb4 x:0 0 0 2023-12-16T07:40:22.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/611: dread d0/f12 [0,4194304] 0 2023-12-16T07:40:22.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/612: chown d0/d1f/d56/f72 30 1 2023-12-16T07:40:22.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/613: dread - d0/d6a/fa4 zero size 2023-12-16T07:40:22.347 INFO:tasks.workunit.client.0.smithi049.stdout:8/614: write d0/d13/f66 [538365,73033] 0 2023-12-16T07:40:22.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/615: write d0/d13/d42/d5b/d68/d6b/fae [659449,43154] 0 2023-12-16T07:40:22.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/616: truncate d0/d13/d42/d5b/dab/d89/f94 898373 0 2023-12-16T07:40:22.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/617: symlink d0/d1f/d1c/lc3 0 2023-12-16T07:40:22.356 INFO:tasks.workunit.client.0.smithi049.stdout:0/745: dwrite d13/d21/d2f/f80 [0,4194304] 0 2023-12-16T07:40:22.357 INFO:tasks.workunit.client.0.smithi049.stdout:8/618: dread d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:22.357 INFO:tasks.workunit.client.0.smithi049.stdout:8/619: write d0/d13/d42/f4c [149127,22355] 0 2023-12-16T07:40:22.360 INFO:tasks.workunit.client.0.smithi049.stdout:7/568: dread d7/dc/dd/d27/f8c [0,4194304] 0 2023-12-16T07:40:22.360 INFO:tasks.workunit.client.0.smithi049.stdout:3/438: dwrite d1/d2b/f57 [0,4194304] 0 2023-12-16T07:40:22.360 INFO:tasks.workunit.client.0.smithi049.stdout:3/439: chown d1/l67 2044203 1 2023-12-16T07:40:22.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/746: mknod d13/d21/d2f/d7d/da0/c10a 0 2023-12-16T07:40:22.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/747: write d13/d21/d99/d46/d65/d82/ddb/fed [1491405,84972] 0 2023-12-16T07:40:22.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/748: chown d13/d3c/fb7 169402713 1 2023-12-16T07:40:22.362 INFO:tasks.workunit.client.0.smithi049.stdout:5/548: dread d5/f8 [4194304,4194304] 0 2023-12-16T07:40:22.362 INFO:tasks.workunit.client.0.smithi049.stdout:8/620: creat d0/d13/d42/d5b/fc4 x:0 0 0 2023-12-16T07:40:22.362 INFO:tasks.workunit.client.0.smithi049.stdout:8/621: chown d0/d13/d42/l5c 207700 1 2023-12-16T07:40:22.363 INFO:tasks.workunit.client.0.smithi049.stdout:7/569: creat d7/dc/d15/fc0 x:0 0 0 2023-12-16T07:40:22.365 INFO:tasks.workunit.client.0.smithi049.stdout:8/622: creat d0/d1f/d36/fc5 x:0 0 0 2023-12-16T07:40:22.365 INFO:tasks.workunit.client.0.smithi049.stdout:8/623: stat d0/d13/d42/d5b/dab/d89/l98 0 2023-12-16T07:40:22.365 INFO:tasks.workunit.client.0.smithi049.stdout:8/624: stat d0/d13/d42/l87 0 2023-12-16T07:40:22.368 INFO:tasks.workunit.client.0.smithi049.stdout:0/749: read d13/d21/d2f/f80 [3493543,7941] 0 2023-12-16T07:40:22.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/625: dread d0/f19 [0,4194304] 0 2023-12-16T07:40:22.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/626: write d0/d13/d42/d5b/d68/d6b/da2/db9/fbd [426370,100713] 0 2023-12-16T07:40:22.372 INFO:tasks.workunit.client.0.smithi049.stdout:0/750: creat d13/d21/d99/d46/d65/f10b x:0 0 0 2023-12-16T07:40:22.372 INFO:tasks.workunit.client.0.smithi049.stdout:0/751: dread - d13/d39/dbe/dbf/f102 zero size 2023-12-16T07:40:22.379 INFO:tasks.workunit.client.0.smithi049.stdout:2/512: dwrite d2/d1d/d24/f50 [0,4194304] 0 2023-12-16T07:40:22.380 INFO:tasks.workunit.client.0.smithi049.stdout:4/548: dwrite d2/db/dd/de/f96 [0,4194304] 0 2023-12-16T07:40:22.380 INFO:tasks.workunit.client.0.smithi049.stdout:4/549: write d2/f86 [1109728,73421] 0 2023-12-16T07:40:22.390 INFO:tasks.workunit.client.0.smithi049.stdout:1/559: dwrite d20/d40/d6f/fb8 [0,4194304] 0 2023-12-16T07:40:22.390 INFO:tasks.workunit.client.0.smithi049.stdout:1/560: dread - d20/d7b/d71/fb5 zero size 2023-12-16T07:40:22.390 INFO:tasks.workunit.client.0.smithi049.stdout:2/513: creat d2/d26/d6e/faa x:0 0 0 2023-12-16T07:40:22.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/752: dread d13/d21/fb8 [0,4194304] 0 2023-12-16T07:40:22.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/753: fsync d13/d21/d99/d46/d65/d82/ddb/fdd 0 2023-12-16T07:40:22.392 INFO:tasks.workunit.client.0.smithi049.stdout:1/561: write d20/f3e [3307974,101630] 0 2023-12-16T07:40:22.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/514: rename d2/d26/d6e/f8f to d2/d1d/fab 0 2023-12-16T07:40:22.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/515: chown d2/l5 186 1 2023-12-16T07:40:22.396 INFO:tasks.workunit.client.0.smithi049.stdout:0/754: mknod d13/d39/d8a/de7/c10c 0 2023-12-16T07:40:22.398 INFO:tasks.workunit.client.0.smithi049.stdout:1/562: creat d20/d45/d77/fc3 x:0 0 0 2023-12-16T07:40:22.399 INFO:tasks.workunit.client.0.smithi049.stdout:1/563: chown d20/d40/d6f/c70 633 1 2023-12-16T07:40:22.399 INFO:tasks.workunit.client.0.smithi049.stdout:1/564: chown d20/d45/d47/l98 156801255 1 2023-12-16T07:40:22.399 INFO:tasks.workunit.client.0.smithi049.stdout:3/440: dwrite d1/f26 [0,4194304] 0 2023-12-16T07:40:22.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/627: truncate d0/d13/d42/d5b/d68/d6b/fae 538896 0 2023-12-16T07:40:22.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/755: mkdir d13/d39/dbe/dd7/dda/d10d 0 2023-12-16T07:40:22.404 INFO:tasks.workunit.client.0.smithi049.stdout:5/549: dwrite d5/d1e/f51 [0,4194304] 0 2023-12-16T07:40:22.404 INFO:tasks.workunit.client.0.smithi049.stdout:1/565: mknod d20/d45/cc4 0 2023-12-16T07:40:22.404 INFO:tasks.workunit.client.0.smithi049.stdout:4/550: dwrite d2/db/dd/de/d1e/d37/d82/fae [0,4194304] 0 2023-12-16T07:40:22.405 INFO:tasks.workunit.client.0.smithi049.stdout:3/441: link d1/d2a/l36 d1/d2a/d37/d3f/d5a/l95 0 2023-12-16T07:40:22.405 INFO:tasks.workunit.client.0.smithi049.stdout:0/756: symlink d13/d21/d99/d46/l10e 0 2023-12-16T07:40:22.405 INFO:tasks.workunit.client.0.smithi049.stdout:0/757: chown d13/d39/dbe/dbf/f102 40308 1 2023-12-16T07:40:22.405 INFO:tasks.workunit.client.0.smithi049.stdout:0/758: dread - d13/d21/d99/ffb zero size 2023-12-16T07:40:22.406 INFO:tasks.workunit.client.0.smithi049.stdout:0/759: write d13/d3c/f4c [970996,4985] 0 2023-12-16T07:40:22.406 INFO:tasks.workunit.client.0.smithi049.stdout:7/570: dwrite d7/dc/d15/d57/f80 [0,4194304] 0 2023-12-16T07:40:22.409 INFO:tasks.workunit.client.0.smithi049.stdout:1/566: mkdir d20/d41/d4f/d55/d82/dc5 0 2023-12-16T07:40:22.413 INFO:tasks.workunit.client.0.smithi049.stdout:1/567: dread d20/d41/d4f/d55/f83 [0,4194304] 0 2023-12-16T07:40:22.413 INFO:tasks.workunit.client.0.smithi049.stdout:0/760: creat d13/d21/f10f x:0 0 0 2023-12-16T07:40:22.413 INFO:tasks.workunit.client.0.smithi049.stdout:0/761: write d13/d39/dbe/dbf/f102 [508484,128949] 0 2023-12-16T07:40:22.413 INFO:tasks.workunit.client.0.smithi049.stdout:0/762: readlink d13/d21/d99/l64 0 2023-12-16T07:40:22.416 INFO:tasks.workunit.client.0.smithi049.stdout:8/628: write d0/d1f/d36/f54 [168034,93385] 0 2023-12-16T07:40:22.416 INFO:tasks.workunit.client.0.smithi049.stdout:3/442: dread d1/d2a/d37/d3f/f41 [0,4194304] 0 2023-12-16T07:40:22.416 INFO:tasks.workunit.client.0.smithi049.stdout:1/568: read d20/d41/f5a [12562,120971] 0 2023-12-16T07:40:22.416 INFO:tasks.workunit.client.0.smithi049.stdout:1/569: chown d20/d41/l85 199 1 2023-12-16T07:40:22.416 INFO:tasks.workunit.client.0.smithi049.stdout:0/763: getdents d13/d39/d78/d83/db2 0 2023-12-16T07:40:22.421 INFO:tasks.workunit.client.0.smithi049.stdout:2/516: dwrite d2/d1d/d24/d55/d76/f7f [0,4194304] 0 2023-12-16T07:40:22.421 INFO:tasks.workunit.client.0.smithi049.stdout:2/517: write d2/d1d/f5e [928976,48369] 0 2023-12-16T07:40:22.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/629: unlink d0/d13/l2a 0 2023-12-16T07:40:22.422 INFO:tasks.workunit.client.0.smithi049.stdout:8/630: readlink d0/d13/l27 0 2023-12-16T07:40:22.422 INFO:tasks.workunit.client.0.smithi049.stdout:1/570: mknod d20/d43/cc6 0 2023-12-16T07:40:22.422 INFO:tasks.workunit.client.0.smithi049.stdout:1/571: dread - d20/d41/d52/fa5 zero size 2023-12-16T07:40:22.426 INFO:tasks.workunit.client.0.smithi049.stdout:0/764: rename d13/d39/d38/d7e/d8b/cb1 to d13/d39/dbe/dd7/dda/c110 0 2023-12-16T07:40:22.427 INFO:tasks.workunit.client.0.smithi049.stdout:2/518: creat d2/d1d/d28/d56/d11/fac x:0 0 0 2023-12-16T07:40:22.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/631: readlink d0/d1f/la1 0 2023-12-16T07:40:22.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/632: stat d0/f6e 0 2023-12-16T07:40:22.429 INFO:tasks.workunit.client.0.smithi049.stdout:1/572: symlink d20/d43/lc7 0 2023-12-16T07:40:22.429 INFO:tasks.workunit.client.0.smithi049.stdout:1/573: fdatasync f14 0 2023-12-16T07:40:22.430 INFO:tasks.workunit.client.0.smithi049.stdout:0/765: unlink d13/d21/d2f/d7d/da0/dc9/lce 0 2023-12-16T07:40:22.431 INFO:tasks.workunit.client.0.smithi049.stdout:2/519: symlink d2/d1d/d24/d55/d7c/d98/lad 0 2023-12-16T07:40:22.431 INFO:tasks.workunit.client.0.smithi049.stdout:8/633: readlink d0/d1f/l91 0 2023-12-16T07:40:22.433 INFO:tasks.workunit.client.0.smithi049.stdout:1/574: rmdir d20/d40/d6f 39 2023-12-16T07:40:22.434 INFO:tasks.workunit.client.0.smithi049.stdout:0/766: getdents d13/de1 0 2023-12-16T07:40:22.437 INFO:tasks.workunit.client.0.smithi049.stdout:2/520: creat d2/d1d/d28/d56/fae x:0 0 0 2023-12-16T07:40:22.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/634: unlink d0/d1f/d36/f45 0 2023-12-16T07:40:22.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/635: fsync d0/d13/d42/d5b/d68/f8f 0 2023-12-16T07:40:22.439 INFO:tasks.workunit.client.0.smithi049.stdout:1/575: mknod d20/d41/d4f/d55/d82/cc8 0 2023-12-16T07:40:22.439 INFO:tasks.workunit.client.0.smithi049.stdout:1/576: stat d20/d45/d47 0 2023-12-16T07:40:22.440 INFO:tasks.workunit.client.0.smithi049.stdout:0/767: creat d13/d39/d38/da7/f111 x:0 0 0 2023-12-16T07:40:22.440 INFO:tasks.workunit.client.0.smithi049.stdout:0/768: fdatasync d13/fb5 0 2023-12-16T07:40:22.440 INFO:tasks.workunit.client.0.smithi049.stdout:2/521: truncate d2/d26/f59 2369675 0 2023-12-16T07:40:22.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/769: symlink d13/d39/d38/l112 0 2023-12-16T07:40:22.441 INFO:tasks.workunit.client.0.smithi049.stdout:2/522: write d2/d1d/f6d [1376754,47924] 0 2023-12-16T07:40:22.441 INFO:tasks.workunit.client.0.smithi049.stdout:2/523: getdents d2/d1d/d24/d55 0 2023-12-16T07:40:22.441 INFO:tasks.workunit.client.0.smithi049.stdout:1/577: read d20/d41/d4f/f69 [1202476,56281] 0 2023-12-16T07:40:22.442 INFO:tasks.workunit.client.0.smithi049.stdout:1/578: write d20/f3f [4402613,117951] 0 2023-12-16T07:40:22.445 INFO:tasks.workunit.client.0.smithi049.stdout:4/551: dwrite d2/db/dd/de/d1e/d21/f40 [0,4194304] 0 2023-12-16T07:40:22.445 INFO:tasks.workunit.client.0.smithi049.stdout:2/524: symlink d2/de/d93/laf 0 2023-12-16T07:40:22.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/550: dwrite d5/de/d1c/d62/d81/f97 [0,4194304] 0 2023-12-16T07:40:22.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/443: dwrite d1/fc [0,4194304] 0 2023-12-16T07:40:22.446 INFO:tasks.workunit.client.0.smithi049.stdout:3/444: truncate d1/d2a/d37/d3f/d5a/f6f 356529 0 2023-12-16T07:40:22.446 INFO:tasks.workunit.client.0.smithi049.stdout:3/445: fsync d1/d2b/f62 0 2023-12-16T07:40:22.446 INFO:tasks.workunit.client.0.smithi049.stdout:3/446: write d1/d2a/f30 [4249194,35089] 0 2023-12-16T07:40:22.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/579: creat d20/d41/d52/d86/db1/fc9 x:0 0 0 2023-12-16T07:40:22.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/580: chown d20/d41/d4f/f51 5797127 1 2023-12-16T07:40:22.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/581: chown d20/d41/d4f/d55/d7f/d8a 157 1 2023-12-16T07:40:22.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/447: dread d1/f18 [0,4194304] 0 2023-12-16T07:40:22.448 INFO:tasks.workunit.client.0.smithi049.stdout:8/636: dread d0/d1f/d1c/f39 [4194304,4194304] 0 2023-12-16T07:40:22.449 INFO:tasks.workunit.client.0.smithi049.stdout:4/552: rename d2/db/dd/de/d1e/d21/c49 to d2/db/dd/d52/d8c/cb5 0 2023-12-16T07:40:22.449 INFO:tasks.workunit.client.0.smithi049.stdout:2/525: creat d2/d1d/d28/d56/d66/da9/fb0 x:0 0 0 2023-12-16T07:40:22.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/526: read d2/de/f46 [1991657,85519] 0 2023-12-16T07:40:22.458 INFO:tasks.workunit.client.0.smithi049.stdout:9/453: sync 2023-12-16T07:40:22.459 INFO:tasks.workunit.client.0.smithi049.stdout:9/454: chown d4/d3e/c81 5493007 1 2023-12-16T07:40:22.459 INFO:tasks.workunit.client.0.smithi049.stdout:9/455: chown d4/db/c15 371 1 2023-12-16T07:40:22.459 INFO:tasks.workunit.client.0.smithi049.stdout:5/551: creat d5/de/d54/d57/d3c/fb9 x:0 0 0 2023-12-16T07:40:22.459 INFO:tasks.workunit.client.0.smithi049.stdout:5/552: chown d5/de/d54/d57/d2f/c87 442673 1 2023-12-16T07:40:22.459 INFO:tasks.workunit.client.0.smithi049.stdout:1/582: creat d20/d41/d52/d86/fca x:0 0 0 2023-12-16T07:40:22.459 INFO:tasks.workunit.client.0.smithi049.stdout:8/637: mkdir d0/d1f/d4e/dc6 0 2023-12-16T07:40:22.461 INFO:tasks.workunit.client.0.smithi049.stdout:4/553: creat d2/db/dd/de/fb6 x:0 0 0 2023-12-16T07:40:22.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/770: dwrite d13/d21/fb8 [4194304,4194304] 0 2023-12-16T07:40:22.463 INFO:tasks.workunit.client.0.smithi049.stdout:2/527: rmdir d2 39 2023-12-16T07:40:22.468 INFO:tasks.workunit.client.0.smithi049.stdout:4/554: dread d2/f61 [0,4194304] 0 2023-12-16T07:40:22.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/583: truncate d20/d41/d4f/d55/d58/f7e 3414265 0 2023-12-16T07:40:22.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/584: fdatasync d20/d7b/d71/fb5 0 2023-12-16T07:40:22.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/771: getdents d13/d21/d99 0 2023-12-16T07:40:22.471 INFO:tasks.workunit.client.0.smithi049.stdout:2/528: mknod d2/d1d/d28/cb1 0 2023-12-16T07:40:22.473 INFO:tasks.workunit.client.0.smithi049.stdout:4/555: mkdir d2/db/dd/db7 0 2023-12-16T07:40:22.474 INFO:tasks.workunit.client.0.smithi049.stdout:5/553: dwrite d5/de/d1c/f46 [4194304,4194304] 0 2023-12-16T07:40:22.476 INFO:tasks.workunit.client.0.smithi049.stdout:2/529: creat d2/fb2 x:0 0 0 2023-12-16T07:40:22.476 INFO:tasks.workunit.client.0.smithi049.stdout:4/556: creat d2/db/dd/de/d1e/d44/fb8 x:0 0 0 2023-12-16T07:40:22.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/554: mkdir d5/d1e/d21/d4e/dba 0 2023-12-16T07:40:22.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/555: chown d5/de/d54/d57/d3c/fb9 4 1 2023-12-16T07:40:22.479 INFO:tasks.workunit.client.0.smithi049.stdout:2/530: creat d2/d1d/d28/d56/d66/d6b/fb3 x:0 0 0 2023-12-16T07:40:22.480 INFO:tasks.workunit.client.0.smithi049.stdout:5/556: truncate d5/de/d1c/d62/f6a 410927 0 2023-12-16T07:40:22.482 INFO:tasks.workunit.client.0.smithi049.stdout:2/531: creat d2/de/d78/fb4 x:0 0 0 2023-12-16T07:40:22.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/633: sync 2023-12-16T07:40:22.483 INFO:tasks.workunit.client.0.smithi049.stdout:4/557: dread d2/db/dd/d52/f6a [0,4194304] 0 2023-12-16T07:40:22.485 INFO:tasks.workunit.client.0.smithi049.stdout:1/585: dwrite d20/f33 [0,4194304] 0 2023-12-16T07:40:22.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/772: dread d13/fb5 [0,4194304] 0 2023-12-16T07:40:22.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/773: write d13/d21/d99/d46/f60 [5628358,42078] 0 2023-12-16T07:40:22.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/557: mkdir d5/de/d54/da9/dbb 0 2023-12-16T07:40:22.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/558: fsync d5/f19 0 2023-12-16T07:40:22.488 INFO:tasks.workunit.client.0.smithi049.stdout:2/532: creat d2/d1d/d28/d56/d11/d1c/fb5 x:0 0 0 2023-12-16T07:40:22.489 INFO:tasks.workunit.client.0.smithi049.stdout:6/634: mkdir d0/d39/d5b/d65/d58/d33/dc2 0 2023-12-16T07:40:22.490 INFO:tasks.workunit.client.0.smithi049.stdout:4/558: mkdir d2/db/d6b/db9 0 2023-12-16T07:40:22.492 INFO:tasks.workunit.client.0.smithi049.stdout:8/638: rmdir d0/d1f/d4e 39 2023-12-16T07:40:22.496 INFO:tasks.workunit.client.0.smithi049.stdout:1/586: creat d20/d41/d4f/d55/d7f/d84/fcb x:0 0 0 2023-12-16T07:40:22.497 INFO:tasks.workunit.client.0.smithi049.stdout:1/587: dread - d20/d43/f9a zero size 2023-12-16T07:40:22.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/774: creat d13/d39/dbe/dd7/df9/f113 x:0 0 0 2023-12-16T07:40:22.498 INFO:tasks.workunit.client.0.smithi049.stdout:5/559: rename d5/de/d54/d5c/f74 to d5/de/d54/d67/da0/fbc 0 2023-12-16T07:40:22.500 INFO:tasks.workunit.client.0.smithi049.stdout:2/533: symlink d2/d1d/d28/d56/d71/lb6 0 2023-12-16T07:40:22.500 INFO:tasks.workunit.client.0.smithi049.stdout:2/534: fsync d2/d1d/d24/d55/d76/fa2 0 2023-12-16T07:40:22.501 INFO:tasks.workunit.client.0.smithi049.stdout:4/559: mknod d2/db/d6b/db9/cba 0 2023-12-16T07:40:22.501 INFO:tasks.workunit.client.0.smithi049.stdout:4/560: write d2/db/dd/de/d1e/d21/f4f [539182,69291] 0 2023-12-16T07:40:22.502 INFO:tasks.workunit.client.0.smithi049.stdout:6/635: dwrite d0/d39/d5b/d65/fbd [0,4194304] 0 2023-12-16T07:40:22.504 INFO:tasks.workunit.client.0.smithi049.stdout:6/636: dread d0/d2/f82 [0,4194304] 0 2023-12-16T07:40:22.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/560: creat d5/de/d54/d78/d9b/fbd x:0 0 0 2023-12-16T07:40:22.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/561: readlink d5/de/d1c/d62/d81/lb8 0 2023-12-16T07:40:22.509 INFO:tasks.workunit.client.0.smithi049.stdout:0/775: rename d13/d39/d38/d7e/d8b/fe8 to d13/d21/d27/d2c/d62/d70/dff/f114 0 2023-12-16T07:40:22.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/535: mkdir d2/de/db7 0 2023-12-16T07:40:22.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/561: unlink d2/db/dd/de/d1e/f3b 0 2023-12-16T07:40:22.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/562: truncate d2/db/dd/de/d1e/d37/d4e/f89 572901 0 2023-12-16T07:40:22.517 INFO:tasks.workunit.client.0.smithi049.stdout:0/776: creat d13/d21/d27/d2c/d62/d70/f115 x:0 0 0 2023-12-16T07:40:22.520 INFO:tasks.workunit.client.0.smithi049.stdout:8/639: getdents d0/d1f/d36 0 2023-12-16T07:40:22.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/562: mknod d5/d1e/d21/d58/d65/cbe 0 2023-12-16T07:40:22.520 INFO:tasks.workunit.client.0.smithi049.stdout:2/536: dread d2/f17 [0,4194304] 0 2023-12-16T07:40:22.520 INFO:tasks.workunit.client.0.smithi049.stdout:0/777: rmdir d13/d21/d2f/d7d 39 2023-12-16T07:40:22.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/778: dread - d13/d21/d27/f86 zero size 2023-12-16T07:40:22.521 INFO:tasks.workunit.client.0.smithi049.stdout:1/588: dwrite d20/d41/d4f/d55/f59 [0,4194304] 0 2023-12-16T07:40:22.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/637: dwrite d0/d39/d5b/d65/d58/d33/daa/fac [0,4194304] 0 2023-12-16T07:40:22.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/563: mkdir d5/de/d54/dbf 0 2023-12-16T07:40:22.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/564: chown d5/de/d54/d67/f7e 369047429 1 2023-12-16T07:40:22.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/779: read d13/d21/d99/d46/d65/d82/ddb/fdd [13337,40975] 0 2023-12-16T07:40:22.531 INFO:tasks.workunit.client.0.smithi049.stdout:6/638: dread d0/d39/f54 [0,4194304] 0 2023-12-16T07:40:22.531 INFO:tasks.workunit.client.0.smithi049.stdout:1/589: truncate f19 429252 0 2023-12-16T07:40:22.531 INFO:tasks.workunit.client.0.smithi049.stdout:1/590: write d20/d40/d6f/faa [806459,106835] 0 2023-12-16T07:40:22.532 INFO:tasks.workunit.client.0.smithi049.stdout:4/563: dwrite d2/db/f15 [0,4194304] 0 2023-12-16T07:40:22.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/565: link d5/de/d1c/f25 d5/de/d54/d67/da0/fc0 0 2023-12-16T07:40:22.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/566: chown d5/de/f1d 0 1 2023-12-16T07:40:22.536 INFO:tasks.workunit.client.0.smithi049.stdout:6/639: mkdir d0/d2/df/d4e/d5d/dc3 0 2023-12-16T07:40:22.538 INFO:tasks.workunit.client.0.smithi049.stdout:1/591: mknod d20/d41/d4f/ccc 0 2023-12-16T07:40:22.540 INFO:tasks.workunit.client.0.smithi049.stdout:5/567: mknod d5/de/d54/cc1 0 2023-12-16T07:40:22.543 INFO:tasks.workunit.client.0.smithi049.stdout:6/640: creat d0/d39/d5b/fc4 x:0 0 0 2023-12-16T07:40:22.543 INFO:tasks.workunit.client.0.smithi049.stdout:6/641: stat d0/d2/l50 0 2023-12-16T07:40:22.543 INFO:tasks.workunit.client.0.smithi049.stdout:1/592: creat d20/d45/fcd x:0 0 0 2023-12-16T07:40:22.544 INFO:tasks.workunit.client.0.smithi049.stdout:6/642: mkdir d0/d39/d5b/d65/d58/d33/dc5 0 2023-12-16T07:40:22.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/643: symlink d0/d2/df/d4e/d5d/d6f/lc6 0 2023-12-16T07:40:22.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/644: chown d0/d39/d5b/d65/d32/c78 763146 1 2023-12-16T07:40:22.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/593: write d20/d41/d4f/d55/f59 [883940,131060] 0 2023-12-16T07:40:22.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/594: chown d20/d41/d4f/d7c 233104 1 2023-12-16T07:40:22.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/595: write d20/d41/d4f/f51 [1569283,54994] 0 2023-12-16T07:40:22.548 INFO:tasks.workunit.client.0.smithi049.stdout:6/645: creat d0/d39/d5b/d65/d4c/d4d/fc7 x:0 0 0 2023-12-16T07:40:22.549 INFO:tasks.workunit.client.0.smithi049.stdout:6/646: chown d0/d39/d5b/d65/d58/d33/daa/lbc 67 1 2023-12-16T07:40:22.550 INFO:tasks.workunit.client.0.smithi049.stdout:1/596: rename d20/d41/d4f/f76 to d20/d45/d77/fce 0 2023-12-16T07:40:22.551 INFO:tasks.workunit.client.0.smithi049.stdout:6/647: mknod d0/d39/d8b/cc8 0 2023-12-16T07:40:22.551 INFO:tasks.workunit.client.0.smithi049.stdout:6/648: fdatasync d0/f64 0 2023-12-16T07:40:22.552 INFO:tasks.workunit.client.0.smithi049.stdout:6/649: write d0/d39/d8b/fb4 [3537343,119725] 0 2023-12-16T07:40:22.563 INFO:tasks.workunit.client.0.smithi049.stdout:8/640: dwrite d0/d13/fc1 [0,4194304] 0 2023-12-16T07:40:22.563 INFO:tasks.workunit.client.0.smithi049.stdout:1/597: dread d20/d41/d52/f5e [0,4194304] 0 2023-12-16T07:40:22.565 INFO:tasks.workunit.client.0.smithi049.stdout:7/571: sync 2023-12-16T07:40:22.566 INFO:tasks.workunit.client.0.smithi049.stdout:0/780: dwrite fd [0,4194304] 0 2023-12-16T07:40:22.566 INFO:tasks.workunit.client.0.smithi049.stdout:2/537: dwrite d2/d1d/f6d [0,4194304] 0 2023-12-16T07:40:22.566 INFO:tasks.workunit.client.0.smithi049.stdout:6/650: dread d0/d2/df/d4e/d5d/d6f/d4a/f92 [0,4194304] 0 2023-12-16T07:40:22.566 INFO:tasks.workunit.client.0.smithi049.stdout:5/568: dwrite d5/de/d1c/f55 [4194304,4194304] 0 2023-12-16T07:40:22.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/538: dread d2/d1d/d28/d56/fb [0,4194304] 0 2023-12-16T07:40:22.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/539: chown d2/de/d77/c85 0 1 2023-12-16T07:40:22.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/540: chown d2/d26/d43/c65 1 1 2023-12-16T07:40:22.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/541: fdatasync d2/fb2 0 2023-12-16T07:40:22.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/641: symlink d0/d13/d42/d5b/d68/d6b/da2/lc7 0 2023-12-16T07:40:22.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/642: fdatasync d0/d13/f2f 0 2023-12-16T07:40:22.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/598: truncate fc 3706888 0 2023-12-16T07:40:22.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/599: fsync d20/d7b/d71/fb5 0 2023-12-16T07:40:22.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/643: truncate d0/d1f/d36/db8/fc0 372688 0 2023-12-16T07:40:22.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/572: mknod d7/db4/cc1 0 2023-12-16T07:40:22.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/651: write d0/d39/d5b/d65/d53/f5f [794857,58440] 0 2023-12-16T07:40:22.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/652: readlink d0/d39/d5b/d65/d53/l7b 0 2023-12-16T07:40:22.579 INFO:tasks.workunit.client.0.smithi049.stdout:0/781: creat d13/d21/d99/d46/d65/d82/f116 x:0 0 0 2023-12-16T07:40:22.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/600: creat d20/d41/fcf x:0 0 0 2023-12-16T07:40:22.583 INFO:tasks.workunit.client.0.smithi049.stdout:7/573: mknod d7/dc/d6b/cc2 0 2023-12-16T07:40:22.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/653: unlink d0/d39/d5b/d65/d27/d91/la1 0 2023-12-16T07:40:22.586 INFO:tasks.workunit.client.0.smithi049.stdout:8/644: rename d0/f4f to d0/d13/d42/d5b/d68/d6b/fc8 0 2023-12-16T07:40:22.589 INFO:tasks.workunit.client.0.smithi049.stdout:5/569: dwrite d5/f7c [0,4194304] 0 2023-12-16T07:40:22.589 INFO:tasks.workunit.client.0.smithi049.stdout:8/645: truncate d0/d1f/d4e/f8b 808241 0 2023-12-16T07:40:22.589 INFO:tasks.workunit.client.0.smithi049.stdout:8/646: truncate d0/d13/d42/d5b/d68/d6b/da2/db9/fbd 566706 0 2023-12-16T07:40:22.591 INFO:tasks.workunit.client.0.smithi049.stdout:7/574: rename d7/dc/dd/d14/f32 to d7/dc/d6b/d70/fc3 0 2023-12-16T07:40:22.594 INFO:tasks.workunit.client.0.smithi049.stdout:2/542: dwrite d2/d1d/d24/f33 [0,4194304] 0 2023-12-16T07:40:22.598 INFO:tasks.workunit.client.0.smithi049.stdout:5/570: write d5/de/d54/d67/f7b [2413720,41605] 0 2023-12-16T07:40:22.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/543: stat d2/de/d77/c85 0 2023-12-16T07:40:22.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/544: fdatasync d2/f4d 0 2023-12-16T07:40:22.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/782: dwrite d13/d39/dbe/fc3 [0,4194304] 0 2023-12-16T07:40:22.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/783: stat d13/d21/d27/f5f 0 2023-12-16T07:40:22.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/647: rename d0/f43 to d0/d13/d42/d5b/d68/d6b/da2/fc9 0 2023-12-16T07:40:22.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/448: sync 2023-12-16T07:40:22.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/449: chown d1/l71 6353 1 2023-12-16T07:40:22.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/450: write d1/d2a/d37/d3f/d5a/f6f [554356,52101] 0 2023-12-16T07:40:22.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/451: readlink d1/l11 0 2023-12-16T07:40:22.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/452: chown d1/d2a/d37/d63/c6e 7755 1 2023-12-16T07:40:22.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/571: truncate d5/f2a 1412546 0 2023-12-16T07:40:22.605 INFO:tasks.workunit.client.0.smithi049.stdout:2/545: mkdir d2/db8 0 2023-12-16T07:40:22.606 INFO:tasks.workunit.client.0.smithi049.stdout:0/784: creat d13/d21/d2f/d7d/d90/f117 x:0 0 0 2023-12-16T07:40:22.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/575: dwrite d7/dc/d2f/d40/d5d/f96 [0,4194304] 0 2023-12-16T07:40:22.607 INFO:tasks.workunit.client.0.smithi049.stdout:1/601: getdents d20/d41 0 2023-12-16T07:40:22.607 INFO:tasks.workunit.client.0.smithi049.stdout:1/602: write d20/d45/d77/fc3 [14108,111263] 0 2023-12-16T07:40:22.616 INFO:tasks.workunit.client.0.smithi049.stdout:1/603: rename d20/f35 to d20/d40/d6f/dac/fd0 0 2023-12-16T07:40:22.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/648: link d0/d1f/f9f d0/d1f/d36/db8/fca 0 2023-12-16T07:40:22.621 INFO:tasks.workunit.client.0.smithi049.stdout:1/604: dread d20/f3d [0,4194304] 0 2023-12-16T07:40:22.621 INFO:tasks.workunit.client.0.smithi049.stdout:1/605: read - d20/d40/f81 zero size 2023-12-16T07:40:22.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/649: symlink d0/d13/lcb 0 2023-12-16T07:40:22.628 INFO:tasks.workunit.client.0.smithi049.stdout:1/606: truncate d20/f2d 1993985 0 2023-12-16T07:40:22.628 INFO:tasks.workunit.client.0.smithi049.stdout:5/572: dwrite d5/de/d54/d67/f7e [0,4194304] 0 2023-12-16T07:40:22.632 INFO:tasks.workunit.client.0.smithi049.stdout:1/607: creat d20/d41/d4f/d55/d82/dc5/fd1 x:0 0 0 2023-12-16T07:40:22.634 INFO:tasks.workunit.client.0.smithi049.stdout:5/573: mkdir d5/de/d54/d67/dc2 0 2023-12-16T07:40:22.635 INFO:tasks.workunit.client.0.smithi049.stdout:8/650: dread d0/d1f/d56/f74 [0,4194304] 0 2023-12-16T07:40:22.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/651: unlink d0/d1f/l53 0 2023-12-16T07:40:22.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/652: fdatasync d0/d1f/d36/f3c 0 2023-12-16T07:40:22.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/653: chown d0/d13/f2f 10987998 1 2023-12-16T07:40:22.653 INFO:tasks.workunit.client.0.smithi049.stdout:2/546: dwrite d2/fb2 [0,4194304] 0 2023-12-16T07:40:22.654 INFO:tasks.workunit.client.0.smithi049.stdout:2/547: mkdir d2/db8/db9 0 2023-12-16T07:40:22.654 INFO:tasks.workunit.client.0.smithi049.stdout:2/548: write d2/d1d/d28/d56/d11/f67 [402127,1672] 0 2023-12-16T07:40:22.655 INFO:tasks.workunit.client.0.smithi049.stdout:2/549: symlink d2/d1d/d24/d55/lba 0 2023-12-16T07:40:22.656 INFO:tasks.workunit.client.0.smithi049.stdout:2/550: rmdir d2/de/db7 0 2023-12-16T07:40:22.657 INFO:tasks.workunit.client.0.smithi049.stdout:2/551: getdents d2/d1d/d28/d8b 0 2023-12-16T07:40:22.658 INFO:tasks.workunit.client.0.smithi049.stdout:2/552: dread d2/de/f86 [0,4194304] 0 2023-12-16T07:40:22.659 INFO:tasks.workunit.client.0.smithi049.stdout:2/553: creat d2/d1d/d24/fbb x:0 0 0 2023-12-16T07:40:22.659 INFO:tasks.workunit.client.0.smithi049.stdout:2/554: dread - d2/d1d/d28/d56/d11/d1c/f3c zero size 2023-12-16T07:40:22.660 INFO:tasks.workunit.client.0.smithi049.stdout:1/608: dwrite d20/f33 [4194304,4194304] 0 2023-12-16T07:40:22.660 INFO:tasks.workunit.client.0.smithi049.stdout:7/576: dwrite d7/dc/f1d [0,4194304] 0 2023-12-16T07:40:22.660 INFO:tasks.workunit.client.0.smithi049.stdout:0/785: dwrite d13/f1c [0,4194304] 0 2023-12-16T07:40:22.661 INFO:tasks.workunit.client.0.smithi049.stdout:3/453: dwrite d1/d2a/d37/d3f/d5a/f6f [0,4194304] 0 2023-12-16T07:40:22.661 INFO:tasks.workunit.client.0.smithi049.stdout:3/454: dread - d1/d2a/d37/d3f/d5a/d61/d6b/f72 zero size 2023-12-16T07:40:22.662 INFO:tasks.workunit.client.0.smithi049.stdout:5/574: dwrite d5/de/f40 [0,4194304] 0 2023-12-16T07:40:22.662 INFO:tasks.workunit.client.0.smithi049.stdout:5/575: write d5/d1e/d20/f6d [4572964,122191] 0 2023-12-16T07:40:22.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/555: unlink d2/d1d/d28/d56/d11/c8a 0 2023-12-16T07:40:22.663 INFO:tasks.workunit.client.0.smithi049.stdout:1/609: mkdir d20/d41/d4f/d55/d82/dd2 0 2023-12-16T07:40:22.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/556: truncate d2/de/d77/f90 316365 0 2023-12-16T07:40:22.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/557: chown d2/d1d/d28/d56/c1f 1780 1 2023-12-16T07:40:22.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/558: fsync d2/d1d/f89 0 2023-12-16T07:40:22.663 INFO:tasks.workunit.client.0.smithi049.stdout:1/610: write d20/d41/f8d [571480,74114] 0 2023-12-16T07:40:22.667 INFO:tasks.workunit.client.0.smithi049.stdout:7/577: rename d7/dc/d2f/d40/l49 to d7/d2b/d59/lc4 0 2023-12-16T07:40:22.667 INFO:tasks.workunit.client.0.smithi049.stdout:7/578: dread - d7/dc/dd/d27/fab zero size 2023-12-16T07:40:22.668 INFO:tasks.workunit.client.0.smithi049.stdout:0/786: creat d13/d21/d99/f118 x:0 0 0 2023-12-16T07:40:22.672 INFO:tasks.workunit.client.0.smithi049.stdout:8/654: rmdir d0/d1f 39 2023-12-16T07:40:22.675 INFO:tasks.workunit.client.0.smithi049.stdout:1/611: write d20/d40/d6f/fb8 [3630274,111603] 0 2023-12-16T07:40:22.675 INFO:tasks.workunit.client.0.smithi049.stdout:1/612: readlink d20/d41/d4f/l6b 0 2023-12-16T07:40:22.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/576: symlink d5/de/d1c/d62/lc3 0 2023-12-16T07:40:22.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/577: dread - d5/d1e/d21/fad zero size 2023-12-16T07:40:22.681 INFO:tasks.workunit.client.0.smithi049.stdout:7/579: truncate d7/dc/d2f/d38/f3d 3567462 0 2023-12-16T07:40:22.683 INFO:tasks.workunit.client.0.smithi049.stdout:0/787: link d13/d21/d27/d2c/f41 d13/d21/d99/d46/d65/d82/ddb/f119 0 2023-12-16T07:40:22.683 INFO:tasks.workunit.client.0.smithi049.stdout:0/788: chown d13/d39/dbe 3 1 2023-12-16T07:40:22.683 INFO:tasks.workunit.client.0.smithi049.stdout:0/789: chown d13/d21/d99/d46/d65/lf4 846 1 2023-12-16T07:40:22.683 INFO:tasks.workunit.client.0.smithi049.stdout:8/655: fdatasync d0/d1f/d1c/f52 0 2023-12-16T07:40:22.685 INFO:tasks.workunit.client.0.smithi049.stdout:5/578: symlink d5/d1e/d21/d4e/lc4 0 2023-12-16T07:40:22.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/580: rmdir d7/dc/d2f/d38 39 2023-12-16T07:40:22.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/581: dread - d7/dc/d15/fa7 zero size 2023-12-16T07:40:22.687 INFO:tasks.workunit.client.0.smithi049.stdout:2/559: dwrite d2/d1d/d28/d56/d71/f9f [0,4194304] 0 2023-12-16T07:40:22.687 INFO:tasks.workunit.client.0.smithi049.stdout:2/560: truncate d2/d1d/d24/d55/d76/fa2 148405 0 2023-12-16T07:40:22.688 INFO:tasks.workunit.client.0.smithi049.stdout:3/455: dwrite d1/d2b/f4f [0,4194304] 0 2023-12-16T07:40:22.688 INFO:tasks.workunit.client.0.smithi049.stdout:3/456: chown d1/l71 1 1 2023-12-16T07:40:22.688 INFO:tasks.workunit.client.0.smithi049.stdout:8/656: unlink d0/d13/d42/d5b/d68/lb3 0 2023-12-16T07:40:22.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/582: creat d7/dc/dd/d37/d5c/fc5 x:0 0 0 2023-12-16T07:40:22.690 INFO:tasks.workunit.client.0.smithi049.stdout:0/790: dread d13/d21/d2f/f80 [0,4194304] 0 2023-12-16T07:40:22.690 INFO:tasks.workunit.client.0.smithi049.stdout:0/791: stat d13/d3c 0 2023-12-16T07:40:22.690 INFO:tasks.workunit.client.0.smithi049.stdout:0/792: stat d13/d21/d27/d2c/l81 0 2023-12-16T07:40:22.690 INFO:tasks.workunit.client.0.smithi049.stdout:0/793: chown d13/d21/d27/d2c/d62/d70/dff/f114 6 1 2023-12-16T07:40:22.692 INFO:tasks.workunit.client.0.smithi049.stdout:2/561: mknod d2/d26/cbc 0 2023-12-16T07:40:22.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/457: mkdir d1/d2a/d37/d3f/d5a/d6d/d96 0 2023-12-16T07:40:22.695 INFO:tasks.workunit.client.0.smithi049.stdout:1/613: dwrite d20/d43/f9c [0,4194304] 0 2023-12-16T07:40:22.697 INFO:tasks.workunit.client.0.smithi049.stdout:8/657: symlink d0/d1f/d36/db8/lcc 0 2023-12-16T07:40:22.697 INFO:tasks.workunit.client.0.smithi049.stdout:5/579: creat d5/d1e/d21/d5a/fc5 x:0 0 0 2023-12-16T07:40:22.698 INFO:tasks.workunit.client.0.smithi049.stdout:7/583: dread d7/dc/dd/d14/f52 [0,4194304] 0 2023-12-16T07:40:22.698 INFO:tasks.workunit.client.0.smithi049.stdout:9/456: sync 2023-12-16T07:40:22.700 INFO:tasks.workunit.client.0.smithi049.stdout:0/794: link d13/d39/d38/d7e/d8b/f9a d13/d21/d2f/d7d/da0/f11a 0 2023-12-16T07:40:22.700 INFO:tasks.workunit.client.0.smithi049.stdout:4/564: sync 2023-12-16T07:40:22.700 INFO:tasks.workunit.client.0.smithi049.stdout:6/654: sync 2023-12-16T07:40:22.701 INFO:tasks.workunit.client.0.smithi049.stdout:2/562: symlink d2/de/d77/lbd 0 2023-12-16T07:40:22.701 INFO:tasks.workunit.client.0.smithi049.stdout:2/563: fdatasync d2/d1d/d28/d56/d66/f7e 0 2023-12-16T07:40:22.703 INFO:tasks.workunit.client.0.smithi049.stdout:3/458: rename d1/l67 to d1/d2a/d37/d63/d76/l97 0 2023-12-16T07:40:22.708 INFO:tasks.workunit.client.0.smithi049.stdout:7/584: mknod d7/dc/dd/d35/cc6 0 2023-12-16T07:40:22.708 INFO:tasks.workunit.client.0.smithi049.stdout:7/585: chown d7/dc/dd/d27/f48 228 1 2023-12-16T07:40:22.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/580: link d5/de/d54/d57/f50 d5/de/d54/da9/fc6 0 2023-12-16T07:40:22.709 INFO:tasks.workunit.client.0.smithi049.stdout:4/565: creat d2/db/dd/fbb x:0 0 0 2023-12-16T07:40:22.709 INFO:tasks.workunit.client.0.smithi049.stdout:4/566: fdatasync d2/db/dd/de/d1e/d37/d6f/fa7 0 2023-12-16T07:40:22.712 INFO:tasks.workunit.client.0.smithi049.stdout:6/655: write d0/d2/f9 [141138,27166] 0 2023-12-16T07:40:22.712 INFO:tasks.workunit.client.0.smithi049.stdout:2/564: dread d2/d26/f30 [0,4194304] 0 2023-12-16T07:40:22.712 INFO:tasks.workunit.client.0.smithi049.stdout:6/656: fdatasync d0/d39/d5b/d65/d58/d33/f70 0 2023-12-16T07:40:22.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/657: write d0/d39/f54 [3372798,79759] 0 2023-12-16T07:40:22.715 INFO:tasks.workunit.client.0.smithi049.stdout:8/658: creat d0/d1f/db7/dbe/fcd x:0 0 0 2023-12-16T07:40:22.715 INFO:tasks.workunit.client.0.smithi049.stdout:8/659: fdatasync d0/d1f/d56/f72 0 2023-12-16T07:40:22.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/586: mkdir d7/dc/d6b/d70/dc7 0 2023-12-16T07:40:22.715 INFO:tasks.workunit.client.0.smithi049.stdout:9/457: dwrite d4/d3e/f6e [0,4194304] 0 2023-12-16T07:40:22.716 INFO:tasks.workunit.client.0.smithi049.stdout:4/567: truncate d2/db/dd/de/d1e/d21/f40 1175429 0 2023-12-16T07:40:22.718 INFO:tasks.workunit.client.0.smithi049.stdout:7/587: dread f5 [0,4194304] 0 2023-12-16T07:40:22.718 INFO:tasks.workunit.client.0.smithi049.stdout:2/565: truncate d2/d26/f30 130031 0 2023-12-16T07:40:22.719 INFO:tasks.workunit.client.0.smithi049.stdout:6/658: creat d0/d2/fc9 x:0 0 0 2023-12-16T07:40:22.719 INFO:tasks.workunit.client.0.smithi049.stdout:6/659: chown d0/d39/d5b/d65/d58/d33/daa/lbc 27678101 1 2023-12-16T07:40:22.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/458: write d4/d7/d11/d26/d47/d59/f70 [3405544,109662] 0 2023-12-16T07:40:22.720 INFO:tasks.workunit.client.0.smithi049.stdout:3/459: unlink d1/l23 0 2023-12-16T07:40:22.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/459: dread d4/d7/d11/f16 [0,4194304] 0 2023-12-16T07:40:22.725 INFO:tasks.workunit.client.0.smithi049.stdout:1/614: dwrite d20/d40/f5f [0,4194304] 0 2023-12-16T07:40:22.725 INFO:tasks.workunit.client.0.smithi049.stdout:0/795: dwrite d13/d21/d99/d46/d65/d82/ddb/f119 [0,4194304] 0 2023-12-16T07:40:22.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/568: link d2/db/dd/de/d1e/d44/c88 d2/db/dd/d9f/cbc 0 2023-12-16T07:40:22.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/588: mkdir d7/dc/d15/d57/dc8 0 2023-12-16T07:40:22.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/569: chown d2/db/dd/de/d1e/d37/d82/fae 143 1 2023-12-16T07:40:22.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/660: mknod d0/d2/df/d4e/d5d/d6f/cca 0 2023-12-16T07:40:22.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/589: write d7/dc/d6b/d70/d86/f88 [2298831,28181] 0 2023-12-16T07:40:22.728 INFO:tasks.workunit.client.0.smithi049.stdout:9/460: link d4/d7/d11/d56/l75 d4/d7/d11/d1d/l92 0 2023-12-16T07:40:22.728 INFO:tasks.workunit.client.0.smithi049.stdout:9/461: stat d4/d7/d11/d26/d47/d8a/f5a 0 2023-12-16T07:40:22.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/460: mknod d1/d2a/d37/d63/c98 0 2023-12-16T07:40:22.729 INFO:tasks.workunit.client.0.smithi049.stdout:2/566: symlink d2/de/d93/lbe 0 2023-12-16T07:40:22.729 INFO:tasks.workunit.client.0.smithi049.stdout:2/567: fdatasync d2/d1d/f68 0 2023-12-16T07:40:22.730 INFO:tasks.workunit.client.0.smithi049.stdout:1/615: truncate d20/d41/d4f/d55/d58/f7e 748455 0 2023-12-16T07:40:22.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/570: link d2/db/dd/de/d1e/d37/f38 d2/db/dd/de/d1e/d37/d82/fbd 0 2023-12-16T07:40:22.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/571: chown d2/db/d6b/dad 3040 1 2023-12-16T07:40:22.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/661: truncate d0/d2/df/d81/fa9 3683154 0 2023-12-16T07:40:22.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/662: stat d0/d2/df/d4e/faf 0 2023-12-16T07:40:22.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/590: link d7/dc/d2f/l4e d7/dc/dd/d27/lc9 0 2023-12-16T07:40:22.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/462: mkdir d4/d7/d11/d1d/d48/d93 0 2023-12-16T07:40:22.749 INFO:tasks.workunit.client.0.smithi049.stdout:8/660: dwrite d0/d1f/f22 [0,4194304] 0 2023-12-16T07:40:22.749 INFO:tasks.workunit.client.0.smithi049.stdout:0/796: dwrite d13/d21/d27/f86 [0,4194304] 0 2023-12-16T07:40:22.749 INFO:tasks.workunit.client.0.smithi049.stdout:3/461: creat d1/d2a/d37/d3f/d5a/d5b/f99 x:0 0 0 2023-12-16T07:40:22.749 INFO:tasks.workunit.client.0.smithi049.stdout:2/568: creat d2/d1d/d38/fbf x:0 0 0 2023-12-16T07:40:22.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/572: rename d2/db/d6b/db9/cba to d2/db/dd/de/d1e/d37/d4e/cbe 0 2023-12-16T07:40:22.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/573: readlink d2/db/dd/de/la3 0 2023-12-16T07:40:22.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/574: readlink d2/l7 0 2023-12-16T07:40:22.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/575: write d2/f9 [13213106,98059] 0 2023-12-16T07:40:22.752 INFO:tasks.workunit.client.0.smithi049.stdout:6/663: rmdir d0/d39/d5b/d65/d27/d91 39 2023-12-16T07:40:22.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/591: rmdir d7/dc/dd/d35/d36 39 2023-12-16T07:40:22.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/592: write d7/dc/f1d [4779600,27013] 0 2023-12-16T07:40:22.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/593: chown d7/dc/d2f/l89 65 1 2023-12-16T07:40:22.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/797: mknod d13/d39/dbe/dbf/c11b 0 2023-12-16T07:40:22.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/798: stat d13/d21/d2f/d7d/l96 0 2023-12-16T07:40:22.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/799: dread - d13/d39/d78/fca zero size 2023-12-16T07:40:22.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/462: creat d1/d2a/d37/f9a x:0 0 0 2023-12-16T07:40:22.764 INFO:tasks.workunit.client.0.smithi049.stdout:9/463: dread d4/f34 [0,4194304] 0 2023-12-16T07:40:22.764 INFO:tasks.workunit.client.0.smithi049.stdout:2/569: rename d2/d1d/d28/d56/d71/fa4 to d2/d26/d6e/fc0 0 2023-12-16T07:40:22.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/576: creat d2/db/dd/de/d1e/d37/fbf x:0 0 0 2023-12-16T07:40:22.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/577: write d2/f12 [5493211,71822] 0 2023-12-16T07:40:22.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/578: chown d2/db/dd/de/d1e/d37/f3c 336905337 1 2023-12-16T07:40:22.765 INFO:tasks.workunit.client.0.smithi049.stdout:6/664: symlink d0/d39/d5b/d65/d58/lcb 0 2023-12-16T07:40:22.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/594: unlink d7/d2b/f8b 0 2023-12-16T07:40:22.768 INFO:tasks.workunit.client.0.smithi049.stdout:3/463: rmdir d1/d2a/d37/d3f/d5a/d61 39 2023-12-16T07:40:22.769 INFO:tasks.workunit.client.0.smithi049.stdout:8/661: dwrite d0/d13/f2f [4194304,4194304] 0 2023-12-16T07:40:22.770 INFO:tasks.workunit.client.0.smithi049.stdout:9/464: unlink d4/d7/d11/d26/f68 0 2023-12-16T07:40:22.771 INFO:tasks.workunit.client.0.smithi049.stdout:0/800: rename d13/d39/dbe/dbf/f102 to d13/d21/d27/f11c 0 2023-12-16T07:40:22.772 INFO:tasks.workunit.client.0.smithi049.stdout:2/570: symlink d2/d1d/d28/d56/d66/da9/lc1 0 2023-12-16T07:40:22.776 INFO:tasks.workunit.client.0.smithi049.stdout:4/579: mknod d2/db/dd/de/d1e/d37/d4e/cc0 0 2023-12-16T07:40:22.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/595: symlink d7/da5/lca 0 2023-12-16T07:40:22.779 INFO:tasks.workunit.client.0.smithi049.stdout:3/464: getdents d1/d2a/d37/d3f/d5a/d6d 0 2023-12-16T07:40:22.780 INFO:tasks.workunit.client.0.smithi049.stdout:7/596: write f4 [1723466,56645] 0 2023-12-16T07:40:22.780 INFO:tasks.workunit.client.0.smithi049.stdout:7/597: chown d7/dc/d2f/d40/d5d 693657 1 2023-12-16T07:40:22.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/801: creat d13/d21/d27/d2c/d62/d70/d107/f11d x:0 0 0 2023-12-16T07:40:22.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/802: chown d13/d21/d2f/d7d 11965962 1 2023-12-16T07:40:22.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/571: rmdir d2/d1d/d24 39 2023-12-16T07:40:22.790 INFO:tasks.workunit.client.0.smithi049.stdout:7/598: creat d7/dc/dd/d27/dba/fcb x:0 0 0 2023-12-16T07:40:22.790 INFO:tasks.workunit.client.0.smithi049.stdout:7/599: readlink d7/dc/la6 0 2023-12-16T07:40:22.792 INFO:tasks.workunit.client.0.smithi049.stdout:0/803: rename d13/d39/dbe/dd7/dda to d13/d39/df3/d11e 0 2023-12-16T07:40:22.793 INFO:tasks.workunit.client.0.smithi049.stdout:2/572: getdents d2/d1d/d24/d55/d76 0 2023-12-16T07:40:22.794 INFO:tasks.workunit.client.0.smithi049.stdout:3/465: mknod d1/c9b 0 2023-12-16T07:40:22.795 INFO:tasks.workunit.client.0.smithi049.stdout:7/600: creat d7/dc/d6b/dbf/fcc x:0 0 0 2023-12-16T07:40:22.796 INFO:tasks.workunit.client.0.smithi049.stdout:0/804: truncate d13/d21/d99/d46/f60 5446284 0 2023-12-16T07:40:22.798 INFO:tasks.workunit.client.0.smithi049.stdout:6/665: getdents d0/d39/d5b/d65/d58 0 2023-12-16T07:40:22.798 INFO:tasks.workunit.client.0.smithi049.stdout:0/805: dread d13/d39/f87 [0,4194304] 0 2023-12-16T07:40:22.798 INFO:tasks.workunit.client.0.smithi049.stdout:0/806: write d13/d3c/fde [400266,11844] 0 2023-12-16T07:40:22.798 INFO:tasks.workunit.client.0.smithi049.stdout:2/573: rmdir d2/d1d/d38 39 2023-12-16T07:40:22.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/662: dwrite d0/d1f/d1c/f52 [0,4194304] 0 2023-12-16T07:40:22.799 INFO:tasks.workunit.client.0.smithi049.stdout:3/466: creat d1/d2a/d37/d3f/d4c/f9c x:0 0 0 2023-12-16T07:40:22.799 INFO:tasks.workunit.client.0.smithi049.stdout:3/467: readlink d1/d2a/d37/d3f/l45 0 2023-12-16T07:40:22.800 INFO:tasks.workunit.client.0.smithi049.stdout:7/601: rmdir d7/dc/dd/d37/d5c 39 2023-12-16T07:40:22.800 INFO:tasks.workunit.client.0.smithi049.stdout:7/602: getdents d7/dc/d15/d57/dc8 0 2023-12-16T07:40:22.800 INFO:tasks.workunit.client.0.smithi049.stdout:7/603: chown d7/dc/dd/d37/l42 246658 1 2023-12-16T07:40:22.801 INFO:tasks.workunit.client.0.smithi049.stdout:9/465: dwrite d4/d7/d11/d26/f52 [4194304,4194304] 0 2023-12-16T07:40:22.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/580: dwrite d2/f12 [4194304,4194304] 0 2023-12-16T07:40:22.802 INFO:tasks.workunit.client.0.smithi049.stdout:6/666: symlink d0/d39/d5b/d65/d58/d33/daa/lcc 0 2023-12-16T07:40:22.803 INFO:tasks.workunit.client.0.smithi049.stdout:0/807: creat d13/d39/dbe/dd7/f11f x:0 0 0 2023-12-16T07:40:22.803 INFO:tasks.workunit.client.0.smithi049.stdout:0/808: readlink d13/d39/d38/d7e/l85 0 2023-12-16T07:40:22.806 INFO:tasks.workunit.client.0.smithi049.stdout:8/663: creat d0/d13/d42/d5b/dab/d89/fce x:0 0 0 2023-12-16T07:40:22.812 INFO:tasks.workunit.client.0.smithi049.stdout:3/468: creat d1/d2a/d37/d3f/d5a/d6d/d96/f9d x:0 0 0 2023-12-16T07:40:22.812 INFO:tasks.workunit.client.0.smithi049.stdout:3/469: readlink d1/l11 0 2023-12-16T07:40:22.815 INFO:tasks.workunit.client.0.smithi049.stdout:9/466: creat d4/d7/d11/d1d/d48/d93/f94 x:0 0 0 2023-12-16T07:40:22.816 INFO:tasks.workunit.client.0.smithi049.stdout:4/581: creat d2/db/dd/db7/fc1 x:0 0 0 2023-12-16T07:40:22.817 INFO:tasks.workunit.client.0.smithi049.stdout:4/582: dread d2/db/dd/f3d [0,4194304] 0 2023-12-16T07:40:22.817 INFO:tasks.workunit.client.0.smithi049.stdout:0/809: dwrite d13/d21/d27/d2c/d62/f84 [0,4194304] 0 2023-12-16T07:40:22.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/667: creat d0/d39/d5b/d65/d27/d91/d94/fcd x:0 0 0 2023-12-16T07:40:22.819 INFO:tasks.workunit.client.0.smithi049.stdout:2/574: dread d2/d1d/d24/d55/d76/fa2 [0,4194304] 0 2023-12-16T07:40:22.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/664: rename d0/d13/d42/d5b/dab/d89/f9c to d0/d1f/d36/db8/fcf 0 2023-12-16T07:40:22.822 INFO:tasks.workunit.client.0.smithi049.stdout:7/604: rmdir d7/dc 39 2023-12-16T07:40:22.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/583: dread d2/f28 [0,4194304] 0 2023-12-16T07:40:22.824 INFO:tasks.workunit.client.0.smithi049.stdout:4/584: dread - d2/db/dd/de/d1e/f64 zero size 2023-12-16T07:40:22.827 INFO:tasks.workunit.client.0.smithi049.stdout:6/668: mkdir d0/d2/df/dce 0 2023-12-16T07:40:22.827 INFO:tasks.workunit.client.0.smithi049.stdout:9/467: rename d4/db/c17 to d4/d7/d11/d26/d47/d59/c95 0 2023-12-16T07:40:22.827 INFO:tasks.workunit.client.0.smithi049.stdout:0/810: dread d13/d21/d99/d46/fac [0,4194304] 0 2023-12-16T07:40:22.827 INFO:tasks.workunit.client.0.smithi049.stdout:9/468: chown d4/d7/d11/d1d/d5b 623 1 2023-12-16T07:40:22.828 INFO:tasks.workunit.client.0.smithi049.stdout:8/665: symlink d0/d13/d42/d5b/dab/d89/ld0 0 2023-12-16T07:40:22.829 INFO:tasks.workunit.client.0.smithi049.stdout:0/811: write d13/d21/d27/d2c/d62/daa/fec [2638280,812] 0 2023-12-16T07:40:22.829 INFO:tasks.workunit.client.0.smithi049.stdout:0/812: chown d13/d21/d99/l64 27998 1 2023-12-16T07:40:22.829 INFO:tasks.workunit.client.0.smithi049.stdout:0/813: chown d13/d39/d78/d83/l106 33200536 1 2023-12-16T07:40:22.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/605: creat d7/dc/dd/d37/fcd x:0 0 0 2023-12-16T07:40:22.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/606: chown d7/dc/c87 2 1 2023-12-16T07:40:22.830 INFO:tasks.workunit.client.0.smithi049.stdout:4/585: symlink d2/db/dd/de/d1e/d37/lc2 0 2023-12-16T07:40:22.830 INFO:tasks.workunit.client.0.smithi049.stdout:4/586: chown d2/db/c93 10375 1 2023-12-16T07:40:22.833 INFO:tasks.workunit.client.0.smithi049.stdout:3/470: dwrite d1/d2a/d37/f55 [0,4194304] 0 2023-12-16T07:40:22.833 INFO:tasks.workunit.client.0.smithi049.stdout:6/669: rename d0/d39/d5b/d65/d27/d91/l99 to d0/d39/d5b/d65/d58/d33/dc5/lcf 0 2023-12-16T07:40:22.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/587: dread d2/db/dd/de/f63 [0,4194304] 0 2023-12-16T07:40:22.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/588: write d2/db/dd/d52/f59 [9328336,110872] 0 2023-12-16T07:40:22.833 INFO:tasks.workunit.client.0.smithi049.stdout:3/471: write d1/f44 [384075,26032] 0 2023-12-16T07:40:22.834 INFO:tasks.workunit.client.0.smithi049.stdout:9/469: rename d4/d7/d11/d1d/d5b/c87 to d4/d7/d11/d1d/d5b/c96 0 2023-12-16T07:40:22.835 INFO:tasks.workunit.client.0.smithi049.stdout:8/666: symlink d0/d13/d42/d5b/ld1 0 2023-12-16T07:40:22.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/814: mknod d13/de1/c120 0 2023-12-16T07:40:22.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/815: truncate d13/d21/d27/d2c/d62/d70/d107/f11d 492038 0 2023-12-16T07:40:22.838 INFO:tasks.workunit.client.0.smithi049.stdout:7/607: mknod d7/cce 0 2023-12-16T07:40:22.838 INFO:tasks.workunit.client.0.smithi049.stdout:7/608: read f5 [1334904,53519] 0 2023-12-16T07:40:22.844 INFO:tasks.workunit.client.0.smithi049.stdout:6/670: mkdir d0/d39/dd0 0 2023-12-16T07:40:22.845 INFO:tasks.workunit.client.0.smithi049.stdout:6/671: write d0/d2/df/d4e/d5d/d6f/d4a/fb5 [636884,83503] 0 2023-12-16T07:40:22.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/589: mknod d2/db/dd/de/d1e/d44/cc3 0 2023-12-16T07:40:22.848 INFO:tasks.workunit.client.0.smithi049.stdout:3/472: creat d1/d2a/d37/d3f/d5a/d61/f9e x:0 0 0 2023-12-16T07:40:22.849 INFO:tasks.workunit.client.0.smithi049.stdout:9/470: creat d4/db/f97 x:0 0 0 2023-12-16T07:40:22.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/816: mknod d13/d21/d27/d2c/c121 0 2023-12-16T07:40:22.851 INFO:tasks.workunit.client.0.smithi049.stdout:7/609: symlink d7/dc/dd/d35/lcf 0 2023-12-16T07:40:22.852 INFO:tasks.workunit.client.0.smithi049.stdout:6/672: mkdir d0/d39/d5b/d65/d58/d33/daa/dd1 0 2023-12-16T07:40:22.852 INFO:tasks.workunit.client.0.smithi049.stdout:6/673: chown d0/d2/df/d4e/d5d/d6f/c8d 7 1 2023-12-16T07:40:22.853 INFO:tasks.workunit.client.0.smithi049.stdout:4/590: creat d2/db/dd/d2a/fc4 x:0 0 0 2023-12-16T07:40:22.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/471: getdents d4/d7/d11/d1d/d69 0 2023-12-16T07:40:22.855 INFO:tasks.workunit.client.0.smithi049.stdout:0/817: symlink d13/d39/df3/d11e/l122 0 2023-12-16T07:40:22.857 INFO:tasks.workunit.client.0.smithi049.stdout:4/591: symlink d2/db/dd/de/d1e/d37/da4/lc5 0 2023-12-16T07:40:22.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/592: write d2/db/dd/de/d1e/d44/fb8 [217606,107985] 0 2023-12-16T07:40:22.858 INFO:tasks.workunit.client.0.smithi049.stdout:9/472: mknod d4/c98 0 2023-12-16T07:40:22.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/818: symlink d13/d39/d78/l123 0 2023-12-16T07:40:22.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/593: creat d2/db/d6b/db9/fc6 x:0 0 0 2023-12-16T07:40:22.862 INFO:tasks.workunit.client.0.smithi049.stdout:9/473: creat d4/d7/d11/d1d/d69/d76/f99 x:0 0 0 2023-12-16T07:40:22.863 INFO:tasks.workunit.client.0.smithi049.stdout:0/819: mkdir d13/d21/d99/d46/d124 0 2023-12-16T07:40:22.863 INFO:tasks.workunit.client.0.smithi049.stdout:9/474: read d4/d7/f7a [2079172,126670] 0 2023-12-16T07:40:22.864 INFO:tasks.workunit.client.0.smithi049.stdout:9/475: creat d4/d7/d11/d1d/d69/d76/f9a x:0 0 0 2023-12-16T07:40:22.864 INFO:tasks.workunit.client.0.smithi049.stdout:9/476: dread - d4/d7/d11/d26/d47/d8a/f5a zero size 2023-12-16T07:40:22.865 INFO:tasks.workunit.client.0.smithi049.stdout:9/477: write d4/ff [4611498,45150] 0 2023-12-16T07:40:22.866 INFO:tasks.workunit.client.0.smithi049.stdout:9/478: dread - d4/d7/d11/d3f/f54 zero size 2023-12-16T07:40:22.866 INFO:tasks.workunit.client.0.smithi049.stdout:9/479: mkdir d4/d7/d11/d1d/d9b 0 2023-12-16T07:40:22.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/674: write d0/d39/d5b/d65/d58/d33/daa/fac [850546,27315] 0 2023-12-16T07:40:22.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/675: creat d0/d39/d5b/d65/d4c/d4d/d6a/fd2 x:0 0 0 2023-12-16T07:40:22.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/676: write d0/d39/d5b/d65/d32/f9c [487809,81713] 0 2023-12-16T07:40:22.943 INFO:tasks.workunit.client.0.smithi049.stdout:5/581: sync 2023-12-16T07:40:22.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/616: sync 2023-12-16T07:40:22.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/677: getdents d0/d39/d5b/d65/d27/db1 0 2023-12-16T07:40:22.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/594: dwrite d2/ff [0,4194304] 0 2023-12-16T07:40:22.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/617: rename d20/d7b/f91 to d20/d40/d6f/fd3 0 2023-12-16T07:40:22.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/618: read - f15 zero size 2023-12-16T07:40:22.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/619: read - d20/d41/d4f/d55/d7f/d84/fbf zero size 2023-12-16T07:40:22.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/620: write d20/d41/d4f/d55/d7f/d84/fcb [93037,91847] 0 2023-12-16T07:40:22.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/582: symlink d5/de/d54/d78/lc7 0 2023-12-16T07:40:22.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/583: fdatasync d5/d1e/d21/d58/fb2 0 2023-12-16T07:40:22.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/584: fsync d5/d1e/d21/fb6 0 2023-12-16T07:40:22.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/585: chown d5/d1e/d21/d58/d65/cbe 64746 1 2023-12-16T07:40:22.946 INFO:tasks.workunit.client.0.smithi049.stdout:8/667: dwrite d0/d13/d42/d5b/dab/faa [0,4194304] 0 2023-12-16T07:40:22.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/678: creat d0/d2/df/d4e/d5d/d6f/d4a/fd3 x:0 0 0 2023-12-16T07:40:22.947 INFO:tasks.workunit.client.0.smithi049.stdout:9/480: dread d4/db/f41 [0,4194304] 0 2023-12-16T07:40:22.947 INFO:tasks.workunit.client.0.smithi049.stdout:9/481: dread - d4/d7/d11/d26/f8c zero size 2023-12-16T07:40:22.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/621: creat d20/d43/fd4 x:0 0 0 2023-12-16T07:40:22.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/622: write d20/d43/f8c [678764,126086] 0 2023-12-16T07:40:22.948 INFO:tasks.workunit.client.0.smithi049.stdout:5/586: symlink d5/de/d54/da9/lc8 0 2023-12-16T07:40:22.948 INFO:tasks.workunit.client.0.smithi049.stdout:5/587: chown d5/d1e/d20 49 1 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/668: link d0/d1f/d56/f72 d0/d13/d42/d5b/dab/fd2 0 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/669: chown d0/d1f/d4e/dbb 2225082 1 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/670: chown d0/d13/lcb 1005 1 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/671: chown d0/d1f/d56/f74 7011778 1 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:6/679: mknod d0/d2/df/d4e/d5d/dc3/cd4 0 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:9/482: dread d4/f85 [0,4194304] 0 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:1/623: truncate d20/d45/d77/fce 1279395 0 2023-12-16T07:40:22.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/588: unlink d5/c30 0 2023-12-16T07:40:22.955 INFO:tasks.workunit.client.0.smithi049.stdout:4/595: dread d2/db/dd/de/d1e/d37/f38 [0,4194304] 0 2023-12-16T07:40:22.956 INFO:tasks.workunit.client.0.smithi049.stdout:9/483: write d4/d7/d11/d26/f53 [2206633,38647] 0 2023-12-16T07:40:22.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/589: write d5/de/d1c/d62/d81/f97 [2453776,8272] 0 2023-12-16T07:40:22.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/590: fdatasync d5/f3e 0 2023-12-16T07:40:22.956 INFO:tasks.workunit.client.0.smithi049.stdout:8/672: symlink d0/d1f/d56/ld3 0 2023-12-16T07:40:22.957 INFO:tasks.workunit.client.0.smithi049.stdout:1/624: creat d20/d41/d4f/fd5 x:0 0 0 2023-12-16T07:40:22.957 INFO:tasks.workunit.client.0.smithi049.stdout:1/625: fdatasync d20/d40/d6f/dac/fd0 0 2023-12-16T07:40:22.957 INFO:tasks.workunit.client.0.smithi049.stdout:1/626: write d20/d45/d47/fb9 [160787,105854] 0 2023-12-16T07:40:22.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/591: creat d5/de/d54/da9/fc9 x:0 0 0 2023-12-16T07:40:22.961 INFO:tasks.workunit.client.0.smithi049.stdout:1/627: creat d20/d45/d77/fd6 x:0 0 0 2023-12-16T07:40:22.962 INFO:tasks.workunit.client.0.smithi049.stdout:1/628: fsync d20/d45/d77/f9e 0 2023-12-16T07:40:22.963 INFO:tasks.workunit.client.0.smithi049.stdout:5/592: mknod d5/d1e/d21/d4e/dba/cca 0 2023-12-16T07:40:22.963 INFO:tasks.workunit.client.0.smithi049.stdout:1/629: creat d20/d41/d52/d86/db1/fd7 x:0 0 0 2023-12-16T07:40:22.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/593: unlink d5/de/d54/d57/c4f 0 2023-12-16T07:40:22.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/630: getdents d20/d41/d4f/d55/d82 0 2023-12-16T07:40:22.979 INFO:tasks.workunit.client.0.smithi049.stdout:1/631: dread d20/d41/f5a [0,4194304] 0 2023-12-16T07:40:22.985 INFO:tasks.workunit.client.0.smithi049.stdout:1/632: dread d20/d45/d47/fb3 [0,4194304] 0 2023-12-16T07:40:22.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/594: dread d5/de/d1c/f46 [4194304,4194304] 0 2023-12-16T07:40:22.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/595: mkdir d5/de/d54/da9/dcb 0 2023-12-16T07:40:22.987 INFO:tasks.workunit.client.0.smithi049.stdout:5/596: chown d5/d1e/d20/f6d 203 1 2023-12-16T07:40:22.987 INFO:tasks.workunit.client.0.smithi049.stdout:5/597: creat d5/de/d54/d67/dc2/fcc x:0 0 0 2023-12-16T07:40:22.989 INFO:tasks.workunit.client.0.smithi049.stdout:5/598: rename d5/d1e/l3f to d5/de/d54/d78/lcd 0 2023-12-16T07:40:22.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/599: mknod d5/de/d54/cce 0 2023-12-16T07:40:22.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/680: dwrite d0/f64 [4194304,4194304] 0 2023-12-16T07:40:22.992 INFO:tasks.workunit.client.0.smithi049.stdout:8/673: dwrite d0/fa7 [0,4194304] 0 2023-12-16T07:40:22.992 INFO:tasks.workunit.client.0.smithi049.stdout:8/674: write d0/d13/d42/d5b/fc4 [922783,109370] 0 2023-12-16T07:40:22.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/600: symlink d5/de/d1c/db1/lcf 0 2023-12-16T07:40:22.993 INFO:tasks.workunit.client.0.smithi049.stdout:9/484: dwrite d4/db/f5d [0,4194304] 0 2023-12-16T07:40:22.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/633: dread d20/d41/d4f/d55/d58/f7e [0,4194304] 0 2023-12-16T07:40:22.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/634: truncate d20/d41/d4f/d55/d7f/d8a/fa1 550223 0 2023-12-16T07:40:22.994 INFO:tasks.workunit.client.0.smithi049.stdout:6/681: read d0/d39/d5b/d65/d53/f61 [1967721,55877] 0 2023-12-16T07:40:22.995 INFO:tasks.workunit.client.0.smithi049.stdout:4/596: dwrite d2/db/dd/de/d1e/d21/fb3 [0,4194304] 0 2023-12-16T07:40:22.995 INFO:tasks.workunit.client.0.smithi049.stdout:8/675: truncate d0/d1f/d1c/f39 853875 0 2023-12-16T07:40:22.997 INFO:tasks.workunit.client.0.smithi049.stdout:9/485: unlink d4/d7/d11/d26/d47/d59/f7d 0 2023-12-16T07:40:23.009 INFO:tasks.workunit.client.0.smithi049.stdout:6/682: creat d0/d39/d5b/d65/d27/fd5 x:0 0 0 2023-12-16T07:40:23.009 INFO:tasks.workunit.client.0.smithi049.stdout:6/683: fdatasync d0/d39/f54 0 2023-12-16T07:40:23.009 INFO:tasks.workunit.client.0.smithi049.stdout:6/684: readlink d0/d2/l38 0 2023-12-16T07:40:23.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/597: rename d2/db/dd/de/f96 to d2/db/dd/de/d1e/d44/fc7 0 2023-12-16T07:40:23.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/676: mknod d0/d13/d42/d5b/d68/d6b/da2/db9/cd4 0 2023-12-16T07:40:23.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/677: chown d0/d1f/d36/db8/fc0 102 1 2023-12-16T07:40:23.014 INFO:tasks.workunit.client.0.smithi049.stdout:9/486: creat d4/d7/d11/d1d/d69/f9c x:0 0 0 2023-12-16T07:40:23.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/685: mkdir d0/d39/d5b/d65/d4c/d4d/d6a/dd6 0 2023-12-16T07:40:23.016 INFO:tasks.workunit.client.0.smithi049.stdout:4/598: mkdir d2/db/d6b/dc8 0 2023-12-16T07:40:23.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/487: creat d4/d7/d11/d1d/d69/f9d x:0 0 0 2023-12-16T07:40:23.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/599: creat d2/db/dd/de/d1e/d37/d4e/fc9 x:0 0 0 2023-12-16T07:40:23.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/601: dwrite d5/fb [0,4194304] 0 2023-12-16T07:40:23.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/635: dwrite d20/d45/d77/fce [0,4194304] 0 2023-12-16T07:40:23.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/678: unlink d0/l73 0 2023-12-16T07:40:23.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/488: creat d4/d7/d11/d1d/d5b/f9e x:0 0 0 2023-12-16T07:40:23.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/489: stat d4/d3e/f4e 0 2023-12-16T07:40:23.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/600: mknod d2/db/dd/de/d1e/d37/da4/cca 0 2023-12-16T07:40:23.023 INFO:tasks.workunit.client.0.smithi049.stdout:4/601: read d2/ff [1850739,29391] 0 2023-12-16T07:40:23.023 INFO:tasks.workunit.client.0.smithi049.stdout:5/602: mknod d5/de/d54/d57/cd0 0 2023-12-16T07:40:23.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/490: read d4/d7/d11/d26/f53 [340876,100611] 0 2023-12-16T07:40:23.025 INFO:tasks.workunit.client.0.smithi049.stdout:1/636: mknod d20/d41/d52/d86/db1/cd8 0 2023-12-16T07:40:23.025 INFO:tasks.workunit.client.0.smithi049.stdout:1/637: truncate d20/d40/d6f/fb4 998668 0 2023-12-16T07:40:23.026 INFO:tasks.workunit.client.0.smithi049.stdout:8/679: dread - d0/d6a/fa4 zero size 2023-12-16T07:40:23.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/603: mkdir d5/de/d54/d78/d9b/dd1 0 2023-12-16T07:40:23.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/638: mkdir d20/d41/d52/d86/dd9 0 2023-12-16T07:40:23.032 INFO:tasks.workunit.client.0.smithi049.stdout:8/680: symlink d0/d1f/d4e/dbb/ld5 0 2023-12-16T07:40:23.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/604: mknod d5/de/d54/d57/d3c/d82/cd2 0 2023-12-16T07:40:23.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/605: fdatasync d5/de/d54/f42 0 2023-12-16T07:40:23.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/606: link d5/d1e/d21/ca8 d5/de/d54/d85/cd3 0 2023-12-16T07:40:23.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/607: mknod d5/d1e/d21/d4e/cd4 0 2023-12-16T07:40:23.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/608: creat d5/d1e/d21/d58/d65/dae/fd5 x:0 0 0 2023-12-16T07:40:23.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/639: write d20/f8e [2917076,52121] 0 2023-12-16T07:40:23.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/609: creat d5/de/d54/d67/da0/fd6 x:0 0 0 2023-12-16T07:40:23.042 INFO:tasks.workunit.client.0.smithi049.stdout:1/640: rename d20/c26 to d20/d45/cda 0 2023-12-16T07:40:23.043 INFO:tasks.workunit.client.0.smithi049.stdout:2/575: sync 2023-12-16T07:40:23.043 INFO:tasks.workunit.client.0.smithi049.stdout:6/686: dwrite d0/d2/fc9 [0,4194304] 0 2023-12-16T07:40:23.044 INFO:tasks.workunit.client.0.smithi049.stdout:5/610: getdents d5/d1e/d21/d5a 0 2023-12-16T07:40:23.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/641: rename d20/l3a to d20/d41/d4f/d55/d7f/d84/ldb 0 2023-12-16T07:40:23.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/642: write d20/d45/d77/f9e [547724,129985] 0 2023-12-16T07:40:23.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/643: stat d20/d41/d4f/d55 0 2023-12-16T07:40:23.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/644: dread - d20/d40/f81 zero size 2023-12-16T07:40:23.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/645: chown d20/d43/f9a 17726 1 2023-12-16T07:40:23.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/576: mkdir d2/d1d/dc2 0 2023-12-16T07:40:23.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/577: chown d2/d1d/d28/d56/d66/f88 6746436 1 2023-12-16T07:40:23.046 INFO:tasks.workunit.client.0.smithi049.stdout:5/611: symlink d5/de/d1c/d62/ld7 0 2023-12-16T07:40:23.046 INFO:tasks.workunit.client.0.smithi049.stdout:5/612: truncate d5/d1e/d20/f36 1665699 0 2023-12-16T07:40:23.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/646: rename d20/d41/d4f/d55/d82/cc8 to d20/d41/d4f/d55/d82/dd2/cdc 0 2023-12-16T07:40:23.048 INFO:tasks.workunit.client.0.smithi049.stdout:2/578: creat d2/d1d/fc3 x:0 0 0 2023-12-16T07:40:23.048 INFO:tasks.workunit.client.0.smithi049.stdout:2/579: dread - d2/d1d/d24/d55/d7c/d98/da1/fa7 zero size 2023-12-16T07:40:23.048 INFO:tasks.workunit.client.0.smithi049.stdout:5/613: creat d5/de/d54/d78/fd8 x:0 0 0 2023-12-16T07:40:23.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/580: symlink d2/d1d/d28/d56/d66/d6b/lc4 0 2023-12-16T07:40:23.050 INFO:tasks.workunit.client.0.smithi049.stdout:5/614: mknod d5/d1e/d21/d58/d65/cd9 0 2023-12-16T07:40:23.050 INFO:tasks.workunit.client.0.smithi049.stdout:5/615: write d5/de/d54/d57/f33 [4932490,116464] 0 2023-12-16T07:40:23.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/581: creat d2/d1d/d28/d56/d11/da8/fc5 x:0 0 0 2023-12-16T07:40:23.051 INFO:tasks.workunit.client.0.smithi049.stdout:5/616: write d5/d1e/f51 [319076,63922] 0 2023-12-16T07:40:23.052 INFO:tasks.workunit.client.0.smithi049.stdout:9/491: dwrite d4/f1f [0,4194304] 0 2023-12-16T07:40:23.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/582: creat d2/d1d/dc2/fc6 x:0 0 0 2023-12-16T07:40:23.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/583: dread - d2/d1d/f68 zero size 2023-12-16T07:40:23.054 INFO:tasks.workunit.client.0.smithi049.stdout:4/602: dwrite d2/db/dd/de/d1e/d21/f39 [0,4194304] 0 2023-12-16T07:40:23.054 INFO:tasks.workunit.client.0.smithi049.stdout:4/603: read - d2/db/dd/db7/fc1 zero size 2023-12-16T07:40:23.054 INFO:tasks.workunit.client.0.smithi049.stdout:4/604: dread - d2/db/dd/de/fb6 zero size 2023-12-16T07:40:23.054 INFO:tasks.workunit.client.0.smithi049.stdout:4/605: write d2/db/d6b/faf [523133,44980] 0 2023-12-16T07:40:23.055 INFO:tasks.workunit.client.0.smithi049.stdout:5/617: creat d5/d1e/d21/d4e/fda x:0 0 0 2023-12-16T07:40:23.055 INFO:tasks.workunit.client.0.smithi049.stdout:5/618: fdatasync d5/de/f76 0 2023-12-16T07:40:23.057 INFO:tasks.workunit.client.0.smithi049.stdout:9/492: symlink d4/d7/d11/d56/d7f/l9f 0 2023-12-16T07:40:23.057 INFO:tasks.workunit.client.0.smithi049.stdout:9/493: write d4/d7/d11/d1d/f5c [2262868,46389] 0 2023-12-16T07:40:23.058 INFO:tasks.workunit.client.0.smithi049.stdout:9/494: write d4/d7/d11/d26/f74 [345829,59662] 0 2023-12-16T07:40:23.058 INFO:tasks.workunit.client.0.smithi049.stdout:9/495: chown d4/d7/d11/d1d/d5b/c7e 244252 1 2023-12-16T07:40:23.058 INFO:tasks.workunit.client.0.smithi049.stdout:9/496: write d4/db/f22 [7640691,10618] 0 2023-12-16T07:40:23.058 INFO:tasks.workunit.client.0.smithi049.stdout:6/687: dread d0/d39/d5b/d65/f26 [0,4194304] 0 2023-12-16T07:40:23.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/647: dread f14 [0,4194304] 0 2023-12-16T07:40:23.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/648: write d20/d41/d4f/d55/d7f/d8a/fa1 [818877,93405] 0 2023-12-16T07:40:23.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/649: fdatasync d20/d41/d52/d86/fa8 0 2023-12-16T07:40:23.066 INFO:tasks.workunit.client.0.smithi049.stdout:5/619: mknod d5/d1e/d20/d95/cdb 0 2023-12-16T07:40:23.068 INFO:tasks.workunit.client.0.smithi049.stdout:9/497: mknod d4/d7/d11/d56/d7f/ca0 0 2023-12-16T07:40:23.068 INFO:tasks.workunit.client.0.smithi049.stdout:9/498: readlink d4/l8e 0 2023-12-16T07:40:23.069 INFO:tasks.workunit.client.0.smithi049.stdout:6/688: mkdir d0/d2/dd7 0 2023-12-16T07:40:23.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/584: dwrite d2/de/f86 [0,4194304] 0 2023-12-16T07:40:23.071 INFO:tasks.workunit.client.0.smithi049.stdout:1/650: symlink d20/d41/d4f/d7c/ldd 0 2023-12-16T07:40:23.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/620: link d5/de/d54/d85/cd3 d5/de/d54/d57/cdc 0 2023-12-16T07:40:23.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/621: chown d5/de/d1c/f55 27437442 1 2023-12-16T07:40:23.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/622: truncate d5/d1e/d21/d58/d65/fa6 30298 0 2023-12-16T07:40:23.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/623: write d5/de/d54/d57/f50 [342592,100076] 0 2023-12-16T07:40:23.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/624: fsync d5/d1e/d20/f6d 0 2023-12-16T07:40:23.073 INFO:tasks.workunit.client.0.smithi049.stdout:9/499: mknod d4/d7/d11/d26/d47/d8a/ca1 0 2023-12-16T07:40:23.073 INFO:tasks.workunit.client.0.smithi049.stdout:9/500: readlink d4/d7/d11/d1d/l92 0 2023-12-16T07:40:23.074 INFO:tasks.workunit.client.0.smithi049.stdout:6/689: getdents d0/d2/df/d4e/d5d/d6f/d4a 0 2023-12-16T07:40:23.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/585: mknod d2/de/d93/cc7 0 2023-12-16T07:40:23.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/586: write d2/d1d/d28/d56/fae [209096,26815] 0 2023-12-16T07:40:23.078 INFO:tasks.workunit.client.0.smithi049.stdout:1/651: getdents d20/d7b/d71 0 2023-12-16T07:40:23.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/625: link d5/de/d1c/d62/l99 d5/de/d54/d57/ldd 0 2023-12-16T07:40:23.083 INFO:tasks.workunit.client.0.smithi049.stdout:9/501: creat d4/d7/d11/d1d/d9b/fa2 x:0 0 0 2023-12-16T07:40:23.083 INFO:tasks.workunit.client.0.smithi049.stdout:9/502: fsync d4/d7/d11/d26/d47/d8a/f89 0 2023-12-16T07:40:23.085 INFO:tasks.workunit.client.0.smithi049.stdout:2/587: rename d2/f22 to d2/d1d/d28/d56/d66/fc8 0 2023-12-16T07:40:23.087 INFO:tasks.workunit.client.0.smithi049.stdout:1/652: mknod d20/d41/d4f/cde 0 2023-12-16T07:40:23.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/626: mknod d5/de/d54/d78/d9b/cde 0 2023-12-16T07:40:23.090 INFO:tasks.workunit.client.0.smithi049.stdout:2/588: symlink d2/d1d/d28/d56/d71/lc9 0 2023-12-16T07:40:23.090 INFO:tasks.workunit.client.0.smithi049.stdout:2/589: write d2/d1d/d28/d56/d11/f51 [53643,28234] 0 2023-12-16T07:40:23.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/690: dwrite d0/d39/d5b/d65/f1d [0,4194304] 0 2023-12-16T07:40:23.093 INFO:tasks.workunit.client.0.smithi049.stdout:1/653: unlink d20/f97 0 2023-12-16T07:40:23.093 INFO:tasks.workunit.client.0.smithi049.stdout:1/654: stat d20/d45/d47/l4d 0 2023-12-16T07:40:23.093 INFO:tasks.workunit.client.0.smithi049.stdout:2/590: getdents d2/d1d/d38 0 2023-12-16T07:40:23.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/691: rename d0/d39/d5b/d65/d4c/d4d/d6a/c87 to d0/d39/d5b/d65/d4c/cd8 0 2023-12-16T07:40:23.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/591: mkdir d2/d26/d6e/dca 0 2023-12-16T07:40:23.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/592: readlink d2/d1d/d28/d56/l54 0 2023-12-16T07:40:23.099 INFO:tasks.workunit.client.0.smithi049.stdout:1/655: rename d20/d41/f4b to d20/d7b/d88/fdf 0 2023-12-16T07:40:23.099 INFO:tasks.workunit.client.0.smithi049.stdout:1/656: fdatasync d20/d40/d6f/faa 0 2023-12-16T07:40:23.099 INFO:tasks.workunit.client.0.smithi049.stdout:1/657: rename d20/d40/d6f to d20/d40/d6f/de0 22 2023-12-16T07:40:23.100 INFO:tasks.workunit.client.0.smithi049.stdout:9/503: dwrite d4/d7/d11/d1d/f79 [0,4194304] 0 2023-12-16T07:40:23.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/692: mknod d0/d2/df/d4e/d5d/d6f/d4a/da4/cd9 0 2023-12-16T07:40:23.101 INFO:tasks.workunit.client.0.smithi049.stdout:2/593: symlink d2/d26/d43/lcb 0 2023-12-16T07:40:23.102 INFO:tasks.workunit.client.0.smithi049.stdout:5/627: dwrite d5/de/d54/d67/f7e [4194304,4194304] 0 2023-12-16T07:40:23.103 INFO:tasks.workunit.client.0.smithi049.stdout:1/658: mknod d20/d45/d77/ce1 0 2023-12-16T07:40:23.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/693: mknod d0/d39/d5b/d65/d27/d91/d94/da7/cda 0 2023-12-16T07:40:23.108 INFO:tasks.workunit.client.0.smithi049.stdout:2/594: creat d2/d1d/d28/d8b/fcc x:0 0 0 2023-12-16T07:40:23.109 INFO:tasks.workunit.client.0.smithi049.stdout:5/628: creat d5/de/d54/d78/d9b/fdf x:0 0 0 2023-12-16T07:40:23.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/473: sync 2023-12-16T07:40:23.110 INFO:tasks.workunit.client.0.smithi049.stdout:0/820: sync 2023-12-16T07:40:23.110 INFO:tasks.workunit.client.0.smithi049.stdout:7/610: sync 2023-12-16T07:40:23.112 INFO:tasks.workunit.client.0.smithi049.stdout:1/659: link d20/d45/d47/f65 d20/d7b/fe2 0 2023-12-16T07:40:23.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/694: creat d0/d39/d5b/d65/d27/fdb x:0 0 0 2023-12-16T07:40:23.121 INFO:tasks.workunit.client.0.smithi049.stdout:2/595: rmdir d2/d1d/d28/d56/d11 39 2023-12-16T07:40:23.121 INFO:tasks.workunit.client.0.smithi049.stdout:2/596: chown d2/f17 1306873 1 2023-12-16T07:40:23.122 INFO:tasks.workunit.client.0.smithi049.stdout:5/629: link d5/de/f1d d5/d1e/d21/d4e/dba/fe0 0 2023-12-16T07:40:23.123 INFO:tasks.workunit.client.0.smithi049.stdout:3/474: mknod d1/d2a/d37/d3f/d5a/d6d/c9f 0 2023-12-16T07:40:23.123 INFO:tasks.workunit.client.0.smithi049.stdout:3/475: chown d1/d2a/d37/d3f/c43 2497911 1 2023-12-16T07:40:23.124 INFO:tasks.workunit.client.0.smithi049.stdout:0/821: mkdir d13/d21/d99/d101/d125 0 2023-12-16T07:40:23.125 INFO:tasks.workunit.client.0.smithi049.stdout:5/630: dread d5/d1e/d20/f36 [0,4194304] 0 2023-12-16T07:40:23.125 INFO:tasks.workunit.client.0.smithi049.stdout:7/611: mkdir d7/dc/d2f/d38/dd0 0 2023-12-16T07:40:23.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/660: getdents d20/d41/d4f/d55/d7f/d8a 0 2023-12-16T07:40:23.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/661: write d20/d41/f5a [1188278,1562] 0 2023-12-16T07:40:23.127 INFO:tasks.workunit.client.0.smithi049.stdout:6/695: creat d0/d39/d5b/fdc x:0 0 0 2023-12-16T07:40:23.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/597: rmdir d2/d1d/d38 39 2023-12-16T07:40:23.129 INFO:tasks.workunit.client.0.smithi049.stdout:3/476: symlink d1/d2a/d37/d63/d88/d8e/la0 0 2023-12-16T07:40:23.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/822: mkdir d13/d21/d27/d2c/d126 0 2023-12-16T07:40:23.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/612: unlink d7/d2b/d59/f7e 0 2023-12-16T07:40:23.134 INFO:tasks.workunit.client.0.smithi049.stdout:1/662: link d20/l30 d20/d41/d4f/d55/d7f/d8a/le3 0 2023-12-16T07:40:23.135 INFO:tasks.workunit.client.0.smithi049.stdout:1/663: write d20/f8e [3228599,119849] 0 2023-12-16T07:40:23.136 INFO:tasks.workunit.client.0.smithi049.stdout:2/598: symlink d2/d1d/d24/d55/lcd 0 2023-12-16T07:40:23.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/696: rmdir d0/d39/d5b/d65/d27/d91/d94 39 2023-12-16T07:40:23.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/504: truncate d4/ff 11566097 0 2023-12-16T07:40:23.142 INFO:tasks.workunit.client.0.smithi049.stdout:5/631: dwrite d5/de/d54/d57/d3c/fb9 [0,4194304] 0 2023-12-16T07:40:23.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/599: mknod d2/de/d93/cce 0 2023-12-16T07:40:23.144 INFO:tasks.workunit.client.0.smithi049.stdout:6/697: symlink d0/d2/df/d81/ldd 0 2023-12-16T07:40:23.144 INFO:tasks.workunit.client.0.smithi049.stdout:6/698: chown d0/d39/d5b/d65/d58/l9a 58 1 2023-12-16T07:40:23.146 INFO:tasks.workunit.client.0.smithi049.stdout:2/600: mkdir d2/de/d93/dcf 0 2023-12-16T07:40:23.147 INFO:tasks.workunit.client.0.smithi049.stdout:6/699: getdents d0/d39/d5b/d65/d58/d33/dc5 0 2023-12-16T07:40:23.148 INFO:tasks.workunit.client.0.smithi049.stdout:6/700: write d0/d39/d5b/d65/d58/d2c/f36 [2845662,33114] 0 2023-12-16T07:40:23.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/701: unlink d0/d2/df/d4e/d5d/dc3/cd4 0 2023-12-16T07:40:23.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/702: write d0/d39/d5b/d65/d58/d2c/f36 [5328423,78857] 0 2023-12-16T07:40:23.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/703: chown d0/d39/d5b/d65/l41 908534 1 2023-12-16T07:40:23.153 INFO:tasks.workunit.client.0.smithi049.stdout:5/632: dread d5/f7c [0,4194304] 0 2023-12-16T07:40:23.153 INFO:tasks.workunit.client.0.smithi049.stdout:5/633: truncate d5/f8f 1232571 0 2023-12-16T07:40:23.153 INFO:tasks.workunit.client.0.smithi049.stdout:5/634: dread - d5/de/d54/d78/d9b/fdf zero size 2023-12-16T07:40:23.154 INFO:tasks.workunit.client.0.smithi049.stdout:6/704: link d0/d2/df/l19 d0/d39/d5b/d65/d27/lde 0 2023-12-16T07:40:23.154 INFO:tasks.workunit.client.0.smithi049.stdout:5/635: write d5/de/d54/d67/f7b [2477403,114766] 0 2023-12-16T07:40:23.155 INFO:tasks.workunit.client.0.smithi049.stdout:5/636: mknod d5/de/d54/d57/d3c/d82/ce1 0 2023-12-16T07:40:23.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/705: truncate d0/f1b 978124 0 2023-12-16T07:40:23.156 INFO:tasks.workunit.client.0.smithi049.stdout:6/706: read d0/d39/d5b/d65/f26 [3819570,3880] 0 2023-12-16T07:40:23.156 INFO:tasks.workunit.client.0.smithi049.stdout:6/707: chown d0/d39/d5b/d65/d27/l68 245578 1 2023-12-16T07:40:23.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/477: rename d1/d2a/d37/d63 to d1/d2a/d37/d3f/d5a/d61/d6b/da1 0 2023-12-16T07:40:23.161 INFO:tasks.workunit.client.0.smithi049.stdout:7/613: rename d7/dc/d15/c9d to d7/dc/d2f/d40/cd1 0 2023-12-16T07:40:23.161 INFO:tasks.workunit.client.0.smithi049.stdout:7/614: stat d7/dc/dd/d35/f41 0 2023-12-16T07:40:23.161 INFO:tasks.workunit.client.0.smithi049.stdout:7/615: chown d7/d2b/c30 14 1 2023-12-16T07:40:23.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/478: creat d1/d2a/d37/d3f/d5a/d6d/d96/fa2 x:0 0 0 2023-12-16T07:40:23.162 INFO:tasks.workunit.client.0.smithi049.stdout:9/505: rename d4/d7/d11/d1d/d9b/fa2 to d4/d7/d11/d26/d80/fa3 0 2023-12-16T07:40:23.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/601: rmdir d2/d1d 39 2023-12-16T07:40:23.165 INFO:tasks.workunit.client.0.smithi049.stdout:7/616: mknod d7/dc/dd/d37/d5c/db2/cd2 0 2023-12-16T07:40:23.165 INFO:tasks.workunit.client.0.smithi049.stdout:2/602: stat d2/de/l87 0 2023-12-16T07:40:23.167 INFO:tasks.workunit.client.0.smithi049.stdout:7/617: rmdir d7 39 2023-12-16T07:40:23.170 INFO:tasks.workunit.client.0.smithi049.stdout:2/603: creat d2/db8/db9/fd0 x:0 0 0 2023-12-16T07:40:23.171 INFO:tasks.workunit.client.0.smithi049.stdout:5/637: dwrite d5/de/d54/d67/da0/fc0 [0,4194304] 0 2023-12-16T07:40:23.171 INFO:tasks.workunit.client.0.smithi049.stdout:5/638: dread - d5/d1e/d20/f98 zero size 2023-12-16T07:40:23.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/604: mkdir d2/d1d/d28/d56/d11/d1c/dd1 0 2023-12-16T07:40:23.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/605: fdatasync d2/fb2 0 2023-12-16T07:40:23.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/606: chown d2/d1d/d28/d56/d71/f80 1543 1 2023-12-16T07:40:23.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/607: write d2/d1d/d28/d56/d11/da8/fc5 [602188,35953] 0 2023-12-16T07:40:23.172 INFO:tasks.workunit.client.0.smithi049.stdout:6/708: dread d0/d39/d5b/d65/d27/f89 [0,4194304] 0 2023-12-16T07:40:23.173 INFO:tasks.workunit.client.0.smithi049.stdout:9/506: write d4/d7/f7a [1690675,114486] 0 2023-12-16T07:40:23.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/608: write d2/d1d/d24/f42 [1412868,17160] 0 2023-12-16T07:40:23.173 INFO:tasks.workunit.client.0.smithi049.stdout:6/709: write d0/d39/d5b/d65/f12 [2552951,11303] 0 2023-12-16T07:40:23.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/639: rmdir d5/de/d54/dbf 0 2023-12-16T07:40:23.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/609: write d2/f17 [1912110,88461] 0 2023-12-16T07:40:23.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/507: symlink d4/d7/d11/d1d/d5b/d8b/la4 0 2023-12-16T07:40:23.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/508: chown d4/d7/d11/l43 0 1 2023-12-16T07:40:23.177 INFO:tasks.workunit.client.0.smithi049.stdout:6/710: symlink d0/d39/d5b/d65/d58/d2c/ldf 0 2023-12-16T07:40:23.179 INFO:tasks.workunit.client.0.smithi049.stdout:5/640: symlink d5/de/d54/d57/d3c/d82/le2 0 2023-12-16T07:40:23.180 INFO:tasks.workunit.client.0.smithi049.stdout:2/610: rename d2/d26/d6e/c82 to d2/d1d/d24/d55/d7c/d98/da1/cd2 0 2023-12-16T07:40:23.181 INFO:tasks.workunit.client.0.smithi049.stdout:9/509: creat d4/d7/d11/d26/d47/d8a/fa5 x:0 0 0 2023-12-16T07:40:23.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/711: unlink d0/d2/df/d81/la6 0 2023-12-16T07:40:23.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/510: write f0 [7271380,129066] 0 2023-12-16T07:40:23.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/511: write d4/db/f41 [5101789,21733] 0 2023-12-16T07:40:23.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/512: dread - d4/d7/d11/d26/d47/d8a/fa5 zero size 2023-12-16T07:40:23.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/611: link d2/d26/d6e/c5f d2/d26/d43/cd3 0 2023-12-16T07:40:23.191 INFO:tasks.workunit.client.0.smithi049.stdout:6/712: getdents d0/d39/d5b/d65/d32 0 2023-12-16T07:40:23.192 INFO:tasks.workunit.client.0.smithi049.stdout:9/513: link d4/d7/d11/d26/c5e d4/d3e/ca6 0 2023-12-16T07:40:23.193 INFO:tasks.workunit.client.0.smithi049.stdout:9/514: fsync d4/d7/d11/d26/f74 0 2023-12-16T07:40:23.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/479: dwrite d1/ff [0,4194304] 0 2023-12-16T07:40:23.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/480: read - d1/d2a/d37/d3f/d4c/f90 zero size 2023-12-16T07:40:23.194 INFO:tasks.workunit.client.0.smithi049.stdout:3/481: dread - d1/d2a/f48 zero size 2023-12-16T07:40:23.194 INFO:tasks.workunit.client.0.smithi049.stdout:2/612: rename d2/d1d/d28/d56/d66/da9 to d2/d1d/d24/dd4 0 2023-12-16T07:40:23.195 INFO:tasks.workunit.client.0.smithi049.stdout:6/713: creat d0/d2/df/d4e/fe0 x:0 0 0 2023-12-16T07:40:23.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/618: dwrite d7/dc/f61 [0,4194304] 0 2023-12-16T07:40:23.196 INFO:tasks.workunit.client.0.smithi049.stdout:5/641: dwrite d5/d1e/d21/d4e/f9d [0,4194304] 0 2023-12-16T07:40:23.197 INFO:tasks.workunit.client.0.smithi049.stdout:3/482: truncate d1/f2c 1679251 0 2023-12-16T07:40:23.197 INFO:tasks.workunit.client.0.smithi049.stdout:3/483: stat d1/d2a/d37/d3f/d5a/d61/d6b/da1/c6e 0 2023-12-16T07:40:23.198 INFO:tasks.workunit.client.0.smithi049.stdout:3/484: chown d1/l11 62 1 2023-12-16T07:40:23.200 INFO:tasks.workunit.client.0.smithi049.stdout:2/613: symlink d2/de/d77/ld5 0 2023-12-16T07:40:23.202 INFO:tasks.workunit.client.0.smithi049.stdout:6/714: symlink d0/d2/df/le1 0 2023-12-16T07:40:23.213 INFO:tasks.workunit.client.0.smithi049.stdout:7/619: mkdir d7/dc/d6b/dbf/dd3 0 2023-12-16T07:40:23.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/642: creat d5/de/d54/d78/fe3 x:0 0 0 2023-12-16T07:40:23.216 INFO:tasks.workunit.client.0.smithi049.stdout:3/485: getdents d1/d2a/d37/d3f/d5a/d61/d6b/da1 0 2023-12-16T07:40:23.217 INFO:tasks.workunit.client.0.smithi049.stdout:3/486: fsync d1/f44 0 2023-12-16T07:40:23.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/715: dwrite d0/d39/f8a [0,4194304] 0 2023-12-16T07:40:23.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/716: write d0/d2/f86 [4528835,12813] 0 2023-12-16T07:40:23.218 INFO:tasks.workunit.client.0.smithi049.stdout:7/620: getdents d7/dc/d6b 0 2023-12-16T07:40:23.220 INFO:tasks.workunit.client.0.smithi049.stdout:5/643: mknod d5/de/d54/d67/da0/ce4 0 2023-12-16T07:40:23.224 INFO:tasks.workunit.client.0.smithi049.stdout:6/717: mknod d0/d2/df/d81/ce2 0 2023-12-16T07:40:23.224 INFO:tasks.workunit.client.0.smithi049.stdout:7/621: symlink d7/dc/d2f/d40/d5d/ld4 0 2023-12-16T07:40:23.225 INFO:tasks.workunit.client.0.smithi049.stdout:7/622: dread - d7/dc/dd/d14/fb7 zero size 2023-12-16T07:40:23.225 INFO:tasks.workunit.client.0.smithi049.stdout:5/644: rmdir d5/de/d54 39 2023-12-16T07:40:23.225 INFO:tasks.workunit.client.0.smithi049.stdout:5/645: readlink d5/l75 0 2023-12-16T07:40:23.226 INFO:tasks.workunit.client.0.smithi049.stdout:6/718: mknod d0/d39/d5b/d65/dc1/ce3 0 2023-12-16T07:40:23.226 INFO:tasks.workunit.client.0.smithi049.stdout:6/719: fsync d0/d39/d5b/d65/d4c/fb7 0 2023-12-16T07:40:23.227 INFO:tasks.workunit.client.0.smithi049.stdout:7/623: creat d7/dc/dd/d27/fd5 x:0 0 0 2023-12-16T07:40:23.229 INFO:tasks.workunit.client.0.smithi049.stdout:9/515: truncate d4/ff 10343337 0 2023-12-16T07:40:23.229 INFO:tasks.workunit.client.0.smithi049.stdout:9/516: readlink d4/d7/d11/d26/l27 0 2023-12-16T07:40:23.230 INFO:tasks.workunit.client.0.smithi049.stdout:6/720: symlink d0/d39/d5b/d65/d32/le4 0 2023-12-16T07:40:23.231 INFO:tasks.workunit.client.0.smithi049.stdout:7/624: unlink d7/d2b/c2d 0 2023-12-16T07:40:23.232 INFO:tasks.workunit.client.0.smithi049.stdout:9/517: symlink d4/d7/d11/d1d/d9b/la7 0 2023-12-16T07:40:23.233 INFO:tasks.workunit.client.0.smithi049.stdout:9/518: stat d4/d7/d11/f67 0 2023-12-16T07:40:23.234 INFO:tasks.workunit.client.0.smithi049.stdout:3/487: dwrite d1/f26 [0,4194304] 0 2023-12-16T07:40:23.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/646: dread d5/f13 [0,4194304] 0 2023-12-16T07:40:23.234 INFO:tasks.workunit.client.0.smithi049.stdout:6/721: mknod d0/d2/df/d4e/ce5 0 2023-12-16T07:40:23.234 INFO:tasks.workunit.client.0.smithi049.stdout:6/722: truncate d0/d39/d5b/d65/d58/fb0 708790 0 2023-12-16T07:40:23.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/625: mknod d7/dc/dd/d35/d36/cd6 0 2023-12-16T07:40:23.238 INFO:tasks.workunit.client.0.smithi049.stdout:9/519: write d4/db/f72 [726702,44880] 0 2023-12-16T07:40:23.238 INFO:tasks.workunit.client.0.smithi049.stdout:9/520: write d4/d7/d11/d26/d47/d8a/f61 [425345,33556] 0 2023-12-16T07:40:23.238 INFO:tasks.workunit.client.0.smithi049.stdout:3/488: symlink d1/d2a/d37/d3f/d5a/d61/d75/la3 0 2023-12-16T07:40:23.238 INFO:tasks.workunit.client.0.smithi049.stdout:3/489: truncate d1/d2a/d37/d3f/d5a/d61/f9e 213421 0 2023-12-16T07:40:23.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/647: mknod d5/de/d54/d57/d3c/ce5 0 2023-12-16T07:40:23.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/723: link d0/d2/df/d4e/d5d/d6f/d4a/fa3 d0/d39/dd0/fe6 0 2023-12-16T07:40:23.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/724: write d0/d39/d5b/d65/d4c/d4d/d6a/fd2 [917288,24058] 0 2023-12-16T07:40:23.245 INFO:tasks.workunit.client.0.smithi049.stdout:3/490: truncate d1/f16 702532 0 2023-12-16T07:40:23.245 INFO:tasks.workunit.client.0.smithi049.stdout:5/648: link d5/f2a d5/de/d54/da9/fe6 0 2023-12-16T07:40:23.246 INFO:tasks.workunit.client.0.smithi049.stdout:6/725: symlink d0/le7 0 2023-12-16T07:40:23.246 INFO:tasks.workunit.client.0.smithi049.stdout:6/726: fdatasync d0/d39/d5b/d65/d27/d91/fb9 0 2023-12-16T07:40:23.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/491: creat d1/d2a/d37/d3f/d4c/fa4 x:0 0 0 2023-12-16T07:40:23.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/492: chown d1/d2a/f48 903477 1 2023-12-16T07:40:23.248 INFO:tasks.workunit.client.0.smithi049.stdout:3/493: write d1/d2a/d37/d3f/d5a/d61/f66 [504852,121528] 0 2023-12-16T07:40:23.248 INFO:tasks.workunit.client.0.smithi049.stdout:3/494: write d1/d2b/f53 [2186627,57137] 0 2023-12-16T07:40:23.248 INFO:tasks.workunit.client.0.smithi049.stdout:5/649: rmdir d5/de/d54/d67/dc2 39 2023-12-16T07:40:23.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/727: link d0/d2/df/le1 d0/d39/d5b/d65/d4c/le8 0 2023-12-16T07:40:23.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/728: chown d0/d2/df/d4e/fe0 890099687 1 2023-12-16T07:40:23.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/495: creat d1/fa5 x:0 0 0 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/729: mkdir d0/d39/d5b/d65/d4c/d4d/d6a/de9 0 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/730: chown d0/f64 32788 1 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/731: truncate d0/d2/df/d4e/d5d/d6f/d4a/fd3 1036815 0 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:5/650: write d5/de/d54/da9/fe6 [1269332,53561] 0 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/626: dwrite d7/d2b/d59/f5e [0,4194304] 0 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:8/681: sync 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:4/606: sync 2023-12-16T07:40:23.254 INFO:tasks.workunit.client.0.smithi049.stdout:9/521: write f0 [10719118,104596] 0 2023-12-16T07:40:23.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/682: write d0/d13/d42/d5b/f61 [1107167,84393] 0 2023-12-16T07:40:23.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/683: dread - d0/d13/d42/d5b/f8a zero size 2023-12-16T07:40:23.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/684: fsync d0/d1f/d36/f3c 0 2023-12-16T07:40:23.255 INFO:tasks.workunit.client.0.smithi049.stdout:7/627: write f5 [1231994,118814] 0 2023-12-16T07:40:23.256 INFO:tasks.workunit.client.0.smithi049.stdout:5/651: rename d5/d1e/d21/ca8 to d5/d1e/ce7 0 2023-12-16T07:40:23.256 INFO:tasks.workunit.client.0.smithi049.stdout:5/652: chown d5/de/f40 45073287 1 2023-12-16T07:40:23.257 INFO:tasks.workunit.client.0.smithi049.stdout:7/628: write d7/dc/dd/d27/f8c [1718836,26620] 0 2023-12-16T07:40:23.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/496: dread d1/f26 [0,4194304] 0 2023-12-16T07:40:23.259 INFO:tasks.workunit.client.0.smithi049.stdout:4/607: getdents d2/db/dd/db7 0 2023-12-16T07:40:23.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/522: dread d4/f85 [0,4194304] 0 2023-12-16T07:40:23.260 INFO:tasks.workunit.client.0.smithi049.stdout:0/823: sync 2023-12-16T07:40:23.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/523: read - d4/d7/d11/d26/d47/d8a/f5a zero size 2023-12-16T07:40:23.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/524: fsync d4/d7/d11/d26/d80/f91 0 2023-12-16T07:40:23.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/629: link f2 d7/db4/fd7 0 2023-12-16T07:40:23.264 INFO:tasks.workunit.client.0.smithi049.stdout:7/630: write d7/dc/d6b/dbf/fcc [764959,96338] 0 2023-12-16T07:40:23.267 INFO:tasks.workunit.client.0.smithi049.stdout:5/653: dread d5/d1e/d20/f6d [0,4194304] 0 2023-12-16T07:40:23.270 INFO:tasks.workunit.client.0.smithi049.stdout:3/497: rename d1/fc to d1/d2a/d37/d3f/d5a/d61/d6b/fa6 0 2023-12-16T07:40:23.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/498: read d1/d2a/d37/d3f/d5a/f6f [2315498,81593] 0 2023-12-16T07:40:23.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/499: chown d1/d2a/f3b 3 1 2023-12-16T07:40:23.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/500: stat d1/d2a/d37/d3f/d5a/d61/f9e 0 2023-12-16T07:40:23.273 INFO:tasks.workunit.client.0.smithi049.stdout:3/501: write d1/d2a/d37/d3f/d4c/f79 [202188,71092] 0 2023-12-16T07:40:23.273 INFO:tasks.workunit.client.0.smithi049.stdout:0/824: creat d13/d39/d78/d83/f127 x:0 0 0 2023-12-16T07:40:23.275 INFO:tasks.workunit.client.0.smithi049.stdout:0/825: write fa [1946503,8769] 0 2023-12-16T07:40:23.275 INFO:tasks.workunit.client.0.smithi049.stdout:0/826: write d13/d21/d99/d46/d65/f73 [3560861,99039] 0 2023-12-16T07:40:23.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/827: readlink d13/d21/d27/d2c/l31 0 2023-12-16T07:40:23.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/525: link d4/d7/d11/d1d/d48/l78 d4/d7/d11/d56/d7f/la8 0 2023-12-16T07:40:23.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/526: dread - d4/d7/d11/d3f/f54 zero size 2023-12-16T07:40:23.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/527: chown d4/d7/d11/d26/f52 4876656 1 2023-12-16T07:40:23.279 INFO:tasks.workunit.client.0.smithi049.stdout:5/654: mknod d5/d1e/ce8 0 2023-12-16T07:40:23.280 INFO:tasks.workunit.client.0.smithi049.stdout:3/502: write d1/d2a/f30 [1399759,85202] 0 2023-12-16T07:40:23.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/528: write d4/d7/f7a [1139573,65324] 0 2023-12-16T07:40:23.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/529: fdatasync d4/db/f39 0 2023-12-16T07:40:23.280 INFO:tasks.workunit.client.0.smithi049.stdout:4/608: dwrite d2/f9 [0,4194304] 0 2023-12-16T07:40:23.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/530: chown d4/d3e/l42 800596 1 2023-12-16T07:40:23.280 INFO:tasks.workunit.client.0.smithi049.stdout:5/655: rename d5/d1e/d21/d58/l7f to d5/de/d54/d5c/le9 0 2023-12-16T07:40:23.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/503: rmdir d1/d2a/d37/d3f/d5a/d61/d6b/da1 39 2023-12-16T07:40:23.282 INFO:tasks.workunit.client.0.smithi049.stdout:9/531: creat d4/d7/d11/d1d/d5b/d8b/fa9 x:0 0 0 2023-12-16T07:40:23.283 INFO:tasks.workunit.client.0.smithi049.stdout:3/504: rmdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e 39 2023-12-16T07:40:23.283 INFO:tasks.workunit.client.0.smithi049.stdout:3/505: write d1/d2b/f65 [4570293,18169] 0 2023-12-16T07:40:23.284 INFO:tasks.workunit.client.0.smithi049.stdout:3/506: mknod d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/ca7 0 2023-12-16T07:40:23.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/631: getdents d7/db4 0 2023-12-16T07:40:23.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/632: mknod d7/dc/cd8 0 2023-12-16T07:40:23.289 INFO:tasks.workunit.client.0.smithi049.stdout:7/633: rmdir d7 39 2023-12-16T07:40:23.289 INFO:tasks.workunit.client.0.smithi049.stdout:7/634: readlink d7/dc/d2f/d38/l99 0 2023-12-16T07:40:23.289 INFO:tasks.workunit.client.0.smithi049.stdout:7/635: write d7/dc/d6b/f84 [670580,108477] 0 2023-12-16T07:40:23.289 INFO:tasks.workunit.client.0.smithi049.stdout:7/636: truncate d7/dc/fb3 185971 0 2023-12-16T07:40:23.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/656: dwrite d5/f9 [0,4194304] 0 2023-12-16T07:40:23.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/657: readlink d5/de/d54/d78/l8a 0 2023-12-16T07:40:23.290 INFO:tasks.workunit.client.0.smithi049.stdout:7/637: rename d7/dc/d2f/d38/lb1 to d7/dc/d2f/d38/ld9 0 2023-12-16T07:40:23.294 INFO:tasks.workunit.client.0.smithi049.stdout:5/658: creat d5/de/d54/d67/da0/fea x:0 0 0 2023-12-16T07:40:23.294 INFO:tasks.workunit.client.0.smithi049.stdout:5/659: stat d5/d1e/d21/d5a/c63 0 2023-12-16T07:40:23.316 INFO:tasks.workunit.client.0.smithi049.stdout:7/638: dwrite f5 [0,4194304] 0 2023-12-16T07:40:23.316 INFO:tasks.workunit.client.0.smithi049.stdout:5/660: dwrite d5/de/d54/d78/d9b/fdf [0,4194304] 0 2023-12-16T07:40:23.316 INFO:tasks.workunit.client.0.smithi049.stdout:5/661: write d5/d1e/d20/f98 [631816,65810] 0 2023-12-16T07:40:23.317 INFO:tasks.workunit.client.0.smithi049.stdout:5/662: creat d5/de/d54/d78/feb x:0 0 0 2023-12-16T07:40:23.331 INFO:tasks.workunit.client.0.smithi049.stdout:3/507: dread d1/ff [0,4194304] 0 2023-12-16T07:40:23.331 INFO:tasks.workunit.client.0.smithi049.stdout:5/663: dread d5/d1e/d20/f56 [0,4194304] 0 2023-12-16T07:40:23.333 INFO:tasks.workunit.client.0.smithi049.stdout:5/664: creat d5/de/d54/d78/d9b/dd1/fec x:0 0 0 2023-12-16T07:40:23.333 INFO:tasks.workunit.client.0.smithi049.stdout:5/665: fdatasync d5/f8 0 2023-12-16T07:40:23.333 INFO:tasks.workunit.client.0.smithi049.stdout:5/666: creat d5/d1e/d20/d95/fed x:0 0 0 2023-12-16T07:40:23.335 INFO:tasks.workunit.client.0.smithi049.stdout:6/732: dwrite d0/d2/df/d4e/d5d/d6f/fa0 [0,4194304] 0 2023-12-16T07:40:23.335 INFO:tasks.workunit.client.0.smithi049.stdout:3/508: write d1/d2a/d37/d3f/d4c/f4d [794117,116265] 0 2023-12-16T07:40:23.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/733: truncate d0/d39/d8b/fa5 754845 0 2023-12-16T07:40:23.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/734: dread - d0/d39/d5b/d65/d27/d91/d94/fcd zero size 2023-12-16T07:40:23.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/735: readlink d0/d39/d5b/d65/d4c/d4d/d6a/lb8 0 2023-12-16T07:40:23.338 INFO:tasks.workunit.client.0.smithi049.stdout:0/828: dwrite f4 [4194304,4194304] 0 2023-12-16T07:40:23.339 INFO:tasks.workunit.client.0.smithi049.stdout:0/829: write d13/d39/d38/ff5 [1655052,70307] 0 2023-12-16T07:40:23.339 INFO:tasks.workunit.client.0.smithi049.stdout:0/830: chown d13/d21/d99/d46/d65/d82/ddb/f119 9 1 2023-12-16T07:40:23.339 INFO:tasks.workunit.client.0.smithi049.stdout:3/509: creat d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fa8 x:0 0 0 2023-12-16T07:40:23.340 INFO:tasks.workunit.client.0.smithi049.stdout:0/831: mkdir d13/d39/d78/d83/dfc/d128 0 2023-12-16T07:40:23.340 INFO:tasks.workunit.client.0.smithi049.stdout:0/832: chown d13/d39/d38/d7e 7569227 1 2023-12-16T07:40:23.343 INFO:tasks.workunit.client.0.smithi049.stdout:7/639: dwrite d7/dc/fb3 [0,4194304] 0 2023-12-16T07:40:23.345 INFO:tasks.workunit.client.0.smithi049.stdout:0/833: dread d13/d21/d99/d46/fdf [0,4194304] 0 2023-12-16T07:40:23.347 INFO:tasks.workunit.client.0.smithi049.stdout:4/609: dwrite d2/ff [4194304,4194304] 0 2023-12-16T07:40:23.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/610: read d2/db/dd/de/d1e/d21/f4f [1165472,103052] 0 2023-12-16T07:40:23.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/611: fdatasync d2/db/dd/de/d1e/d44/fa6 0 2023-12-16T07:40:23.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/612: stat d2/db/dd/de/d1e/d44/l9a 0 2023-12-16T07:40:23.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/736: read d0/d2/df/d4e/d5d/d6f/f75 [460273,121918] 0 2023-12-16T07:40:23.350 INFO:tasks.workunit.client.0.smithi049.stdout:4/613: rename d2/ff to d2/db/dd/db7/fcb 0 2023-12-16T07:40:23.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/614: rename d2/db/dd/d52/f59 to d2/db/dd/de/d1e/d37/d82/fcc 0 2023-12-16T07:40:23.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/615: fsync d2/db/dd/de/d1e/d21/f4f 0 2023-12-16T07:40:23.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/616: stat d2/db/dd/de/d1e/d44/fc7 0 2023-12-16T07:40:23.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/617: mknod d2/db/dd/de/d1e/d37/ccd 0 2023-12-16T07:40:23.353 INFO:tasks.workunit.client.0.smithi049.stdout:7/640: dread d7/dc/d6b/d70/fad [0,4194304] 0 2023-12-16T07:40:23.353 INFO:tasks.workunit.client.0.smithi049.stdout:4/618: creat d2/db/dd/de/d1e/fce x:0 0 0 2023-12-16T07:40:23.353 INFO:tasks.workunit.client.0.smithi049.stdout:3/510: dwrite d1/d2a/d37/d3f/d4c/f90 [0,4194304] 0 2023-12-16T07:40:23.354 INFO:tasks.workunit.client.0.smithi049.stdout:7/641: mknod d7/dc/d7c/cda 0 2023-12-16T07:40:23.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/619: write d2/db/dd/de/d1e/d37/d4e/f5f [237098,113393] 0 2023-12-16T07:40:23.356 INFO:tasks.workunit.client.0.smithi049.stdout:5/667: dwrite d5/de/d1c/d62/d81/f97 [0,4194304] 0 2023-12-16T07:40:23.356 INFO:tasks.workunit.client.0.smithi049.stdout:3/511: creat d1/d2a/d37/d3f/d5a/d5b/d5e/fa9 x:0 0 0 2023-12-16T07:40:23.356 INFO:tasks.workunit.client.0.smithi049.stdout:4/620: rmdir d2/db/dd/db7 39 2023-12-16T07:40:23.360 INFO:tasks.workunit.client.0.smithi049.stdout:5/668: dread d5/f8f [0,4194304] 0 2023-12-16T07:40:23.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/512: creat d1/d2a/d37/d3f/faa x:0 0 0 2023-12-16T07:40:23.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/513: fsync d1/d2a/d37/d3f/d4c/f79 0 2023-12-16T07:40:23.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/514: write d1/d2a/d37/d3f/d4c/f9c [510442,35940] 0 2023-12-16T07:40:23.455 INFO:tasks.workunit.client.0.smithi049.stdout:5/669: symlink d5/de/d1c/d62/d81/lee 0 2023-12-16T07:40:23.456 INFO:tasks.workunit.client.0.smithi049.stdout:6/737: dwrite d0/f64 [4194304,4194304] 0 2023-12-16T07:40:23.456 INFO:tasks.workunit.client.0.smithi049.stdout:6/738: truncate d0/d39/d5b/d65/d58/f2b 4993174 0 2023-12-16T07:40:23.465 INFO:tasks.workunit.client.0.smithi049.stdout:3/515: link d1/d2a/l7d d1/d2a/d37/d3f/d5a/d6d/lab 0 2023-12-16T07:40:23.466 INFO:tasks.workunit.client.0.smithi049.stdout:3/516: stat d1/d2b/f62 0 2023-12-16T07:40:23.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/670: symlink d5/de/d54/d67/lef 0 2023-12-16T07:40:23.467 INFO:tasks.workunit.client.0.smithi049.stdout:3/517: rename d1/d2a/d37/d3f/d5a/d5b/d5e/fa9 to d1/d2a/d37/d3f/d5a/d61/d6b/fac 0 2023-12-16T07:40:23.468 INFO:tasks.workunit.client.0.smithi049.stdout:5/671: symlink d5/de/d54/d67/lf0 0 2023-12-16T07:40:23.468 INFO:tasks.workunit.client.0.smithi049.stdout:5/672: chown d5/l80 5076953 1 2023-12-16T07:40:23.469 INFO:tasks.workunit.client.0.smithi049.stdout:5/673: symlink d5/de/d54/d57/d3c/d82/lf1 0 2023-12-16T07:40:23.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/674: rename d5/d1e/d21/d58/d65/cd9 to d5/de/d54/d5c/cf2 0 2023-12-16T07:40:23.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/675: mkdir d5/de/d1c/d62/d81/df3 0 2023-12-16T07:40:23.475 INFO:tasks.workunit.client.0.smithi049.stdout:7/642: dwrite d7/dc/d6b/d70/fb8 [0,4194304] 0 2023-12-16T07:40:23.476 INFO:tasks.workunit.client.0.smithi049.stdout:6/739: dwrite d0/d2/f8 [4194304,4194304] 0 2023-12-16T07:40:23.479 INFO:tasks.workunit.client.0.smithi049.stdout:7/643: write d7/dc/d6b/d70/fb8 [3998486,108944] 0 2023-12-16T07:40:23.479 INFO:tasks.workunit.client.0.smithi049.stdout:7/644: chown d7 2 1 2023-12-16T07:40:23.481 INFO:tasks.workunit.client.0.smithi049.stdout:6/740: creat d0/d2/df/d4e/d5d/d6f/d4a/da4/fea x:0 0 0 2023-12-16T07:40:23.483 INFO:tasks.workunit.client.0.smithi049.stdout:7/645: dread d7/dc/dd/d27/f8c [4194304,4194304] 0 2023-12-16T07:40:23.485 INFO:tasks.workunit.client.0.smithi049.stdout:6/741: mkdir d0/d39/d8b/deb 0 2023-12-16T07:40:23.485 INFO:tasks.workunit.client.0.smithi049.stdout:6/742: readlink d0/d2/l11 0 2023-12-16T07:40:23.485 INFO:tasks.workunit.client.0.smithi049.stdout:6/743: chown d0/d2/f86 471 1 2023-12-16T07:40:23.485 INFO:tasks.workunit.client.0.smithi049.stdout:6/744: fdatasync d0/d2/df/d4e/faf 0 2023-12-16T07:40:23.485 INFO:tasks.workunit.client.0.smithi049.stdout:3/518: dwrite d1/d2b/f53 [0,4194304] 0 2023-12-16T07:40:23.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/676: dread d5/de/d54/d67/f7e [0,4194304] 0 2023-12-16T07:40:23.486 INFO:tasks.workunit.client.0.smithi049.stdout:7/646: mkdir d7/dc/d2f/d38/ddb 0 2023-12-16T07:40:23.486 INFO:tasks.workunit.client.0.smithi049.stdout:6/745: creat d0/d2/df/d4e/d5d/d6f/d4a/da4/fec x:0 0 0 2023-12-16T07:40:23.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/519: mkdir d1/d2a/d37/d3f/d5a/d5b/d5e/dad 0 2023-12-16T07:40:23.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/520: dread - d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fa8 zero size 2023-12-16T07:40:23.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/521: write d1/d2a/d37/d3f/d5a/d61/d6b/f72 [713053,71215] 0 2023-12-16T07:40:23.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/522: chown d1/d2a/l2e 0 1 2023-12-16T07:40:23.490 INFO:tasks.workunit.client.0.smithi049.stdout:3/523: write d1/d2a/d37/d3f/d5a/d61/d75/f83 [4998386,108834] 0 2023-12-16T07:40:23.490 INFO:tasks.workunit.client.0.smithi049.stdout:5/677: truncate d5/d1e/d21/fb6 2599127 0 2023-12-16T07:40:23.492 INFO:tasks.workunit.client.0.smithi049.stdout:7/647: creat d7/dc/d2f/d38/fdc x:0 0 0 2023-12-16T07:40:23.492 INFO:tasks.workunit.client.0.smithi049.stdout:3/524: symlink d1/d2a/d37/d3f/d5a/d5b/d5e/lae 0 2023-12-16T07:40:23.495 INFO:tasks.workunit.client.0.smithi049.stdout:5/678: rmdir d5/de/d1c/d62/d81/df3 0 2023-12-16T07:40:23.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/746: dread d0/d2/df/d4e/d5d/d6f/fa0 [0,4194304] 0 2023-12-16T07:40:23.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/525: mkdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/daf 0 2023-12-16T07:40:23.496 INFO:tasks.workunit.client.0.smithi049.stdout:5/679: stat d5/d1e/d21/d4e/l93 0 2023-12-16T07:40:23.496 INFO:tasks.workunit.client.0.smithi049.stdout:5/680: write d5/de/d54/d57/fa1 [3747255,97114] 0 2023-12-16T07:40:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/747: mknod d0/d39/d5b/d65/d53/ced 0 2023-12-16T07:40:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/748: stat d0/d2/df/d4e/d5d/d6f 0 2023-12-16T07:40:23.498 INFO:tasks.workunit.client.0.smithi049.stdout:3/526: creat d1/d2a/fb0 x:0 0 0 2023-12-16T07:40:23.498 INFO:tasks.workunit.client.0.smithi049.stdout:7/648: dread d7/dc/f1b [4194304,4194304] 0 2023-12-16T07:40:23.498 INFO:tasks.workunit.client.0.smithi049.stdout:7/649: write d7/dc/dd/d27/fb5 [491971,121490] 0 2023-12-16T07:40:23.500 INFO:tasks.workunit.client.0.smithi049.stdout:6/749: rename d0/d2/c9b to d0/d39/d5b/d65/d58/d33/daa/cee 0 2023-12-16T07:40:23.500 INFO:tasks.workunit.client.0.smithi049.stdout:6/750: write d0/d39/d5b/d65/d58/d2c/f4b [1613136,117495] 0 2023-12-16T07:40:23.500 INFO:tasks.workunit.client.0.smithi049.stdout:3/527: dread d1/f25 [0,4194304] 0 2023-12-16T07:40:23.501 INFO:tasks.workunit.client.0.smithi049.stdout:3/528: readlink d1/d2a/l36 0 2023-12-16T07:40:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/751: mknod d0/d39/d5b/cef 0 2023-12-16T07:40:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/752: dread - d0/d39/d5b/d65/d4c/f8e zero size 2023-12-16T07:40:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:1/664: sync 2023-12-16T07:40:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/621: sync 2023-12-16T07:40:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:8/685: sync 2023-12-16T07:40:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:8/686: stat d0/d13/f31 0 2023-12-16T07:40:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/622: fdatasync d2/db/dd/de/d1e/d21/f4f 0 2023-12-16T07:40:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:8/687: chown d0/d13/f66 466 1 2023-12-16T07:40:23.510 INFO:tasks.workunit.client.0.smithi049.stdout:9/532: sync 2023-12-16T07:40:23.510 INFO:tasks.workunit.client.0.smithi049.stdout:0/834: sync 2023-12-16T07:40:23.510 INFO:tasks.workunit.client.0.smithi049.stdout:3/529: creat d1/d2a/d37/d3f/fb1 x:0 0 0 2023-12-16T07:40:23.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/688: write d0/d13/d42/d5b/d68/d6b/fae [310575,122860] 0 2023-12-16T07:40:23.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/689: chown d0/d1f/d56/ca3 1685408 1 2023-12-16T07:40:23.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/690: truncate d0/d13/f2f 9405078 0 2023-12-16T07:40:23.510 INFO:tasks.workunit.client.0.smithi049.stdout:4/623: write d2/db/fab [3963023,65108] 0 2023-12-16T07:40:23.512 INFO:tasks.workunit.client.0.smithi049.stdout:9/533: rmdir d4/d7/d11/d26 39 2023-12-16T07:40:23.512 INFO:tasks.workunit.client.0.smithi049.stdout:2/614: sync 2023-12-16T07:40:23.515 INFO:tasks.workunit.client.0.smithi049.stdout:0/835: mkdir d13/d21/d2f/d7d/da0/dc9/d129 0 2023-12-16T07:40:23.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/530: rmdir d1/d2a/d37/d3f/d5a/d61/d75 39 2023-12-16T07:40:23.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/531: write d1/d2a/d37/d3f/d5a/d6d/f84 [900974,34898] 0 2023-12-16T07:40:23.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/532: chown d1/d2a/d37/d3f/d5a/d61/f7c 116 1 2023-12-16T07:40:23.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/533: stat d1/d2a/d37/d3f/d5a/d5b/d5e/c64 0 2023-12-16T07:40:23.515 INFO:tasks.workunit.client.0.smithi049.stdout:4/624: mkdir d2/db/dd/de/d1e/d37/dcf 0 2023-12-16T07:40:23.516 INFO:tasks.workunit.client.0.smithi049.stdout:7/650: dwrite d7/dc/dd/d27/f95 [0,4194304] 0 2023-12-16T07:40:23.516 INFO:tasks.workunit.client.0.smithi049.stdout:9/534: mkdir d4/d7/d11/d26/d47/d8a/daa 0 2023-12-16T07:40:23.516 INFO:tasks.workunit.client.0.smithi049.stdout:2/615: mkdir d2/de/d78/dd6 0 2023-12-16T07:40:23.518 INFO:tasks.workunit.client.0.smithi049.stdout:3/534: unlink d1/d2a/d37/d3f/c52 0 2023-12-16T07:40:23.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/753: dread d0/d39/d5b/d65/d27/f85 [0,4194304] 0 2023-12-16T07:40:23.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/754: write d0/d2/df/d4e/d5d/d6f/d4a/da4/fea [824679,80969] 0 2023-12-16T07:40:23.521 INFO:tasks.workunit.client.0.smithi049.stdout:4/625: rename d2/c2c to d2/db/d6b/dad/cd0 0 2023-12-16T07:40:23.521 INFO:tasks.workunit.client.0.smithi049.stdout:4/626: fdatasync d2/db/dd/de/d1e/d37/d82/fbd 0 2023-12-16T07:40:23.521 INFO:tasks.workunit.client.0.smithi049.stdout:7/651: symlink d7/dc/d7c/ldd 0 2023-12-16T07:40:23.521 INFO:tasks.workunit.client.0.smithi049.stdout:5/681: dread d5/d1e/d21/fb6 [0,4194304] 0 2023-12-16T07:40:23.522 INFO:tasks.workunit.client.0.smithi049.stdout:2/616: creat d2/d1d/d28/d56/d66/d6b/fd7 x:0 0 0 2023-12-16T07:40:23.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/755: symlink d0/d2/df/d4e/d5d/d6f/d4a/da4/lf0 0 2023-12-16T07:40:23.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/652: mknod d7/dc/d6b/d70/d86/cde 0 2023-12-16T07:40:23.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/653: chown d7/dc/dd/d37/f8d 242408574 1 2023-12-16T07:40:23.529 INFO:tasks.workunit.client.0.smithi049.stdout:6/756: creat d0/d2/df/d4e/ff1 x:0 0 0 2023-12-16T07:40:23.530 INFO:tasks.workunit.client.0.smithi049.stdout:2/617: dread d2/d1d/f5e [0,4194304] 0 2023-12-16T07:40:23.532 INFO:tasks.workunit.client.0.smithi049.stdout:2/618: write d2/d1d/d28/d56/d66/f88 [3159261,36035] 0 2023-12-16T07:40:23.532 INFO:tasks.workunit.client.0.smithi049.stdout:2/619: fsync d2/d26/f59 0 2023-12-16T07:40:23.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/682: dread d5/de/d1c/d62/f88 [0,4194304] 0 2023-12-16T07:40:23.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/683: write d5/de/d54/d78/d9b/fbd [726769,52807] 0 2023-12-16T07:40:23.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/691: dread d0/d13/d42/d5b/d68/d6b/fae [0,4194304] 0 2023-12-16T07:40:23.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/692: readlink d0/d13/d42/d5b/l9d 0 2023-12-16T07:40:23.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/665: dwrite d20/f3e [0,4194304] 0 2023-12-16T07:40:23.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/684: write d5/f9 [1166505,28913] 0 2023-12-16T07:40:23.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/654: creat d7/dc/d15/fdf x:0 0 0 2023-12-16T07:40:23.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/655: chown d7/dc/d2f/d38 41809257 1 2023-12-16T07:40:23.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/656: write d7/dc/dd/d27/f48 [774597,90168] 0 2023-12-16T07:40:23.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/657: write d7/dc/d2f/d40/d5d/f78 [191398,85361] 0 2023-12-16T07:40:23.540 INFO:tasks.workunit.client.0.smithi049.stdout:2/620: symlink d2/d1d/d24/d55/d76/ld8 0 2023-12-16T07:40:23.542 INFO:tasks.workunit.client.0.smithi049.stdout:8/693: mkdir d0/d13/d42/d5b/d68/d6b/dd6 0 2023-12-16T07:40:23.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/836: dwrite d13/d39/d38/d7e/d8b/f9a [0,4194304] 0 2023-12-16T07:40:23.544 INFO:tasks.workunit.client.0.smithi049.stdout:7/658: unlink d7/dc/dd/f93 0 2023-12-16T07:40:23.545 INFO:tasks.workunit.client.0.smithi049.stdout:2/621: rename d2/de/d93/dcf to d2/de/d78/dd9 0 2023-12-16T07:40:23.545 INFO:tasks.workunit.client.0.smithi049.stdout:8/694: dread d0/d13/d42/d5b/dab/fd2 [0,4194304] 0 2023-12-16T07:40:23.546 INFO:tasks.workunit.client.0.smithi049.stdout:9/535: dwrite d4/db/f97 [0,4194304] 0 2023-12-16T07:40:23.551 INFO:tasks.workunit.client.0.smithi049.stdout:0/837: creat d13/f12a x:0 0 0 2023-12-16T07:40:23.551 INFO:tasks.workunit.client.0.smithi049.stdout:0/838: chown d13/fcb 1398 1 2023-12-16T07:40:23.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/627: write d2/db/dd/fa [3832696,59770] 0 2023-12-16T07:40:23.560 INFO:tasks.workunit.client.0.smithi049.stdout:7/659: creat d7/dc/d2f/d38/ddb/fe0 x:0 0 0 2023-12-16T07:40:23.561 INFO:tasks.workunit.client.0.smithi049.stdout:2/622: dread d2/d1d/d28/d56/d66/d6b/f79 [0,4194304] 0 2023-12-16T07:40:23.562 INFO:tasks.workunit.client.0.smithi049.stdout:3/535: dwrite d1/d2b/f4f [0,4194304] 0 2023-12-16T07:40:23.562 INFO:tasks.workunit.client.0.smithi049.stdout:9/536: creat d4/d7/d11/d26/d47/fab x:0 0 0 2023-12-16T07:40:23.564 INFO:tasks.workunit.client.0.smithi049.stdout:8/695: creat d0/d13/fd7 x:0 0 0 2023-12-16T07:40:23.564 INFO:tasks.workunit.client.0.smithi049.stdout:8/696: truncate d0/d13/f31 2004111 0 2023-12-16T07:40:23.566 INFO:tasks.workunit.client.0.smithi049.stdout:2/623: mknod d2/d26/cda 0 2023-12-16T07:40:23.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/660: creat d7/dc/d6b/dbf/dd3/fe1 x:0 0 0 2023-12-16T07:40:23.569 INFO:tasks.workunit.client.0.smithi049.stdout:6/757: dwrite d0/d39/d5b/d65/d4c/fb7 [0,4194304] 0 2023-12-16T07:40:23.569 INFO:tasks.workunit.client.0.smithi049.stdout:6/758: write d0/d39/d5b/d65/d53/f66 [815567,51746] 0 2023-12-16T07:40:23.569 INFO:tasks.workunit.client.0.smithi049.stdout:6/759: dread - d0/d2/df/d4e/d5d/d6f/d4a/da4/fec zero size 2023-12-16T07:40:23.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/536: rename d1/d2a/d37/d3f/d4c/f9c to d1/d2a/d37/d3f/d5a/d5b/d5e/fb2 0 2023-12-16T07:40:23.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/537: chown d1/d2a/d37/d3f/d5a/d61/d75/f83 0 1 2023-12-16T07:40:23.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/538: dread - d1/d2a/d37/d3f/d5a/d6d/d96/fa2 zero size 2023-12-16T07:40:23.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/537: link d4/d7/d11/f20 d4/d7/d11/d26/d47/d8a/fac 0 2023-12-16T07:40:23.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/697: mknod d0/d1f/d4e/dbb/cd8 0 2023-12-16T07:40:23.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/661: mknod d7/dc/dd/d35/ce2 0 2023-12-16T07:40:23.574 INFO:tasks.workunit.client.0.smithi049.stdout:5/685: dwrite d5/de/d54/d57/d3c/d82/f84 [0,4194304] 0 2023-12-16T07:40:23.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/760: symlink d0/d39/d5b/d65/d58/lf2 0 2023-12-16T07:40:23.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/538: truncate d4/db/f41 1220864 0 2023-12-16T07:40:23.575 INFO:tasks.workunit.client.0.smithi049.stdout:4/628: dwrite d2/db/dd/de/d1e/fce [0,4194304] 0 2023-12-16T07:40:23.576 INFO:tasks.workunit.client.0.smithi049.stdout:4/629: dread d2/db/dd/d52/fa0 [0,4194304] 0 2023-12-16T07:40:23.577 INFO:tasks.workunit.client.0.smithi049.stdout:4/630: readlink d2/db/dd/de/d1e/d37/da4/l71 0 2023-12-16T07:40:23.577 INFO:tasks.workunit.client.0.smithi049.stdout:4/631: chown d2/db/dd/de/d1e/d37/da4 765 1 2023-12-16T07:40:23.577 INFO:tasks.workunit.client.0.smithi049.stdout:8/698: link d0/d13/d42/d5b/dab/faa d0/d1f/d1c/fd9 0 2023-12-16T07:40:23.579 INFO:tasks.workunit.client.0.smithi049.stdout:2/624: dread d2/d1d/d24/d55/f5a [0,4194304] 0 2023-12-16T07:40:23.579 INFO:tasks.workunit.client.0.smithi049.stdout:1/666: dwrite d20/d41/d4f/d55/f83 [0,4194304] 0 2023-12-16T07:40:23.579 INFO:tasks.workunit.client.0.smithi049.stdout:1/667: readlink d20/d41/d4f/d55/d7f/l9b 0 2023-12-16T07:40:23.584 INFO:tasks.workunit.client.0.smithi049.stdout:5/686: write d5/d1e/d21/d58/f79 [699965,3931] 0 2023-12-16T07:40:23.584 INFO:tasks.workunit.client.0.smithi049.stdout:5/687: chown d5/de/d1c/f35 1469230 1 2023-12-16T07:40:23.585 INFO:tasks.workunit.client.0.smithi049.stdout:5/688: read d5/de/d54/da9/fe6 [757283,76] 0 2023-12-16T07:40:23.588 INFO:tasks.workunit.client.0.smithi049.stdout:5/689: write d5/de/d54/d67/fa4 [1057628,31821] 0 2023-12-16T07:40:23.589 INFO:tasks.workunit.client.0.smithi049.stdout:5/690: dread - d5/de/d54/d78/fe3 zero size 2023-12-16T07:40:23.589 INFO:tasks.workunit.client.0.smithi049.stdout:5/691: write d5/d1e/d21/d4e/f9d [3200651,96510] 0 2023-12-16T07:40:23.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/539: creat d4/d7/d11/d1d/d48/d93/fad x:0 0 0 2023-12-16T07:40:23.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/540: write d4/d7/d11/d1d/d5b/d8b/fa9 [512561,16071] 0 2023-12-16T07:40:23.594 INFO:tasks.workunit.client.0.smithi049.stdout:3/539: dwrite d1/d2a/d37/f5c [0,4194304] 0 2023-12-16T07:40:23.594 INFO:tasks.workunit.client.0.smithi049.stdout:7/662: dwrite d7/dc/dd/d27/fd5 [0,4194304] 0 2023-12-16T07:40:23.594 INFO:tasks.workunit.client.0.smithi049.stdout:7/663: chown d7/dc/dd/d35/f94 946280 1 2023-12-16T07:40:23.594 INFO:tasks.workunit.client.0.smithi049.stdout:7/664: truncate d7/dc/d2f/d38/ddb/fe0 778052 0 2023-12-16T07:40:23.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/632: creat d2/db/dd/de/d1e/d37/d82/fd1 x:0 0 0 2023-12-16T07:40:23.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/699: unlink d0/d1f/d36/l88 0 2023-12-16T07:40:23.604 INFO:tasks.workunit.client.0.smithi049.stdout:6/761: getdents d0/d39/d5b/d65/d58 0 2023-12-16T07:40:23.604 INFO:tasks.workunit.client.0.smithi049.stdout:6/762: fsync d0/d39/d5b/d65/d27/d91/d94/fcd 0 2023-12-16T07:40:23.604 INFO:tasks.workunit.client.0.smithi049.stdout:6/763: chown d0/d39/d5b/d65/d53/f61 371191632 1 2023-12-16T07:40:23.605 INFO:tasks.workunit.client.0.smithi049.stdout:2/625: mknod d2/de/d93/cdb 0 2023-12-16T07:40:23.607 INFO:tasks.workunit.client.0.smithi049.stdout:1/668: getdents d20/d41/d4f/d55/d82/dc5 0 2023-12-16T07:40:23.607 INFO:tasks.workunit.client.0.smithi049.stdout:6/764: dread d0/d2/df/f7a [0,4194304] 0 2023-12-16T07:40:23.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/692: mknod d5/de/d54/d5c/cf4 0 2023-12-16T07:40:23.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/541: mkdir d4/d7/d11/d1d/d9b/dae 0 2023-12-16T07:40:23.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/540: mkdir d1/d2a/d37/d3f/d5a/d6d/d96/db3 0 2023-12-16T07:40:23.614 INFO:tasks.workunit.client.0.smithi049.stdout:7/665: creat d7/dc/dd/d27/dba/fe3 x:0 0 0 2023-12-16T07:40:23.615 INFO:tasks.workunit.client.0.smithi049.stdout:4/633: mknod d2/db/dd/d52/cd2 0 2023-12-16T07:40:23.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/700: readlink d0/d1f/la1 0 2023-12-16T07:40:23.618 INFO:tasks.workunit.client.0.smithi049.stdout:2/626: creat d2/d26/d6e/fdc x:0 0 0 2023-12-16T07:40:23.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/669: mkdir d20/de4 0 2023-12-16T07:40:23.620 INFO:tasks.workunit.client.0.smithi049.stdout:6/765: mkdir d0/d2/df/df3 0 2023-12-16T07:40:23.620 INFO:tasks.workunit.client.0.smithi049.stdout:6/766: getdents d0/d39/d5b/d65/d58/d33/daa/dd1 0 2023-12-16T07:40:23.623 INFO:tasks.workunit.client.0.smithi049.stdout:3/541: rename d1/l15 to d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/lb4 0 2023-12-16T07:40:23.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/666: mkdir d7/dc/d6b/dbf/dd3/de4 0 2023-12-16T07:40:23.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/667: truncate d7/dc/d15/fa7 289107 0 2023-12-16T07:40:23.625 INFO:tasks.workunit.client.0.smithi049.stdout:4/634: mknod d2/db/dd/de/d1e/d37/cd3 0 2023-12-16T07:40:23.625 INFO:tasks.workunit.client.0.smithi049.stdout:2/627: dread d2/de/f1b [0,4194304] 0 2023-12-16T07:40:23.625 INFO:tasks.workunit.client.0.smithi049.stdout:9/542: dwrite d4/d7/d11/d3f/f51 [0,4194304] 0 2023-12-16T07:40:23.626 INFO:tasks.workunit.client.0.smithi049.stdout:1/670: creat d20/d41/d52/d86/fe5 x:0 0 0 2023-12-16T07:40:23.627 INFO:tasks.workunit.client.0.smithi049.stdout:9/543: dread d4/d7/d11/f16 [0,4194304] 0 2023-12-16T07:40:23.627 INFO:tasks.workunit.client.0.smithi049.stdout:9/544: getdents d4/d7/d11 0 2023-12-16T07:40:23.627 INFO:tasks.workunit.client.0.smithi049.stdout:9/545: chown d4/d7/d11/d26/d80/fa3 6956735 1 2023-12-16T07:40:23.627 INFO:tasks.workunit.client.0.smithi049.stdout:2/628: write d2/d1d/d24/d55/f74 [959493,126958] 0 2023-12-16T07:40:23.627 INFO:tasks.workunit.client.0.smithi049.stdout:7/668: read d7/dc/d2f/d40/f74 [2732511,111079] 0 2023-12-16T07:40:23.627 INFO:tasks.workunit.client.0.smithi049.stdout:6/767: mknod d0/d39/d5b/d65/d58/d33/dc5/cf4 0 2023-12-16T07:40:23.628 INFO:tasks.workunit.client.0.smithi049.stdout:2/629: dread d2/d1d/d28/d56/fae [0,4194304] 0 2023-12-16T07:40:23.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/669: dread d7/dc/dd/d27/fb5 [0,4194304] 0 2023-12-16T07:40:23.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/670: write d7/dc/dd/d14/fa3 [315306,86291] 0 2023-12-16T07:40:23.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/671: fdatasync d7/dc/d6b/d70/fac 0 2023-12-16T07:40:23.632 INFO:tasks.workunit.client.0.smithi049.stdout:4/635: rmdir d2/db/d6b 39 2023-12-16T07:40:23.632 INFO:tasks.workunit.client.0.smithi049.stdout:4/636: readlink d2/db/dd/d2a/l30 0 2023-12-16T07:40:23.632 INFO:tasks.workunit.client.0.smithi049.stdout:4/637: chown d2/db/dd/d2a/f1c 3966 1 2023-12-16T07:40:23.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/693: truncate d5/de/d54/d67/fa4 821227 0 2023-12-16T07:40:23.635 INFO:tasks.workunit.client.0.smithi049.stdout:1/671: creat d20/d41/d4f/d55/d82/dd2/fe6 x:0 0 0 2023-12-16T07:40:23.637 INFO:tasks.workunit.client.0.smithi049.stdout:5/694: read d5/de/d1c/f46 [6093493,65344] 0 2023-12-16T07:40:23.637 INFO:tasks.workunit.client.0.smithi049.stdout:5/695: write d5/de/d54/d57/faf [361023,384] 0 2023-12-16T07:40:23.637 INFO:tasks.workunit.client.0.smithi049.stdout:5/696: dread - d5/de/d54/da9/fc9 zero size 2023-12-16T07:40:23.637 INFO:tasks.workunit.client.0.smithi049.stdout:5/697: stat d5/de/d1c 0 2023-12-16T07:40:23.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/546: creat d4/d7/d11/d1d/d69/d76/d83/faf x:0 0 0 2023-12-16T07:40:23.639 INFO:tasks.workunit.client.0.smithi049.stdout:2/630: creat d2/d1d/d28/d56/d11/fdd x:0 0 0 2023-12-16T07:40:23.639 INFO:tasks.workunit.client.0.smithi049.stdout:2/631: chown d2/d1d/d24/d55/d76/fa2 328621941 1 2023-12-16T07:40:23.640 INFO:tasks.workunit.client.0.smithi049.stdout:7/672: creat d7/dc/d2f/d38/fe5 x:0 0 0 2023-12-16T07:40:23.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/638: rmdir d2/db/dd/de/d1e/d44 39 2023-12-16T07:40:23.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/639: dread d2/db/dd/de/d1e/d37/f5c [0,4194304] 0 2023-12-16T07:40:23.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/640: chown d2/db/dd/de/d1e/d21/l90 2238 1 2023-12-16T07:40:23.643 INFO:tasks.workunit.client.0.smithi049.stdout:1/672: symlink d20/d43/le7 0 2023-12-16T07:40:23.643 INFO:tasks.workunit.client.0.smithi049.stdout:1/673: chown d20/f3d 0 1 2023-12-16T07:40:23.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/641: write d2/db/dd/de/d1e/d21/f4f [1905841,78352] 0 2023-12-16T07:40:23.647 INFO:tasks.workunit.client.0.smithi049.stdout:5/698: mknod d5/de/d54/d57/d2f/cf5 0 2023-12-16T07:40:23.647 INFO:tasks.workunit.client.0.smithi049.stdout:6/768: dwrite d0/d39/d5b/f74 [0,4194304] 0 2023-12-16T07:40:23.647 INFO:tasks.workunit.client.0.smithi049.stdout:2/632: dread d2/fb2 [0,4194304] 0 2023-12-16T07:40:23.647 INFO:tasks.workunit.client.0.smithi049.stdout:9/547: symlink d4/db/lb0 0 2023-12-16T07:40:23.647 INFO:tasks.workunit.client.0.smithi049.stdout:2/633: dread - d2/d1d/d28/d56/d11/fdd zero size 2023-12-16T07:40:23.647 INFO:tasks.workunit.client.0.smithi049.stdout:2/634: chown d2/d1d/d38/fbf 280 1 2023-12-16T07:40:23.647 INFO:tasks.workunit.client.0.smithi049.stdout:7/673: mknod d7/dc/d6b/d70/d86/ce6 0 2023-12-16T07:40:23.648 INFO:tasks.workunit.client.0.smithi049.stdout:1/674: getdents d20/d41/d52/d86/db1 0 2023-12-16T07:40:23.648 INFO:tasks.workunit.client.0.smithi049.stdout:1/675: chown d20/d41/d4f/d55/d7f 5291 1 2023-12-16T07:40:23.648 INFO:tasks.workunit.client.0.smithi049.stdout:1/676: write d20/d45/d77/fd6 [526851,93046] 0 2023-12-16T07:40:23.649 INFO:tasks.workunit.client.0.smithi049.stdout:6/769: mknod d0/d2/dd7/cf5 0 2023-12-16T07:40:23.651 INFO:tasks.workunit.client.0.smithi049.stdout:5/699: mknod d5/de/d54/d67/d9e/cf6 0 2023-12-16T07:40:23.652 INFO:tasks.workunit.client.0.smithi049.stdout:9/548: mknod d4/d7/cb1 0 2023-12-16T07:40:23.653 INFO:tasks.workunit.client.0.smithi049.stdout:2/635: mknod d2/d1d/d24/d55/d7c/d98/cde 0 2023-12-16T07:40:23.654 INFO:tasks.workunit.client.0.smithi049.stdout:7/674: symlink d7/dc/dd/d27/dba/le7 0 2023-12-16T07:40:23.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/675: truncate d7/dc/d15/fdf 385970 0 2023-12-16T07:40:23.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/676: chown d7/dc/d2f/d40/d5d 1285 1 2023-12-16T07:40:23.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/677: write d7/dc/d15/d57/f98 [638257,106002] 0 2023-12-16T07:40:23.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/678: readlink d7/dc/d15/d57/l68 0 2023-12-16T07:40:23.655 INFO:tasks.workunit.client.0.smithi049.stdout:9/549: dread d4/d7/f21 [0,4194304] 0 2023-12-16T07:40:23.656 INFO:tasks.workunit.client.0.smithi049.stdout:1/677: mkdir d20/d41/de8 0 2023-12-16T07:40:23.656 INFO:tasks.workunit.client.0.smithi049.stdout:7/679: dread d7/dc/dd/d27/f48 [0,4194304] 0 2023-12-16T07:40:23.656 INFO:tasks.workunit.client.0.smithi049.stdout:7/680: chown d7/dc/d15/d57/l5a 2391808 1 2023-12-16T07:40:23.656 INFO:tasks.workunit.client.0.smithi049.stdout:7/681: fsync d7/dc/dd/d27/d8e/f90 0 2023-12-16T07:40:23.657 INFO:tasks.workunit.client.0.smithi049.stdout:7/682: fdatasync d7/dc/dd/d27/fb5 0 2023-12-16T07:40:23.657 INFO:tasks.workunit.client.0.smithi049.stdout:7/683: stat d7/dc/d6b/d70/d86/f88 0 2023-12-16T07:40:23.659 INFO:tasks.workunit.client.0.smithi049.stdout:5/700: truncate f3 3702213 0 2023-12-16T07:40:23.659 INFO:tasks.workunit.client.0.smithi049.stdout:9/550: mkdir d4/db2 0 2023-12-16T07:40:23.660 INFO:tasks.workunit.client.0.smithi049.stdout:9/551: truncate d4/d7/d11/d1d/d69/f9c 1034766 0 2023-12-16T07:40:23.660 INFO:tasks.workunit.client.0.smithi049.stdout:9/552: write d4/d7/d11/d26/d47/d8a/f61 [780203,72338] 0 2023-12-16T07:40:23.660 INFO:tasks.workunit.client.0.smithi049.stdout:1/678: getdents d20/d40/d6f 0 2023-12-16T07:40:23.661 INFO:tasks.workunit.client.0.smithi049.stdout:0/839: sync 2023-12-16T07:40:23.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/636: dread d2/d1d/d24/d55/f5a [0,4194304] 0 2023-12-16T07:40:23.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/642: dwrite d2/db/dd/de/d1e/d21/f39 [4194304,4194304] 0 2023-12-16T07:40:23.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/643: chown d2/f28 288689 1 2023-12-16T07:40:23.662 INFO:tasks.workunit.client.0.smithi049.stdout:7/684: creat d7/dc/d2f/d38/fe8 x:0 0 0 2023-12-16T07:40:23.662 INFO:tasks.workunit.client.0.smithi049.stdout:2/637: write d2/d1d/d24/f50 [1094527,7877] 0 2023-12-16T07:40:23.662 INFO:tasks.workunit.client.0.smithi049.stdout:2/638: readlink d2/d26/l72 0 2023-12-16T07:40:23.666 INFO:tasks.workunit.client.0.smithi049.stdout:5/701: symlink d5/de/d1c/db1/lf7 0 2023-12-16T07:40:23.666 INFO:tasks.workunit.client.0.smithi049.stdout:1/679: creat d20/d41/d4f/d55/d82/fe9 x:0 0 0 2023-12-16T07:40:23.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/553: rename d4/d7/d11/d26/d47 to d4/d7/d11/db3 0 2023-12-16T07:40:23.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/554: fsync d4/d7/f7a 0 2023-12-16T07:40:23.666 INFO:tasks.workunit.client.0.smithi049.stdout:0/840: symlink d13/d21/d99/d46/d65/d82/ddb/l12b 0 2023-12-16T07:40:23.667 INFO:tasks.workunit.client.0.smithi049.stdout:0/841: write d13/d21/d2f/f80 [331021,94004] 0 2023-12-16T07:40:23.668 INFO:tasks.workunit.client.0.smithi049.stdout:4/644: mkdir d2/db/dd/de/d1e/d37/d82/dd4 0 2023-12-16T07:40:23.668 INFO:tasks.workunit.client.0.smithi049.stdout:6/770: dwrite d0/d39/d5b/d65/d27/fd5 [0,4194304] 0 2023-12-16T07:40:23.676 INFO:tasks.workunit.client.0.smithi049.stdout:2/639: rename d2/d1d/d24/dd4 to d2/d1d/d28/d56/d71/ddf 0 2023-12-16T07:40:23.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/555: rmdir d4/d7/d11/db3/d59 39 2023-12-16T07:40:23.682 INFO:tasks.workunit.client.0.smithi049.stdout:4/645: mknod d2/db/dd/de/d1e/d37/cd5 0 2023-12-16T07:40:23.684 INFO:tasks.workunit.client.0.smithi049.stdout:7/685: rmdir d7/dc/dd/d27 39 2023-12-16T07:40:23.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/686: dread - d7/dc/d2f/f9f zero size 2023-12-16T07:40:23.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/687: stat d7/dc/d6b/d70/fb8 0 2023-12-16T07:40:23.685 INFO:tasks.workunit.client.0.smithi049.stdout:2/640: mkdir d2/de/de0 0 2023-12-16T07:40:23.686 INFO:tasks.workunit.client.0.smithi049.stdout:9/556: mkdir d4/d7/d11/d1d/d69/d76/d83/db4 0 2023-12-16T07:40:23.689 INFO:tasks.workunit.client.0.smithi049.stdout:1/680: dwrite ff [0,4194304] 0 2023-12-16T07:40:23.692 INFO:tasks.workunit.client.0.smithi049.stdout:7/688: symlink d7/dc/dd/d35/le9 0 2023-12-16T07:40:23.692 INFO:tasks.workunit.client.0.smithi049.stdout:2/641: mknod d2/ce1 0 2023-12-16T07:40:23.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/842: dwrite f0 [0,4194304] 0 2023-12-16T07:40:23.695 INFO:tasks.workunit.client.0.smithi049.stdout:0/843: write d13/d21/d27/d2c/f8d [986663,76304] 0 2023-12-16T07:40:23.701 INFO:tasks.workunit.client.0.smithi049.stdout:1/681: symlink d20/d41/d4f/d55/d82/dc5/lea 0 2023-12-16T07:40:23.701 INFO:tasks.workunit.client.0.smithi049.stdout:7/689: mknod d7/dc/d15/d57/cea 0 2023-12-16T07:40:23.701 INFO:tasks.workunit.client.0.smithi049.stdout:1/682: chown d20/d41/d4f/d55/d82/fe9 45977134 1 2023-12-16T07:40:23.703 INFO:tasks.workunit.client.0.smithi049.stdout:2/642: rename d2/d1d/dc2/fc6 to d2/d1d/d24/d55/d76/fe2 0 2023-12-16T07:40:23.703 INFO:tasks.workunit.client.0.smithi049.stdout:2/643: chown d2/d1d/d28/d56/d11/fdd 0 1 2023-12-16T07:40:23.707 INFO:tasks.workunit.client.0.smithi049.stdout:0/844: rmdir d13/d21/d27/d2c 39 2023-12-16T07:40:23.708 INFO:tasks.workunit.client.0.smithi049.stdout:1/683: truncate d20/d45/d47/f56 482999 0 2023-12-16T07:40:23.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/690: truncate d7/dc/d6b/d70/fb8 66765 0 2023-12-16T07:40:23.711 INFO:tasks.workunit.client.0.smithi049.stdout:0/845: creat d13/d21/d2f/d7d/da0/dc9/f12c x:0 0 0 2023-12-16T07:40:23.711 INFO:tasks.workunit.client.0.smithi049.stdout:0/846: readlink d13/d21/d2f/d7d/l96 0 2023-12-16T07:40:23.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/684: creat d20/feb x:0 0 0 2023-12-16T07:40:23.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/847: creat d13/d21/d2f/d7d/da0/dc9/f12d x:0 0 0 2023-12-16T07:40:23.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/848: write d13/d3c/fde [1167064,112548] 0 2023-12-16T07:40:23.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/849: chown d13/d39/df3/d11e/fe4 89127 1 2023-12-16T07:40:23.714 INFO:tasks.workunit.client.0.smithi049.stdout:0/850: dread - d13/d21/d99/ffb zero size 2023-12-16T07:40:23.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/685: mkdir d20/d41/d4f/dec 0 2023-12-16T07:40:23.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/686: symlink d20/d45/d47/led 0 2023-12-16T07:40:23.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/687: chown d20/d45/cda 65 1 2023-12-16T07:40:23.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/688: chown d20/l2c 8 1 2023-12-16T07:40:23.719 INFO:tasks.workunit.client.0.smithi049.stdout:4/646: dwrite d2/db/dd/de/fa1 [0,4194304] 0 2023-12-16T07:40:23.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/557: dwrite d4/d7/d11/d1d/d69/f9d [0,4194304] 0 2023-12-16T07:40:23.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/558: fdatasync d4/d7/d11/d3f/f54 0 2023-12-16T07:40:23.719 INFO:tasks.workunit.client.0.smithi049.stdout:5/702: dwrite f3 [0,4194304] 0 2023-12-16T07:40:23.720 INFO:tasks.workunit.client.0.smithi049.stdout:5/703: write d5/de/d1c/d62/f88 [2828781,2946] 0 2023-12-16T07:40:23.722 INFO:tasks.workunit.client.0.smithi049.stdout:1/689: dread d20/d41/f5a [0,4194304] 0 2023-12-16T07:40:23.722 INFO:tasks.workunit.client.0.smithi049.stdout:1/690: truncate d20/d41/d4f/d55/d58/f5d 5202361 0 2023-12-16T07:40:23.722 INFO:tasks.workunit.client.0.smithi049.stdout:1/691: read - d20/d41/d52/d86/fca zero size 2023-12-16T07:40:23.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/704: dread d5/de/d1c/f55 [0,4194304] 0 2023-12-16T07:40:23.726 INFO:tasks.workunit.client.0.smithi049.stdout:9/559: mknod d4/d7/d11/d1d/d69/d76/d83/db4/cb5 0 2023-12-16T07:40:23.726 INFO:tasks.workunit.client.0.smithi049.stdout:9/560: chown d4/d7/d11/d26/l90 0 1 2023-12-16T07:40:23.726 INFO:tasks.workunit.client.0.smithi049.stdout:9/561: stat d4/l58 0 2023-12-16T07:40:23.727 INFO:tasks.workunit.client.0.smithi049.stdout:1/692: link d20/d41/d52/d86/db1/fd7 d20/fee 0 2023-12-16T07:40:23.727 INFO:tasks.workunit.client.0.smithi049.stdout:1/693: truncate d20/f32 4612187 0 2023-12-16T07:40:23.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/705: mkdir d5/de/d54/d67/df8 0 2023-12-16T07:40:23.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/706: readlink d5/de/d54/l5e 0 2023-12-16T07:40:23.730 INFO:tasks.workunit.client.0.smithi049.stdout:9/562: creat d4/d7/fb6 x:0 0 0 2023-12-16T07:40:23.730 INFO:tasks.workunit.client.0.smithi049.stdout:9/563: fdatasync d4/d7/f10 0 2023-12-16T07:40:23.730 INFO:tasks.workunit.client.0.smithi049.stdout:9/564: fdatasync d4/d7/d11/d1d/d69/d76/f9a 0 2023-12-16T07:40:23.730 INFO:tasks.workunit.client.0.smithi049.stdout:1/694: mknod d20/d41/de8/cef 0 2023-12-16T07:40:23.731 INFO:tasks.workunit.client.0.smithi049.stdout:5/707: creat d5/de/d54/da9/ff9 x:0 0 0 2023-12-16T07:40:23.731 INFO:tasks.workunit.client.0.smithi049.stdout:9/565: creat d4/d7/d11/d1d/d5b/fb7 x:0 0 0 2023-12-16T07:40:23.731 INFO:tasks.workunit.client.0.smithi049.stdout:9/566: write d4/d7/d11/d1d/f64 [369437,73397] 0 2023-12-16T07:40:23.732 INFO:tasks.workunit.client.0.smithi049.stdout:1/695: creat d20/d7b/d88/ff0 x:0 0 0 2023-12-16T07:40:23.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/708: truncate d5/f15 1974273 0 2023-12-16T07:40:23.734 INFO:tasks.workunit.client.0.smithi049.stdout:9/567: mknod d4/d7/d11/d26/d80/cb8 0 2023-12-16T07:40:23.734 INFO:tasks.workunit.client.0.smithi049.stdout:9/568: dread - d4/d7/d11/d1d/d69/d76/d83/faf zero size 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:9/569: dread - d4/d7/d11/d3f/f54 zero size 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:9/570: read - d4/d7/d11/d26/d80/fa3 zero size 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:9/571: write d4/d7/d11/d3f/f54 [485006,25285] 0 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:9/572: write d4/d7/d11/db3/d8a/fa5 [999303,109768] 0 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:1/696: truncate d20/f28 112430 0 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:7/691: dwrite d7/dc/d15/fa7 [0,4194304] 0 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:0/851: dwrite d13/d21/d99/f118 [0,4194304] 0 2023-12-16T07:40:23.735 INFO:tasks.workunit.client.0.smithi049.stdout:0/852: chown d13/d21/d2f/d7d/d90/fa5 115 1 2023-12-16T07:40:23.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/853: readlink d13/d21/d99/d46/l10e 0 2023-12-16T07:40:23.737 INFO:tasks.workunit.client.0.smithi049.stdout:5/709: rename d5/d1e to d5/de/d54/d57/dfa 0 2023-12-16T07:40:23.739 INFO:tasks.workunit.client.0.smithi049.stdout:9/573: mknod d4/d7/d11/db3/cb9 0 2023-12-16T07:40:23.739 INFO:tasks.workunit.client.0.smithi049.stdout:9/574: chown d4/c1b 36830 1 2023-12-16T07:40:23.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/697: link d20/d41/f78 d20/d41/d4f/d55/d7f/ff1 0 2023-12-16T07:40:23.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/698: write ff [3139652,80855] 0 2023-12-16T07:40:23.754 INFO:tasks.workunit.client.0.smithi049.stdout:0/854: dwrite d13/d21/d27/d2c/f41 [0,4194304] 0 2023-12-16T07:40:23.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/692: rename d7/dc/dd/l1c to d7/dc/d6b/dbf/dd3/de4/leb 0 2023-12-16T07:40:23.756 INFO:tasks.workunit.client.0.smithi049.stdout:5/710: getdents d5/de/d54/d57/dfa/d20 0 2023-12-16T07:40:23.756 INFO:tasks.workunit.client.0.smithi049.stdout:5/711: chown d5/de/d54/d5c/lb3 38064066 1 2023-12-16T07:40:23.756 INFO:tasks.workunit.client.0.smithi049.stdout:9/575: mknod d4/cba 0 2023-12-16T07:40:23.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/712: dread d5/de/d54/d57/dfa/d20/f6d [0,4194304] 0 2023-12-16T07:40:23.761 INFO:tasks.workunit.client.0.smithi049.stdout:1/699: mknod d20/d41/d4f/d55/d82/cf2 0 2023-12-16T07:40:23.761 INFO:tasks.workunit.client.0.smithi049.stdout:5/713: fsync d5/de/d54/d57/dfa/d21/d4e/f9d 0 2023-12-16T07:40:23.763 INFO:tasks.workunit.client.0.smithi049.stdout:7/693: creat d7/dc/dd/d27/dba/fec x:0 0 0 2023-12-16T07:40:23.763 INFO:tasks.workunit.client.0.smithi049.stdout:1/700: write f2 [3457698,27020] 0 2023-12-16T07:40:23.763 INFO:tasks.workunit.client.0.smithi049.stdout:7/694: stat d7/dc/dd/d27/laa 0 2023-12-16T07:40:23.763 INFO:tasks.workunit.client.0.smithi049.stdout:1/701: dread - d20/d41/d4f/d55/d82/dc5/fd1 zero size 2023-12-16T07:40:23.764 INFO:tasks.workunit.client.0.smithi049.stdout:0/855: dread d13/d3c/fc8 [0,4194304] 0 2023-12-16T07:40:23.765 INFO:tasks.workunit.client.0.smithi049.stdout:5/714: creat d5/de/d54/ffb x:0 0 0 2023-12-16T07:40:23.765 INFO:tasks.workunit.client.0.smithi049.stdout:5/715: dread - d5/f3e zero size 2023-12-16T07:40:23.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/695: creat d7/fed x:0 0 0 2023-12-16T07:40:23.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/696: read d7/dc/dd/d35/f97 [348455,88724] 0 2023-12-16T07:40:23.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/697: stat d7/dc/dd/d27/fb5 0 2023-12-16T07:40:23.768 INFO:tasks.workunit.client.0.smithi049.stdout:1/702: rename d20/d41/d4f/fd5 to d20/d41/dab/ff3 0 2023-12-16T07:40:23.774 INFO:tasks.workunit.client.0.smithi049.stdout:1/703: rename fc to d20/d41/d4f/d55/d7f/ff4 0 2023-12-16T07:40:23.774 INFO:tasks.workunit.client.0.smithi049.stdout:9/576: dwrite f0 [0,4194304] 0 2023-12-16T07:40:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:9/577: write d4/d7/d11/db3/d59/f70 [3199015,1449] 0 2023-12-16T07:40:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:5/716: rename d5/c28 to d5/de/d54/d57/dfa/d20/cfc 0 2023-12-16T07:40:23.775 INFO:tasks.workunit.client.0.smithi049.stdout:0/856: dread d13/d21/d99/d46/d65/d82/ddb/ff7 [0,4194304] 0 2023-12-16T07:40:23.776 INFO:tasks.workunit.client.0.smithi049.stdout:0/857: write d13/d21/d99/d46/f9d [963918,110733] 0 2023-12-16T07:40:23.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/704: write d20/d40/f5f [1385933,28892] 0 2023-12-16T07:40:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:5/717: write d5/de/d54/d67/f7e [149037,66814] 0 2023-12-16T07:40:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:5/718: fdatasync d5/de/d1c/d62/f6a 0 2023-12-16T07:40:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:5/719: fsync d5/de/d54/d67/da0/fea 0 2023-12-16T07:40:23.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/858: unlink d13/d21/c25 0 2023-12-16T07:40:23.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/859: chown d13/d21/d27/d2c/d62/f94 767049282 1 2023-12-16T07:40:23.784 INFO:tasks.workunit.client.0.smithi049.stdout:9/578: dread d4/ff [0,4194304] 0 2023-12-16T07:40:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/579: truncate d4/db/f66 583130 0 2023-12-16T07:40:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/580: fdatasync d4/d7/d11/d1d/d69/d76/d83/faf 0 2023-12-16T07:40:23.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/701: sync 2023-12-16T07:40:23.794 INFO:tasks.workunit.client.0.smithi049.stdout:9/581: unlink d4/d3e/f4e 0 2023-12-16T07:40:23.795 INFO:tasks.workunit.client.0.smithi049.stdout:9/582: write d4/d7/d11/db3/d8a/fa5 [931827,102116] 0 2023-12-16T07:40:23.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/583: dread d4/d7/d11/d1d/f64 [0,4194304] 0 2023-12-16T07:40:23.800 INFO:tasks.workunit.client.0.smithi049.stdout:8/702: dread d0/d13/fd [0,4194304] 0 2023-12-16T07:40:23.801 INFO:tasks.workunit.client.0.smithi049.stdout:9/584: dread f0 [0,4194304] 0 2023-12-16T07:40:23.802 INFO:tasks.workunit.client.0.smithi049.stdout:9/585: rename d4/d7/d11/db3/cb9 to d4/d7/d11/d26/cbb 0 2023-12-16T07:40:23.803 INFO:tasks.workunit.client.0.smithi049.stdout:9/586: write d4/d7/d11/db3/d8a/f89 [882000,128241] 0 2023-12-16T07:40:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:9/587: unlink d4/d7/d11/d26/l90 0 2023-12-16T07:40:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:9/588: fsync d4/d7/fb6 0 2023-12-16T07:40:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:8/703: dread d0/d13/fd [0,4194304] 0 2023-12-16T07:40:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:9/589: rmdir d4/d7/d11/d1d/d9b 39 2023-12-16T07:40:23.804 INFO:tasks.workunit.client.0.smithi049.stdout:9/590: dread - d4/d7/d11/d1d/d69/d76/f9a zero size 2023-12-16T07:40:23.805 INFO:tasks.workunit.client.0.smithi049.stdout:9/591: stat d4/l8e 0 2023-12-16T07:40:23.806 INFO:tasks.workunit.client.0.smithi049.stdout:9/592: mkdir d4/d7/d11/d26/d80/dbc 0 2023-12-16T07:40:23.809 INFO:tasks.workunit.client.0.smithi049.stdout:7/698: dwrite d7/dc/dd/d27/d8e/f90 [0,4194304] 0 2023-12-16T07:40:23.811 INFO:tasks.workunit.client.0.smithi049.stdout:0/860: dwrite d13/d21/f2a [0,4194304] 0 2023-12-16T07:40:23.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/705: dwrite d20/d41/d4f/d55/d7f/f80 [0,4194304] 0 2023-12-16T07:40:23.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/706: chown d20/de4 6 1 2023-12-16T07:40:23.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/720: dwrite d5/de/d54/d57/dfa/d21/d58/d65/dae/fd5 [0,4194304] 0 2023-12-16T07:40:23.815 INFO:tasks.workunit.client.0.smithi049.stdout:7/699: rename d7/da5 to d7/dc/dd/d27/dba/dee 0 2023-12-16T07:40:23.815 INFO:tasks.workunit.client.0.smithi049.stdout:5/721: chown d5/de/d54/d57/d3c/d82/cd2 14791 1 2023-12-16T07:40:23.815 INFO:tasks.workunit.client.0.smithi049.stdout:5/722: chown d5/de/d54/d67/da0/fc0 741 1 2023-12-16T07:40:23.815 INFO:tasks.workunit.client.0.smithi049.stdout:7/700: readlink d7/dc/d15/d57/la1 0 2023-12-16T07:40:23.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/704: dwrite d0/f12 [0,4194304] 0 2023-12-16T07:40:23.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/707: unlink d20/d45/d47/led 0 2023-12-16T07:40:23.830 INFO:tasks.workunit.client.0.smithi049.stdout:7/701: symlink d7/dc/d6b/dbf/dd3/de4/lef 0 2023-12-16T07:40:23.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/723: creat d5/de/d54/d67/da0/ffd x:0 0 0 2023-12-16T07:40:23.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/724: fsync d5/de/d54/d78/fe3 0 2023-12-16T07:40:23.835 INFO:tasks.workunit.client.0.smithi049.stdout:0/861: dwrite f4 [0,4194304] 0 2023-12-16T07:40:23.837 INFO:tasks.workunit.client.0.smithi049.stdout:8/705: rename d0/d13/d42/d5b/dab/d89 to d0/d6a/dda 0 2023-12-16T07:40:23.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/708: mknod d20/d43/cf5 0 2023-12-16T07:40:23.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/709: truncate d20/feb 277830 0 2023-12-16T07:40:23.837 INFO:tasks.workunit.client.0.smithi049.stdout:7/702: symlink d7/dc/d15/d66/lf0 0 2023-12-16T07:40:23.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/725: creat d5/de/d54/da9/ffe x:0 0 0 2023-12-16T07:40:23.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/862: mknod d13/d39/d78/d83/dfc/d128/c12e 0 2023-12-16T07:40:23.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/706: creat d0/d1f/fdb x:0 0 0 2023-12-16T07:40:23.841 INFO:tasks.workunit.client.0.smithi049.stdout:8/707: stat d0/d13/d42/d5b/d68/d6b/dd6 0 2023-12-16T07:40:23.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/710: rename d20/d41/d4f/d7c/fb7 to d20/d41/d52/d86/ff6 0 2023-12-16T07:40:23.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/711: chown d20/d41/d4f/d55/d82/dc5 52467 1 2023-12-16T07:40:23.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/863: rename d13/d21/f105 to d13/d21/f12f 0 2023-12-16T07:40:23.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/708: rmdir d0/d1f/d1c 39 2023-12-16T07:40:23.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/709: readlink d0/d13/d42/d5b/l80 0 2023-12-16T07:40:23.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/710: write d0/d13/d42/d5b/f63 [307662,91907] 0 2023-12-16T07:40:23.848 INFO:tasks.workunit.client.0.smithi049.stdout:7/703: dread d7/d2b/d59/f5e [0,4194304] 0 2023-12-16T07:40:23.849 INFO:tasks.workunit.client.0.smithi049.stdout:0/864: truncate d13/d21/d99/d46/d65/d82/ddb/fdd 1167773 0 2023-12-16T07:40:23.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/865: write d13/d21/d27/f11c [340903,62177] 0 2023-12-16T07:40:23.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/866: stat d13/d39/d78/d83/db2/cd2 0 2023-12-16T07:40:23.850 INFO:tasks.workunit.client.0.smithi049.stdout:7/704: creat d7/dc/dd/d14/ff1 x:0 0 0 2023-12-16T07:40:23.852 INFO:tasks.workunit.client.0.smithi049.stdout:0/867: creat d13/d21/d99/d46/d124/f130 x:0 0 0 2023-12-16T07:40:23.854 INFO:tasks.workunit.client.0.smithi049.stdout:7/705: mknod d7/dc/d6b/cf2 0 2023-12-16T07:40:23.855 INFO:tasks.workunit.client.0.smithi049.stdout:0/868: creat d13/d21/d2f/d7d/f131 x:0 0 0 2023-12-16T07:40:23.855 INFO:tasks.workunit.client.0.smithi049.stdout:0/869: readlink d13/d39/d78/d83/l106 0 2023-12-16T07:40:23.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/706: write d7/dc/d2f/d38/f63 [2051497,107356] 0 2023-12-16T07:40:23.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/707: creat d7/dc/d15/d57/dc8/ff3 x:0 0 0 2023-12-16T07:40:23.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/708: dread - d7/dc/d15/d57/fa2 zero size 2023-12-16T07:40:23.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/709: chown d7/d2b/c30 12904 1 2023-12-16T07:40:23.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/710: dread - d7/dc/d2f/d38/fdc zero size 2023-12-16T07:40:23.862 INFO:tasks.workunit.client.0.smithi049.stdout:0/870: dread d13/d21/d2f/fa6 [0,4194304] 0 2023-12-16T07:40:23.863 INFO:tasks.workunit.client.0.smithi049.stdout:7/711: creat d7/dc/dd/d37/d5c/ff4 x:0 0 0 2023-12-16T07:40:23.865 INFO:tasks.workunit.client.0.smithi049.stdout:0/871: creat d13/d39/df3/d11e/d10d/f132 x:0 0 0 2023-12-16T07:40:23.866 INFO:tasks.workunit.client.0.smithi049.stdout:7/712: creat d7/dc/d2f/d40/d5d/ff5 x:0 0 0 2023-12-16T07:40:23.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/713: getdents d7/dc/dd 0 2023-12-16T07:40:23.872 INFO:tasks.workunit.client.0.smithi049.stdout:3/542: sync 2023-12-16T07:40:23.873 INFO:tasks.workunit.client.0.smithi049.stdout:6/771: sync 2023-12-16T07:40:23.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/647: sync 2023-12-16T07:40:23.873 INFO:tasks.workunit.client.0.smithi049.stdout:2/644: sync 2023-12-16T07:40:23.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/648: chown d2/db/dd/de/d1e/d37/fbf 58534428 1 2023-12-16T07:40:23.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/543: read d1/f26 [2950915,53843] 0 2023-12-16T07:40:23.874 INFO:tasks.workunit.client.0.smithi049.stdout:6/772: symlink d0/d39/d5b/d65/d58/lf6 0 2023-12-16T07:40:23.874 INFO:tasks.workunit.client.0.smithi049.stdout:6/773: fsync d0/d2/f9 0 2023-12-16T07:40:23.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/544: mkdir d1/d2a/d37/d3f/d5a/d61/d6b/db5 0 2023-12-16T07:40:23.875 INFO:tasks.workunit.client.0.smithi049.stdout:4/649: mknod d2/db/cd6 0 2023-12-16T07:40:23.875 INFO:tasks.workunit.client.0.smithi049.stdout:4/650: write d2/db/dd/de/d1e/d37/f38 [5027207,108350] 0 2023-12-16T07:40:23.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/651: creat d2/db/d6b/dad/fd7 x:0 0 0 2023-12-16T07:40:23.881 INFO:tasks.workunit.client.0.smithi049.stdout:5/726: dwrite d5/de/d1c/f55 [4194304,4194304] 0 2023-12-16T07:40:23.881 INFO:tasks.workunit.client.0.smithi049.stdout:5/727: fsync d5/fb 0 2023-12-16T07:40:23.884 INFO:tasks.workunit.client.0.smithi049.stdout:8/711: dwrite d0/d13/d42/d5b/d68/f8e [0,4194304] 0 2023-12-16T07:40:23.884 INFO:tasks.workunit.client.0.smithi049.stdout:8/712: chown d0/d13/d42/c69 72 1 2023-12-16T07:40:23.889 INFO:tasks.workunit.client.0.smithi049.stdout:2/645: dread d2/de/f86 [0,4194304] 0 2023-12-16T07:40:23.889 INFO:tasks.workunit.client.0.smithi049.stdout:1/712: dwrite d20/d45/d47/f65 [0,4194304] 0 2023-12-16T07:40:23.889 INFO:tasks.workunit.client.0.smithi049.stdout:2/646: chown d2/d1d/d24/d55/d76/fa2 361 1 2023-12-16T07:40:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:1/713: truncate d20/d41/fcf 110258 0 2023-12-16T07:40:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:2/647: truncate d2/d26/d6e/fdc 281232 0 2023-12-16T07:40:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:5/728: read d5/de/d54/d67/f7b [2952690,74762] 0 2023-12-16T07:40:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:2/648: write d2/f17 [4298529,46438] 0 2023-12-16T07:40:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:2/649: chown d2/f17 817253923 1 2023-12-16T07:40:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:2/650: dread - d2/d1d/f89 zero size 2023-12-16T07:40:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:2/651: chown d2/d1d/d24/d55/d7c 1033 1 2023-12-16T07:40:23.892 INFO:tasks.workunit.client.0.smithi049.stdout:1/714: creat d20/de4/ff7 x:0 0 0 2023-12-16T07:40:23.893 INFO:tasks.workunit.client.0.smithi049.stdout:2/652: dread d2/d1d/d28/d56/d66/d6b/f94 [0,4194304] 0 2023-12-16T07:40:23.894 INFO:tasks.workunit.client.0.smithi049.stdout:2/653: stat d2/d26/d43/l9c 0 2023-12-16T07:40:23.897 INFO:tasks.workunit.client.0.smithi049.stdout:2/654: rmdir d2/de/d77 39 2023-12-16T07:40:23.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/655: creat d2/d1d/d24/d55/fe3 x:0 0 0 2023-12-16T07:40:23.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/656: truncate d2/d1d/d28/d56/d71/f9f 331784 0 2023-12-16T07:40:23.902 INFO:tasks.workunit.client.0.smithi049.stdout:2/657: symlink d2/d1d/d24/d55/d7c/d98/da1/le4 0 2023-12-16T07:40:23.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/658: mknod d2/d26/d6e/ce5 0 2023-12-16T07:40:23.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/659: truncate d2/d26/d6e/fdc 281430 0 2023-12-16T07:40:23.904 INFO:tasks.workunit.client.0.smithi049.stdout:2/660: chown d2/d26/d43/l75 403183 1 2023-12-16T07:40:23.904 INFO:tasks.workunit.client.0.smithi049.stdout:2/661: truncate d2/d26/d6e/f7b 2107083 0 2023-12-16T07:40:23.904 INFO:tasks.workunit.client.0.smithi049.stdout:2/662: chown d2/d26/l72 152437904 1 2023-12-16T07:40:23.904 INFO:tasks.workunit.client.0.smithi049.stdout:2/663: mkdir d2/d26/de6 0 2023-12-16T07:40:23.905 INFO:tasks.workunit.client.0.smithi049.stdout:2/664: mknod d2/d1d/d28/d56/d71/ce7 0 2023-12-16T07:40:23.907 INFO:tasks.workunit.client.0.smithi049.stdout:0/872: dwrite d13/d21/d99/d46/d65/d82/fc0 [0,4194304] 0 2023-12-16T07:40:23.913 INFO:tasks.workunit.client.0.smithi049.stdout:0/873: rename d13/d3c/fc8 to d13/d39/d38/d7e/d8b/f133 0 2023-12-16T07:40:23.914 INFO:tasks.workunit.client.0.smithi049.stdout:0/874: rmdir d13/d39/d78 39 2023-12-16T07:40:23.914 INFO:tasks.workunit.client.0.smithi049.stdout:3/545: dread d1/d2a/d37/d3f/d5a/d61/d6b/fa6 [0,4194304] 0 2023-12-16T07:40:23.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/774: dwrite d0/d39/d5b/d65/d53/f5f [0,4194304] 0 2023-12-16T07:40:23.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/775: creat d0/d39/d5b/d65/d4c/ff7 x:0 0 0 2023-12-16T07:40:23.918 INFO:tasks.workunit.client.0.smithi049.stdout:6/776: creat d0/d2/df/d81/ff8 x:0 0 0 2023-12-16T07:40:23.918 INFO:tasks.workunit.client.0.smithi049.stdout:1/715: dwrite d20/d41/d4f/d55/d7f/d84/fcb [0,4194304] 0 2023-12-16T07:40:23.918 INFO:tasks.workunit.client.0.smithi049.stdout:4/652: dwrite d2/db/f15 [0,4194304] 0 2023-12-16T07:40:23.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/546: dread d1/f25 [0,4194304] 0 2023-12-16T07:40:23.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/777: unlink d0/f40 0 2023-12-16T07:40:23.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/778: chown d0/d2/dd7 126605611 1 2023-12-16T07:40:23.922 INFO:tasks.workunit.client.0.smithi049.stdout:2/665: write d2/d1d/d28/d56/d71/f9f [1147297,100398] 0 2023-12-16T07:40:23.929 INFO:tasks.workunit.client.0.smithi049.stdout:4/653: getdents d2/db/d6b/dad 0 2023-12-16T07:40:23.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/716: getdents d20/d7b/d88 0 2023-12-16T07:40:23.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/717: chown d20/d40/f81 7 1 2023-12-16T07:40:23.932 INFO:tasks.workunit.client.0.smithi049.stdout:6/779: rename d0/d39/d5b/d65/d53/c97 to d0/d39/d5b/d65/dc1/cf9 0 2023-12-16T07:40:23.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/666: link d2/d1d/f68 d2/d1d/d28/d8b/fe8 0 2023-12-16T07:40:23.935 INFO:tasks.workunit.client.0.smithi049.stdout:4/654: unlink d2/db/dd/de/d1e/d44/l50 0 2023-12-16T07:40:23.936 INFO:tasks.workunit.client.0.smithi049.stdout:1/718: creat d20/d41/d4f/d7c/ff8 x:0 0 0 2023-12-16T07:40:23.937 INFO:tasks.workunit.client.0.smithi049.stdout:6/780: mknod d0/d2/df/d81/cfa 0 2023-12-16T07:40:23.937 INFO:tasks.workunit.client.0.smithi049.stdout:2/667: symlink d2/d1d/dc2/le9 0 2023-12-16T07:40:23.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/719: truncate d20/d41/d4f/d55/d7f/f80 861005 0 2023-12-16T07:40:23.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/720: write d20/f33 [8655320,79429] 0 2023-12-16T07:40:23.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/721: read - d20/d7b/d88/ff0 zero size 2023-12-16T07:40:23.939 INFO:tasks.workunit.client.0.smithi049.stdout:6/781: mkdir d0/d39/d5b/d65/d4c/d4d/d6a/de9/dfb 0 2023-12-16T07:40:23.939 INFO:tasks.workunit.client.0.smithi049.stdout:6/782: readlink d0/d39/d5b/d65/d27/d91/la8 0 2023-12-16T07:40:23.940 INFO:tasks.workunit.client.0.smithi049.stdout:0/875: dwrite d13/d21/d99/d46/d65/d82/ddb/ff7 [0,4194304] 0 2023-12-16T07:40:23.940 INFO:tasks.workunit.client.0.smithi049.stdout:0/876: chown d13/d21/d2f/d7d/d90/f117 247841595 1 2023-12-16T07:40:23.940 INFO:tasks.workunit.client.0.smithi049.stdout:0/877: write d13/d39/d78/d83/db2/fc6 [404342,121308] 0 2023-12-16T07:40:23.940 INFO:tasks.workunit.client.0.smithi049.stdout:4/655: dread d2/db/dd/d52/f6a [0,4194304] 0 2023-12-16T07:40:23.940 INFO:tasks.workunit.client.0.smithi049.stdout:2/668: mknod d2/d26/de6/cea 0 2023-12-16T07:40:23.940 INFO:tasks.workunit.client.0.smithi049.stdout:2/669: write d2/d1d/d28/d56/d11/fac [262822,6126] 0 2023-12-16T07:40:23.940 INFO:tasks.workunit.client.0.smithi049.stdout:3/547: dwrite d1/d2a/d37/d3f/d5a/d5b/f99 [0,4194304] 0 2023-12-16T07:40:23.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/783: link d0/d39/d5b/d65/d58/d2c/ldf d0/d39/d5b/d65/d4c/d4d/d6a/dd6/lfc 0 2023-12-16T07:40:23.947 INFO:tasks.workunit.client.0.smithi049.stdout:4/656: symlink d2/db/dd/ld8 0 2023-12-16T07:40:23.947 INFO:tasks.workunit.client.0.smithi049.stdout:0/878: creat d13/d21/d99/d46/d124/f134 x:0 0 0 2023-12-16T07:40:23.950 INFO:tasks.workunit.client.0.smithi049.stdout:3/548: dread d1/d2b/f65 [0,4194304] 0 2023-12-16T07:40:23.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/670: dwrite d2/de/d78/fb4 [0,4194304] 0 2023-12-16T07:40:23.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:23 smithi049 ceph-mon[111939]: pgmap v8: 65 pgs: 65 active+clean; 837 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 103 MiB/s wr, 193 op/s 2023-12-16T07:40:23.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/784: truncate d0/d39/d5b/f74 2995036 0 2023-12-16T07:40:23.962 INFO:tasks.workunit.client.0.smithi049.stdout:0/879: rename d13/d21/d99/d46/d124/f130 to d13/d21/d2f/f135 0 2023-12-16T07:40:23.965 INFO:tasks.workunit.client.0.smithi049.stdout:2/671: symlink d2/d1d/d28/d56/d11/leb 0 2023-12-16T07:40:23.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/785: mkdir d0/d39/d5b/d65/d4c/d4d/d6a/de9/dfd 0 2023-12-16T07:40:23.967 INFO:tasks.workunit.client.0.smithi049.stdout:0/880: mknod d13/d39/d8a/c136 0 2023-12-16T07:40:23.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/881: rename d13/d21/d2f/d7d/da0/dc9/f12c to d13/d39/d78/d83/f137 0 2023-12-16T07:40:23.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/882: chown d13/d21/d27/d2c/d62/d70/f115 41 1 2023-12-16T07:40:23.971 INFO:tasks.workunit.client.0.smithi049.stdout:0/883: write d13/d21/d2f/fa6 [877168,46805] 0 2023-12-16T07:40:23.971 INFO:tasks.workunit.client.0.smithi049.stdout:0/884: dread - d13/d39/d78/d83/f137 zero size 2023-12-16T07:40:23.973 INFO:tasks.workunit.client.0.smithi049.stdout:0/885: creat d13/d21/d2f/d7d/d90/f138 x:0 0 0 2023-12-16T07:40:23.983 INFO:tasks.workunit.client.0.smithi049.stdout:3/549: dwrite d1/d2b/f65 [0,4194304] 0 2023-12-16T07:40:23.983 INFO:tasks.workunit.client.0.smithi049.stdout:4/657: dwrite d2/db/dd/f13 [4194304,4194304] 0 2023-12-16T07:40:23.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/658: read d2/db/dd/db7/fcb [819917,53130] 0 2023-12-16T07:40:23.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/659: write d2/db/dd/de/d1e/d44/fa6 [625359,101349] 0 2023-12-16T07:40:23.984 INFO:tasks.workunit.client.0.smithi049.stdout:3/550: dread d1/d2a/f47 [0,4194304] 0 2023-12-16T07:40:23.985 INFO:tasks.workunit.client.0.smithi049.stdout:4/660: truncate f1 1856462 0 2023-12-16T07:40:23.986 INFO:tasks.workunit.client.0.smithi049.stdout:3/551: truncate d1/d2b/f2d 1445345 0 2023-12-16T07:40:23.987 INFO:tasks.workunit.client.0.smithi049.stdout:4/661: creat d2/db/dd/db7/fd9 x:0 0 0 2023-12-16T07:40:23.987 INFO:tasks.workunit.client.0.smithi049.stdout:4/662: fdatasync d2/db/dd/f3d 0 2023-12-16T07:40:23.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/672: dwrite d2/d1d/d38/fbf [0,4194304] 0 2023-12-16T07:40:23.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/722: dread d20/d41/d4f/d55/d7f/f80 [0,4194304] 0 2023-12-16T07:40:23.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/723: dread - d20/d41/d52/d86/db1/fc9 zero size 2023-12-16T07:40:23.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/724: truncate d20/d43/f74 268697 0 2023-12-16T07:40:23.990 INFO:tasks.workunit.client.0.smithi049.stdout:3/552: rmdir d1/d2a 39 2023-12-16T07:40:23.991 INFO:tasks.workunit.client.0.smithi049.stdout:4/663: mkdir d2/db/dd/de/d1e/d21/dda 0 2023-12-16T07:40:23.995 INFO:tasks.workunit.client.0.smithi049.stdout:2/673: mknod d2/d1d/d38/cec 0 2023-12-16T07:40:23.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/725: mknod d20/d45/d47/cf9 0 2023-12-16T07:40:24.001 INFO:tasks.workunit.client.0.smithi049.stdout:3/553: rename d1/d2a/d37/d3f/d5a/d5b/d77/c85 to d1/d2a/d37/d3f/d5a/d61/d75/cb6 0 2023-12-16T07:40:24.001 INFO:tasks.workunit.client.0.smithi049.stdout:4/664: unlink d2/db/dd/de/d1e/d37/cd5 0 2023-12-16T07:40:24.001 INFO:tasks.workunit.client.0.smithi049.stdout:2/674: truncate d2/d1d/d24/f42 1995087 0 2023-12-16T07:40:24.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/726: truncate d20/f5b 888372 0 2023-12-16T07:40:24.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/665: mkdir d2/db/dd/de/d1e/d37/da4/ddb 0 2023-12-16T07:40:24.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/666: readlink d2/db/dd/de/d1e/d37/l45 0 2023-12-16T07:40:24.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/667: readlink d2/db/dd/de/d1e/d21/l77 0 2023-12-16T07:40:24.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/675: creat d2/d1d/d24/d55/d76/fed x:0 0 0 2023-12-16T07:40:24.005 INFO:tasks.workunit.client.0.smithi049.stdout:1/727: mkdir d20/d41/d4f/d7c/dfa 0 2023-12-16T07:40:24.006 INFO:tasks.workunit.client.0.smithi049.stdout:4/668: mknod d2/db/d6b/dc8/cdc 0 2023-12-16T07:40:24.006 INFO:tasks.workunit.client.0.smithi049.stdout:9/593: sync 2023-12-16T07:40:24.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/676: symlink d2/d1d/d28/d56/d71/lee 0 2023-12-16T07:40:24.010 INFO:tasks.workunit.client.0.smithi049.stdout:1/728: rename d20/f22 to d20/d41/dab/ffb 0 2023-12-16T07:40:24.013 INFO:tasks.workunit.client.0.smithi049.stdout:9/594: rename d4/d7/d11/d1d/l24 to d4/d7/d11/d1d/d48/lbd 0 2023-12-16T07:40:24.013 INFO:tasks.workunit.client.0.smithi049.stdout:9/595: chown d4/d7/d11/d26/cbb 35 1 2023-12-16T07:40:24.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/729: mkdir d20/d41/d4f/d55/d82/dd2/dfc 0 2023-12-16T07:40:24.014 INFO:tasks.workunit.client.0.smithi049.stdout:9/596: write d4/d7/d11/db3/f4f [1073,69552] 0 2023-12-16T07:40:24.016 INFO:tasks.workunit.client.0.smithi049.stdout:1/730: creat d20/d41/d4f/dec/ffd x:0 0 0 2023-12-16T07:40:24.016 INFO:tasks.workunit.client.0.smithi049.stdout:1/731: fdatasync d20/d41/d4f/d55/d7f/d84/fbf 0 2023-12-16T07:40:24.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/554: dread d1/d2a/d37/d3f/d5a/f6f [0,4194304] 0 2023-12-16T07:40:24.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/555: readlink d1/d2a/d37/d3f/d5a/d5b/d5e/l7b 0 2023-12-16T07:40:24.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/597: mkdir d4/d7/d11/d1d/d5b/dbe 0 2023-12-16T07:40:24.017 INFO:tasks.workunit.client.0.smithi049.stdout:1/732: dread d20/d43/f8c [0,4194304] 0 2023-12-16T07:40:24.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/598: rename d4/db/f66 to d4/d7/d11/d1d/d5b/dbe/fbf 0 2023-12-16T07:40:24.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/599: dread - d4/d7/d11/d26/f8c zero size 2023-12-16T07:40:24.020 INFO:tasks.workunit.client.0.smithi049.stdout:6/786: write d0/d2/df/d81/fa9 [885649,55053] 0 2023-12-16T07:40:24.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/733: symlink d20/d45/lfe 0 2023-12-16T07:40:24.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/734: stat d20/d7b/d88/fdf 0 2023-12-16T07:40:24.022 INFO:tasks.workunit.client.0.smithi049.stdout:9/600: creat d4/d7/fc0 x:0 0 0 2023-12-16T07:40:24.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/677: dwrite d2/d1d/d28/d56/d11/fdd [0,4194304] 0 2023-12-16T07:40:24.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/678: read - d2/d1d/d24/d55/d7c/d98/da1/fa7 zero size 2023-12-16T07:40:24.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/735: getdents d20/d41/d4f/d55/d7f/d84 0 2023-12-16T07:40:24.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/736: mknod d20/d7b/cff 0 2023-12-16T07:40:24.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/737: rename d20/f33 to d20/d41/d52/f100 0 2023-12-16T07:40:24.031 INFO:tasks.workunit.client.0.smithi049.stdout:2/679: dread d2/d1d/d28/d56/d11/fdd [0,4194304] 0 2023-12-16T07:40:24.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/738: write d20/d45/d77/fce [1124121,107334] 0 2023-12-16T07:40:24.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/739: fdatasync d20/f8e 0 2023-12-16T07:40:24.036 INFO:tasks.workunit.client.0.smithi049.stdout:1/740: rmdir d20/d41/de8 39 2023-12-16T07:40:24.037 INFO:tasks.workunit.client.0.smithi049.stdout:1/741: readlink d20/d41/d4f/d7c/ldd 0 2023-12-16T07:40:24.038 INFO:tasks.workunit.client.0.smithi049.stdout:1/742: symlink d20/d45/l101 0 2023-12-16T07:40:24.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/743: chown d20/c4e 21049488 1 2023-12-16T07:40:24.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/744: mkdir d20/d41/d4f/dec/d102 0 2023-12-16T07:40:24.040 INFO:tasks.workunit.client.0.smithi049.stdout:3/556: dwrite d1/d2a/d37/d3f/f41 [0,4194304] 0 2023-12-16T07:40:24.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/745: mknod d20/d45/d77/c103 0 2023-12-16T07:40:24.042 INFO:tasks.workunit.client.0.smithi049.stdout:3/557: mkdir d1/d2a/d37/d3f/d5a/d61/d75/db7 0 2023-12-16T07:40:24.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/558: chown d1/d2a/d37/c49 169156 1 2023-12-16T07:40:24.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/559: fsync d1/d2a/d37/d3f/d4c/f90 0 2023-12-16T07:40:24.046 INFO:tasks.workunit.client.0.smithi049.stdout:3/560: write d1/d2b/f58 [2151653,121746] 0 2023-12-16T07:40:24.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/746: creat d20/d41/d4f/dec/d102/f104 x:0 0 0 2023-12-16T07:40:24.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/747: chown d20/d45/d47/f56 838067893 1 2023-12-16T07:40:24.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/748: read - d20/de4/ff7 zero size 2023-12-16T07:40:24.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/561: rmdir d1/d2a/d37 39 2023-12-16T07:40:24.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/562: read d1/d2a/d37/d3f/f59 [385811,22840] 0 2023-12-16T07:40:24.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/563: readlink d1/d2a/d37/d3f/d5a/d5b/d5e/lae 0 2023-12-16T07:40:24.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/749: rmdir d20/d40/d6f/dac 39 2023-12-16T07:40:24.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/750: dread - d20/d41/d52/d86/db1/fd7 zero size 2023-12-16T07:40:24.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/751: fsync d20/d40/d6f/dac/fd0 0 2023-12-16T07:40:24.049 INFO:tasks.workunit.client.0.smithi049.stdout:3/564: mknod d1/d2a/d37/d3f/d5a/d5b/d77/cb8 0 2023-12-16T07:40:24.051 INFO:tasks.workunit.client.0.smithi049.stdout:1/752: mkdir d20/d41/d4f/d7c/d105 0 2023-12-16T07:40:24.051 INFO:tasks.workunit.client.0.smithi049.stdout:1/753: fsync d20/d41/d4f/d55/d58/f5d 0 2023-12-16T07:40:24.051 INFO:tasks.workunit.client.0.smithi049.stdout:1/754: write d20/feb [896447,76186] 0 2023-12-16T07:40:24.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/755: rename d20/d7b/d88 to d20/d41/d4f/d55/d7f/d106 0 2023-12-16T07:40:24.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/756: read - d20/d41/d4f/d55/d82/dc5/fd1 zero size 2023-12-16T07:40:24.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/757: fdatasync f14 0 2023-12-16T07:40:24.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/758: write d20/d41/d52/d86/db1/fd7 [60370,76241] 0 2023-12-16T07:40:24.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/759: dwrite d20/d45/d47/f9d [0,4194304] 0 2023-12-16T07:40:24.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/760: stat d20/d45/fcd 0 2023-12-16T07:40:24.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/761: dread - d20/d41/d4f/d55/d82/dd2/fe6 zero size 2023-12-16T07:40:24.084 INFO:tasks.workunit.client.0.smithi049.stdout:9/601: dwrite d4/d7/d11/db3/d8a/f61 [0,4194304] 0 2023-12-16T07:40:24.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/762: write fe [1031572,10632] 0 2023-12-16T07:40:24.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/763: fsync d20/d41/d4f/d55/fc1 0 2023-12-16T07:40:24.085 INFO:tasks.workunit.client.0.smithi049.stdout:3/565: dread d1/d2a/d37/d3f/d5a/d5b/d5e/fb2 [0,4194304] 0 2023-12-16T07:40:24.085 INFO:tasks.workunit.client.0.smithi049.stdout:3/566: chown d1/c9b 195 1 2023-12-16T07:40:24.087 INFO:tasks.workunit.client.0.smithi049.stdout:3/567: mkdir d1/d2a/d37/db9 0 2023-12-16T07:40:24.091 INFO:tasks.workunit.client.0.smithi049.stdout:9/602: dread d4/d7/d11/d1d/f25 [0,4194304] 0 2023-12-16T07:40:24.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/764: dwrite f1b [0,4194304] 0 2023-12-16T07:40:24.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/765: truncate d20/d40/f81 641840 0 2023-12-16T07:40:24.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/568: dwrite d1/d2a/d37/d3f/d5a/d6d/f84 [0,4194304] 0 2023-12-16T07:40:24.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/766: creat d20/d41/d52/d86/dd9/f107 x:0 0 0 2023-12-16T07:40:24.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/569: rmdir d1/d2a/d37/d3f/d5a/d5b/d5e/dad 0 2023-12-16T07:40:24.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/570: creat d1/d2b/fba x:0 0 0 2023-12-16T07:40:24.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/571: fdatasync d1/d2a/d37/d3f/d4c/f79 0 2023-12-16T07:40:24.111 INFO:tasks.workunit.client.0.smithi049.stdout:3/572: rmdir d1/d2a/d37/d3f/d5a 39 2023-12-16T07:40:24.112 INFO:tasks.workunit.client.0.smithi049.stdout:1/767: dread d20/d41/dab/ffb [0,4194304] 0 2023-12-16T07:40:24.112 INFO:tasks.workunit.client.0.smithi049.stdout:1/768: write d20/d41/d4f/d55/d7f/f80 [1343179,116791] 0 2023-12-16T07:40:24.112 INFO:tasks.workunit.client.0.smithi049.stdout:3/573: creat d1/d2a/d37/d3f/d4c/fbb x:0 0 0 2023-12-16T07:40:24.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/769: mknod d20/d7b/d71/c108 0 2023-12-16T07:40:24.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/770: rmdir d20/d41/d4f/dec/d102 39 2023-12-16T07:40:24.117 INFO:tasks.workunit.client.0.smithi049.stdout:3/574: getdents d1/d2a/d37/d3f/d4c 0 2023-12-16T07:40:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:23 smithi133 ceph-mon[120445]: pgmap v8: 65 pgs: 65 active+clean; 837 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 103 MiB/s wr, 193 op/s 2023-12-16T07:40:24.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/575: symlink d1/d2a/d37/db9/lbc 0 2023-12-16T07:40:24.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/576: chown d1/l1d 6 1 2023-12-16T07:40:24.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/577: truncate d1/d2a/f40 581564 0 2023-12-16T07:40:24.119 INFO:tasks.workunit.client.0.smithi049.stdout:3/578: fsync d1/d2a/d37/d3f/d5a/d6d/d96/f9d 0 2023-12-16T07:40:24.143 INFO:tasks.workunit.client.0.smithi049.stdout:3/579: dwrite d1/d2a/d37/d3f/d5a/d61/d6b/fac [0,4194304] 0 2023-12-16T07:40:24.156 INFO:tasks.workunit.client.0.smithi049.stdout:3/580: dwrite d1/d2b/fba [0,4194304] 0 2023-12-16T07:40:24.156 INFO:tasks.workunit.client.0.smithi049.stdout:3/581: readlink d1/d2a/l7f 0 2023-12-16T07:40:24.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/582: mknod d1/d2a/d37/d3f/d5a/d61/d75/cbd 0 2023-12-16T07:40:24.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/583: rename d1/d2b/l35 to d1/d2a/d37/d3f/d5a/d61/d6b/lbe 0 2023-12-16T07:40:24.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/584: creat d1/d2a/d37/d3f/d5a/d5b/d77/fbf x:0 0 0 2023-12-16T07:40:24.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/585: fsync d1/d2a/d37/d3f/d4c/f90 0 2023-12-16T07:40:24.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/586: unlink d1/d2a/d37/d3f/d5a/d6d/f82 0 2023-12-16T07:40:24.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/587: read d1/d2a/d37/d3f/f41 [4140481,86631] 0 2023-12-16T07:40:24.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/588: dread - d1/d2a/d37/d3f/d5a/d5b/d5e/f91 zero size 2023-12-16T07:40:24.165 INFO:tasks.workunit.client.0.smithi049.stdout:3/589: symlink d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/daf/lc0 0 2023-12-16T07:40:24.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/590: link d1/d2a/d37/d3f/l45 d1/d2a/d37/d3f/d5a/d61/d75/db7/lc1 0 2023-12-16T07:40:24.168 INFO:tasks.workunit.client.0.smithi049.stdout:6/787: sync 2023-12-16T07:40:24.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/886: sync 2023-12-16T07:40:24.168 INFO:tasks.workunit.client.0.smithi049.stdout:8/713: sync 2023-12-16T07:40:24.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/669: sync 2023-12-16T07:40:24.168 INFO:tasks.workunit.client.0.smithi049.stdout:5/729: sync 2023-12-16T07:40:24.168 INFO:tasks.workunit.client.0.smithi049.stdout:7/714: sync 2023-12-16T07:40:24.168 INFO:tasks.workunit.client.0.smithi049.stdout:8/714: write d0/d13/fd [5290797,58964] 0 2023-12-16T07:40:24.169 INFO:tasks.workunit.client.0.smithi049.stdout:3/591: truncate d1/d2a/d37/d3f/d5a/d6d/f84 2382535 0 2023-12-16T07:40:24.170 INFO:tasks.workunit.client.0.smithi049.stdout:0/887: unlink d13/d39/d38/da7/l108 0 2023-12-16T07:40:24.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/715: link d7/dc/f25 d7/dc/d2f/d38/ff6 0 2023-12-16T07:40:24.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/716: fdatasync d7/dc/d15/d57/f98 0 2023-12-16T07:40:24.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/717: chown d7/dc/d15/d57/c92 195 1 2023-12-16T07:40:24.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/730: symlink d5/de/d54/lff 0 2023-12-16T07:40:24.174 INFO:tasks.workunit.client.0.smithi049.stdout:6/788: dread d0/d39/f54 [0,4194304] 0 2023-12-16T07:40:24.175 INFO:tasks.workunit.client.0.smithi049.stdout:3/592: mkdir d1/d2a/d37/d3f/d5a/dc2 0 2023-12-16T07:40:24.177 INFO:tasks.workunit.client.0.smithi049.stdout:0/888: creat d13/d39/d8a/de7/f139 x:0 0 0 2023-12-16T07:40:24.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/718: mkdir d7/dc/d6b/dbf/dd3/de4/df7 0 2023-12-16T07:40:24.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/719: truncate d7/dc/d6b/fa4 889996 0 2023-12-16T07:40:24.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/720: stat d7/dc/d15/d66/c72 0 2023-12-16T07:40:24.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/721: dread - d7/dc/d6b/dbf/dd3/fe1 zero size 2023-12-16T07:40:24.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/722: write d7/dc/dd/d27/f95 [4519807,45990] 0 2023-12-16T07:40:24.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/723: chown d7/dc/d6b/f84 1802 1 2023-12-16T07:40:24.182 INFO:tasks.workunit.client.0.smithi049.stdout:5/731: symlink d5/de/d54/d78/d9b/dd1/l100 0 2023-12-16T07:40:24.184 INFO:tasks.workunit.client.0.smithi049.stdout:6/789: getdents d0/d39/d5b/d65/d4c/d4d 0 2023-12-16T07:40:24.186 INFO:tasks.workunit.client.0.smithi049.stdout:3/593: rename d1/d2a/d37/d3f/d5a/d5b/d5e/fb2 to d1/d2a/d37/d3f/d5a/d6d/fc3 0 2023-12-16T07:40:24.188 INFO:tasks.workunit.client.0.smithi049.stdout:7/724: symlink d7/dc/dd/d27/dba/lf8 0 2023-12-16T07:40:24.189 INFO:tasks.workunit.client.0.smithi049.stdout:7/725: dread - d7/dc/d15/fc0 zero size 2023-12-16T07:40:24.189 INFO:tasks.workunit.client.0.smithi049.stdout:7/726: chown d7/dc/d6b/c82 2 1 2023-12-16T07:40:24.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/732: rmdir d5/de/d1c/d62 39 2023-12-16T07:40:24.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/733: readlink d5/l7 0 2023-12-16T07:40:24.190 INFO:tasks.workunit.client.0.smithi049.stdout:6/790: mknod d0/d39/d5b/d65/d27/cfe 0 2023-12-16T07:40:24.191 INFO:tasks.workunit.client.0.smithi049.stdout:0/889: rename f4 to d13/d39/d38/f13a 0 2023-12-16T07:40:24.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/791: symlink d0/d39/d8b/deb/lff 0 2023-12-16T07:40:24.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/792: fsync d0/d39/d8b/fb4 0 2023-12-16T07:40:24.194 INFO:tasks.workunit.client.0.smithi049.stdout:0/890: getdents d13/d21/d99/d46 0 2023-12-16T07:40:24.194 INFO:tasks.workunit.client.0.smithi049.stdout:7/727: write d7/dc/dd/ff [36718,66631] 0 2023-12-16T07:40:24.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/728: fdatasync d7/dc/dd/d14/fb7 0 2023-12-16T07:40:24.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/729: read - d7/dc/d15/d57/fa2 zero size 2023-12-16T07:40:24.195 INFO:tasks.workunit.client.0.smithi049.stdout:6/793: mkdir d0/d39/d5b/d65/dc1/d100 0 2023-12-16T07:40:24.197 INFO:tasks.workunit.client.0.smithi049.stdout:0/891: creat d13/d21/d27/d2c/d62/d70/dff/f13b x:0 0 0 2023-12-16T07:40:24.197 INFO:tasks.workunit.client.0.smithi049.stdout:6/794: read d0/d2/df/d4e/d5d/d6f/d4a/f92 [3759182,91769] 0 2023-12-16T07:40:24.197 INFO:tasks.workunit.client.0.smithi049.stdout:6/795: readlink d0/d39/d5b/d65/d58/d33/daa/lbc 0 2023-12-16T07:40:24.199 INFO:tasks.workunit.client.0.smithi049.stdout:7/730: rename d7/dc/d6b/d70/fac to d7/dc/dd/d27/dba/dee/ff9 0 2023-12-16T07:40:24.200 INFO:tasks.workunit.client.0.smithi049.stdout:6/796: mkdir d0/d2/df/d4e/d5d/d6f/d4a/d101 0 2023-12-16T07:40:24.201 INFO:tasks.workunit.client.0.smithi049.stdout:7/731: truncate d7/dc/f1b 5718231 0 2023-12-16T07:40:24.202 INFO:tasks.workunit.client.0.smithi049.stdout:6/797: mkdir d0/d39/d5b/d102 0 2023-12-16T07:40:24.202 INFO:tasks.workunit.client.0.smithi049.stdout:7/732: creat d7/dc/dd/d27/dba/ffa x:0 0 0 2023-12-16T07:40:24.203 INFO:tasks.workunit.client.0.smithi049.stdout:4/670: dwrite d2/db/dd/de/d1e/d37/f38 [0,4194304] 0 2023-12-16T07:40:24.203 INFO:tasks.workunit.client.0.smithi049.stdout:7/733: stat d7/dc/dd/d37/d5c/db2/cd2 0 2023-12-16T07:40:24.203 INFO:tasks.workunit.client.0.smithi049.stdout:4/671: truncate d2/f86 746388 0 2023-12-16T07:40:24.206 INFO:tasks.workunit.client.0.smithi049.stdout:0/892: dread d13/d21/d2f/d7d/da0/f11a [0,4194304] 0 2023-12-16T07:40:24.212 INFO:tasks.workunit.client.0.smithi049.stdout:4/672: dread d2/db/dd/de/d1e/d21/f4f [0,4194304] 0 2023-12-16T07:40:24.212 INFO:tasks.workunit.client.0.smithi049.stdout:4/673: stat d2/db/dd/de/d1e/d37/d6f 0 2023-12-16T07:40:24.213 INFO:tasks.workunit.client.0.smithi049.stdout:8/715: dwrite d0/d1f/d4e/f96 [0,4194304] 0 2023-12-16T07:40:24.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/594: dwrite d1/d2a/d37/d3f/d5a/d5b/d77/fbf [0,4194304] 0 2023-12-16T07:40:24.214 INFO:tasks.workunit.client.0.smithi049.stdout:4/674: getdents d2/db/dd/d2a 0 2023-12-16T07:40:24.214 INFO:tasks.workunit.client.0.smithi049.stdout:4/675: readlink d2/l7 0 2023-12-16T07:40:24.215 INFO:tasks.workunit.client.0.smithi049.stdout:4/676: truncate d2/db/dd/de/d1e/d37/d4e/f89 1324150 0 2023-12-16T07:40:24.216 INFO:tasks.workunit.client.0.smithi049.stdout:5/734: dwrite d5/de/d54/f42 [0,4194304] 0 2023-12-16T07:40:24.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/735: write d5/de/d54/d57/dfa/f51 [2688063,2077] 0 2023-12-16T07:40:24.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/595: mkdir d1/d2a/d37/d3f/d5a/d5b/d77/dc4 0 2023-12-16T07:40:24.222 INFO:tasks.workunit.client.0.smithi049.stdout:4/677: rename d2/db/dd/de/c51 to d2/db/dd/de/d1e/d21/cdd 0 2023-12-16T07:40:24.222 INFO:tasks.workunit.client.0.smithi049.stdout:4/678: write d2/db/dd/de/d1e/d37/fbf [182340,128041] 0 2023-12-16T07:40:24.223 INFO:tasks.workunit.client.0.smithi049.stdout:0/893: dread d13/d39/dbe/fc3 [0,4194304] 0 2023-12-16T07:40:24.224 INFO:tasks.workunit.client.0.smithi049.stdout:4/679: dread d2/db/dd/d52/fa0 [0,4194304] 0 2023-12-16T07:40:24.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/680: write d2/db/dd/db7/fc1 [281991,24990] 0 2023-12-16T07:40:24.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/681: chown d2/db/dd/de/d1e/d37/d6f/c81 33 1 2023-12-16T07:40:24.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/682: write d2/db/dd/de/d1e/d37/da4/f7b [495857,2873] 0 2023-12-16T07:40:24.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/683: dread - d2/db/dd/de/d1e/f64 zero size 2023-12-16T07:40:24.226 INFO:tasks.workunit.client.0.smithi049.stdout:0/894: mknod d13/d39/d38/d7e/c13c 0 2023-12-16T07:40:24.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/895: write d13/d21/f12f [404,130357] 0 2023-12-16T07:40:24.227 INFO:tasks.workunit.client.0.smithi049.stdout:5/736: dread d5/de/d54/d57/d3c/f5d [0,4194304] 0 2023-12-16T07:40:24.227 INFO:tasks.workunit.client.0.smithi049.stdout:5/737: fdatasync d5/de/d54/d57/dfa/d21/fad 0 2023-12-16T07:40:24.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/596: write d1/d2a/d37/d3f/d5a/d5b/d77/fbf [713655,75620] 0 2023-12-16T07:40:24.229 INFO:tasks.workunit.client.0.smithi049.stdout:5/738: creat d5/de/d54/f101 x:0 0 0 2023-12-16T07:40:24.230 INFO:tasks.workunit.client.0.smithi049.stdout:5/739: mkdir d5/de/d1c/d102 0 2023-12-16T07:40:24.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/597: write d1/d2a/d37/d3f/d4c/f73 [3195346,90067] 0 2023-12-16T07:40:24.232 INFO:tasks.workunit.client.0.smithi049.stdout:5/740: link d5/de/d54/d57/f33 d5/de/d54/d57/dfa/f103 0 2023-12-16T07:40:24.232 INFO:tasks.workunit.client.0.smithi049.stdout:5/741: write d5/de/d54/d67/f7b [5074913,111688] 0 2023-12-16T07:40:24.239 INFO:tasks.workunit.client.0.smithi049.stdout:0/896: dread d13/d21/d99/d46/d65/f73 [0,4194304] 0 2023-12-16T07:40:24.239 INFO:tasks.workunit.client.0.smithi049.stdout:6/798: dwrite d0/d39/d5b/d65/d58/d2c/fc0 [0,4194304] 0 2023-12-16T07:40:24.239 INFO:tasks.workunit.client.0.smithi049.stdout:8/716: dwrite d0/d1f/d1c/f39 [0,4194304] 0 2023-12-16T07:40:24.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/598: dread d1/f26 [0,4194304] 0 2023-12-16T07:40:24.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/734: dwrite d7/dc/dd/d27/dba/ffa [0,4194304] 0 2023-12-16T07:40:24.240 INFO:tasks.workunit.client.0.smithi049.stdout:4/684: dwrite d2/db/dd/de/d1e/f2d [0,4194304] 0 2023-12-16T07:40:24.240 INFO:tasks.workunit.client.0.smithi049.stdout:4/685: stat d2/db/dd/de/d1e/d37/da4/l83 0 2023-12-16T07:40:24.243 INFO:tasks.workunit.client.0.smithi049.stdout:8/717: rename d0/d1f/d36/db8/fca to d0/d1f/db7/fdc 0 2023-12-16T07:40:24.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/599: dread d1/d2a/d37/d3f/d4c/f73 [0,4194304] 0 2023-12-16T07:40:24.258 INFO:tasks.workunit.client.0.smithi049.stdout:7/735: mknod d7/dc/d6b/d70/d86/cfb 0 2023-12-16T07:40:24.260 INFO:tasks.workunit.client.0.smithi049.stdout:6/799: rename d0/d2/f86 to d0/d2/df/d4e/d5d/d6f/d4a/da4/f103 0 2023-12-16T07:40:24.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/718: creat d0/d1f/d36/fdd x:0 0 0 2023-12-16T07:40:24.264 INFO:tasks.workunit.client.0.smithi049.stdout:3/600: link d1/d2a/d37/d3f/d5a/d61/f66 d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fc5 0 2023-12-16T07:40:24.265 INFO:tasks.workunit.client.0.smithi049.stdout:3/601: readlink d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/l97 0 2023-12-16T07:40:24.267 INFO:tasks.workunit.client.0.smithi049.stdout:6/800: rmdir d0/d39/d5b/d65/d4c/d4d/d6a/de9/dfd 0 2023-12-16T07:40:24.268 INFO:tasks.workunit.client.0.smithi049.stdout:5/742: dwrite d5/de/d54/d57/dfa/d21/f45 [0,4194304] 0 2023-12-16T07:40:24.269 INFO:tasks.workunit.client.0.smithi049.stdout:6/801: symlink d0/d39/d5b/d65/d4c/d4d/d6a/dd6/l104 0 2023-12-16T07:40:24.269 INFO:tasks.workunit.client.0.smithi049.stdout:6/802: dread - d0/d2/df/d81/ff8 zero size 2023-12-16T07:40:24.270 INFO:tasks.workunit.client.0.smithi049.stdout:5/743: symlink d5/de/d54/d67/da0/l104 0 2023-12-16T07:40:24.272 INFO:tasks.workunit.client.0.smithi049.stdout:6/803: rename d0/d2/fc9 to d0/d39/d5b/d65/dc1/f105 0 2023-12-16T07:40:24.274 INFO:tasks.workunit.client.0.smithi049.stdout:0/897: dwrite d13/fb5 [4194304,4194304] 0 2023-12-16T07:40:24.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/736: dread f4 [0,4194304] 0 2023-12-16T07:40:24.275 INFO:tasks.workunit.client.0.smithi049.stdout:4/686: dwrite d2/db/dd/db7/fcb [0,4194304] 0 2023-12-16T07:40:24.275 INFO:tasks.workunit.client.0.smithi049.stdout:7/737: write d7/dc/d2f/d40/d5d/fb0 [4549939,46900] 0 2023-12-16T07:40:24.279 INFO:tasks.workunit.client.0.smithi049.stdout:0/898: symlink d13/d21/d27/d2c/d62/d70/l13d 0 2023-12-16T07:40:24.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/738: getdents d7/dc/dd/d35 0 2023-12-16T07:40:24.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/739: readlink d7/dc/dd/d27/dba/lf8 0 2023-12-16T07:40:24.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/740: readlink d7/dc/l65 0 2023-12-16T07:40:24.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/680: sync 2023-12-16T07:40:24.286 INFO:tasks.workunit.client.0.smithi049.stdout:8/719: dwrite d0/d1f/d36/db8/fc0 [0,4194304] 0 2023-12-16T07:40:24.287 INFO:tasks.workunit.client.0.smithi049.stdout:0/899: dread d13/d21/d99/d46/fac [0,4194304] 0 2023-12-16T07:40:24.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/741: rename d7/dc/dd/d27/fd5 to d7/dc/d6b/ffc 0 2023-12-16T07:40:24.287 INFO:tasks.workunit.client.0.smithi049.stdout:2/681: creat d2/d26/d6e/fef x:0 0 0 2023-12-16T07:40:24.289 INFO:tasks.workunit.client.0.smithi049.stdout:8/720: symlink d0/d1f/d56/lde 0 2023-12-16T07:40:24.290 INFO:tasks.workunit.client.0.smithi049.stdout:7/742: rename d7/dc/dd/d37/d5c/f9b to d7/dc/dd/d37/ffd 0 2023-12-16T07:40:24.295 INFO:tasks.workunit.client.0.smithi049.stdout:3/602: dwrite d1/d2a/d37/d3f/d5a/d5b/f99 [0,4194304] 0 2023-12-16T07:40:24.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/804: dread d0/d39/d5b/d65/d58/d2c/f93 [0,4194304] 0 2023-12-16T07:40:24.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/805: fsync d0/d39/f54 0 2023-12-16T07:40:24.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/806: chown d0/d39/d5b/d65/d4c/d4d/d6a/dd6/lfc 1491538 1 2023-12-16T07:40:24.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/900: dread d13/f17 [0,4194304] 0 2023-12-16T07:40:24.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/901: dread - d13/d21/d99/d46/d124/f134 zero size 2023-12-16T07:40:24.301 INFO:tasks.workunit.client.0.smithi049.stdout:6/807: creat d0/d39/d5b/d65/d4c/d4d/d6a/de9/dfb/f106 x:0 0 0 2023-12-16T07:40:24.301 INFO:tasks.workunit.client.0.smithi049.stdout:6/808: fsync d0/d39/d5b/d65/d58/d2c/f36 0 2023-12-16T07:40:24.302 INFO:tasks.workunit.client.0.smithi049.stdout:4/687: dwrite d2/db/dd/de/d1e/d21/f25 [0,4194304] 0 2023-12-16T07:40:24.302 INFO:tasks.workunit.client.0.smithi049.stdout:3/603: write d1/f18 [2139617,31073] 0 2023-12-16T07:40:24.303 INFO:tasks.workunit.client.0.smithi049.stdout:3/604: chown d1/d2a/d37/db9 12158 1 2023-12-16T07:40:24.303 INFO:tasks.workunit.client.0.smithi049.stdout:6/809: creat d0/d2/df/dce/f107 x:0 0 0 2023-12-16T07:40:24.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/605: dread d1/d2a/d37/d3f/d4c/f79 [0,4194304] 0 2023-12-16T07:40:24.305 INFO:tasks.workunit.client.0.smithi049.stdout:4/688: rmdir d2/db/dd/de/d1e/d37/da4 39 2023-12-16T07:40:24.305 INFO:tasks.workunit.client.0.smithi049.stdout:4/689: truncate d2/fa9 574019 0 2023-12-16T07:40:24.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/603: sync 2023-12-16T07:40:24.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/604: stat d4/d7/d11/d1d/f64 0 2023-12-16T07:40:24.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/605: dread - d4/d7/d11/d1d/d69/d76/d83/faf zero size 2023-12-16T07:40:24.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/606: chown d4/c2f 1 1 2023-12-16T07:40:24.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/607: chown d4/d7/d11/d1d/d69/d76/f99 66419 1 2023-12-16T07:40:24.307 INFO:tasks.workunit.client.0.smithi049.stdout:6/810: creat d0/d39/d5b/d65/d4c/d4d/d6a/dd6/f108 x:0 0 0 2023-12-16T07:40:24.307 INFO:tasks.workunit.client.0.smithi049.stdout:3/606: creat d1/fc6 x:0 0 0 2023-12-16T07:40:24.309 INFO:tasks.workunit.client.0.smithi049.stdout:0/902: dread d13/d21/d27/d2c/d62/d70/f8f [0,4194304] 0 2023-12-16T07:40:24.309 INFO:tasks.workunit.client.0.smithi049.stdout:4/690: unlink d2/db/dd/de/d1e/d44/c9d 0 2023-12-16T07:40:24.310 INFO:tasks.workunit.client.0.smithi049.stdout:3/607: symlink d1/d2a/d37/d3f/d5a/d61/d6b/db5/lc7 0 2023-12-16T07:40:24.312 INFO:tasks.workunit.client.0.smithi049.stdout:0/903: creat d13/d39/dbe/dd7/f13e x:0 0 0 2023-12-16T07:40:24.312 INFO:tasks.workunit.client.0.smithi049.stdout:1/771: sync 2023-12-16T07:40:24.314 INFO:tasks.workunit.client.0.smithi049.stdout:3/608: symlink d1/d2a/d37/d3f/d5a/d5b/d77/dc4/lc8 0 2023-12-16T07:40:24.314 INFO:tasks.workunit.client.0.smithi049.stdout:3/609: fdatasync d1/d2a/d37/d3f/d5a/d6d/fc3 0 2023-12-16T07:40:24.315 INFO:tasks.workunit.client.0.smithi049.stdout:3/610: dread - d1/d2a/d37/d3f/d5a/d6d/d96/f9d zero size 2023-12-16T07:40:24.315 INFO:tasks.workunit.client.0.smithi049.stdout:1/772: rename d20/d41/d4f/d55/d7f/d106/ff0 to d20/d41/dab/f109 0 2023-12-16T07:40:24.315 INFO:tasks.workunit.client.0.smithi049.stdout:3/611: getdents d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76 0 2023-12-16T07:40:24.316 INFO:tasks.workunit.client.0.smithi049.stdout:1/773: rename d20/d45/d77/c103 to d20/d41/d52/d86/dd9/c10a 0 2023-12-16T07:40:24.317 INFO:tasks.workunit.client.0.smithi049.stdout:3/612: rmdir d1/d2a/d37/d3f/d5a/d61/d75/db7 39 2023-12-16T07:40:24.317 INFO:tasks.workunit.client.0.smithi049.stdout:3/613: fdatasync d1/d2a/d37/f55 0 2023-12-16T07:40:24.318 INFO:tasks.workunit.client.0.smithi049.stdout:1/774: mkdir d20/d41/d52/d10b 0 2023-12-16T07:40:24.318 INFO:tasks.workunit.client.0.smithi049.stdout:3/614: stat d1/d2a/d37/d3f/l45 0 2023-12-16T07:40:24.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/615: rename d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fa8 to d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/fc9 0 2023-12-16T07:40:24.322 INFO:tasks.workunit.client.0.smithi049.stdout:3/616: fdatasync d1/d2a/d37/d3f/f5d 0 2023-12-16T07:40:24.322 INFO:tasks.workunit.client.0.smithi049.stdout:3/617: chown d1/fc6 0 1 2023-12-16T07:40:24.323 INFO:tasks.workunit.client.0.smithi049.stdout:3/618: fsync d1/d2a/d37/f9a 0 2023-12-16T07:40:24.323 INFO:tasks.workunit.client.0.smithi049.stdout:3/619: truncate d1/d2a/d37/d3f/f93 766982 0 2023-12-16T07:40:24.326 INFO:tasks.workunit.client.0.smithi049.stdout:6/811: dread d0/f35 [0,4194304] 0 2023-12-16T07:40:24.328 INFO:tasks.workunit.client.0.smithi049.stdout:6/812: creat d0/d39/f109 x:0 0 0 2023-12-16T07:40:24.330 INFO:tasks.workunit.client.0.smithi049.stdout:2/682: dwrite d2/d1d/f89 [0,4194304] 0 2023-12-16T07:40:24.330 INFO:tasks.workunit.client.0.smithi049.stdout:2/683: truncate d2/d1d/d24/d55/d76/fed 313676 0 2023-12-16T07:40:24.331 INFO:tasks.workunit.client.0.smithi049.stdout:2/684: write d2/d1d/d28/d56/d66/d6b/f94 [1733965,115271] 0 2023-12-16T07:40:24.339 INFO:tasks.workunit.client.0.smithi049.stdout:1/775: dwrite d20/d41/d52/d86/fe5 [0,4194304] 0 2023-12-16T07:40:24.340 INFO:tasks.workunit.client.0.smithi049.stdout:9/608: dwrite d4/d7/d11/db3/fab [0,4194304] 0 2023-12-16T07:40:24.345 INFO:tasks.workunit.client.0.smithi049.stdout:7/743: dwrite d7/dc/d2f/f9f [0,4194304] 0 2023-12-16T07:40:24.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/776: dread d20/d45/f48 [0,4194304] 0 2023-12-16T07:40:24.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/609: write d4/d7/d11/d26/f53 [3921755,48011] 0 2023-12-16T07:40:24.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/610: dread - d4/d3e/f8f zero size 2023-12-16T07:40:24.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/611: readlink d4/l8e 0 2023-12-16T07:40:24.349 INFO:tasks.workunit.client.0.smithi049.stdout:7/744: truncate d7/dc/dd/d27/dba/fbc 1747728 0 2023-12-16T07:40:24.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/745: link d7/dc/d15/cbd d7/dc/d15/cfe 0 2023-12-16T07:40:24.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/746: mknod d7/db4/cff 0 2023-12-16T07:40:24.351 INFO:tasks.workunit.client.0.smithi049.stdout:7/747: rename f5 to d7/dc/d6b/d70/dc7/f100 0 2023-12-16T07:40:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:7/748: creat d7/dc/dd/d27/d8e/f101 x:0 0 0 2023-12-16T07:40:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:7/749: fdatasync d7/dc/dd/d35/d36/f5f 0 2023-12-16T07:40:24.353 INFO:tasks.workunit.client.0.smithi049.stdout:7/750: mknod d7/dc/d15/c102 0 2023-12-16T07:40:24.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/612: dread d4/d7/d11/d26/f52 [0,4194304] 0 2023-12-16T07:40:24.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/613: rename d4 to d4/d7/d11/d1d/d5b/dc1 22 2023-12-16T07:40:24.364 INFO:tasks.workunit.client.0.smithi049.stdout:3/620: dwrite d1/d2a/d37/d3f/d5a/d6d/f84 [0,4194304] 0 2023-12-16T07:40:24.364 INFO:tasks.workunit.client.0.smithi049.stdout:3/621: dread - d1/d2a/d37/d3f/d5a/d5b/d5e/f91 zero size 2023-12-16T07:40:24.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/614: mkdir d4/d7/d11/d1d/d82/dc2 0 2023-12-16T07:40:24.367 INFO:tasks.workunit.client.0.smithi049.stdout:6/813: dwrite d0/d2/f9 [0,4194304] 0 2023-12-16T07:40:24.368 INFO:tasks.workunit.client.0.smithi049.stdout:2/685: dwrite d2/d1d/d28/d56/fae [0,4194304] 0 2023-12-16T07:40:24.368 INFO:tasks.workunit.client.0.smithi049.stdout:2/686: read - d2/d1d/f68 zero size 2023-12-16T07:40:24.368 INFO:tasks.workunit.client.0.smithi049.stdout:2/687: truncate d2/d1d/fab 785263 0 2023-12-16T07:40:24.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/622: rename d1/d2a/f74 to d1/d2a/d37/d3f/d5a/d5b/d77/dc4/fca 0 2023-12-16T07:40:24.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/623: chown d1/d2a/d37/d3f/d5a/d61/d6b/db5/lc7 82346 1 2023-12-16T07:40:24.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/615: mkdir d4/d7/d11/d1d/d9b/dae/dc3 0 2023-12-16T07:40:24.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/616: chown d4/d7/d11/d1d/f5c 214258054 1 2023-12-16T07:40:24.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/617: read d4/d7/d11/d1d/f25 [2242747,14491] 0 2023-12-16T07:40:24.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/618: stat d4/d7/d11/d1d/d5b/d8b/fa9 0 2023-12-16T07:40:24.373 INFO:tasks.workunit.client.0.smithi049.stdout:2/688: mkdir d2/de/df0 0 2023-12-16T07:40:24.374 INFO:tasks.workunit.client.0.smithi049.stdout:6/814: rename d0/d2/df/d4e/d5d/d6f/f75 to d0/d39/d5b/d65/d58/d33/daa/f10a 0 2023-12-16T07:40:24.375 INFO:tasks.workunit.client.0.smithi049.stdout:3/624: symlink d1/d2a/d37/d3f/d5a/d5b/d77/lcb 0 2023-12-16T07:40:24.375 INFO:tasks.workunit.client.0.smithi049.stdout:3/625: chown d1/l1d 17190 1 2023-12-16T07:40:24.376 INFO:tasks.workunit.client.0.smithi049.stdout:9/619: mkdir d4/d7/d11/d1d/d5b/dbe/dc4 0 2023-12-16T07:40:24.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/751: dwrite d7/dc/d2f/d38/fe8 [0,4194304] 0 2023-12-16T07:40:24.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/815: rename d0/d2/df/f24 to d0/d2/df/d4e/f10b 0 2023-12-16T07:40:24.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/816: read - d0/d2/df/d4e/fe0 zero size 2023-12-16T07:40:24.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/626: mkdir d1/d2a/d37/d3f/dcc 0 2023-12-16T07:40:24.385 INFO:tasks.workunit.client.0.smithi049.stdout:2/689: rename d2/d1d/dc2/le9 to d2/d1d/d28/d56/d11/d1c/lf1 0 2023-12-16T07:40:24.386 INFO:tasks.workunit.client.0.smithi049.stdout:7/752: write d7/dc/dd/d35/f41 [1226156,120589] 0 2023-12-16T07:40:24.388 INFO:tasks.workunit.client.0.smithi049.stdout:6/817: rename d0/d2/f82 to d0/d39/d5b/f10c 0 2023-12-16T07:40:24.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/690: mkdir d2/de/df2 0 2023-12-16T07:40:24.391 INFO:tasks.workunit.client.0.smithi049.stdout:7/753: creat d7/dc/dd/d27/f103 x:0 0 0 2023-12-16T07:40:24.391 INFO:tasks.workunit.client.0.smithi049.stdout:3/627: dread d1/d2a/d37/d3f/d5a/d5b/f99 [0,4194304] 0 2023-12-16T07:40:24.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/818: mkdir d0/d39/d5b/d65/d27/d91/d94/d10d 0 2023-12-16T07:40:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/691: symlink d2/d1d/d24/d55/d7c/d98/lf3 0 2023-12-16T07:40:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/692: chown d2/d1d/d28/d56/d71/ddf/lc1 6 1 2023-12-16T07:40:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:9/620: dwrite d4/d7/d11/d1d/d5b/f9e [0,4194304] 0 2023-12-16T07:40:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/754: dread d7/dc/dd/d35/d36/f5f [0,4194304] 0 2023-12-16T07:40:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/755: fdatasync d7/dc/dd/d35/d36/f5f 0 2023-12-16T07:40:24.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/756: dread - d7/dc/dd/d37/ffd zero size 2023-12-16T07:40:24.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/628: symlink d1/d2a/d37/d3f/d5a/lcd 0 2023-12-16T07:40:24.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/629: chown d1/f16 6476632 1 2023-12-16T07:40:24.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/630: fsync d1/d2a/d37/d3f/f93 0 2023-12-16T07:40:24.404 INFO:tasks.workunit.client.0.smithi049.stdout:6/819: creat d0/d39/d5b/f10e x:0 0 0 2023-12-16T07:40:24.405 INFO:tasks.workunit.client.0.smithi049.stdout:9/621: mkdir d4/d7/d11/db3/d8a/dc5 0 2023-12-16T07:40:24.405 INFO:tasks.workunit.client.0.smithi049.stdout:6/820: write d0/d39/d5b/d65/d53/f66 [707550,55280] 0 2023-12-16T07:40:24.407 INFO:tasks.workunit.client.0.smithi049.stdout:7/757: mkdir d7/dc/d2f/d40/d104 0 2023-12-16T07:40:24.407 INFO:tasks.workunit.client.0.smithi049.stdout:7/758: read d7/dc/d2f/d40/f4b [201625,39861] 0 2023-12-16T07:40:24.408 INFO:tasks.workunit.client.0.smithi049.stdout:9/622: unlink d4/ff 0 2023-12-16T07:40:24.411 INFO:tasks.workunit.client.0.smithi049.stdout:2/693: dwrite d2/d1d/fab [0,4194304] 0 2023-12-16T07:40:24.411 INFO:tasks.workunit.client.0.smithi049.stdout:7/759: mkdir d7/dc/d6b/d105 0 2023-12-16T07:40:24.414 INFO:tasks.workunit.client.0.smithi049.stdout:3/631: dwrite d1/d2a/f3b [0,4194304] 0 2023-12-16T07:40:24.416 INFO:tasks.workunit.client.0.smithi049.stdout:7/760: mkdir d7/dc/dd/d37/d5c/db2/d106 0 2023-12-16T07:40:24.417 INFO:tasks.workunit.client.0.smithi049.stdout:7/761: read d7/f67 [874525,27414] 0 2023-12-16T07:40:24.417 INFO:tasks.workunit.client.0.smithi049.stdout:7/762: stat d7/dc/dd/d37/d5c 0 2023-12-16T07:40:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:3/632: link d1/d2a/d37/d3f/d5a/d61/d6b/lbe d1/d2a/d37/d3f/lce 0 2023-12-16T07:40:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:3/633: dread - d1/d2a/d37/d3f/d5a/d5b/d5e/f91 zero size 2023-12-16T07:40:24.423 INFO:tasks.workunit.client.0.smithi049.stdout:3/634: chown d1/d2a/d37/d3f/d5a/d6d/fc3 7 1 2023-12-16T07:40:24.424 INFO:tasks.workunit.client.0.smithi049.stdout:7/763: mkdir d7/db4/d107 0 2023-12-16T07:40:24.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/635: symlink d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/lcf 0 2023-12-16T07:40:24.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/636: stat d1/fa5 0 2023-12-16T07:40:24.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/637: write d1/d2a/d37/d3f/d4c/f79 [44033,121346] 0 2023-12-16T07:40:24.428 INFO:tasks.workunit.client.0.smithi049.stdout:5/744: sync 2023-12-16T07:40:24.429 INFO:tasks.workunit.client.0.smithi049.stdout:3/638: write d1/d2b/f2d [1077325,118091] 0 2023-12-16T07:40:24.430 INFO:tasks.workunit.client.0.smithi049.stdout:3/639: symlink d1/d2a/d37/d3f/d5a/ld0 0 2023-12-16T07:40:24.431 INFO:tasks.workunit.client.0.smithi049.stdout:3/640: mknod d1/d2a/d37/d3f/d5a/d61/cd1 0 2023-12-16T07:40:24.432 INFO:tasks.workunit.client.0.smithi049.stdout:5/745: write d5/de/d54/d67/f7b [2112859,46300] 0 2023-12-16T07:40:24.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/746: rename d5/de/d54/d57/cdc to d5/de/d54/d57/d3c/d82/c105 0 2023-12-16T07:40:24.437 INFO:tasks.workunit.client.0.smithi049.stdout:9/623: dwrite d4/d7/d11/d26/f52 [0,4194304] 0 2023-12-16T07:40:24.437 INFO:tasks.workunit.client.0.smithi049.stdout:6/821: dwrite d0/d39/d5b/d65/f26 [0,4194304] 0 2023-12-16T07:40:24.437 INFO:tasks.workunit.client.0.smithi049.stdout:6/822: chown d0/d2/df/d4e/d5d/d6f/d4a/fa3 4 1 2023-12-16T07:40:24.437 INFO:tasks.workunit.client.0.smithi049.stdout:6/823: write d0/d39/d5b/d65/d4c/f8e [912199,6220] 0 2023-12-16T07:40:24.438 INFO:tasks.workunit.client.0.smithi049.stdout:2/694: dwrite d2/d1d/d28/d56/d11/f61 [8388608,4194304] 0 2023-12-16T07:40:24.443 INFO:tasks.workunit.client.0.smithi049.stdout:6/824: mkdir d0/d2/df/d10f 0 2023-12-16T07:40:24.443 INFO:tasks.workunit.client.0.smithi049.stdout:2/695: rename d2/d1d/d28/d56/d11/d1c/lf1 to d2/d1d/d24/lf4 0 2023-12-16T07:40:24.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/825: rename d0/d39/d5b/d65/d58/d2c/lae to d0/d2/df/d10f/l110 0 2023-12-16T07:40:24.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/826: chown d0/d39/d5b/d65/d4c/d4d/d6a/de9/dfb/f106 7 1 2023-12-16T07:40:24.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/827: fdatasync d0/d39/d5b/d65/d27/f89 0 2023-12-16T07:40:24.447 INFO:tasks.workunit.client.0.smithi049.stdout:2/696: mkdir d2/d1d/d24/d55/df5 0 2023-12-16T07:40:24.447 INFO:tasks.workunit.client.0.smithi049.stdout:2/697: chown d2/d1d/d28/d56/d11/d1c/l3a 64 1 2023-12-16T07:40:24.448 INFO:tasks.workunit.client.0.smithi049.stdout:6/828: creat d0/d2/df/d10f/f111 x:0 0 0 2023-12-16T07:40:24.449 INFO:tasks.workunit.client.0.smithi049.stdout:3/641: dwrite d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fc5 [0,4194304] 0 2023-12-16T07:40:24.449 INFO:tasks.workunit.client.0.smithi049.stdout:2/698: symlink d2/d1d/d38/lf6 0 2023-12-16T07:40:24.450 INFO:tasks.workunit.client.0.smithi049.stdout:3/642: write d1/d2a/d37/d3f/d4c/f73 [4045739,126915] 0 2023-12-16T07:40:24.456 INFO:tasks.workunit.client.0.smithi049.stdout:3/643: creat d1/d2a/d37/d3f/d5a/d5b/d5e/fd2 x:0 0 0 2023-12-16T07:40:24.459 INFO:tasks.workunit.client.0.smithi049.stdout:8/721: sync 2023-12-16T07:40:24.462 INFO:tasks.workunit.client.0.smithi049.stdout:8/722: unlink d0/d1f/d36/db8/fc0 0 2023-12-16T07:40:24.464 INFO:tasks.workunit.client.0.smithi049.stdout:8/723: mkdir d0/d1f/db7/ddf 0 2023-12-16T07:40:24.464 INFO:tasks.workunit.client.0.smithi049.stdout:8/724: chown d0/d13/d42/d5b/f8d 90 1 2023-12-16T07:40:24.464 INFO:tasks.workunit.client.0.smithi049.stdout:9/624: dwrite d4/d7/d11/d1d/d5b/f9e [0,4194304] 0 2023-12-16T07:40:24.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/747: dwrite d5/de/d54/d78/feb [0,4194304] 0 2023-12-16T07:40:24.468 INFO:tasks.workunit.client.0.smithi049.stdout:9/625: rmdir d4/d7/d11/d1d/d69/d76/d83 39 2023-12-16T07:40:24.473 INFO:tasks.workunit.client.0.smithi049.stdout:5/748: truncate d5/de/d54/d57/dfa/d21/d4e/dba/fe0 2790476 0 2023-12-16T07:40:24.473 INFO:tasks.workunit.client.0.smithi049.stdout:9/626: getdents d4/d7/d11/d56 0 2023-12-16T07:40:24.474 INFO:tasks.workunit.client.0.smithi049.stdout:9/627: rmdir d4/d7/d11/d26 39 2023-12-16T07:40:24.474 INFO:tasks.workunit.client.0.smithi049.stdout:3/644: dread d1/d2a/d37/d3f/f5d [0,4194304] 0 2023-12-16T07:40:24.476 INFO:tasks.workunit.client.0.smithi049.stdout:5/749: rename d5/de/d54/d57/dfa/d21/d5a/c63 to d5/de/d54/d67/df8/c106 0 2023-12-16T07:40:24.476 INFO:tasks.workunit.client.0.smithi049.stdout:3/645: stat d1/d2a/d37/d3f/d5a/l95 0 2023-12-16T07:40:24.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/829: dwrite d0/d39/d5b/fdc [0,4194304] 0 2023-12-16T07:40:24.479 INFO:tasks.workunit.client.0.smithi049.stdout:6/830: chown d0/d39/d5b/d65/d58/lf6 31 1 2023-12-16T07:40:24.479 INFO:tasks.workunit.client.0.smithi049.stdout:6/831: write d0/d39/d5b/f74 [3216031,99613] 0 2023-12-16T07:40:24.479 INFO:tasks.workunit.client.0.smithi049.stdout:2/699: dwrite d2/d1d/f89 [0,4194304] 0 2023-12-16T07:40:24.481 INFO:tasks.workunit.client.0.smithi049.stdout:9/628: rename d4/d7/d11/d1d/d48/l78 to d4/db2/lc6 0 2023-12-16T07:40:24.481 INFO:tasks.workunit.client.0.smithi049.stdout:5/750: creat d5/de/d1c/d62/d81/f107 x:0 0 0 2023-12-16T07:40:24.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/629: chown d4/d7/d11/db3/d8a/daa 2269466 1 2023-12-16T07:40:24.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/630: write d4/d7/d11/db3/f77 [696897,62045] 0 2023-12-16T07:40:24.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/631: getdents d4/d7/d11/d1d/d5b/dbe/dc4 0 2023-12-16T07:40:24.482 INFO:tasks.workunit.client.0.smithi049.stdout:2/700: dread d2/d1d/d28/d56/d11/fdd [0,4194304] 0 2023-12-16T07:40:24.488 INFO:tasks.workunit.client.0.smithi049.stdout:2/701: rmdir d2/de/d78 39 2023-12-16T07:40:24.498 INFO:tasks.workunit.client.0.smithi049.stdout:5/751: read d5/de/f40 [3362851,110154] 0 2023-12-16T07:40:24.499 INFO:tasks.workunit.client.0.smithi049.stdout:3/646: dwrite d1/d2a/d37/d3f/d5a/d6d/d96/f9d [0,4194304] 0 2023-12-16T07:40:24.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/752: dread d5/de/f76 [0,4194304] 0 2023-12-16T07:40:24.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/753: fsync d5/de/d54/d57/dfa/d20/d95/fab 0 2023-12-16T07:40:24.515 INFO:tasks.workunit.client.0.smithi049.stdout:5/754: dread d5/de/d1c/d62/f88 [0,4194304] 0 2023-12-16T07:40:24.515 INFO:tasks.workunit.client.0.smithi049.stdout:6/832: dwrite d0/d39/d5b/d65/d58/d2c/f4b [0,4194304] 0 2023-12-16T07:40:24.515 INFO:tasks.workunit.client.0.smithi049.stdout:6/833: fsync d0/d39/d5b/d65/d4c/ff7 0 2023-12-16T07:40:24.516 INFO:tasks.workunit.client.0.smithi049.stdout:5/755: rename d5/de/d54/d57/d3c/d82/ce1 to d5/de/d54/da9/dbb/c108 0 2023-12-16T07:40:24.517 INFO:tasks.workunit.client.0.smithi049.stdout:5/756: write d5/de/d54/d57/dfa/d21/d5a/fc5 [886503,28525] 0 2023-12-16T07:40:24.517 INFO:tasks.workunit.client.0.smithi049.stdout:5/757: dread - d5/de/d54/d57/dfa/d20/d95/fed zero size 2023-12-16T07:40:24.517 INFO:tasks.workunit.client.0.smithi049.stdout:5/758: chown f3 350823 1 2023-12-16T07:40:24.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/834: mkdir d0/d39/d5b/d65/d27/d91/d94/d10d/d112 0 2023-12-16T07:40:24.518 INFO:tasks.workunit.client.0.smithi049.stdout:5/759: mkdir d5/de/d54/d57/dfa/d21/d5a/d109 0 2023-12-16T07:40:24.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/760: creat d5/de/d54/d57/d2f/f10a x:0 0 0 2023-12-16T07:40:24.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/761: truncate d5/de/d54/d57/f50 582655 0 2023-12-16T07:40:24.520 INFO:tasks.workunit.client.0.smithi049.stdout:9/632: dwrite d4/d7/d11/d1d/d48/d93/f94 [0,4194304] 0 2023-12-16T07:40:24.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/647: dwrite d1/d2a/d37/f9a [0,4194304] 0 2023-12-16T07:40:24.526 INFO:tasks.workunit.client.0.smithi049.stdout:2/702: dwrite d2/d1d/d24/f2e [0,4194304] 0 2023-12-16T07:40:24.528 INFO:tasks.workunit.client.0.smithi049.stdout:3/648: dread d1/d2a/d37/d3f/d5a/d5b/f99 [0,4194304] 0 2023-12-16T07:40:24.528 INFO:tasks.workunit.client.0.smithi049.stdout:3/649: dread - d1/fa5 zero size 2023-12-16T07:40:24.528 INFO:tasks.workunit.client.0.smithi049.stdout:2/703: write d2/d1d/d28/d56/d66/d6b/f79 [2975266,115844] 0 2023-12-16T07:40:24.534 INFO:tasks.workunit.client.0.smithi049.stdout:3/650: rmdir d1/d2a/d37/d3f/d5a/d5b/d77/dc4 39 2023-12-16T07:40:24.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/762: dread d5/de/d54/d67/da0/fac [0,4194304] 0 2023-12-16T07:40:24.536 INFO:tasks.workunit.client.0.smithi049.stdout:2/704: link d2/d1d/d28/d56/d66/f7e d2/d1d/d24/d55/d7c/ff7 0 2023-12-16T07:40:24.536 INFO:tasks.workunit.client.0.smithi049.stdout:2/705: truncate d2/fb2 4739954 0 2023-12-16T07:40:24.538 INFO:tasks.workunit.client.0.smithi049.stdout:5/763: creat d5/de/d1c/f10b x:0 0 0 2023-12-16T07:40:24.539 INFO:tasks.workunit.client.0.smithi049.stdout:5/764: write d5/de/d54/d57/d3c/fb9 [1222148,63526] 0 2023-12-16T07:40:24.539 INFO:tasks.workunit.client.0.smithi049.stdout:5/765: stat d5/de/d54/d78/d9b/cb7 0 2023-12-16T07:40:24.539 INFO:tasks.workunit.client.0.smithi049.stdout:2/706: link d2/d1d/d28/d56/c1f d2/d1d/d24/d55/df5/cf8 0 2023-12-16T07:40:24.539 INFO:tasks.workunit.client.0.smithi049.stdout:5/766: write d5/de/d54/ffb [650325,49432] 0 2023-12-16T07:40:24.540 INFO:tasks.workunit.client.0.smithi049.stdout:2/707: write d2/d1d/f8e [3675965,57834] 0 2023-12-16T07:40:24.540 INFO:tasks.workunit.client.0.smithi049.stdout:5/767: symlink d5/de/d54/da9/dcb/l10c 0 2023-12-16T07:40:24.540 INFO:tasks.workunit.client.0.smithi049.stdout:3/651: dread d1/d2a/f3b [0,4194304] 0 2023-12-16T07:40:24.540 INFO:tasks.workunit.client.0.smithi049.stdout:3/652: fsync d1/d2a/f3b 0 2023-12-16T07:40:24.540 INFO:tasks.workunit.client.0.smithi049.stdout:3/653: fdatasync d1/d2a/d37/d3f/d5a/d6d/f84 0 2023-12-16T07:40:24.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/708: dread d2/d1d/d24/d55/d76/fed [0,4194304] 0 2023-12-16T07:40:24.542 INFO:tasks.workunit.client.0.smithi049.stdout:3/654: dread d1/d2a/d37/d3f/d5a/d6d/fc3 [0,4194304] 0 2023-12-16T07:40:24.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/709: getdents d2/de/df2 0 2023-12-16T07:40:24.544 INFO:tasks.workunit.client.0.smithi049.stdout:3/655: link d1/d2a/d37/d3f/d5a/l80 d1/d2a/d37/d3f/d4c/ld3 0 2023-12-16T07:40:24.544 INFO:tasks.workunit.client.0.smithi049.stdout:2/710: rename d2/d1d/d28/d56/d11/d1c/fb5 to d2/d1d/d28/d56/ff9 0 2023-12-16T07:40:24.545 INFO:tasks.workunit.client.0.smithi049.stdout:6/835: dwrite d0/d39/d5b/d65/d27/d91/d94/fcd [0,4194304] 0 2023-12-16T07:40:24.548 INFO:tasks.workunit.client.0.smithi049.stdout:9/633: dwrite d4/d7/d11/f20 [8388608,4194304] 0 2023-12-16T07:40:24.548 INFO:tasks.workunit.client.0.smithi049.stdout:2/711: mknod d2/db8/db9/cfa 0 2023-12-16T07:40:24.549 INFO:tasks.workunit.client.0.smithi049.stdout:2/712: creat d2/d1d/d24/d55/d7c/d98/da1/ffb x:0 0 0 2023-12-16T07:40:24.551 INFO:tasks.workunit.client.0.smithi049.stdout:2/713: creat d2/d1d/d28/d56/d71/ddf/ffc x:0 0 0 2023-12-16T07:40:24.552 INFO:tasks.workunit.client.0.smithi049.stdout:5/768: dwrite d5/de/d54/d57/dfa/d21/d58/d65/dae/fd5 [4194304,4194304] 0 2023-12-16T07:40:24.552 INFO:tasks.workunit.client.0.smithi049.stdout:5/769: read d5/f7c [3307867,52594] 0 2023-12-16T07:40:24.559 INFO:tasks.workunit.client.0.smithi049.stdout:5/770: mkdir d5/de/d54/d57/d3c/d10d 0 2023-12-16T07:40:24.560 INFO:tasks.workunit.client.0.smithi049.stdout:5/771: symlink d5/de/d54/d67/l10e 0 2023-12-16T07:40:24.561 INFO:tasks.workunit.client.0.smithi049.stdout:5/772: write d5/de/d54/d57/dfa/d21/d4e/f9d [5008064,16001] 0 2023-12-16T07:40:24.562 INFO:tasks.workunit.client.0.smithi049.stdout:9/634: truncate f0 7028247 0 2023-12-16T07:40:24.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/635: link d4/d7/d11/db3/d8a/fa5 d4/d7/d11/d1d/d5b/dbe/dc4/fc7 0 2023-12-16T07:40:24.569 INFO:tasks.workunit.client.0.smithi049.stdout:9/636: creat d4/d7/d11/d1d/d5b/fc8 x:0 0 0 2023-12-16T07:40:24.571 INFO:tasks.workunit.client.0.smithi049.stdout:0/904: sync 2023-12-16T07:40:24.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/777: sync 2023-12-16T07:40:24.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/778: chown d20/d41/d4f/dec/d102 73 1 2023-12-16T07:40:24.572 INFO:tasks.workunit.client.0.smithi049.stdout:4/691: sync 2023-12-16T07:40:24.572 INFO:tasks.workunit.client.0.smithi049.stdout:4/692: write d2/fa9 [1207196,50806] 0 2023-12-16T07:40:24.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/779: getdents d20/d41/d4f/d55/d7f 0 2023-12-16T07:40:24.574 INFO:tasks.workunit.client.0.smithi049.stdout:1/780: symlink d20/de4/l10c 0 2023-12-16T07:40:24.574 INFO:tasks.workunit.client.0.smithi049.stdout:0/905: write d13/d39/df3/d11e/fe4 [421121,115741] 0 2023-12-16T07:40:24.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/906: link d13/d21/d2f/f80 d13/d21/d2f/d7d/d90/f13f 0 2023-12-16T07:40:24.578 INFO:tasks.workunit.client.0.smithi049.stdout:0/907: creat d13/d21/d2f/f140 x:0 0 0 2023-12-16T07:40:24.581 INFO:tasks.workunit.client.0.smithi049.stdout:0/908: link d13/f40 d13/d21/d99/d46/f141 0 2023-12-16T07:40:24.593 INFO:tasks.workunit.client.0.smithi049.stdout:2/714: dwrite d2/d1d/f9a [0,4194304] 0 2023-12-16T07:40:24.593 INFO:tasks.workunit.client.0.smithi049.stdout:2/715: rmdir d2/d1d/d24/d55/d76 39 2023-12-16T07:40:24.604 INFO:tasks.workunit.client.0.smithi049.stdout:5/773: dwrite d5/de/d54/d57/dfa/d21/d58/fb2 [4194304,4194304] 0 2023-12-16T07:40:24.604 INFO:tasks.workunit.client.0.smithi049.stdout:1/781: dwrite d20/d41/d52/d86/fe5 [0,4194304] 0 2023-12-16T07:40:24.604 INFO:tasks.workunit.client.0.smithi049.stdout:9/637: dwrite d4/d7/d11/db3/d8a/f5a [0,4194304] 0 2023-12-16T07:40:24.604 INFO:tasks.workunit.client.0.smithi049.stdout:1/782: write d20/d45/d77/fd6 [1310554,113142] 0 2023-12-16T07:40:24.604 INFO:tasks.workunit.client.0.smithi049.stdout:1/783: write d20/f79 [675683,1274] 0 2023-12-16T07:40:24.604 INFO:tasks.workunit.client.0.smithi049.stdout:4/693: dwrite d2/db/dd/de/d1e/d21/f9e [0,4194304] 0 2023-12-16T07:40:24.604 INFO:tasks.workunit.client.0.smithi049.stdout:4/694: readlink d2/db/dd/d2a/l41 0 2023-12-16T07:40:24.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/909: dwrite d13/d39/d78/d83/f127 [0,4194304] 0 2023-12-16T07:40:24.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/910: truncate d13/d39/d53/fa9 733942 0 2023-12-16T07:40:24.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/911: chown d13/d21/d27/d2c/d62/d70/d107/cf0 258112 1 2023-12-16T07:40:24.605 INFO:tasks.workunit.client.0.smithi049.stdout:5/774: symlink d5/de/d54/d78/l10f 0 2023-12-16T07:40:24.609 INFO:tasks.workunit.client.0.smithi049.stdout:9/638: unlink d4/d7/d11/d26/f37 0 2023-12-16T07:40:24.612 INFO:tasks.workunit.client.0.smithi049.stdout:1/784: symlink d20/d41/l10d 0 2023-12-16T07:40:24.616 INFO:tasks.workunit.client.0.smithi049.stdout:4/695: mknod d2/db/dd/de/d1e/d21/cde 0 2023-12-16T07:40:24.618 INFO:tasks.workunit.client.0.smithi049.stdout:0/912: creat d13/d39/dfe/f142 x:0 0 0 2023-12-16T07:40:24.619 INFO:tasks.workunit.client.0.smithi049.stdout:9/639: creat d4/d7/d11/db3/d8a/fc9 x:0 0 0 2023-12-16T07:40:24.620 INFO:tasks.workunit.client.0.smithi049.stdout:1/785: creat d20/d45/d77/f10e x:0 0 0 2023-12-16T07:40:24.621 INFO:tasks.workunit.client.0.smithi049.stdout:4/696: unlink d2/db/dd/d2a/l30 0 2023-12-16T07:40:24.621 INFO:tasks.workunit.client.0.smithi049.stdout:4/697: fsync d2/db/dd/fa 0 2023-12-16T07:40:24.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/786: rename d20/d41/fcf to d20/d40/d6f/f10f 0 2023-12-16T07:40:24.627 INFO:tasks.workunit.client.0.smithi049.stdout:5/775: dread d5/de/d54/d57/dfa/d21/d58/d65/dae/fd5 [4194304,4194304] 0 2023-12-16T07:40:24.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/764: sync 2023-12-16T07:40:24.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/765: readlink d7/dc/d15/d57/l5a 0 2023-12-16T07:40:24.632 INFO:tasks.workunit.client.0.smithi049.stdout:8/725: sync 2023-12-16T07:40:24.633 INFO:tasks.workunit.client.0.smithi049.stdout:9/640: dread d4/d7/d11/db3/d8a/f5a [0,4194304] 0 2023-12-16T07:40:24.636 INFO:tasks.workunit.client.0.smithi049.stdout:7/766: mkdir d7/dc/dd/d14/d108 0 2023-12-16T07:40:24.636 INFO:tasks.workunit.client.0.smithi049.stdout:8/726: creat d0/d1f/d36/fe0 x:0 0 0 2023-12-16T07:40:24.636 INFO:tasks.workunit.client.0.smithi049.stdout:9/641: rmdir d4/d7/d11/d1d/d5b/dbe 39 2023-12-16T07:40:24.640 INFO:tasks.workunit.client.0.smithi049.stdout:7/767: mkdir d7/dc/dd/d37/d5c/db2/d109 0 2023-12-16T07:40:24.640 INFO:tasks.workunit.client.0.smithi049.stdout:7/768: fsync d7/dc/dd/d35/d36/f5f 0 2023-12-16T07:40:24.643 INFO:tasks.workunit.client.0.smithi049.stdout:9/642: dread d4/d7/d11/db3/d8a/fac [0,4194304] 0 2023-12-16T07:40:24.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/643: creat d4/d7/d11/db3/d8a/daa/fca x:0 0 0 2023-12-16T07:40:24.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/644: write d4/d7/d11/d26/f52 [5171919,85965] 0 2023-12-16T07:40:24.648 INFO:tasks.workunit.client.0.smithi049.stdout:7/769: dread f2 [0,4194304] 0 2023-12-16T07:40:24.648 INFO:tasks.workunit.client.0.smithi049.stdout:7/770: readlink d7/dc/d2f/d38/ld9 0 2023-12-16T07:40:24.649 INFO:tasks.workunit.client.0.smithi049.stdout:7/771: creat d7/dc/d6b/f10a x:0 0 0 2023-12-16T07:40:24.650 INFO:tasks.workunit.client.0.smithi049.stdout:8/727: dread d0/d1f/f67 [0,4194304] 0 2023-12-16T07:40:24.652 INFO:tasks.workunit.client.0.smithi049.stdout:8/728: getdents d0/d13 0 2023-12-16T07:40:24.654 INFO:tasks.workunit.client.0.smithi049.stdout:1/787: dwrite d20/d7b/fba [0,4194304] 0 2023-12-16T07:40:24.654 INFO:tasks.workunit.client.0.smithi049.stdout:4/698: dwrite d2/db/dd/de/d1e/d44/f95 [0,4194304] 0 2023-12-16T07:40:24.654 INFO:tasks.workunit.client.0.smithi049.stdout:4/699: fdatasync d2/db/dd/d52/fa0 0 2023-12-16T07:40:24.655 INFO:tasks.workunit.client.0.smithi049.stdout:5/776: dwrite d5/de/d54/d57/d2f/f10a [0,4194304] 0 2023-12-16T07:40:24.655 INFO:tasks.workunit.client.0.smithi049.stdout:0/913: dwrite d13/d21/d27/f5f [0,4194304] 0 2023-12-16T07:40:24.655 INFO:tasks.workunit.client.0.smithi049.stdout:8/729: rename d0/d1f/d36/l3b to d0/d1f/d36/le1 0 2023-12-16T07:40:24.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/788: unlink d20/de4/ff7 0 2023-12-16T07:40:24.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/789: write d20/d41/d4f/fa2 [316264,87821] 0 2023-12-16T07:40:24.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/790: dread - d20/d41/d4f/d7c/ff8 zero size 2023-12-16T07:40:24.664 INFO:tasks.workunit.client.0.smithi049.stdout:5/777: link d5/de/d54/d67/cb4 d5/de/d54/da9/dcb/c110 0 2023-12-16T07:40:24.664 INFO:tasks.workunit.client.0.smithi049.stdout:5/778: write d5/de/d54/d67/da0/fd6 [915574,71625] 0 2023-12-16T07:40:24.665 INFO:tasks.workunit.client.0.smithi049.stdout:0/914: mknod d13/d39/d78/c143 0 2023-12-16T07:40:24.669 INFO:tasks.workunit.client.0.smithi049.stdout:8/730: mknod d0/d13/d42/d5b/d68/d6b/da2/db9/ce2 0 2023-12-16T07:40:24.669 INFO:tasks.workunit.client.0.smithi049.stdout:8/731: chown d0/d1f/d4e/dbb/ld5 148935269 1 2023-12-16T07:40:24.669 INFO:tasks.workunit.client.0.smithi049.stdout:1/791: dread f1b [0,4194304] 0 2023-12-16T07:40:24.670 INFO:tasks.workunit.client.0.smithi049.stdout:0/915: mkdir d13/d39/d8a/db6/d144 0 2023-12-16T07:40:24.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/732: truncate d0/d13/fc1 2094073 0 2023-12-16T07:40:24.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/733: dread d0/d13/f2f [8388608,4194304] 0 2023-12-16T07:40:24.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/645: dwrite d4/d3e/f8f [0,4194304] 0 2023-12-16T07:40:24.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/792: link d20/d45/d47/fb9 d20/d41/d4f/d55/d82/f110 0 2023-12-16T07:40:24.679 INFO:tasks.workunit.client.0.smithi049.stdout:7/772: write d7/dc/d2f/d38/f8f [503855,115559] 0 2023-12-16T07:40:24.679 INFO:tasks.workunit.client.0.smithi049.stdout:7/773: write d7/dc/d2f/d40/f4b [2382806,72328] 0 2023-12-16T07:40:24.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/774: mknod d7/dc/d6b/dbf/dd3/c10b 0 2023-12-16T07:40:24.687 INFO:tasks.workunit.client.0.smithi049.stdout:1/793: dread fe [0,4194304] 0 2023-12-16T07:40:24.687 INFO:tasks.workunit.client.0.smithi049.stdout:1/794: write d20/d43/f9a [894686,44054] 0 2023-12-16T07:40:24.688 INFO:tasks.workunit.client.0.smithi049.stdout:1/795: creat d20/d40/f111 x:0 0 0 2023-12-16T07:40:24.689 INFO:tasks.workunit.client.0.smithi049.stdout:1/796: mkdir d20/d45/d112 0 2023-12-16T07:40:24.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/779: dwrite d5/f8f [0,4194304] 0 2023-12-16T07:40:24.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/780: write d5/f83 [24184,74351] 0 2023-12-16T07:40:24.697 INFO:tasks.workunit.client.0.smithi049.stdout:5/781: rename d5/de/d54/d57/d3c/d82/f84 to d5/de/d54/d78/f111 0 2023-12-16T07:40:24.698 INFO:tasks.workunit.client.0.smithi049.stdout:5/782: read d5/de/f1d [250831,31260] 0 2023-12-16T07:40:24.698 INFO:tasks.workunit.client.0.smithi049.stdout:5/783: creat d5/de/f112 x:0 0 0 2023-12-16T07:40:24.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/784: stat d5/de/d54/d57/dfa/d20/f56 0 2023-12-16T07:40:24.700 INFO:tasks.workunit.client.0.smithi049.stdout:5/785: symlink d5/de/d54/d57/dfa/d21/l113 0 2023-12-16T07:40:24.700 INFO:tasks.workunit.client.0.smithi049.stdout:5/786: fsync d5/fb 0 2023-12-16T07:40:24.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/916: dwrite d13/d39/d38/d7e/d8b/f133 [0,4194304] 0 2023-12-16T07:40:24.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/917: fsync d13/d39/f6b 0 2023-12-16T07:40:24.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/918: write d13/d39/d8a/f9e [744058,82322] 0 2023-12-16T07:40:24.701 INFO:tasks.workunit.client.0.smithi049.stdout:9/646: dwrite d4/db/f41 [0,4194304] 0 2023-12-16T07:40:24.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/797: dread d20/d41/d4f/d55/f59 [0,4194304] 0 2023-12-16T07:40:24.704 INFO:tasks.workunit.client.0.smithi049.stdout:0/919: link cc d13/d39/df3/c145 0 2023-12-16T07:40:24.704 INFO:tasks.workunit.client.0.smithi049.stdout:0/920: chown d13/d21/d2f/d7d/da0/dc9/d129 57772149 1 2023-12-16T07:40:24.706 INFO:tasks.workunit.client.0.smithi049.stdout:1/798: dread d20/fee [0,4194304] 0 2023-12-16T07:40:24.708 INFO:tasks.workunit.client.0.smithi049.stdout:5/787: symlink d5/de/d54/d57/dfa/d21/l114 0 2023-12-16T07:40:24.714 INFO:tasks.workunit.client.0.smithi049.stdout:5/788: dread d5/de/d54/d57/dfa/f51 [0,4194304] 0 2023-12-16T07:40:24.716 INFO:tasks.workunit.client.0.smithi049.stdout:5/789: rmdir d5/de/d54/d67/da0 39 2023-12-16T07:40:24.718 INFO:tasks.workunit.client.0.smithi049.stdout:5/790: creat d5/de/d54/d57/dfa/d21/d4e/f115 x:0 0 0 2023-12-16T07:40:24.719 INFO:tasks.workunit.client.0.smithi049.stdout:5/791: rename d5/de/d54/d57/dfa/d21/d58/l86 to d5/de/d54/d67/l116 0 2023-12-16T07:40:24.727 INFO:tasks.workunit.client.0.smithi049.stdout:1/799: dread d20/d40/d6f/fd3 [0,4194304] 0 2023-12-16T07:40:24.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/775: dwrite d7/dc/d2f/d38/f8f [0,4194304] 0 2023-12-16T07:40:24.729 INFO:tasks.workunit.client.0.smithi049.stdout:9/647: dwrite d4/db/f22 [4194304,4194304] 0 2023-12-16T07:40:24.729 INFO:tasks.workunit.client.0.smithi049.stdout:9/648: fsync f0 0 2023-12-16T07:40:24.729 INFO:tasks.workunit.client.0.smithi049.stdout:9/649: stat d4/d7/ca 0 2023-12-16T07:40:24.729 INFO:tasks.workunit.client.0.smithi049.stdout:1/800: mkdir d20/d41/d4f/d55/d7f/d84/d113 0 2023-12-16T07:40:24.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/921: dwrite d13/d39/df3/d11e/fe4 [0,4194304] 0 2023-12-16T07:40:24.733 INFO:tasks.workunit.client.0.smithi049.stdout:7/776: truncate d7/dc/d2f/d40/f4b 1630953 0 2023-12-16T07:40:24.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/801: mkdir d20/d41/d114 0 2023-12-16T07:40:24.744 INFO:tasks.workunit.client.0.smithi049.stdout:5/792: dwrite d5/de/d54/da9/ffe [0,4194304] 0 2023-12-16T07:40:24.744 INFO:tasks.workunit.client.0.smithi049.stdout:5/793: stat d5/de/d54/d67/da0/fea 0 2023-12-16T07:40:24.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/922: rename d13/d39/dbe/fc3 to d13/d21/d27/d2c/d62/d70/f146 0 2023-12-16T07:40:24.746 INFO:tasks.workunit.client.0.smithi049.stdout:0/923: write d13/d21/d27/f97 [3681418,57632] 0 2023-12-16T07:40:24.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/777: mknod d7/dc/dd/d14/d108/c10c 0 2023-12-16T07:40:24.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/794: rmdir d5/de/d54/da9/dbb 39 2023-12-16T07:40:24.753 INFO:tasks.workunit.client.0.smithi049.stdout:9/650: dwrite d4/d7/d11/f16 [0,4194304] 0 2023-12-16T07:40:24.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/651: write d4/d7/d11/db3/d59/f70 [1106510,110161] 0 2023-12-16T07:40:24.755 INFO:tasks.workunit.client.0.smithi049.stdout:1/802: dwrite d20/d41/d52/d86/fe5 [0,4194304] 0 2023-12-16T07:40:24.756 INFO:tasks.workunit.client.0.smithi049.stdout:1/803: readlink d20/d45/d47/l4d 0 2023-12-16T07:40:24.759 INFO:tasks.workunit.client.0.smithi049.stdout:9/652: creat d4/d7/d11/db3/d59/fcb x:0 0 0 2023-12-16T07:40:24.762 INFO:tasks.workunit.client.0.smithi049.stdout:1/804: mknod d20/d41/d52/d10b/c115 0 2023-12-16T07:40:24.764 INFO:tasks.workunit.client.0.smithi049.stdout:9/653: mkdir d4/db2/dcc 0 2023-12-16T07:40:24.764 INFO:tasks.workunit.client.0.smithi049.stdout:7/778: dwrite d7/dc/dd/d35/f94 [0,4194304] 0 2023-12-16T07:40:24.765 INFO:tasks.workunit.client.0.smithi049.stdout:1/805: rename d20/d45/f48 to d20/d41/d4f/d55/d82/f116 0 2023-12-16T07:40:24.767 INFO:tasks.workunit.client.0.smithi049.stdout:1/806: rename d20/f5b to d20/d41/d4f/d55/d7f/d106/f117 0 2023-12-16T07:40:24.768 INFO:tasks.workunit.client.0.smithi049.stdout:1/807: symlink d20/d45/d112/l118 0 2023-12-16T07:40:24.769 INFO:tasks.workunit.client.0.smithi049.stdout:1/808: mknod d20/d41/dab/c119 0 2023-12-16T07:40:24.770 INFO:tasks.workunit.client.0.smithi049.stdout:1/809: creat d20/d41/d52/d10b/f11a x:0 0 0 2023-12-16T07:40:24.779 INFO:tasks.workunit.client.0.smithi049.stdout:5/795: dwrite d5/f9 [4194304,4194304] 0 2023-12-16T07:40:24.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/924: dwrite d13/d21/d99/f1f [0,4194304] 0 2023-12-16T07:40:24.783 INFO:tasks.workunit.client.0.smithi049.stdout:9/654: dread d4/d7/d11/d26/f53 [0,4194304] 0 2023-12-16T07:40:24.788 INFO:tasks.workunit.client.0.smithi049.stdout:9/655: read d4/d7/d11/db3/f4f [1826072,66405] 0 2023-12-16T07:40:24.788 INFO:tasks.workunit.client.0.smithi049.stdout:9/656: chown d4/c28 33376261 1 2023-12-16T07:40:24.788 INFO:tasks.workunit.client.0.smithi049.stdout:9/657: dread - d4/d7/d11/d1d/d69/d76/f9a zero size 2023-12-16T07:40:24.790 INFO:tasks.workunit.client.0.smithi049.stdout:9/658: getdents d4/d7/d11/d1d/d69/d76/d83 0 2023-12-16T07:40:24.793 INFO:tasks.workunit.client.0.smithi049.stdout:9/659: creat d4/d7/d11/d1d/d5b/dbe/fcd x:0 0 0 2023-12-16T07:40:24.801 INFO:tasks.workunit.client.0.smithi049.stdout:7/779: dwrite d7/dc/dd/d35/f41 [4194304,4194304] 0 2023-12-16T07:40:24.802 INFO:tasks.workunit.client.0.smithi049.stdout:7/780: dread d7/dc/dd/d27/fb5 [0,4194304] 0 2023-12-16T07:40:24.803 INFO:tasks.workunit.client.0.smithi049.stdout:7/781: truncate d7/dc/d6b/f84 1222374 0 2023-12-16T07:40:24.803 INFO:tasks.workunit.client.0.smithi049.stdout:7/782: stat d7/dc/l65 0 2023-12-16T07:40:24.803 INFO:tasks.workunit.client.0.smithi049.stdout:7/783: dread - d7/dc/d15/d57/fa2 zero size 2023-12-16T07:40:24.804 INFO:tasks.workunit.client.0.smithi049.stdout:7/784: stat d7/fa 0 2023-12-16T07:40:24.804 INFO:tasks.workunit.client.0.smithi049.stdout:7/785: chown d7/dc/d6b/d105 288953 1 2023-12-16T07:40:24.811 INFO:tasks.workunit.client.0.smithi049.stdout:0/925: dwrite d13/fcb [0,4194304] 0 2023-12-16T07:40:24.811 INFO:tasks.workunit.client.0.smithi049.stdout:9/660: dwrite d4/d7/d11/d1d/d48/d93/fad [0,4194304] 0 2023-12-16T07:40:24.813 INFO:tasks.workunit.client.0.smithi049.stdout:5/796: dwrite d5/de/d54/d57/dfa/d20/d95/fab [0,4194304] 0 2023-12-16T07:40:24.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/810: dwrite d20/f21 [4194304,4194304] 0 2023-12-16T07:40:24.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/811: chown d20/d41/d52/d86/fe5 126686 1 2023-12-16T07:40:24.814 INFO:tasks.workunit.client.0.smithi049.stdout:0/926: read d13/d21/d99/f1f [1622028,79253] 0 2023-12-16T07:40:24.816 INFO:tasks.workunit.client.0.smithi049.stdout:9/661: mkdir d4/d7/d11/db3/d8a/daa/dce 0 2023-12-16T07:40:24.816 INFO:tasks.workunit.client.0.smithi049.stdout:9/662: chown d4/l7c 101416077 1 2023-12-16T07:40:24.819 INFO:tasks.workunit.client.0.smithi049.stdout:5/797: rename d5/de/d54/d67/dc2/fcc to d5/de/d1c/db1/f117 0 2023-12-16T07:40:24.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/786: dwrite d7/dc/d15/fdf [0,4194304] 0 2023-12-16T07:40:24.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/787: truncate d7/dc/d2f/d40/d5d/ff5 169293 0 2023-12-16T07:40:24.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/788: truncate d7/dc/dd/d37/d5c/ff4 593206 0 2023-12-16T07:40:24.823 INFO:tasks.workunit.client.0.smithi049.stdout:1/812: symlink d20/d45/l11b 0 2023-12-16T07:40:24.823 INFO:tasks.workunit.client.0.smithi049.stdout:1/813: stat d20/d41/d4f/d55/d7f/ff4 0 2023-12-16T07:40:24.825 INFO:tasks.workunit.client.0.smithi049.stdout:5/798: creat d5/de/d1c/f118 x:0 0 0 2023-12-16T07:40:24.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/927: creat d13/d39/d78/f147 x:0 0 0 2023-12-16T07:40:24.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/789: truncate d7/dc/dd/d27/d8e/f90 3237494 0 2023-12-16T07:40:24.832 INFO:tasks.workunit.client.0.smithi049.stdout:5/799: mkdir d5/de/d54/d57/dfa/d21/d58/d119 0 2023-12-16T07:40:24.832 INFO:tasks.workunit.client.0.smithi049.stdout:2/716: sync 2023-12-16T07:40:24.832 INFO:tasks.workunit.client.0.smithi049.stdout:7/790: creat d7/dc/d6b/d105/f10d x:0 0 0 2023-12-16T07:40:24.832 INFO:tasks.workunit.client.0.smithi049.stdout:3/656: sync 2023-12-16T07:40:24.832 INFO:tasks.workunit.client.0.smithi049.stdout:6/836: sync 2023-12-16T07:40:24.833 INFO:tasks.workunit.client.0.smithi049.stdout:7/791: creat d7/dc/d6b/dbf/dd3/f10e x:0 0 0 2023-12-16T07:40:24.833 INFO:tasks.workunit.client.0.smithi049.stdout:3/657: truncate d1/d2a/d37/d3f/d4c/f51 81092 0 2023-12-16T07:40:24.833 INFO:tasks.workunit.client.0.smithi049.stdout:3/658: write d1/d2a/fb0 [1019158,37779] 0 2023-12-16T07:40:24.838 INFO:tasks.workunit.client.0.smithi049.stdout:6/837: rename d0/d2/df/d4e/d5d/d6f/d4a/l60 to d0/d39/d5b/d65/dc1/d100/l113 0 2023-12-16T07:40:24.840 INFO:tasks.workunit.client.0.smithi049.stdout:6/838: read d0/d39/d5b/d65/d4c/fb7 [1722252,40106] 0 2023-12-16T07:40:24.842 INFO:tasks.workunit.client.0.smithi049.stdout:9/663: dwrite f3 [0,4194304] 0 2023-12-16T07:40:24.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/792: rename d7/dc/d6b/dbf/dd3/de4 to d7/db4/d10f 0 2023-12-16T07:40:24.845 INFO:tasks.workunit.client.0.smithi049.stdout:9/664: link d4/db/f97 d4/d7/d11/d26/fcf 0 2023-12-16T07:40:24.846 INFO:tasks.workunit.client.0.smithi049.stdout:3/659: rename d1/d2a/l36 to d1/d2a/d37/db9/ld4 0 2023-12-16T07:40:24.849 INFO:tasks.workunit.client.0.smithi049.stdout:7/793: unlink d7/db4/d10f/lef 0 2023-12-16T07:40:24.849 INFO:tasks.workunit.client.0.smithi049.stdout:4/700: sync 2023-12-16T07:40:24.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/734: sync 2023-12-16T07:40:24.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/735: fdatasync d0/d1f/f9f 0 2023-12-16T07:40:24.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/736: stat d0/d1f/d36/db8/lcc 0 2023-12-16T07:40:24.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/928: dwrite d13/d21/d99/d46/d65/d82/ddb/ff7 [0,4194304] 0 2023-12-16T07:40:24.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/814: dwrite d20/d41/d52/d86/db1/fd7 [0,4194304] 0 2023-12-16T07:40:24.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/815: fsync f1f 0 2023-12-16T07:40:24.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/816: chown d20/d45/l11b 12830 1 2023-12-16T07:40:24.851 INFO:tasks.workunit.client.0.smithi049.stdout:9/665: creat d4/d7/d11/d1d/d69/d76/fd0 x:0 0 0 2023-12-16T07:40:24.854 INFO:tasks.workunit.client.0.smithi049.stdout:3/660: rename d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/daf to d1/d2a/d37/d3f/d5a/d5b/d77/dd5 0 2023-12-16T07:40:24.855 INFO:tasks.workunit.client.0.smithi049.stdout:7/794: symlink d7/dc/d15/d66/l110 0 2023-12-16T07:40:24.855 INFO:tasks.workunit.client.0.smithi049.stdout:7/795: fsync d7/dc/d2f/d40/f4b 0 2023-12-16T07:40:24.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/701: symlink d2/db/dd/d9f/ldf 0 2023-12-16T07:40:24.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/702: chown d2/db/dd/de/l98 528311830 1 2023-12-16T07:40:24.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/703: write d2/db/dd/de/d1e/d37/fbf [458364,22096] 0 2023-12-16T07:40:24.861 INFO:tasks.workunit.client.0.smithi049.stdout:0/929: mknod d13/d39/d38/da7/c148 0 2023-12-16T07:40:24.865 INFO:tasks.workunit.client.0.smithi049.stdout:1/817: mkdir d20/d41/d11c 0 2023-12-16T07:40:24.867 INFO:tasks.workunit.client.0.smithi049.stdout:3/661: symlink d1/d2a/d37/db9/ld6 0 2023-12-16T07:40:24.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/704: getdents d2/db/dd/d52 0 2023-12-16T07:40:24.873 INFO:tasks.workunit.client.0.smithi049.stdout:0/930: chown d13/d21/d99/c35 44523766 1 2023-12-16T07:40:24.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/662: creat d1/d2a/d37/d3f/d5a/dc2/fd7 x:0 0 0 2023-12-16T07:40:24.873 INFO:tasks.workunit.client.0.smithi049.stdout:7/796: mknod d7/dc/d15/d57/dc8/c111 0 2023-12-16T07:40:24.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/663: truncate d1/ff 4514298 0 2023-12-16T07:40:24.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/705: getdents d2/db/dd/de/d1e/d37/d82/dd4 0 2023-12-16T07:40:24.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/664: stat d1/d2a/d37/f55 0 2023-12-16T07:40:24.874 INFO:tasks.workunit.client.0.smithi049.stdout:7/797: write d7/fa [5138813,79720] 0 2023-12-16T07:40:24.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/665: mknod d1/d2a/cd8 0 2023-12-16T07:40:24.875 INFO:tasks.workunit.client.0.smithi049.stdout:4/706: mkdir d2/db/d6b/dad/de0 0 2023-12-16T07:40:24.875 INFO:tasks.workunit.client.0.smithi049.stdout:7/798: creat d7/dc/d15/d57/f112 x:0 0 0 2023-12-16T07:40:24.876 INFO:tasks.workunit.client.0.smithi049.stdout:7/799: read d7/dc/dd/d27/fb5 [546145,45164] 0 2023-12-16T07:40:24.876 INFO:tasks.workunit.client.0.smithi049.stdout:3/666: link d1/d2b/l86 d1/d2a/d37/d3f/d5a/d5b/d77/ld9 0 2023-12-16T07:40:24.877 INFO:tasks.workunit.client.0.smithi049.stdout:4/707: rmdir d2/db/dd/d9f 39 2023-12-16T07:40:24.877 INFO:tasks.workunit.client.0.smithi049.stdout:4/708: write d2/db/dd/f3d [1526017,33262] 0 2023-12-16T07:40:24.877 INFO:tasks.workunit.client.0.smithi049.stdout:4/709: stat d2/f28 0 2023-12-16T07:40:24.878 INFO:tasks.workunit.client.0.smithi049.stdout:4/710: stat d2/db/dd/d9f/ldf 0 2023-12-16T07:40:24.878 INFO:tasks.workunit.client.0.smithi049.stdout:4/711: chown d2/db/dd/de/d1e/d37/c72 37547888 1 2023-12-16T07:40:24.879 INFO:tasks.workunit.client.0.smithi049.stdout:4/712: mkdir d2/db/dd/de/d1e/d37/da4/de1 0 2023-12-16T07:40:24.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/713: chown d2/db/dd/db7/fcb 0 1 2023-12-16T07:40:24.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/714: write d2/db/d6b/f7e [462746,27019] 0 2023-12-16T07:40:24.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/717: dwrite d2/d1d/d24/f50 [0,4194304] 0 2023-12-16T07:40:24.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/715: write d2/db/dd/de/d1e/d44/f95 [3116749,122968] 0 2023-12-16T07:40:24.893 INFO:tasks.workunit.client.0.smithi049.stdout:4/716: dread d2/db/dd/de/d1e/d37/d4e/f5f [0,4194304] 0 2023-12-16T07:40:24.895 INFO:tasks.workunit.client.0.smithi049.stdout:4/717: mknod d2/db/dd/de/d1e/ce2 0 2023-12-16T07:40:24.895 INFO:tasks.workunit.client.0.smithi049.stdout:5/800: dwrite d5/f8 [0,4194304] 0 2023-12-16T07:40:24.895 INFO:tasks.workunit.client.0.smithi049.stdout:5/801: write d5/de/d54/d57/dfa/d21/d4e/fda [488825,78684] 0 2023-12-16T07:40:24.896 INFO:tasks.workunit.client.0.smithi049.stdout:0/931: dread d13/f2b [0,4194304] 0 2023-12-16T07:40:24.897 INFO:tasks.workunit.client.0.smithi049.stdout:5/802: getdents d5/de/d54/d85 0 2023-12-16T07:40:24.898 INFO:tasks.workunit.client.0.smithi049.stdout:5/803: truncate d5/f83 421981 0 2023-12-16T07:40:24.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/932: unlink d13/d21/d27/f11c 0 2023-12-16T07:40:24.900 INFO:tasks.workunit.client.0.smithi049.stdout:5/804: link d5/de/d54/d57/dfa/d20/f6d d5/de/d1c/d62/d81/f11a 0 2023-12-16T07:40:24.900 INFO:tasks.workunit.client.0.smithi049.stdout:0/933: getdents d13/d21/d99 0 2023-12-16T07:40:24.902 INFO:tasks.workunit.client.0.smithi049.stdout:0/934: truncate d13/d21/d27/f5f 2606369 0 2023-12-16T07:40:24.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/935: symlink d13/d39/dbe/dd7/df9/l149 0 2023-12-16T07:40:24.908 INFO:tasks.workunit.client.0.smithi049.stdout:4/718: dread d2/db/dd/de/d1e/d21/f9e [0,4194304] 0 2023-12-16T07:40:24.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/839: dwrite d0/d39/f109 [0,4194304] 0 2023-12-16T07:40:24.910 INFO:tasks.workunit.client.0.smithi049.stdout:6/840: symlink d0/d39/d5b/d65/d27/d91/d94/da7/l114 0 2023-12-16T07:40:24.911 INFO:tasks.workunit.client.0.smithi049.stdout:6/841: write d0/d39/d5b/d65/d4c/ff7 [386539,6076] 0 2023-12-16T07:40:24.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/842: getdents d0/d39/d5b/d65/d4c/d4d/d6a 0 2023-12-16T07:40:24.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/719: dread d2/db/dd/d52/f6a [0,4194304] 0 2023-12-16T07:40:24.914 INFO:tasks.workunit.client.0.smithi049.stdout:6/843: mkdir d0/d39/d5b/d65/d27/d115 0 2023-12-16T07:40:24.914 INFO:tasks.workunit.client.0.smithi049.stdout:6/844: fsync d0/d39/d5b/d65/d32/f71 0 2023-12-16T07:40:24.915 INFO:tasks.workunit.client.0.smithi049.stdout:8/737: dwrite d0/d1f/f9f [0,4194304] 0 2023-12-16T07:40:24.915 INFO:tasks.workunit.client.0.smithi049.stdout:4/720: getdents d2/db/dd/de/d1e/d21 0 2023-12-16T07:40:24.917 INFO:tasks.workunit.client.0.smithi049.stdout:6/845: symlink d0/d39/d5b/d65/d58/d33/dc5/l116 0 2023-12-16T07:40:24.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/846: creat d0/d39/d5b/f117 x:0 0 0 2023-12-16T07:40:24.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/847: chown d0/d39/d5b/f117 123555179 1 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/666: dwrite d4/d7/f38 [0,4194304] 0 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/667: truncate d4/db/f31 4898000 0 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/668: dread - d4/d7/d11/db3/d59/fcb zero size 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:1/818: dwrite d20/d7b/d71/fb5 [0,4194304] 0 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/669: truncate d4/d7/d11/db3/d59/f6d 895244 0 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/718: dwrite d2/d1d/fc3 [0,4194304] 0 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/719: chown d2/d1d/d28/d8b/fcc 74234419 1 2023-12-16T07:40:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:7/800: dwrite d7/dc/dd/d27/dba/fbc [0,4194304] 0 2023-12-16T07:40:24.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/667: dwrite d1/d2a/f32 [0,4194304] 0 2023-12-16T07:40:24.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/936: dwrite d13/d39/d38/d7e/fae [0,4194304] 0 2023-12-16T07:40:24.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/819: creat d20/d41/d52/d10b/f11d x:0 0 0 2023-12-16T07:40:24.931 INFO:tasks.workunit.client.0.smithi049.stdout:8/738: dread d0/d1f/d4e/f96 [0,4194304] 0 2023-12-16T07:40:24.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/670: mknod d4/d7/d11/d1d/d69/d76/d83/db4/cd1 0 2023-12-16T07:40:24.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/671: fsync d4/d7/d11/db3/d8a/f89 0 2023-12-16T07:40:24.934 INFO:tasks.workunit.client.0.smithi049.stdout:4/721: dread d2/db/dd/de/d1e/d37/d82/fae [0,4194304] 0 2023-12-16T07:40:24.934 INFO:tasks.workunit.client.0.smithi049.stdout:6/848: write d0/d39/d5b/d65/d58/d33/daa/f10a [1780742,13641] 0 2023-12-16T07:40:24.939 INFO:tasks.workunit.client.0.smithi049.stdout:2/720: rename d2/d1d/d28/d56/d71/f9f to d2/d1d/d28/d56/d11/d1c/ffd 0 2023-12-16T07:40:24.942 INFO:tasks.workunit.client.0.smithi049.stdout:7/801: link d7/dc/f25 d7/dc/d2f/d40/d104/f113 0 2023-12-16T07:40:24.948 INFO:tasks.workunit.client.0.smithi049.stdout:9/672: mkdir d4/d7/d11/d1d/d5b/d8b/dd2 0 2023-12-16T07:40:24.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/668: dwrite d1/d2b/f4f [0,4194304] 0 2023-12-16T07:40:24.951 INFO:tasks.workunit.client.0.smithi049.stdout:1/820: dwrite d20/f3e [4194304,4194304] 0 2023-12-16T07:40:24.954 INFO:tasks.workunit.client.0.smithi049.stdout:9/673: dread d4/d7/d11/d1d/d69/f9d [0,4194304] 0 2023-12-16T07:40:24.954 INFO:tasks.workunit.client.0.smithi049.stdout:9/674: readlink d4/d7/d11/d1d/d48/lbd 0 2023-12-16T07:40:24.961 INFO:tasks.workunit.client.0.smithi049.stdout:6/849: link d0/d2/df/dce/f107 d0/d2/df/df3/f118 0 2023-12-16T07:40:24.961 INFO:tasks.workunit.client.0.smithi049.stdout:6/850: write d0/d39/dd0/fe6 [206624,50215] 0 2023-12-16T07:40:24.962 INFO:tasks.workunit.client.0.smithi049.stdout:0/937: rename d13/d3c/ffa to d13/d39/d38/d7e/d8b/f14a 0 2023-12-16T07:40:24.963 INFO:tasks.workunit.client.0.smithi049.stdout:2/721: rmdir d2/d1d/d28/d56/d71/ddf 39 2023-12-16T07:40:24.966 INFO:tasks.workunit.client.0.smithi049.stdout:7/802: creat d7/db4/f114 x:0 0 0 2023-12-16T07:40:24.968 INFO:tasks.workunit.client.0.smithi049.stdout:3/669: creat d1/d2a/d37/d3f/d5a/d5b/d77/fda x:0 0 0 2023-12-16T07:40:24.968 INFO:tasks.workunit.client.0.smithi049.stdout:3/670: chown d1/d2a/d37/c3d 505538512 1 2023-12-16T07:40:24.970 INFO:tasks.workunit.client.0.smithi049.stdout:1/821: mkdir d20/d41/d4f/d11e 0 2023-12-16T07:40:24.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/722: rename d2/db/dd/de/d1e/d37/d82/fbd to d2/db/d6b/dc8/fe3 0 2023-12-16T07:40:24.973 INFO:tasks.workunit.client.0.smithi049.stdout:6/851: dread d0/d39/d5b/d65/f1d [0,4194304] 0 2023-12-16T07:40:24.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/722: mkdir d2/d1d/d28/d56/d11/d1c/dd1/dfe 0 2023-12-16T07:40:24.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/723: getdents d2/de/d78/dd9 0 2023-12-16T07:40:24.975 INFO:tasks.workunit.client.0.smithi049.stdout:7/803: link d7/db4/lb9 d7/dc/d2f/d38/ddb/l115 0 2023-12-16T07:40:24.979 INFO:tasks.workunit.client.0.smithi049.stdout:3/671: symlink d1/d2a/d37/d3f/d5a/d5b/d5e/ldb 0 2023-12-16T07:40:24.979 INFO:tasks.workunit.client.0.smithi049.stdout:9/675: rename d4/db/f39 to d4/d7/d11/d1d/d5b/dbe/fd3 0 2023-12-16T07:40:24.979 INFO:tasks.workunit.client.0.smithi049.stdout:3/672: truncate d1/d2a/d37/d3f/d4c/fbb 499408 0 2023-12-16T07:40:24.982 INFO:tasks.workunit.client.0.smithi049.stdout:9/676: rename d4/d7/d11/d1d/d82/dc2 to d4/d7/d11/d26/dd4 0 2023-12-16T07:40:24.984 INFO:tasks.workunit.client.0.smithi049.stdout:3/673: symlink d1/d2a/d37/d3f/ldc 0 2023-12-16T07:40:24.984 INFO:tasks.workunit.client.0.smithi049.stdout:3/674: chown d1/f2c 65311 1 2023-12-16T07:40:24.984 INFO:tasks.workunit.client.0.smithi049.stdout:0/938: dwrite d13/d39/d38/d7e/d8b/f133 [0,4194304] 0 2023-12-16T07:40:24.984 INFO:tasks.workunit.client.0.smithi049.stdout:0/939: chown d13/d21/c22 12 1 2023-12-16T07:40:24.984 INFO:tasks.workunit.client.0.smithi049.stdout:0/940: write d13/d39/df3/d11e/d10d/f132 [786753,18729] 0 2023-12-16T07:40:24.986 INFO:tasks.workunit.client.0.smithi049.stdout:6/852: dread d0/d39/d5b/d65/d27/fd5 [0,4194304] 0 2023-12-16T07:40:24.986 INFO:tasks.workunit.client.0.smithi049.stdout:6/853: readlink d0/d39/d5b/d65/l16 0 2023-12-16T07:40:24.987 INFO:tasks.workunit.client.0.smithi049.stdout:1/822: rename d20/d45/d77 to d20/d41/d4f/dec/d102/d11f 0 2023-12-16T07:40:24.989 INFO:tasks.workunit.client.0.smithi049.stdout:9/677: creat d4/d7/fd5 x:0 0 0 2023-12-16T07:40:24.990 INFO:tasks.workunit.client.0.smithi049.stdout:3/675: mknod d1/d2a/d37/d3f/dcc/cdd 0 2023-12-16T07:40:24.998 INFO:tasks.workunit.client.0.smithi049.stdout:6/854: mkdir d0/d39/d5b/d65/d27/d91/d119 0 2023-12-16T07:40:24.998 INFO:tasks.workunit.client.0.smithi049.stdout:1/823: symlink d20/d41/d4f/d55/d7f/d106/l120 0 2023-12-16T07:40:24.998 INFO:tasks.workunit.client.0.smithi049.stdout:2/724: dwrite d2/d1d/d28/d56/d66/d6b/f94 [0,4194304] 0 2023-12-16T07:40:24.998 INFO:tasks.workunit.client.0.smithi049.stdout:4/723: dwrite d2/db/dd/de/d1e/d37/d4e/f9b [0,4194304] 0 2023-12-16T07:40:24.998 INFO:tasks.workunit.client.0.smithi049.stdout:9/678: rename d4/d7/d11/d1d/d5b/fc8 to d4/d7/d11/d1d/d69/d76/d83/fd6 0 2023-12-16T07:40:24.998 INFO:tasks.workunit.client.0.smithi049.stdout:9/679: fdatasync f0 0 2023-12-16T07:40:24.998 INFO:tasks.workunit.client.0.smithi049.stdout:9/680: fdatasync d4/d7/d11/db3/d59/f6d 0 2023-12-16T07:40:24.999 INFO:tasks.workunit.client.0.smithi049.stdout:9/681: chown d4/c1b 261828258 1 2023-12-16T07:40:24.999 INFO:tasks.workunit.client.0.smithi049.stdout:3/676: mkdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde 0 2023-12-16T07:40:25.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/855: symlink d0/d2/df/d4e/d5d/d6f/l11a 0 2023-12-16T07:40:25.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/824: creat d20/d41/d52/f121 x:0 0 0 2023-12-16T07:40:25.011 INFO:tasks.workunit.client.0.smithi049.stdout:9/682: rmdir d4/d7/d11/db3/d8a 39 2023-12-16T07:40:25.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/856: creat d0/d39/d5b/d65/d27/d91/d94/f11b x:0 0 0 2023-12-16T07:40:25.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/857: chown d0/d2/df/d4e/d5d/d6f/d4a/da4/f103 0 1 2023-12-16T07:40:25.022 INFO:tasks.workunit.client.0.smithi049.stdout:9/683: mkdir d4/d7/d11/d1d/dd7 0 2023-12-16T07:40:25.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/684: creat d4/d7/d11/d1d/d69/d76/d83/db4/fd8 x:0 0 0 2023-12-16T07:40:25.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/685: read - d4/d7/d11/d1d/d69/d76/f99 zero size 2023-12-16T07:40:25.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/686: mknod d4/d7/d11/d1d/d5b/cd9 0 2023-12-16T07:40:25.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/687: unlink d4/d7/d11/d1d/d5b/l6a 0 2023-12-16T07:40:25.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/688: read - d4/d7/d11/d26/d80/fa3 zero size 2023-12-16T07:40:25.033 INFO:tasks.workunit.client.0.smithi049.stdout:9/689: rename d4/d7/d11/d26/dd4 to d4/d7/d11/db3/dda 0 2023-12-16T07:40:25.037 INFO:tasks.workunit.client.0.smithi049.stdout:4/724: dwrite d2/f28 [4194304,4194304] 0 2023-12-16T07:40:25.039 INFO:tasks.workunit.client.0.smithi049.stdout:4/725: dread d2/db/dd/de/d1e/d37/f3c [0,4194304] 0 2023-12-16T07:40:25.040 INFO:tasks.workunit.client.0.smithi049.stdout:4/726: write d2/db/dd/de/fa1 [1937339,55404] 0 2023-12-16T07:40:25.040 INFO:tasks.workunit.client.0.smithi049.stdout:9/690: dread d4/db/f5d [0,4194304] 0 2023-12-16T07:40:25.042 INFO:tasks.workunit.client.0.smithi049.stdout:4/727: rename d2/db/dd/de/d1e/d37/d6f to d2/db/d6b/db9/de4 0 2023-12-16T07:40:25.042 INFO:tasks.workunit.client.0.smithi049.stdout:4/728: truncate d2/db/d6b/fb4 77142 0 2023-12-16T07:40:25.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/691: truncate d4/d7/d11/d26/fcf 542454 0 2023-12-16T07:40:25.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/692: rename d4/d3e/c8d to d4/d7/d11/d26/d80/dbc/cdb 0 2023-12-16T07:40:25.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/693: stat d4/f85 0 2023-12-16T07:40:25.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/694: readlink d4/d7/d11/d1d/d9b/la7 0 2023-12-16T07:40:25.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/725: dwrite d2/d26/f69 [0,4194304] 0 2023-12-16T07:40:25.046 INFO:tasks.workunit.client.0.smithi049.stdout:9/695: truncate d4/db/f72 1071010 0 2023-12-16T07:40:25.046 INFO:tasks.workunit.client.0.smithi049.stdout:3/677: dwrite d1/f25 [4194304,4194304] 0 2023-12-16T07:40:25.046 INFO:tasks.workunit.client.0.smithi049.stdout:3/678: dread - d1/d2a/d37/d3f/f50 zero size 2023-12-16T07:40:25.046 INFO:tasks.workunit.client.0.smithi049.stdout:3/679: chown d1/d2a/d37/d3f/d5a/d5b/d77/cb8 63407965 1 2023-12-16T07:40:25.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/680: write d1/d2a/d37/f5c [3564977,21306] 0 2023-12-16T07:40:25.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/681: fsync d1/d2a/d37/d3f/d4c/f90 0 2023-12-16T07:40:25.050 INFO:tasks.workunit.client.0.smithi049.stdout:1/825: dwrite d20/d40/f5f [0,4194304] 0 2023-12-16T07:40:25.050 INFO:tasks.workunit.client.0.smithi049.stdout:6/858: dwrite d0/d39/d5b/d65/d32/f9c [0,4194304] 0 2023-12-16T07:40:25.051 INFO:tasks.workunit.client.0.smithi049.stdout:9/696: unlink d4/d7/d11/f67 0 2023-12-16T07:40:25.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/682: creat d1/d2a/d37/db9/fdf x:0 0 0 2023-12-16T07:40:25.053 INFO:tasks.workunit.client.0.smithi049.stdout:3/683: write d1/d2a/d37/d3f/f41 [2342384,55227] 0 2023-12-16T07:40:25.059 INFO:tasks.workunit.client.0.smithi049.stdout:6/859: creat d0/d2/f11c x:0 0 0 2023-12-16T07:40:25.059 INFO:tasks.workunit.client.0.smithi049.stdout:6/860: write d0/d2/df/f7a [1990832,38738] 0 2023-12-16T07:40:25.060 INFO:tasks.workunit.client.0.smithi049.stdout:9/697: mknod d4/d7/d11/d1d/d9b/dae/dc3/cdc 0 2023-12-16T07:40:25.060 INFO:tasks.workunit.client.0.smithi049.stdout:6/861: dread d0/d39/dd0/fe6 [0,4194304] 0 2023-12-16T07:40:25.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/684: rmdir d1/d2a/d37/d3f/d5a/d6d/d96/db3 0 2023-12-16T07:40:25.064 INFO:tasks.workunit.client.0.smithi049.stdout:6/862: dread d0/d39/f54 [0,4194304] 0 2023-12-16T07:40:25.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/685: mkdir d1/d2a/d37/d3f/d5a/dc2/de0 0 2023-12-16T07:40:25.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/686: rename d1/d2a/d37/d3f/d4c/fa4 to d1/d2a/d37/d3f/d5a/d6d/d96/fe1 0 2023-12-16T07:40:25.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/687: mknod d1/d2a/d37/d3f/d5a/d61/d75/ce2 0 2023-12-16T07:40:25.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/729: dwrite d2/db/dd/de/d1e/d21/fb3 [0,4194304] 0 2023-12-16T07:40:25.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/730: fsync d2/f86 0 2023-12-16T07:40:25.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/731: chown d2/db/dd/db7/fc1 2120 1 2023-12-16T07:40:25.100 INFO:tasks.workunit.client.0.smithi049.stdout:4/732: dread d2/db/fab [0,4194304] 0 2023-12-16T07:40:25.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/733: write d2/db/dd/de/d1e/d44/fb8 [151668,37397] 0 2023-12-16T07:40:25.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/734: write d2/fac [3141613,55017] 0 2023-12-16T07:40:25.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/826: dwrite d20/d40/d6f/fb4 [0,4194304] 0 2023-12-16T07:40:25.103 INFO:tasks.workunit.client.0.smithi049.stdout:2/726: dwrite d2/d1d/d28/d56/d71/f80 [0,4194304] 0 2023-12-16T07:40:25.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/735: truncate d2/db/d6b/dc8/fe3 2444697 0 2023-12-16T07:40:25.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/698: dwrite d4/d7/d11/d1d/d5b/d8b/fa9 [0,4194304] 0 2023-12-16T07:40:25.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/699: fsync d4/d7/d11/db3/d8a/f5a 0 2023-12-16T07:40:25.105 INFO:tasks.workunit.client.0.smithi049.stdout:3/688: dwrite d1/f18 [0,4194304] 0 2023-12-16T07:40:25.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/863: dwrite d0/d39/d5b/d65/d58/d2c/f4b [4194304,4194304] 0 2023-12-16T07:40:25.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/864: write d0/d2/df/d4e/d5d/d6f/d4a/da4/fec [72019,83943] 0 2023-12-16T07:40:25.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/865: write d0/d39/d5b/d65/d58/d33/daa/fac [4608246,11120] 0 2023-12-16T07:40:25.108 INFO:tasks.workunit.client.0.smithi049.stdout:1/827: creat d20/d7b/d71/f122 x:0 0 0 2023-12-16T07:40:25.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/736: dread d2/db/dd/de/d1e/d44/fa6 [0,4194304] 0 2023-12-16T07:40:25.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/700: creat d4/d7/d11/d1d/d9b/fdd x:0 0 0 2023-12-16T07:40:25.117 INFO:tasks.workunit.client.0.smithi049.stdout:3/689: dread d1/d2b/f62 [0,4194304] 0 2023-12-16T07:40:25.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/739: sync 2023-12-16T07:40:25.117 INFO:tasks.workunit.client.0.smithi049.stdout:5/805: sync 2023-12-16T07:40:25.117 INFO:tasks.workunit.client.0.smithi049.stdout:5/806: stat d5/de/d54/d57/dfa/d20/f36 0 2023-12-16T07:40:25.117 INFO:tasks.workunit.client.0.smithi049.stdout:5/807: readlink d5/de/d54/d67/l73 0 2023-12-16T07:40:25.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/690: read d1/d2a/f40 [325068,40933] 0 2023-12-16T07:40:25.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/691: write d1/d2a/d37/d3f/d5a/d61/f9e [1133975,4079] 0 2023-12-16T07:40:25.122 INFO:tasks.workunit.client.0.smithi049.stdout:3/692: dread d1/f16 [0,4194304] 0 2023-12-16T07:40:25.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/866: mknod d0/d39/d5b/d65/d4c/d4d/d6a/de9/c11d 0 2023-12-16T07:40:25.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/867: fsync d0/d39/d5b/d65/d27/d91/d94/f11b 0 2023-12-16T07:40:25.122 INFO:tasks.workunit.client.0.smithi049.stdout:9/701: mkdir d4/d7/d11/db3/d8a/daa/dce/dde 0 2023-12-16T07:40:25.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/868: readlink d0/d2/df/le1 0 2023-12-16T07:40:25.122 INFO:tasks.workunit.client.0.smithi049.stdout:8/740: creat d0/d1f/d36/db8/fe3 x:0 0 0 2023-12-16T07:40:25.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/808: link d5/de/d54/d57/dfa/d21/d58/c77 d5/de/d54/d67/dc2/c11b 0 2023-12-16T07:40:25.124 INFO:tasks.workunit.client.0.smithi049.stdout:8/741: write d0/d1f/d1c/f39 [2093044,25901] 0 2023-12-16T07:40:25.124 INFO:tasks.workunit.client.0.smithi049.stdout:8/742: getdents d0/d1f/d36/dbf 0 2023-12-16T07:40:25.125 INFO:tasks.workunit.client.0.smithi049.stdout:3/693: creat d1/d2a/d37/d3f/dcc/fe3 x:0 0 0 2023-12-16T07:40:25.127 INFO:tasks.workunit.client.0.smithi049.stdout:6/869: creat d0/d39/d5b/d65/d27/d91/f11e x:0 0 0 2023-12-16T07:40:25.130 INFO:tasks.workunit.client.0.smithi049.stdout:1/828: dwrite d20/d41/d4f/d55/d82/f110 [0,4194304] 0 2023-12-16T07:40:25.130 INFO:tasks.workunit.client.0.smithi049.stdout:5/809: rmdir d5/de/d54/d57/dfa/d21/d5a/d109 0 2023-12-16T07:40:25.132 INFO:tasks.workunit.client.0.smithi049.stdout:3/694: creat d1/d2a/d37/d3f/d5a/d61/d75/fe4 x:0 0 0 2023-12-16T07:40:25.132 INFO:tasks.workunit.client.0.smithi049.stdout:6/870: dread d0/d39/d5b/d65/f1d [0,4194304] 0 2023-12-16T07:40:25.135 INFO:tasks.workunit.client.0.smithi049.stdout:1/829: creat d20/d43/f123 x:0 0 0 2023-12-16T07:40:25.136 INFO:tasks.workunit.client.0.smithi049.stdout:5/810: creat d5/de/d54/d57/d3c/f11c x:0 0 0 2023-12-16T07:40:25.137 INFO:tasks.workunit.client.0.smithi049.stdout:3/695: creat d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fe5 x:0 0 0 2023-12-16T07:40:25.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/830: rename d20/d41/d52/d86/db1 to d20/d41/d124 0 2023-12-16T07:40:25.139 INFO:tasks.workunit.client.0.smithi049.stdout:5/811: symlink d5/de/l11d 0 2023-12-16T07:40:25.139 INFO:tasks.workunit.client.0.smithi049.stdout:5/812: write d5/de/f112 [874275,76661] 0 2023-12-16T07:40:25.140 INFO:tasks.workunit.client.0.smithi049.stdout:5/813: truncate d5/de/d54/d57/d2f/fa3 316844 0 2023-12-16T07:40:25.140 INFO:tasks.workunit.client.0.smithi049.stdout:5/814: write d5/de/d54/d57/dfa/d21/fb6 [3633525,98298] 0 2023-12-16T07:40:25.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/696: truncate d1/d2a/d37/d3f/d5a/d61/d6b/fac 2143259 0 2023-12-16T07:40:25.142 INFO:tasks.workunit.client.0.smithi049.stdout:1/831: mknod d20/d41/d124/c125 0 2023-12-16T07:40:25.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/832: stat d20/c3b 0 2023-12-16T07:40:25.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/833: chown d20/d7b/ca7 3896 1 2023-12-16T07:40:25.143 INFO:tasks.workunit.client.0.smithi049.stdout:7/804: sync 2023-12-16T07:40:25.143 INFO:tasks.workunit.client.0.smithi049.stdout:0/941: sync 2023-12-16T07:40:25.143 INFO:tasks.workunit.client.0.smithi049.stdout:3/697: link d1/d2a/d37/db9/lbc d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde/le6 0 2023-12-16T07:40:25.144 INFO:tasks.workunit.client.0.smithi049.stdout:7/805: creat d7/dc/dd/d14/f116 x:0 0 0 2023-12-16T07:40:25.150 INFO:tasks.workunit.client.0.smithi049.stdout:3/698: mkdir d1/d2a/d37/d3f/d5a/de7 0 2023-12-16T07:40:25.151 INFO:tasks.workunit.client.0.smithi049.stdout:6/871: dwrite d0/d39/d5b/d65/d27/f85 [0,4194304] 0 2023-12-16T07:40:25.152 INFO:tasks.workunit.client.0.smithi049.stdout:3/699: mkdir d1/d2a/d37/d3f/dcc/de8 0 2023-12-16T07:40:25.152 INFO:tasks.workunit.client.0.smithi049.stdout:3/700: write d1/d2a/d37/d3f/d4c/f51 [395662,34962] 0 2023-12-16T07:40:25.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/872: mknod d0/d39/d5b/d65/d27/d91/d119/c11f 0 2023-12-16T07:40:25.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/873: truncate d0/d39/d5b/d65/d58/f51 4499726 0 2023-12-16T07:40:25.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/874: chown d0/d39/d5b/fc4 67013836 1 2023-12-16T07:40:25.156 INFO:tasks.workunit.client.0.smithi049.stdout:1/834: dread d20/d41/d4f/d55/f83 [0,4194304] 0 2023-12-16T07:40:25.158 INFO:tasks.workunit.client.0.smithi049.stdout:3/701: getdents d1/d2b 0 2023-12-16T07:40:25.158 INFO:tasks.workunit.client.0.smithi049.stdout:3/702: chown d1/d2a/d37/d3f/d5a/d61 116063 1 2023-12-16T07:40:25.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/703: link d1/f18 d1/d2b/fe9 0 2023-12-16T07:40:25.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/704: readlink d1/d2a/d37/db9/ld4 0 2023-12-16T07:40:25.163 INFO:tasks.workunit.client.0.smithi049.stdout:6/875: mkdir d0/d2/df/d4e/d5d/d120 0 2023-12-16T07:40:25.165 INFO:tasks.workunit.client.0.smithi049.stdout:6/876: creat d0/d39/d5b/d65/d58/d33/dc2/f121 x:0 0 0 2023-12-16T07:40:25.167 INFO:tasks.workunit.client.0.smithi049.stdout:5/815: dwrite d5/de/d1c/f10b [0,4194304] 0 2023-12-16T07:40:25.167 INFO:tasks.workunit.client.0.smithi049.stdout:6/877: rename d0/d39/d5b/d65/d53/l5e to d0/d39/d5b/d65/d58/d33/daa/l122 0 2023-12-16T07:40:25.167 INFO:tasks.workunit.client.0.smithi049.stdout:6/878: chown d0/d39/d5b/d65/d58/d33/l7c 7 1 2023-12-16T07:40:25.167 INFO:tasks.workunit.client.0.smithi049.stdout:7/806: dwrite d7/fed [0,4194304] 0 2023-12-16T07:40:25.167 INFO:tasks.workunit.client.0.smithi049.stdout:7/807: read d7/dc/dd/d27/f8c [1843211,15130] 0 2023-12-16T07:40:25.169 INFO:tasks.workunit.client.0.smithi049.stdout:6/879: dread d0/d2/df/d81/fa9 [0,4194304] 0 2023-12-16T07:40:25.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/808: rmdir d7/dc/d2f/d40 39 2023-12-16T07:40:25.178 INFO:tasks.workunit.client.0.smithi049.stdout:1/835: dwrite d20/d40/d6f/f10f [0,4194304] 0 2023-12-16T07:40:25.179 INFO:tasks.workunit.client.0.smithi049.stdout:3/705: fsync d1/d2b/fe9 0 2023-12-16T07:40:25.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/880: dwrite d0/d39/d5b/d65/d4c/d4d/d6a/dd6/f108 [0,4194304] 0 2023-12-16T07:40:25.184 INFO:tasks.workunit.client.0.smithi049.stdout:1/836: creat d20/d41/d4f/dec/d102/f126 x:0 0 0 2023-12-16T07:40:25.185 INFO:tasks.workunit.client.0.smithi049.stdout:3/706: symlink d1/d2a/d37/d3f/d5a/d5b/lea 0 2023-12-16T07:40:25.190 INFO:tasks.workunit.client.0.smithi049.stdout:1/837: creat d20/d41/d4f/d7c/dfa/f127 x:0 0 0 2023-12-16T07:40:25.192 INFO:tasks.workunit.client.0.smithi049.stdout:1/838: creat d20/f128 x:0 0 0 2023-12-16T07:40:25.194 INFO:tasks.workunit.client.0.smithi049.stdout:1/839: symlink d20/d41/d52/d86/dd9/l129 0 2023-12-16T07:40:25.194 INFO:tasks.workunit.client.0.smithi049.stdout:1/840: chown d20/d41/d4f/d55/d82/dd2/fe6 28264 1 2023-12-16T07:40:25.195 INFO:tasks.workunit.client.0.smithi049.stdout:1/841: write d20/d41/d4f/dec/d102/d11f/f9e [1407114,80409] 0 2023-12-16T07:40:25.197 INFO:tasks.workunit.client.0.smithi049.stdout:1/842: dread f1c [0,4194304] 0 2023-12-16T07:40:25.201 INFO:tasks.workunit.client.0.smithi049.stdout:1/843: symlink d20/d41/dab/l12a 0 2023-12-16T07:40:25.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/844: truncate d20/d41/d4f/d55/d58/f7e 223337 0 2023-12-16T07:40:25.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/845: truncate d20/d7b/d71/f122 138014 0 2023-12-16T07:40:25.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/846: creat d20/d45/d112/f12b x:0 0 0 2023-12-16T07:40:25.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/847: mkdir d20/d45/d47/d12c 0 2023-12-16T07:40:25.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/848: dread - d20/d41/d4f/d7c/ff8 zero size 2023-12-16T07:40:25.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/849: readlink d20/d45/lc2 0 2023-12-16T07:40:25.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/850: write d20/d41/f8d [474194,76253] 0 2023-12-16T07:40:25.206 INFO:tasks.workunit.client.0.smithi049.stdout:6/881: dwrite d0/d39/d5b/d65/d58/d33/f70 [0,4194304] 0 2023-12-16T07:40:25.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/707: dwrite d1/d2a/d37/d3f/fb1 [0,4194304] 0 2023-12-16T07:40:25.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/708: dread d1/d2a/d37/d3f/f93 [0,4194304] 0 2023-12-16T07:40:25.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/851: dwrite d20/d43/f9a [0,4194304] 0 2023-12-16T07:40:25.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/852: stat d20/d41/d4f/d7c 0 2023-12-16T07:40:25.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/853: truncate d20/d45/d47/fb3 1275601 0 2023-12-16T07:40:25.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/854: truncate d20/d41/d52/d86/dd9/f107 341706 0 2023-12-16T07:40:25.222 INFO:tasks.workunit.client.0.smithi049.stdout:6/882: dwrite d0/d39/d5b/d65/d58/d33/daa/fac [0,4194304] 0 2023-12-16T07:40:25.222 INFO:tasks.workunit.client.0.smithi049.stdout:6/883: fdatasync d0/d2/df/d4e/fe0 0 2023-12-16T07:40:25.224 INFO:tasks.workunit.client.0.smithi049.stdout:1/855: symlink d20/d41/d4f/d7c/d105/l12d 0 2023-12-16T07:40:25.224 INFO:tasks.workunit.client.0.smithi049.stdout:1/856: truncate d20/f3f 3936505 0 2023-12-16T07:40:25.226 INFO:tasks.workunit.client.0.smithi049.stdout:6/884: mkdir d0/d2/df/d81/d123 0 2023-12-16T07:40:25.226 INFO:tasks.workunit.client.0.smithi049.stdout:6/885: write d0/d39/dd0/fe6 [165132,51992] 0 2023-12-16T07:40:25.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/857: mknod d20/d41/d52/d86/c12e 0 2023-12-16T07:40:25.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/858: chown d20/f28 1 1 2023-12-16T07:40:25.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/859: chown d20/l30 318 1 2023-12-16T07:40:25.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/860: chown d20/d40/d6f/dac/fd0 1 1 2023-12-16T07:40:25.228 INFO:tasks.workunit.client.0.smithi049.stdout:6/886: rename d0/d39/d5b/d65/d27/fd5 to d0/d39/d5b/d65/d27/d115/f124 0 2023-12-16T07:40:25.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/709: dwrite d1/d2a/f68 [0,4194304] 0 2023-12-16T07:40:25.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/710: stat d1/l11 0 2023-12-16T07:40:25.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/711: creat d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/feb x:0 0 0 2023-12-16T07:40:25.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/712: readlink d1/d2a/d37/d3f/d5a/d61/d6b/lbe 0 2023-12-16T07:40:25.232 INFO:tasks.workunit.client.0.smithi049.stdout:3/713: creat d1/d2a/d37/d3f/d5a/dc2/de0/fec x:0 0 0 2023-12-16T07:40:25.234 INFO:tasks.workunit.client.0.smithi049.stdout:6/887: write d0/f64 [2851421,90627] 0 2023-12-16T07:40:25.234 INFO:tasks.workunit.client.0.smithi049.stdout:3/714: unlink d1/d2a/d37/d3f/d5a/d61/d6b/fac 0 2023-12-16T07:40:25.236 INFO:tasks.workunit.client.0.smithi049.stdout:6/888: rename d0/d39/d5b/d65/d58/l9a to d0/d39/d5b/d65/d58/d33/daa/l125 0 2023-12-16T07:40:25.236 INFO:tasks.workunit.client.0.smithi049.stdout:3/715: getdents d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde 0 2023-12-16T07:40:25.238 INFO:tasks.workunit.client.0.smithi049.stdout:1/861: dread d20/f8e [0,4194304] 0 2023-12-16T07:40:25.239 INFO:tasks.workunit.client.0.smithi049.stdout:6/889: rename d0/d2/c90 to d0/d2/df/d4e/d5d/d6f/c126 0 2023-12-16T07:40:25.240 INFO:tasks.workunit.client.0.smithi049.stdout:1/862: creat d20/d41/d11c/f12f x:0 0 0 2023-12-16T07:40:25.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/863: dread d20/f79 [0,4194304] 0 2023-12-16T07:40:25.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/864: stat d20/d41/d4f/d7c/fb6 0 2023-12-16T07:40:25.247 INFO:tasks.workunit.client.0.smithi049.stdout:4/737: sync 2023-12-16T07:40:25.247 INFO:tasks.workunit.client.0.smithi049.stdout:2/727: sync 2023-12-16T07:40:25.248 INFO:tasks.workunit.client.0.smithi049.stdout:2/728: fsync d2/db8/db9/fd0 0 2023-12-16T07:40:25.248 INFO:tasks.workunit.client.0.smithi049.stdout:1/865: write d20/d41/d52/f100 [3878219,9945] 0 2023-12-16T07:40:25.250 INFO:tasks.workunit.client.0.smithi049.stdout:4/738: truncate d2/db/dd/f13 2604367 0 2023-12-16T07:40:25.252 INFO:tasks.workunit.client.0.smithi049.stdout:1/866: symlink d20/d41/d4f/d55/l130 0 2023-12-16T07:40:25.255 INFO:tasks.workunit.client.0.smithi049.stdout:1/867: rename d20/d41/d4f/d55/d7f/d84/ldb to d20/d41/d4f/d7c/dfa/l131 0 2023-12-16T07:40:25.255 INFO:tasks.workunit.client.0.smithi049.stdout:6/890: dread d0/d39/d5b/d65/d58/d2c/f4b [4194304,4194304] 0 2023-12-16T07:40:25.258 INFO:tasks.workunit.client.0.smithi049.stdout:1/868: unlink d20/d43/f74 0 2023-12-16T07:40:25.259 INFO:tasks.workunit.client.0.smithi049.stdout:6/891: mknod d0/d39/d5b/d65/d58/d33/c127 0 2023-12-16T07:40:25.259 INFO:tasks.workunit.client.0.smithi049.stdout:6/892: fsync d0/d39/d5b/d65/d27/d91/d94/f11b 0 2023-12-16T07:40:25.264 INFO:tasks.workunit.client.0.smithi049.stdout:6/893: mknod d0/d2/df/d81/d123/c128 0 2023-12-16T07:40:25.264 INFO:tasks.workunit.client.0.smithi049.stdout:6/894: truncate d0/d39/d5b/d65/d27/f96 3920119 0 2023-12-16T07:40:25.264 INFO:tasks.workunit.client.0.smithi049.stdout:6/895: write d0/d2/f11c [421967,105710] 0 2023-12-16T07:40:25.264 INFO:tasks.workunit.client.0.smithi049.stdout:6/896: write d0/d39/d5b/d65/d58/f3d [2655444,19759] 0 2023-12-16T07:40:25.266 INFO:tasks.workunit.client.0.smithi049.stdout:3/716: dwrite d1/d2a/f40 [0,4194304] 0 2023-12-16T07:40:25.266 INFO:tasks.workunit.client.0.smithi049.stdout:4/739: dwrite d2/db/dd/de/d1e/d37/f91 [0,4194304] 0 2023-12-16T07:40:25.266 INFO:tasks.workunit.client.0.smithi049.stdout:4/740: write d2/db/dd/de/d1e/d37/d82/fd1 [714274,49467] 0 2023-12-16T07:40:25.278 INFO:tasks.workunit.client.0.smithi049.stdout:4/741: rename d2/fa9 to d2/fe5 0 2023-12-16T07:40:25.285 INFO:tasks.workunit.client.0.smithi049.stdout:3/717: dwrite d1/d2a/d37/d3f/d5a/dc2/de0/fec [0,4194304] 0 2023-12-16T07:40:25.285 INFO:tasks.workunit.client.0.smithi049.stdout:6/897: dwrite d0/d39/f8a [0,4194304] 0 2023-12-16T07:40:25.288 INFO:tasks.workunit.client.0.smithi049.stdout:8/743: sync 2023-12-16T07:40:25.288 INFO:tasks.workunit.client.0.smithi049.stdout:5/816: sync 2023-12-16T07:40:25.288 INFO:tasks.workunit.client.0.smithi049.stdout:0/942: sync 2023-12-16T07:40:25.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/943: write d13/d21/d27/d2c/d62/f84 [2187561,117766] 0 2023-12-16T07:40:25.290 INFO:tasks.workunit.client.0.smithi049.stdout:6/898: creat d0/d2/df/d4e/d5d/dc3/f129 x:0 0 0 2023-12-16T07:40:25.290 INFO:tasks.workunit.client.0.smithi049.stdout:6/899: stat d0/d39/d5b/d65/d27/d91/d94/d10d/d112 0 2023-12-16T07:40:25.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/744: unlink d0/d13/d42/d5b/d68/fa9 0 2023-12-16T07:40:25.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/745: fsync d0/d1f/d36/fc5 0 2023-12-16T07:40:25.294 INFO:tasks.workunit.client.0.smithi049.stdout:5/817: symlink d5/de/d54/da9/l11e 0 2023-12-16T07:40:25.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/702: sync 2023-12-16T07:40:25.296 INFO:tasks.workunit.client.0.smithi049.stdout:7/809: sync 2023-12-16T07:40:25.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/944: link d13/d39/d38/f67 d13/d39/d8a/de7/f14b 0 2023-12-16T07:40:25.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/746: link d0/d13/d42/d5b/d68/c90 d0/d1f/d36/ce4 0 2023-12-16T07:40:25.302 INFO:tasks.workunit.client.0.smithi049.stdout:5/818: creat d5/de/d54/d57/dfa/d21/d58/f11f x:0 0 0 2023-12-16T07:40:25.303 INFO:tasks.workunit.client.0.smithi049.stdout:4/742: dwrite d2/db/dd/de/f63 [0,4194304] 0 2023-12-16T07:40:25.305 INFO:tasks.workunit.client.0.smithi049.stdout:5/819: dread d5/de/d54/d57/d3c/f5d [0,4194304] 0 2023-12-16T07:40:25.307 INFO:tasks.workunit.client.0.smithi049.stdout:9/703: getdents d4/d7/d11/d26/d80/dbc 0 2023-12-16T07:40:25.307 INFO:tasks.workunit.client.0.smithi049.stdout:7/810: creat d7/dc/d2f/f117 x:0 0 0 2023-12-16T07:40:25.307 INFO:tasks.workunit.client.0.smithi049.stdout:8/747: rmdir d0/d13/d42/d5b/d68/d6b/da2 39 2023-12-16T07:40:25.307 INFO:tasks.workunit.client.0.smithi049.stdout:0/945: creat d13/d39/d53/f14c x:0 0 0 2023-12-16T07:40:25.310 INFO:tasks.workunit.client.0.smithi049.stdout:4/743: rename d2/l73 to d2/db/dd/de/d1e/d37/da4/de1/le6 0 2023-12-16T07:40:25.310 INFO:tasks.workunit.client.0.smithi049.stdout:8/748: mkdir d0/d1f/d36/db8/de5 0 2023-12-16T07:40:25.315 INFO:tasks.workunit.client.0.smithi049.stdout:4/744: rename d2/db/dd/de/d1e/d37/da4/ddb to d2/db/dd/de/d1e/d21/de7 0 2023-12-16T07:40:25.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/749: write d0/d1f/fac [4405757,91418] 0 2023-12-16T07:40:25.322 INFO:tasks.workunit.client.0.smithi049.stdout:6/900: dwrite d0/d39/f109 [0,4194304] 0 2023-12-16T07:40:25.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/704: dread d4/d7/d11/db3/d8a/f61 [0,4194304] 0 2023-12-16T07:40:25.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/705: chown d4/f34 124 1 2023-12-16T07:40:25.323 INFO:tasks.workunit.client.0.smithi049.stdout:3/718: dwrite d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fe5 [0,4194304] 0 2023-12-16T07:40:25.325 INFO:tasks.workunit.client.0.smithi049.stdout:6/901: truncate d0/d2/df/d4e/d5d/d6f/d4a/da4/fea 473293 0 2023-12-16T07:40:25.326 INFO:tasks.workunit.client.0.smithi049.stdout:9/706: mkdir d4/d7/d11/d1d/d69/d76/d83/ddf 0 2023-12-16T07:40:25.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/719: creat d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/fed x:0 0 0 2023-12-16T07:40:25.331 INFO:tasks.workunit.client.0.smithi049.stdout:6/902: unlink d0/d39/d5b/d65/d27/d91/d119/c11f 0 2023-12-16T07:40:25.331 INFO:tasks.workunit.client.0.smithi049.stdout:6/903: chown d0/d39/d5b/d65/d58/d33/daa/lcc 21 1 2023-12-16T07:40:25.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/707: mkdir d4/d7/d11/d1d/d69/de0 0 2023-12-16T07:40:25.333 INFO:tasks.workunit.client.0.smithi049.stdout:6/904: link d0/d39/d5b/d65/l21 d0/d39/d5b/l12a 0 2023-12-16T07:40:25.335 INFO:tasks.workunit.client.0.smithi049.stdout:6/905: getdents d0/d39/d5b/d65/d27/d115 0 2023-12-16T07:40:25.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/906: mknod d0/d2/df/d10f/c12b 0 2023-12-16T07:40:25.343 INFO:tasks.workunit.client.0.smithi049.stdout:0/946: dwrite d13/d21/d99/d46/f9d [0,4194304] 0 2023-12-16T07:40:25.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/811: dwrite d7/dc/dd/d35/f97 [0,4194304] 0 2023-12-16T07:40:25.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/812: chown d7/dc/d6b/d70/d86/f88 0 1 2023-12-16T07:40:25.344 INFO:tasks.workunit.client.0.smithi049.stdout:8/750: dwrite d0/d13/d42/f4c [0,4194304] 0 2023-12-16T07:40:25.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/820: dwrite d5/de/d1c/d62/d81/f11a [0,4194304] 0 2023-12-16T07:40:25.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/813: link d7/dc/dd/d35/c91 d7/dc/d6b/d70/d86/c118 0 2023-12-16T07:40:25.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/814: dread - d7/dc/dd/d14/f116 zero size 2023-12-16T07:40:25.352 INFO:tasks.workunit.client.0.smithi049.stdout:5/821: rename d5/de/d54/d57/dfa/d21/fb6 to d5/de/d54/d78/d9b/dd1/f120 0 2023-12-16T07:40:25.353 INFO:tasks.workunit.client.0.smithi049.stdout:5/822: symlink d5/de/d54/d78/d9b/l121 0 2023-12-16T07:40:25.354 INFO:tasks.workunit.client.0.smithi049.stdout:5/823: creat d5/de/d54/da9/f122 x:0 0 0 2023-12-16T07:40:25.355 INFO:tasks.workunit.client.0.smithi049.stdout:5/824: write d5/de/d54/d78/d9b/fbd [584825,4744] 0 2023-12-16T07:40:25.367 INFO:tasks.workunit.client.0.smithi049.stdout:8/751: dread d0/d13/d42/d5b/d68/d6b/da2/fc9 [0,4194304] 0 2023-12-16T07:40:25.368 INFO:tasks.workunit.client.0.smithi049.stdout:8/752: truncate d0/fb2 972825 0 2023-12-16T07:40:25.368 INFO:tasks.workunit.client.0.smithi049.stdout:8/753: chown d0/d1f/d36/f54 2021789 1 2023-12-16T07:40:25.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/754: dread d0/d13/fc1 [0,4194304] 0 2023-12-16T07:40:25.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/755: getdents d0/d13/d42/d5b/d68/d6b/da2/da5 0 2023-12-16T07:40:25.376 INFO:tasks.workunit.client.0.smithi049.stdout:8/756: mkdir d0/d13/d42/de6 0 2023-12-16T07:40:25.377 INFO:tasks.workunit.client.0.smithi049.stdout:8/757: write d0/d1f/d4e/f8b [607181,7414] 0 2023-12-16T07:40:25.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/758: link d0/d1f/f22 d0/d1f/d1c/fe7 0 2023-12-16T07:40:25.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/759: fsync d0/d1f/d56/f74 0 2023-12-16T07:40:25.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/760: read d0/d1f/fac [1941217,53988] 0 2023-12-16T07:40:25.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/708: dwrite d4/d7/d11/d26/f53 [0,4194304] 0 2023-12-16T07:40:25.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/709: chown d4/d7/d11/d1d/d48 0 1 2023-12-16T07:40:25.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/710: chown d4/l8e 5983792 1 2023-12-16T07:40:25.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/711: write d4/d7/d11/db3/d8a/fc9 [646260,127145] 0 2023-12-16T07:40:25.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/907: dwrite d0/d39/d5b/d65/d27/d91/d94/fcd [0,4194304] 0 2023-12-16T07:40:25.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/908: fdatasync d0/d39/d5b/f117 0 2023-12-16T07:40:25.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/909: chown d0/d2/df/d4e/d5d/d6f/d4a/f92 32358 1 2023-12-16T07:40:25.381 INFO:tasks.workunit.client.0.smithi049.stdout:0/947: dwrite d13/d21/d99/d46/d65/f9b [0,4194304] 0 2023-12-16T07:40:25.382 INFO:tasks.workunit.client.0.smithi049.stdout:0/948: fsync d13/d21/d99/d46/f9d 0 2023-12-16T07:40:25.382 INFO:tasks.workunit.client.0.smithi049.stdout:0/949: fsync fa 0 2023-12-16T07:40:25.382 INFO:tasks.workunit.client.0.smithi049.stdout:0/950: chown d13/d39/dbe 892507 1 2023-12-16T07:40:25.382 INFO:tasks.workunit.client.0.smithi049.stdout:5/825: dwrite d5/de/d54/f42 [0,4194304] 0 2023-12-16T07:40:25.383 INFO:tasks.workunit.client.0.smithi049.stdout:8/761: rmdir d0/d1f/db7/ddf 0 2023-12-16T07:40:25.383 INFO:tasks.workunit.client.0.smithi049.stdout:9/712: mkdir d4/d7/d11/d1d/d9b/dae/dc3/de1 0 2023-12-16T07:40:25.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/910: creat d0/d39/d5b/d65/d27/d91/d94/f12c x:0 0 0 2023-12-16T07:40:25.390 INFO:tasks.workunit.client.0.smithi049.stdout:0/951: rmdir d13/de1 39 2023-12-16T07:40:25.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/952: write d13/d21/d99/d46/f60 [5313088,40776] 0 2023-12-16T07:40:25.394 INFO:tasks.workunit.client.0.smithi049.stdout:8/762: chown d0/d1f/l35 59224930 1 2023-12-16T07:40:25.396 INFO:tasks.workunit.client.0.smithi049.stdout:5/826: dwrite d5/de/d54/d57/f50 [0,4194304] 0 2023-12-16T07:40:25.396 INFO:tasks.workunit.client.0.smithi049.stdout:5/827: write d5/de/d1c/f10b [5161903,57213] 0 2023-12-16T07:40:25.396 INFO:tasks.workunit.client.0.smithi049.stdout:9/713: creat d4/d7/d11/db3/d8a/fe2 x:0 0 0 2023-12-16T07:40:25.398 INFO:tasks.workunit.client.0.smithi049.stdout:0/953: truncate d13/d21/d27/d2c/d62/f94 123408 0 2023-12-16T07:40:25.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/763: rename d0/d1f/d36/la0 to d0/d1f/d36/le8 0 2023-12-16T07:40:25.401 INFO:tasks.workunit.client.0.smithi049.stdout:6/911: dwrite d0/d39/d5b/d65/d4c/d4d/d6a/dd6/f108 [0,4194304] 0 2023-12-16T07:40:25.401 INFO:tasks.workunit.client.0.smithi049.stdout:6/912: fsync d0/d2/df/d4e/fb6 0 2023-12-16T07:40:25.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/828: write d5/f8f [3533847,42076] 0 2023-12-16T07:40:25.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/829: truncate d5/de/d54/da9/f122 535725 0 2023-12-16T07:40:25.406 INFO:tasks.workunit.client.0.smithi049.stdout:9/714: getdents d4/d7/d11/d1d/d48 0 2023-12-16T07:40:25.407 INFO:tasks.workunit.client.0.smithi049.stdout:0/954: getdents d13/d39/d8a/db6 0 2023-12-16T07:40:25.409 INFO:tasks.workunit.client.0.smithi049.stdout:6/913: rename d0/f64 to d0/d39/d5b/d65/d4c/d4d/d6a/de9/f12d 0 2023-12-16T07:40:25.410 INFO:tasks.workunit.client.0.smithi049.stdout:5/830: creat d5/de/d54/d57/d3c/f123 x:0 0 0 2023-12-16T07:40:25.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/715: mknod d4/d7/d11/d1d/d69/d76/d83/ddf/ce3 0 2023-12-16T07:40:25.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/716: fsync d4/d7/d11/d26/f8c 0 2023-12-16T07:40:25.414 INFO:tasks.workunit.client.0.smithi049.stdout:5/831: rmdir d5/de/d54/d67 39 2023-12-16T07:40:25.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/729: sync 2023-12-16T07:40:25.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/730: dread - d2/d1d/d24/d55/d7c/d98/f9d zero size 2023-12-16T07:40:25.418 INFO:tasks.workunit.client.0.smithi049.stdout:8/764: dwrite d0/d1f/d56/f74 [0,4194304] 0 2023-12-16T07:40:25.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/832: mknod d5/de/d54/d57/dfa/c124 0 2023-12-16T07:40:25.421 INFO:tasks.workunit.client.0.smithi049.stdout:2/731: rename d2/d1d/l49 to d2/d1d/d24/lff 0 2023-12-16T07:40:25.422 INFO:tasks.workunit.client.0.smithi049.stdout:2/732: fsync d2/d1d/f89 0 2023-12-16T07:40:25.425 INFO:tasks.workunit.client.0.smithi049.stdout:8/765: write d0/d13/fc1 [1894954,98840] 0 2023-12-16T07:40:25.428 INFO:tasks.workunit.client.0.smithi049.stdout:5/833: creat d5/de/d54/da9/dbb/f125 x:0 0 0 2023-12-16T07:40:25.429 INFO:tasks.workunit.client.0.smithi049.stdout:2/733: rename d2/d1d/d28/d56/d11/f51 to d2/d1d/d24/f100 0 2023-12-16T07:40:25.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/834: mknod d5/de/d54/d67/d9e/c126 0 2023-12-16T07:40:25.432 INFO:tasks.workunit.client.0.smithi049.stdout:2/734: rmdir d2/d1d/d28/d56/d11/da8 39 2023-12-16T07:40:25.432 INFO:tasks.workunit.client.0.smithi049.stdout:2/735: dread - d2/d26/d6e/faa zero size 2023-12-16T07:40:25.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/766: unlink d0/d1f/l16 0 2023-12-16T07:40:25.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/767: fsync d0/d13/d42/d5b/fc4 0 2023-12-16T07:40:25.433 INFO:tasks.workunit.client.0.smithi049.stdout:5/835: creat d5/de/d54/da9/dbb/f127 x:0 0 0 2023-12-16T07:40:25.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/836: creat d5/de/d54/d67/df8/f128 x:0 0 0 2023-12-16T07:40:25.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/837: chown d5/de/d54/d57/dfa/d21/f45 6 1 2023-12-16T07:40:25.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/838: fsync d5/de/d54/d57/d3c/fb9 0 2023-12-16T07:40:25.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/914: dwrite d0/d39/d5b/d65/d4c/fb7 [0,4194304] 0 2023-12-16T07:40:25.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/915: chown d0/d39 439871 1 2023-12-16T07:40:25.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/916: write d0/d39/d8b/fa5 [322799,26174] 0 2023-12-16T07:40:25.439 INFO:tasks.workunit.client.0.smithi049.stdout:6/917: fsync d0/d39/d5b/fc4 0 2023-12-16T07:40:25.439 INFO:tasks.workunit.client.0.smithi049.stdout:6/918: fsync d0/d39/f54 0 2023-12-16T07:40:25.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/839: write d5/de/d54/d57/f50 [997340,22302] 0 2023-12-16T07:40:25.439 INFO:tasks.workunit.client.0.smithi049.stdout:9/717: dwrite d4/d7/d11/d1d/d9b/fdd [0,4194304] 0 2023-12-16T07:40:25.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/919: symlink d0/d2/df/d4e/d5d/dc3/l12e 0 2023-12-16T07:40:25.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/920: chown d0/d39/d5b/d65/d58/d33/dc5/lcf 249 1 2023-12-16T07:40:25.444 INFO:tasks.workunit.client.0.smithi049.stdout:5/840: mkdir d5/de/d129 0 2023-12-16T07:40:25.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/718: mkdir d4/d7/d11/d1d/d69/d76/d83/de4 0 2023-12-16T07:40:25.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/719: fdatasync d4/f1f 0 2023-12-16T07:40:25.448 INFO:tasks.workunit.client.0.smithi049.stdout:2/736: dwrite d2/d1d/f68 [0,4194304] 0 2023-12-16T07:40:25.449 INFO:tasks.workunit.client.0.smithi049.stdout:9/720: dread d4/db/f33 [0,4194304] 0 2023-12-16T07:40:25.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/721: dread d4/d7/d11/d1d/f64 [0,4194304] 0 2023-12-16T07:40:25.452 INFO:tasks.workunit.client.0.smithi049.stdout:2/737: creat d2/d26/d6e/f101 x:0 0 0 2023-12-16T07:40:25.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/722: truncate d4/d7/f7a 1046075 0 2023-12-16T07:40:25.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/723: fsync d4/db/f22 0 2023-12-16T07:40:25.453 INFO:tasks.workunit.client.0.smithi049.stdout:8/768: dwrite d0/fb2 [0,4194304] 0 2023-12-16T07:40:25.458 INFO:tasks.workunit.client.0.smithi049.stdout:2/738: rmdir d2/d1d/d28/d56/d71/ddf 39 2023-12-16T07:40:25.458 INFO:tasks.workunit.client.0.smithi049.stdout:9/724: mkdir d4/d7/d11/d1d/d69/d76/d83/db4/de5 0 2023-12-16T07:40:25.459 INFO:tasks.workunit.client.0.smithi049.stdout:1/869: sync 2023-12-16T07:40:25.459 INFO:tasks.workunit.client.0.smithi049.stdout:1/870: readlink d20/d41/d4f/d55/d7f/d84/l87 0 2023-12-16T07:40:25.460 INFO:tasks.workunit.client.0.smithi049.stdout:8/769: creat d0/d1f/d36/db8/de5/fe9 x:0 0 0 2023-12-16T07:40:25.465 INFO:tasks.workunit.client.0.smithi049.stdout:2/739: rename d2/d1d/d28/d56/d66/d6b/f94 to d2/d1d/d28/d56/d11/da8/f102 0 2023-12-16T07:40:25.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/770: rmdir d0/d1f/db7/dbe 39 2023-12-16T07:40:25.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/771: readlink d0/d1f/d36/l9a 0 2023-12-16T07:40:25.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/772: write d0/d1f/d56/f93 [245571,100367] 0 2023-12-16T07:40:25.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/841: dwrite d5/de/d54/da9/f122 [0,4194304] 0 2023-12-16T07:40:25.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/842: stat d5/de/d54/d57/dfa/d21/l113 0 2023-12-16T07:40:25.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/843: fdatasync d5/de/d54/d57/dfa/d21/fad 0 2023-12-16T07:40:25.468 INFO:tasks.workunit.client.0.smithi049.stdout:2/740: creat d2/de/de0/f103 x:0 0 0 2023-12-16T07:40:25.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/773: symlink d0/d1f/d36/db8/de5/lea 0 2023-12-16T07:40:25.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/774: write d0/d13/d42/d5b/fc4 [270131,126400] 0 2023-12-16T07:40:25.475 INFO:tasks.workunit.client.0.smithi049.stdout:2/741: creat d2/d1d/d28/d56/d11/da8/f104 x:0 0 0 2023-12-16T07:40:25.475 INFO:tasks.workunit.client.0.smithi049.stdout:2/742: write d2/d1d/d28/d56/d66/d6b/fd7 [517355,47149] 0 2023-12-16T07:40:25.477 INFO:tasks.workunit.client.0.smithi049.stdout:8/775: rename d0/d1f/d56/fb1 to d0/d1f/db7/feb 0 2023-12-16T07:40:25.480 INFO:tasks.workunit.client.0.smithi049.stdout:2/743: write d2/d1d/d24/d55/d76/f7f [3101213,96493] 0 2023-12-16T07:40:25.480 INFO:tasks.workunit.client.0.smithi049.stdout:2/744: chown d2/d1d/d28/c41 17379717 1 2023-12-16T07:40:25.481 INFO:tasks.workunit.client.0.smithi049.stdout:2/745: creat d2/d1d/dc2/f105 x:0 0 0 2023-12-16T07:40:25.481 INFO:tasks.workunit.client.0.smithi049.stdout:2/746: readlink d2/d1d/d28/l2d 0 2023-12-16T07:40:25.488 INFO:tasks.workunit.client.0.smithi049.stdout:9/725: dwrite d4/d7/d11/d26/f52 [4194304,4194304] 0 2023-12-16T07:40:25.491 INFO:tasks.workunit.client.0.smithi049.stdout:1/871: dwrite d20/d41/d4f/d55/d82/fe9 [0,4194304] 0 2023-12-16T07:40:25.493 INFO:tasks.workunit.client.0.smithi049.stdout:1/872: symlink d20/d41/d4f/d55/d7f/d84/d113/l132 0 2023-12-16T07:40:25.494 INFO:tasks.workunit.client.0.smithi049.stdout:8/776: dread d0/d13/f2f [0,4194304] 0 2023-12-16T07:40:25.494 INFO:tasks.workunit.client.0.smithi049.stdout:5/844: dwrite d5/de/d54/d57/dfa/d21/d58/f11f [0,4194304] 0 2023-12-16T07:40:25.495 INFO:tasks.workunit.client.0.smithi049.stdout:8/777: chown d0/d1f/d36/l78 1997416614 1 2023-12-16T07:40:25.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/873: creat d20/d45/d47/f133 x:0 0 0 2023-12-16T07:40:25.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/874: fdatasync d20/d7b/fe2 0 2023-12-16T07:40:25.503 INFO:tasks.workunit.client.0.smithi049.stdout:5/845: mkdir d5/de/d54/d85/d12a 0 2023-12-16T07:40:25.504 INFO:tasks.workunit.client.0.smithi049.stdout:8/778: symlink d0/d1f/d36/db8/de5/lec 0 2023-12-16T07:40:25.504 INFO:tasks.workunit.client.0.smithi049.stdout:5/846: truncate d5/f19 1532071 0 2023-12-16T07:40:25.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/875: dread d20/d41/d4f/d55/f83 [0,4194304] 0 2023-12-16T07:40:25.506 INFO:tasks.workunit.client.0.smithi049.stdout:9/726: dwrite d4/f34 [0,4194304] 0 2023-12-16T07:40:25.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/847: unlink d5/de/d54/d57/dfa/d21/f3b 0 2023-12-16T07:40:25.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/727: mknod d4/d7/d11/db3/dda/ce6 0 2023-12-16T07:40:25.510 INFO:tasks.workunit.client.0.smithi049.stdout:5/848: creat d5/de/d54/d57/d2f/f12b x:0 0 0 2023-12-16T07:40:25.511 INFO:tasks.workunit.client.0.smithi049.stdout:9/728: symlink d4/d7/d11/d1d/d48/le7 0 2023-12-16T07:40:25.516 INFO:tasks.workunit.client.0.smithi049.stdout:3/720: sync 2023-12-16T07:40:25.516 INFO:tasks.workunit.client.0.smithi049.stdout:7/815: sync 2023-12-16T07:40:25.516 INFO:tasks.workunit.client.0.smithi049.stdout:4/745: sync 2023-12-16T07:40:25.517 INFO:tasks.workunit.client.0.smithi049.stdout:5/849: write d5/f8 [4820539,123516] 0 2023-12-16T07:40:25.519 INFO:tasks.workunit.client.0.smithi049.stdout:4/746: unlink d2/db/dd/f3d 0 2023-12-16T07:40:25.521 INFO:tasks.workunit.client.0.smithi049.stdout:3/721: creat d1/d2a/d37/d3f/fee x:0 0 0 2023-12-16T07:40:25.521 INFO:tasks.workunit.client.0.smithi049.stdout:3/722: fdatasync d1/d2a/d37/d3f/d5a/d61/d75/fe4 0 2023-12-16T07:40:25.521 INFO:tasks.workunit.client.0.smithi049.stdout:7/816: symlink d7/dc/d15/l119 0 2023-12-16T07:40:25.524 INFO:tasks.workunit.client.0.smithi049.stdout:4/747: unlink d2/db/dd/fa 0 2023-12-16T07:40:25.526 INFO:tasks.workunit.client.0.smithi049.stdout:3/723: symlink d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/lef 0 2023-12-16T07:40:25.527 INFO:tasks.workunit.client.0.smithi049.stdout:7/817: rename d7/dc/d15/d66/c72 to d7/dc/dd/d37/d5c/db2/d106/c11a 0 2023-12-16T07:40:25.528 INFO:tasks.workunit.client.0.smithi049.stdout:9/729: dread d4/d7/d11/db3/f4f [0,4194304] 0 2023-12-16T07:40:25.528 INFO:tasks.workunit.client.0.smithi049.stdout:9/730: stat f3 0 2023-12-16T07:40:25.529 INFO:tasks.workunit.client.0.smithi049.stdout:7/818: rename d7/c9 to d7/dc/d2f/c11b 0 2023-12-16T07:40:25.530 INFO:tasks.workunit.client.0.smithi049.stdout:7/819: creat d7/db4/d10f/df7/f11c x:0 0 0 2023-12-16T07:40:25.530 INFO:tasks.workunit.client.0.smithi049.stdout:7/820: fsync f4 0 2023-12-16T07:40:25.530 INFO:tasks.workunit.client.0.smithi049.stdout:7/821: write d7/dc/d15/d57/fa2 [848546,77674] 0 2023-12-16T07:40:25.532 INFO:tasks.workunit.client.0.smithi049.stdout:7/822: mknod d7/c11d 0 2023-12-16T07:40:25.532 INFO:tasks.workunit.client.0.smithi049.stdout:8/779: dwrite d0/d1f/d36/f3c [0,4194304] 0 2023-12-16T07:40:25.534 INFO:tasks.workunit.client.0.smithi049.stdout:5/850: write d5/de/d54/da9/ffe [1217370,7064] 0 2023-12-16T07:40:25.534 INFO:tasks.workunit.client.0.smithi049.stdout:5/851: chown d5/de/d54/d67/da0/fc0 23492 1 2023-12-16T07:40:25.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/876: dwrite f1b [0,4194304] 0 2023-12-16T07:40:25.537 INFO:tasks.workunit.client.0.smithi049.stdout:8/780: mknod d0/d1f/d36/db8/de5/ced 0 2023-12-16T07:40:25.540 INFO:tasks.workunit.client.0.smithi049.stdout:1/877: write d20/f8e [1696797,31002] 0 2023-12-16T07:40:25.540 INFO:tasks.workunit.client.0.smithi049.stdout:3/724: dread d1/d2a/f68 [0,4194304] 0 2023-12-16T07:40:25.540 INFO:tasks.workunit.client.0.smithi049.stdout:1/878: write d20/f32 [4627970,124820] 0 2023-12-16T07:40:25.542 INFO:tasks.workunit.client.0.smithi049.stdout:5/852: rename d5/de/d54/d57/dfa/d20/cfc to d5/de/d54/d85/c12c 0 2023-12-16T07:40:25.543 INFO:tasks.workunit.client.0.smithi049.stdout:9/731: dread d4/d7/d11/db3/d8a/f5a [0,4194304] 0 2023-12-16T07:40:25.543 INFO:tasks.workunit.client.0.smithi049.stdout:9/732: fdatasync d4/d7/d11/db3/d8a/fa5 0 2023-12-16T07:40:25.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/781: mknod d0/d1f/d1c/cee 0 2023-12-16T07:40:25.546 INFO:tasks.workunit.client.0.smithi049.stdout:4/748: dwrite d2/db/dd/d52/f6a [0,4194304] 0 2023-12-16T07:40:25.550 INFO:tasks.workunit.client.0.smithi049.stdout:5/853: dread d5/de/d54/d57/dfa/d21/d4e/f9d [0,4194304] 0 2023-12-16T07:40:25.551 INFO:tasks.workunit.client.0.smithi049.stdout:3/725: link d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/l97 d1/d2a/d37/d3f/d5a/d5b/d77/dc4/lf0 0 2023-12-16T07:40:25.552 INFO:tasks.workunit.client.0.smithi049.stdout:1/879: symlink d20/d41/dab/l134 0 2023-12-16T07:40:25.552 INFO:tasks.workunit.client.0.smithi049.stdout:1/880: write d20/d41/d4f/dec/d102/d11f/fc3 [183908,13705] 0 2023-12-16T07:40:25.552 INFO:tasks.workunit.client.0.smithi049.stdout:1/881: fsync d20/d40/d6f/faa 0 2023-12-16T07:40:25.553 INFO:tasks.workunit.client.0.smithi049.stdout:1/882: chown d20/d41/d52/f100 15 1 2023-12-16T07:40:25.553 INFO:tasks.workunit.client.0.smithi049.stdout:4/749: dread d2/db/dd/de/d1e/d44/f95 [0,4194304] 0 2023-12-16T07:40:25.553 INFO:tasks.workunit.client.0.smithi049.stdout:9/733: truncate d4/d7/d11/d1d/d5b/f9e 2137878 0 2023-12-16T07:40:25.555 INFO:tasks.workunit.client.0.smithi049.stdout:7/823: dwrite d7/dc/dd/d35/d36/f7d [0,4194304] 0 2023-12-16T07:40:25.555 INFO:tasks.workunit.client.0.smithi049.stdout:8/782: rename d0/d13/l60 to d0/d1f/d36/db8/de5/lef 0 2023-12-16T07:40:25.555 INFO:tasks.workunit.client.0.smithi049.stdout:7/824: write d7/dc/d15/d57/dc8/ff3 [300992,47762] 0 2023-12-16T07:40:25.557 INFO:tasks.workunit.client.0.smithi049.stdout:5/854: rmdir d5/de/d54/d57/dfa/d20 39 2023-12-16T07:40:25.558 INFO:tasks.workunit.client.0.smithi049.stdout:3/726: unlink d1/d2a/f3b 0 2023-12-16T07:40:25.558 INFO:tasks.workunit.client.0.smithi049.stdout:3/727: dread - d1/d2a/d37/d3f/d5a/d5b/d5e/f91 zero size 2023-12-16T07:40:25.559 INFO:tasks.workunit.client.0.smithi049.stdout:1/883: symlink d20/d45/d47/d12c/l135 0 2023-12-16T07:40:25.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/750: creat d2/db/d6b/db9/fe8 x:0 0 0 2023-12-16T07:40:25.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/751: write d2/db/dd/de/d1e/d37/d4e/f9b [4046615,55659] 0 2023-12-16T07:40:25.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/752: readlink d2/db/dd/de/d1e/d21/l77 0 2023-12-16T07:40:25.563 INFO:tasks.workunit.client.0.smithi049.stdout:9/734: creat d4/d7/d11/d1d/d5b/fe8 x:0 0 0 2023-12-16T07:40:25.567 INFO:tasks.workunit.client.0.smithi049.stdout:8/783: mkdir d0/d13/d42/de6/df0 0 2023-12-16T07:40:25.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/825: rename d7/dc/d2f/d40/d5d/fb0 to d7/dc/dd/d37/d5c/db2/d106/f11e 0 2023-12-16T07:40:25.570 INFO:tasks.workunit.client.0.smithi049.stdout:5/855: creat d5/de/d54/d57/dfa/d21/d5a/f12d x:0 0 0 2023-12-16T07:40:25.570 INFO:tasks.workunit.client.0.smithi049.stdout:5/856: chown d5/f83 131641129 1 2023-12-16T07:40:25.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/728: truncate d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fe5 3234701 0 2023-12-16T07:40:25.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/729: readlink d1/d2a/d37/d3f/lce 0 2023-12-16T07:40:25.571 INFO:tasks.workunit.client.0.smithi049.stdout:0/955: sync 2023-12-16T07:40:25.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/747: sync 2023-12-16T07:40:25.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/748: fdatasync d2/de/de0/f103 0 2023-12-16T07:40:25.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/749: stat d2/de/df2 0 2023-12-16T07:40:25.572 INFO:tasks.workunit.client.0.smithi049.stdout:6/921: sync 2023-12-16T07:40:25.572 INFO:tasks.workunit.client.0.smithi049.stdout:0/956: write d13/d21/d99/ffb [201028,106861] 0 2023-12-16T07:40:25.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/957: write d13/d21/d99/d46/d65/f9b [1945452,43990] 0 2023-12-16T07:40:25.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/958: chown d13/d21/d27/d2c/d62/d70/dff 0 1 2023-12-16T07:40:25.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/959: chown d13/d21/d99/ffb 17412 1 2023-12-16T07:40:25.574 INFO:tasks.workunit.client.0.smithi049.stdout:3/730: write d1/d2a/d37/f9a [3604427,35614] 0 2023-12-16T07:40:25.575 INFO:tasks.workunit.client.0.smithi049.stdout:5/857: dread d5/de/d54/d57/dfa/d21/d4e/f9d [0,4194304] 0 2023-12-16T07:40:25.575 INFO:tasks.workunit.client.0.smithi049.stdout:1/884: truncate f2 924182 0 2023-12-16T07:40:25.577 INFO:tasks.workunit.client.0.smithi049.stdout:1/885: dread f19 [0,4194304] 0 2023-12-16T07:40:25.577 INFO:tasks.workunit.client.0.smithi049.stdout:4/753: creat d2/db/dd/de/d1e/d21/fe9 x:0 0 0 2023-12-16T07:40:25.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/735: dwrite d4/d7/d11/d26/d80/f91 [0,4194304] 0 2023-12-16T07:40:25.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/784: rename d0/d13/d42/d5b/d68/ca6 to d0/d13/cf1 0 2023-12-16T07:40:25.583 INFO:tasks.workunit.client.0.smithi049.stdout:6/922: mkdir d0/d2/df/d4e/d5d/d6f/d12f 0 2023-12-16T07:40:25.583 INFO:tasks.workunit.client.0.smithi049.stdout:6/923: chown d0/d2/df/d4e/fb6 11904 1 2023-12-16T07:40:25.583 INFO:tasks.workunit.client.0.smithi049.stdout:6/924: stat d0/d39/d5b/d65/d58/d2c 0 2023-12-16T07:40:25.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/754: dread f1 [0,4194304] 0 2023-12-16T07:40:25.583 INFO:tasks.workunit.client.0.smithi049.stdout:3/731: symlink d1/d2a/d37/d3f/d5a/d6d/lf1 0 2023-12-16T07:40:25.589 INFO:tasks.workunit.client.0.smithi049.stdout:9/736: symlink d4/d7/d11/d1d/d9b/le9 0 2023-12-16T07:40:25.589 INFO:tasks.workunit.client.0.smithi049.stdout:7/826: rename d7/dc/d2f/d38/l99 to d7/dc/dd/d37/d5c/db2/l11f 0 2023-12-16T07:40:25.590 INFO:tasks.workunit.client.0.smithi049.stdout:8/785: mkdir d0/d1f/d36/db8/de5/df2 0 2023-12-16T07:40:25.590 INFO:tasks.workunit.client.0.smithi049.stdout:6/925: symlink d0/d2/df/d4e/d5d/d120/l130 0 2023-12-16T07:40:25.591 INFO:tasks.workunit.client.0.smithi049.stdout:3/732: creat d1/d2a/d37/d3f/d5a/d5b/ff2 x:0 0 0 2023-12-16T07:40:25.595 INFO:tasks.workunit.client.0.smithi049.stdout:1/886: dwrite d20/d41/d4f/dec/ffd [0,4194304] 0 2023-12-16T07:40:25.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/755: dwrite d2/db/dd/d2a/fc4 [0,4194304] 0 2023-12-16T07:40:25.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/756: stat d2/db/dd/de/d1e/d21/f39 0 2023-12-16T07:40:25.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/827: mknod d7/dc/dd/d35/d36/c120 0 2023-12-16T07:40:25.597 INFO:tasks.workunit.client.0.smithi049.stdout:7/828: chown d7/dc/d15/d57/f98 0 1 2023-12-16T07:40:25.597 INFO:tasks.workunit.client.0.smithi049.stdout:7/829: dread - d7/dc/d15/d57/f112 zero size 2023-12-16T07:40:25.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/737: dread d4/d7/d11/d1d/d9b/fdd [0,4194304] 0 2023-12-16T07:40:25.601 INFO:tasks.workunit.client.0.smithi049.stdout:8/786: dread d0/d1f/d36/f54 [0,4194304] 0 2023-12-16T07:40:25.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/960: rename d13/d39/dbe/dbf to d13/d21/d14d 0 2023-12-16T07:40:25.603 INFO:tasks.workunit.client.0.smithi049.stdout:3/733: mknod d1/d2a/d37/d3f/d5a/dc2/de0/cf3 0 2023-12-16T07:40:25.608 INFO:tasks.workunit.client.0.smithi049.stdout:4/757: truncate d2/f28 2767321 0 2023-12-16T07:40:25.609 INFO:tasks.workunit.client.0.smithi049.stdout:7/830: symlink d7/d2b/l121 0 2023-12-16T07:40:25.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/738: getdents d4/d7/d11/d56/d7f 0 2023-12-16T07:40:25.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/739: chown d4/d7/d11/d1d/l92 0 1 2023-12-16T07:40:25.610 INFO:tasks.workunit.client.0.smithi049.stdout:6/926: dwrite d0/f35 [0,4194304] 0 2023-12-16T07:40:25.611 INFO:tasks.workunit.client.0.smithi049.stdout:6/927: fdatasync d0/d2/f11c 0 2023-12-16T07:40:25.612 INFO:tasks.workunit.client.0.smithi049.stdout:8/787: link d0/d1f/d4e/f96 d0/d13/d42/d5b/d68/d6b/da2/da5/ff3 0 2023-12-16T07:40:25.614 INFO:tasks.workunit.client.0.smithi049.stdout:5/858: rename d5/de/f76 to d5/de/d54/d57/dfa/d21/d58/d65/dae/f12e 0 2023-12-16T07:40:25.616 INFO:tasks.workunit.client.0.smithi049.stdout:3/734: mkdir d1/d2a/df4 0 2023-12-16T07:40:25.618 INFO:tasks.workunit.client.0.smithi049.stdout:4/758: link d2/db/d6b/dad/fd7 d2/db/d6b/db9/de4/fea 0 2023-12-16T07:40:25.618 INFO:tasks.workunit.client.0.smithi049.stdout:4/759: write d2/db/dd/de/d1e/d44/fc7 [4849946,113968] 0 2023-12-16T07:40:25.620 INFO:tasks.workunit.client.0.smithi049.stdout:9/740: link d4/d7/d11/d1d/c2b d4/d7/d11/d1d/d82/cea 0 2023-12-16T07:40:25.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/831: rename d7/dc/dd/d14/f116 to d7/dc/d7c/f122 0 2023-12-16T07:40:25.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/859: rename d5 to d5/de/d54/d78/d12f 22 2023-12-16T07:40:25.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/860: fsync d5/f3e 0 2023-12-16T07:40:25.629 INFO:tasks.workunit.client.0.smithi049.stdout:8/788: dread d0/d1f/f82 [0,4194304] 0 2023-12-16T07:40:25.629 INFO:tasks.workunit.client.0.smithi049.stdout:8/789: truncate d0/d13/d42/d5b/f8a 209929 0 2023-12-16T07:40:25.630 INFO:tasks.workunit.client.0.smithi049.stdout:5/861: rename d5/de/d1c/c23 to d5/de/d54/d5c/c130 0 2023-12-16T07:40:25.631 INFO:tasks.workunit.client.0.smithi049.stdout:6/928: dwrite d0/d39/d5b/d65/d58/f80 [0,4194304] 0 2023-12-16T07:40:25.632 INFO:tasks.workunit.client.0.smithi049.stdout:8/790: unlink d0/d13/d42/d5b/d68/d6b/da2/db9/fbd 0 2023-12-16T07:40:25.634 INFO:tasks.workunit.client.0.smithi049.stdout:5/862: mknod d5/de/d54/d57/dfa/d20/c131 0 2023-12-16T07:40:25.635 INFO:tasks.workunit.client.0.smithi049.stdout:4/760: dwrite d2/db/dd/de/d1e/d21/fe9 [0,4194304] 0 2023-12-16T07:40:25.639 INFO:tasks.workunit.client.0.smithi049.stdout:5/863: mkdir d5/de/d54/d57/dfa/d20/d132 0 2023-12-16T07:40:25.639 INFO:tasks.workunit.client.0.smithi049.stdout:5/864: write d5/de/d54/d78/d9b/dd1/fec [991547,12918] 0 2023-12-16T07:40:25.639 INFO:tasks.workunit.client.0.smithi049.stdout:5/865: write d5/de/d54/d57/dfa/d21/d58/d65/fa6 [697277,9153] 0 2023-12-16T07:40:25.641 INFO:tasks.workunit.client.0.smithi049.stdout:7/832: dwrite d7/dc/dd/d14/fa3 [0,4194304] 0 2023-12-16T07:40:25.641 INFO:tasks.workunit.client.0.smithi049.stdout:6/929: dread d0/d39/f54 [0,4194304] 0 2023-12-16T07:40:25.642 INFO:tasks.workunit.client.0.smithi049.stdout:5/866: mknod d5/de/d1c/db1/c133 0 2023-12-16T07:40:25.645 INFO:tasks.workunit.client.0.smithi049.stdout:4/761: dread d2/db/dd/de/fa1 [0,4194304] 0 2023-12-16T07:40:25.646 INFO:tasks.workunit.client.0.smithi049.stdout:7/833: mknod d7/dc/d6b/d105/c123 0 2023-12-16T07:40:25.649 INFO:tasks.workunit.client.0.smithi049.stdout:5/867: mknod d5/de/d54/d57/dfa/d21/d58/d119/c134 0 2023-12-16T07:40:25.650 INFO:tasks.workunit.client.0.smithi049.stdout:4/762: mknod d2/db/dd/de/d1e/d21/de7/ceb 0 2023-12-16T07:40:25.650 INFO:tasks.workunit.client.0.smithi049.stdout:4/763: dread - d2/db/dd/de/d1e/f64 zero size 2023-12-16T07:40:25.650 INFO:tasks.workunit.client.0.smithi049.stdout:4/764: dread - d2/db/dd/de/d1e/d37/d4e/fc9 zero size 2023-12-16T07:40:25.651 INFO:tasks.workunit.client.0.smithi049.stdout:7/834: link d7/dc/dd/d35/cb6 d7/db4/d107/c124 0 2023-12-16T07:40:25.651 INFO:tasks.workunit.client.0.smithi049.stdout:7/835: read d7/dc/dd/d35/d36/f5f [295059,19319] 0 2023-12-16T07:40:25.651 INFO:tasks.workunit.client.0.smithi049.stdout:7/836: chown d7/dc/d2f/f9f 3602 1 2023-12-16T07:40:25.651 INFO:tasks.workunit.client.0.smithi049.stdout:7/837: write d7/dc/dd/d27/d8e/f101 [162983,4972] 0 2023-12-16T07:40:25.652 INFO:tasks.workunit.client.0.smithi049.stdout:8/791: dwrite d0/d13/d42/d5b/f8a [0,4194304] 0 2023-12-16T07:40:25.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/868: creat d5/de/d54/d57/dfa/d20/f135 x:0 0 0 2023-12-16T07:40:25.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/869: write d5/de/d1c/db1/f117 [659725,82017] 0 2023-12-16T07:40:25.654 INFO:tasks.workunit.client.0.smithi049.stdout:4/765: symlink d2/db/d6b/db9/de4/lec 0 2023-12-16T07:40:25.655 INFO:tasks.workunit.client.0.smithi049.stdout:4/766: readlink d2/db/dd/de/d1e/d37/d4e/l80 0 2023-12-16T07:40:25.655 INFO:tasks.workunit.client.0.smithi049.stdout:5/870: dread d5/de/d54/d57/dfa/d21/d58/d65/fa6 [0,4194304] 0 2023-12-16T07:40:25.658 INFO:tasks.workunit.client.0.smithi049.stdout:8/792: write d0/f19 [1738251,127295] 0 2023-12-16T07:40:25.659 INFO:tasks.workunit.client.0.smithi049.stdout:4/767: unlink d2/db/dd/de/d1e/l33 0 2023-12-16T07:40:25.661 INFO:tasks.workunit.client.0.smithi049.stdout:5/871: getdents d5/de/d54 0 2023-12-16T07:40:25.662 INFO:tasks.workunit.client.0.smithi049.stdout:6/930: dread d0/d39/d5b/d65/d58/d33/daa/f10a [0,4194304] 0 2023-12-16T07:40:25.666 INFO:tasks.workunit.client.0.smithi049.stdout:8/793: creat d0/d1f/d4e/dbb/ff4 x:0 0 0 2023-12-16T07:40:25.667 INFO:tasks.workunit.client.0.smithi049.stdout:4/768: creat d2/db/dd/db7/fed x:0 0 0 2023-12-16T07:40:25.669 INFO:tasks.workunit.client.0.smithi049.stdout:5/872: mkdir d5/de/d54/d67/da0/d136 0 2023-12-16T07:40:25.669 INFO:tasks.workunit.client.0.smithi049.stdout:5/873: chown d5/de/d54/d57/dfa/d21/d4e/f59 0 1 2023-12-16T07:40:25.671 INFO:tasks.workunit.client.0.smithi049.stdout:6/931: creat d0/d39/d5b/d65/d58/d33/dc2/f131 x:0 0 0 2023-12-16T07:40:25.672 INFO:tasks.workunit.client.0.smithi049.stdout:8/794: creat d0/d1f/d4e/dbb/ff5 x:0 0 0 2023-12-16T07:40:25.672 INFO:tasks.workunit.client.0.smithi049.stdout:8/795: readlink d0/d1f/la1 0 2023-12-16T07:40:25.674 INFO:tasks.workunit.client.0.smithi049.stdout:5/874: truncate d5/de/d54/d57/dfa/d21/d5a/fc5 176928 0 2023-12-16T07:40:25.676 INFO:tasks.workunit.client.0.smithi049.stdout:7/838: dwrite d7/db4/f114 [0,4194304] 0 2023-12-16T07:40:25.678 INFO:tasks.workunit.client.0.smithi049.stdout:5/875: truncate d5/de/d54/d57/dfa/d21/d4e/fda 59104 0 2023-12-16T07:40:25.678 INFO:tasks.workunit.client.0.smithi049.stdout:5/876: fsync d5/de/d54/d57/dfa/d21/fad 0 2023-12-16T07:40:25.678 INFO:tasks.workunit.client.0.smithi049.stdout:6/932: dread d0/d2/df/d4e/d5d/d6f/d4a/fd3 [0,4194304] 0 2023-12-16T07:40:25.678 INFO:tasks.workunit.client.0.smithi049.stdout:6/933: fdatasync d0/d39/d5b/d65/f26 0 2023-12-16T07:40:25.681 INFO:tasks.workunit.client.0.smithi049.stdout:5/877: rmdir d5/de/d54/d57/d3c/d10d 0 2023-12-16T07:40:25.681 INFO:tasks.workunit.client.0.smithi049.stdout:2/750: sync 2023-12-16T07:40:25.681 INFO:tasks.workunit.client.0.smithi049.stdout:6/934: creat d0/d39/d5b/d65/d58/d33/daa/f132 x:0 0 0 2023-12-16T07:40:25.683 INFO:tasks.workunit.client.0.smithi049.stdout:2/751: mknod d2/d1d/d28/d56/d11/da8/c106 0 2023-12-16T07:40:25.684 INFO:tasks.workunit.client.0.smithi049.stdout:6/935: truncate d0/d39/d5b/d65/d4c/f8e 268290 0 2023-12-16T07:40:25.684 INFO:tasks.workunit.client.0.smithi049.stdout:6/936: chown d0/d39/d5b/d65/d4c/d4d/d6a/dd6 1011 1 2023-12-16T07:40:25.687 INFO:tasks.workunit.client.0.smithi049.stdout:6/937: creat d0/d39/d5b/d65/d58/d2c/f133 x:0 0 0 2023-12-16T07:40:25.689 INFO:tasks.workunit.client.0.smithi049.stdout:6/938: unlink d0/d39/d5b/d65/d58/d33/daa/lbc 0 2023-12-16T07:40:25.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/769: dwrite d2/db/dd/de/d1e/d37/d82/fd1 [0,4194304] 0 2023-12-16T07:40:25.697 INFO:tasks.workunit.client.0.smithi049.stdout:8/796: dwrite d0/d1f/f59 [0,4194304] 0 2023-12-16T07:40:25.699 INFO:tasks.workunit.client.0.smithi049.stdout:8/797: rename d0/d13/d42/d5b/c92 to d0/d13/cf6 0 2023-12-16T07:40:25.699 INFO:tasks.workunit.client.0.smithi049.stdout:8/798: readlink d0/d13/l5e 0 2023-12-16T07:40:25.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/799: write d0/d1f/f59 [859577,49089] 0 2023-12-16T07:40:25.704 INFO:tasks.workunit.client.0.smithi049.stdout:8/800: unlink d0/f41 0 2023-12-16T07:40:25.705 INFO:tasks.workunit.client.0.smithi049.stdout:8/801: rmdir d0/d13/d42/d5b/d68/d6b/da2 39 2023-12-16T07:40:25.708 INFO:tasks.workunit.client.0.smithi049.stdout:8/802: mkdir d0/d1f/d4e/dbb/df7 0 2023-12-16T07:40:25.708 INFO:tasks.workunit.client.0.smithi049.stdout:8/803: fsync d0/fa7 0 2023-12-16T07:40:25.711 INFO:tasks.workunit.client.0.smithi049.stdout:6/939: dwrite d0/d39/d5b/d65/d4c/f67 [0,4194304] 0 2023-12-16T07:40:25.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/940: getdents d0/d2/df/dce 0 2023-12-16T07:40:25.717 INFO:tasks.workunit.client.0.smithi049.stdout:2/752: dwrite d2/d1d/d28/d56/d71/f80 [0,4194304] 0 2023-12-16T07:40:25.717 INFO:tasks.workunit.client.0.smithi049.stdout:2/753: chown d2/d1d/d28/d56/c1f 158 1 2023-12-16T07:40:25.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/770: dwrite d2/fac [0,4194304] 0 2023-12-16T07:40:25.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/771: stat d2/db/dd/de/d1e/d37/da4/f7b 0 2023-12-16T07:40:25.720 INFO:tasks.workunit.client.0.smithi049.stdout:2/754: rename d2/d1d/d24/d55/d76/fed to d2/d26/d6e/dca/f107 0 2023-12-16T07:40:25.722 INFO:tasks.workunit.client.0.smithi049.stdout:4/772: creat d2/db/dd/de/d1e/d37/d4e/fee x:0 0 0 2023-12-16T07:40:25.722 INFO:tasks.workunit.client.0.smithi049.stdout:4/773: write d2/db/dd/de/fa1 [1581942,38775] 0 2023-12-16T07:40:25.723 INFO:tasks.workunit.client.0.smithi049.stdout:4/774: write d2/db/dd/de/d1e/f2d [2609489,94813] 0 2023-12-16T07:40:25.724 INFO:tasks.workunit.client.0.smithi049.stdout:2/755: rmdir d2/de/d93 39 2023-12-16T07:40:25.725 INFO:tasks.workunit.client.0.smithi049.stdout:8/804: dwrite d0/f19 [0,4194304] 0 2023-12-16T07:40:25.725 INFO:tasks.workunit.client.0.smithi049.stdout:2/756: mkdir d2/d1d/d28/d56/d66/d108 0 2023-12-16T07:40:25.730 INFO:tasks.workunit.client.0.smithi049.stdout:8/805: creat d0/d1f/d36/db8/de5/df2/ff8 x:0 0 0 2023-12-16T07:40:25.730 INFO:tasks.workunit.client.0.smithi049.stdout:8/806: stat d0/d13/d42/d5b/d68/d6b/da2/cad 0 2023-12-16T07:40:25.732 INFO:tasks.workunit.client.0.smithi049.stdout:2/757: mknod d2/d26/d6e/dca/c109 0 2023-12-16T07:40:25.732 INFO:tasks.workunit.client.0.smithi049.stdout:2/758: chown d2/d1d/d28/d8b/fe8 25501 1 2023-12-16T07:40:25.732 INFO:tasks.workunit.client.0.smithi049.stdout:2/759: write d2/d1d/d28/d56/d11/fac [673080,5686] 0 2023-12-16T07:40:25.733 INFO:tasks.workunit.client.0.smithi049.stdout:8/807: write d0/d1f/f7e [285817,81956] 0 2023-12-16T07:40:25.734 INFO:tasks.workunit.client.0.smithi049.stdout:8/808: chown d0/d1f/db7/feb 1046800279 1 2023-12-16T07:40:25.734 INFO:tasks.workunit.client.0.smithi049.stdout:2/760: dread d2/d1d/d28/d56/d11/f67 [0,4194304] 0 2023-12-16T07:40:25.734 INFO:tasks.workunit.client.0.smithi049.stdout:8/809: write d0/d1f/d4e/f96 [2626595,119397] 0 2023-12-16T07:40:25.745 INFO:tasks.workunit.client.0.smithi049.stdout:6/941: dwrite d0/d39/d5b/d65/d58/d2c/fc0 [0,4194304] 0 2023-12-16T07:40:25.747 INFO:tasks.workunit.client.0.smithi049.stdout:6/942: unlink d0/d39/d5b/d65/d58/d2c/f133 0 2023-12-16T07:40:25.747 INFO:tasks.workunit.client.0.smithi049.stdout:6/943: chown d0/d39/d5b/d65/d27/l37 267583950 1 2023-12-16T07:40:25.749 INFO:tasks.workunit.client.0.smithi049.stdout:6/944: rename d0/d2/df/d4e/ff1 to d0/d39/d5b/d65/d4c/d4d/d6a/de9/dfb/f134 0 2023-12-16T07:40:25.750 INFO:tasks.workunit.client.0.smithi049.stdout:6/945: mkdir d0/d2/df/d81/d135 0 2023-12-16T07:40:25.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/946: creat d0/f136 x:0 0 0 2023-12-16T07:40:25.751 INFO:tasks.workunit.client.0.smithi049.stdout:4/775: dwrite d2/f86 [0,4194304] 0 2023-12-16T07:40:25.754 INFO:tasks.workunit.client.0.smithi049.stdout:4/776: creat d2/db/dd/de/d1e/d37/dcf/fef x:0 0 0 2023-12-16T07:40:25.756 INFO:tasks.workunit.client.0.smithi049.stdout:0/961: sync 2023-12-16T07:40:25.757 INFO:tasks.workunit.client.0.smithi049.stdout:0/962: write d13/d21/f92 [3451713,57516] 0 2023-12-16T07:40:25.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/735: sync 2023-12-16T07:40:25.757 INFO:tasks.workunit.client.0.smithi049.stdout:9/741: sync 2023-12-16T07:40:25.757 INFO:tasks.workunit.client.0.smithi049.stdout:1/887: sync 2023-12-16T07:40:25.757 INFO:tasks.workunit.client.0.smithi049.stdout:0/963: mkdir d13/d39/d38/da7/d14e 0 2023-12-16T07:40:25.758 INFO:tasks.workunit.client.0.smithi049.stdout:1/888: creat d20/d41/d52/f136 x:0 0 0 2023-12-16T07:40:25.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/964: mkdir d13/d21/d99/d46/d65/d82/ddb/d14f 0 2023-12-16T07:40:25.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/965: stat d13/f7c 0 2023-12-16T07:40:25.759 INFO:tasks.workunit.client.0.smithi049.stdout:2/761: dwrite d2/de/d77/f99 [0,4194304] 0 2023-12-16T07:40:25.761 INFO:tasks.workunit.client.0.smithi049.stdout:0/966: rename d13/d21/d99/d46/d65/f10b to d13/f150 0 2023-12-16T07:40:25.762 INFO:tasks.workunit.client.0.smithi049.stdout:8/810: dwrite d0/f3d [0,4194304] 0 2023-12-16T07:40:25.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/777: dread d2/db/dd/de/d1e/d37/f38 [0,4194304] 0 2023-12-16T07:40:25.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/778: dread d2/db/dd/de/d1e/d37/f5c [0,4194304] 0 2023-12-16T07:40:25.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/779: truncate d2/db/dd/de/d1e/fce 4572911 0 2023-12-16T07:40:25.766 INFO:tasks.workunit.client.0.smithi049.stdout:9/742: dread d4/db/f41 [0,4194304] 0 2023-12-16T07:40:25.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/762: rename d2/d1d/d28/d56/d11/f25 to d2/d1d/d24/f10a 0 2023-12-16T07:40:25.766 INFO:tasks.workunit.client.0.smithi049.stdout:0/967: rmdir d13/d21/d14d 39 2023-12-16T07:40:25.771 INFO:tasks.workunit.client.0.smithi049.stdout:6/947: dread d0/d39/d5b/d65/d53/f5f [0,4194304] 0 2023-12-16T07:40:25.772 INFO:tasks.workunit.client.0.smithi049.stdout:8/811: creat d0/ff9 x:0 0 0 2023-12-16T07:40:25.773 INFO:tasks.workunit.client.0.smithi049.stdout:3/736: dread d1/d2a/d37/d3f/d5a/d61/d6b/f72 [0,4194304] 0 2023-12-16T07:40:25.775 INFO:tasks.workunit.client.0.smithi049.stdout:0/968: rename d13/d39/d38/d7e/d8b/cb0 to d13/d21/d2f/d7d/c151 0 2023-12-16T07:40:25.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/780: link d2/db/dd/de/d1e/d21/fb3 d2/db/dd/d52/ff0 0 2023-12-16T07:40:25.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/781: dread - d2/db/dd/de/d1e/d37/d82/f9c zero size 2023-12-16T07:40:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/737: symlink d1/d2a/d37/d3f/d5a/d5b/lf5 0 2023-12-16T07:40:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:6/948: dread d0/d39/d5b/d65/d4c/f67 [0,4194304] 0 2023-12-16T07:40:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/782: write d2/db/d6b/dc8/fe3 [1344085,121222] 0 2023-12-16T07:40:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/889: dread d20/f2d [0,4194304] 0 2023-12-16T07:40:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/949: rmdir d0/d39/d5b/d65/d4c/d4d/d6a 39 2023-12-16T07:40:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:5/878: sync 2023-12-16T07:40:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/839: sync 2023-12-16T07:40:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/879: read - d5/de/d54/d78/fe3 zero size 2023-12-16T07:40:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/880: chown d5/de/f14 13381 1 2023-12-16T07:40:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/840: write d7/dc/fb3 [4543128,128716] 0 2023-12-16T07:40:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/841: chown d7/dc/dd/l26 813 1 2023-12-16T07:40:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/842: dread - d7/dc/d6b/f10a zero size 2023-12-16T07:40:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/843: stat d7/dc/d6b 0 2023-12-16T07:40:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/969: dread d13/d21/d99/f118 [0,4194304] 0 2023-12-16T07:40:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:1/890: symlink d20/d7b/l137 0 2023-12-16T07:40:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/950: creat d0/d2/df/f137 x:0 0 0 2023-12-16T07:40:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:1/891: read - d20/d45/fcd zero size 2023-12-16T07:40:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/951: chown d0/d2/df/df3/f118 7 1 2023-12-16T07:40:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:1/892: chown d20/d41/d52/d86/la0 0 1 2023-12-16T07:40:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/952: write d0/d39/d5b/f10c [2726870,64746] 0 2023-12-16T07:40:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/881: creat d5/de/d54/d67/f137 x:0 0 0 2023-12-16T07:40:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/882: write d5/f9 [8990104,62165] 0 2023-12-16T07:40:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/844: symlink d7/dc/dd/d37/d5c/db2/d106/l125 0 2023-12-16T07:40:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:1/893: truncate d20/d7b/d71/fb5 624213 0 2023-12-16T07:40:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/894: readlink d20/d45/d47/l98 0 2023-12-16T07:40:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/738: dread d1/d2a/d37/d3f/fb1 [0,4194304] 0 2023-12-16T07:40:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/739: write d1/d2a/f48 [245631,41363] 0 2023-12-16T07:40:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/883: getdents d5/de/d54/d67/da0 0 2023-12-16T07:40:25.791 INFO:tasks.workunit.client.0.smithi049.stdout:7/845: rmdir d7/dc/d2f/d40/d104 39 2023-12-16T07:40:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:1/895: unlink d20/d45/l101 0 2023-12-16T07:40:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:3/740: mknod d1/d2a/d37/d3f/d5a/d5b/d77/dc4/cf6 0 2023-12-16T07:40:25.795 INFO:tasks.workunit.client.0.smithi049.stdout:5/884: mkdir d5/de/d1c/d62/d81/d138 0 2023-12-16T07:40:25.797 INFO:tasks.workunit.client.0.smithi049.stdout:7/846: creat d7/dc/dd/d35/f126 x:0 0 0 2023-12-16T07:40:25.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/812: dwrite d0/ff9 [0,4194304] 0 2023-12-16T07:40:25.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/763: dwrite d2/d26/d6e/fef [0,4194304] 0 2023-12-16T07:40:25.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/764: readlink d2/d1d/d38/lf6 0 2023-12-16T07:40:25.801 INFO:tasks.workunit.client.0.smithi049.stdout:2/765: fsync d2/d26/f30 0 2023-12-16T07:40:25.801 INFO:tasks.workunit.client.0.smithi049.stdout:9/743: dwrite d4/d7/d11/d1d/d69/f9c [0,4194304] 0 2023-12-16T07:40:25.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/896: mkdir d20/d41/de8/d138 0 2023-12-16T07:40:25.802 INFO:tasks.workunit.client.0.smithi049.stdout:5/885: creat d5/de/d129/f139 x:0 0 0 2023-12-16T07:40:25.802 INFO:tasks.workunit.client.0.smithi049.stdout:7/847: mkdir d7/dc/dd/d14/d127 0 2023-12-16T07:40:25.802 INFO:tasks.workunit.client.0.smithi049.stdout:3/741: chown d1/c22 264653895 1 2023-12-16T07:40:25.804 INFO:tasks.workunit.client.0.smithi049.stdout:8/813: truncate d0/d13/f2f 2843141 0 2023-12-16T07:40:25.805 INFO:tasks.workunit.client.0.smithi049.stdout:9/744: write d4/d7/f7a [7492,36687] 0 2023-12-16T07:40:25.806 INFO:tasks.workunit.client.0.smithi049.stdout:4/783: write d2/db/dd/d52/ff0 [3370424,51355] 0 2023-12-16T07:40:25.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/766: mknod d2/d1d/d38/c10b 0 2023-12-16T07:40:25.807 INFO:tasks.workunit.client.0.smithi049.stdout:1/897: write d20/d45/d47/f65 [3597195,81916] 0 2023-12-16T07:40:25.808 INFO:tasks.workunit.client.0.smithi049.stdout:1/898: truncate d20/d41/dab/ffb 4863956 0 2023-12-16T07:40:25.808 INFO:tasks.workunit.client.0.smithi049.stdout:1/899: chown d20/c39 7 1 2023-12-16T07:40:25.808 INFO:tasks.workunit.client.0.smithi049.stdout:1/900: truncate d20/d40/f81 1419648 0 2023-12-16T07:40:25.810 INFO:tasks.workunit.client.0.smithi049.stdout:7/848: creat d7/dc/dd/d37/d5c/db2/d106/f128 x:0 0 0 2023-12-16T07:40:25.810 INFO:tasks.workunit.client.0.smithi049.stdout:7/849: write d7/dc/dd/d37/d5c/ff4 [597477,36141] 0 2023-12-16T07:40:25.811 INFO:tasks.workunit.client.0.smithi049.stdout:9/745: creat d4/d7/d11/d1d/d69/feb x:0 0 0 2023-12-16T07:40:25.811 INFO:tasks.workunit.client.0.smithi049.stdout:9/746: dread - d4/d7/d11/d1d/d5b/dbe/fcd zero size 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:5/886: dread d5/de/d54/d57/dfa/d21/d4e/dba/fe0 [0,4194304] 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:7/850: dread d7/dc/d2f/d38/ff6 [0,4194304] 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:1/901: creat d20/d41/d4f/d55/d82/dd2/f139 x:0 0 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:2/767: link d2/de/d93/cce d2/de/d78/dd6/c10c 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:1/902: fsync d20/f79 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:4/784: write d2/db/dd/de/d1e/d37/d82/fcc [3371562,84091] 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:0/970: dwrite d13/d21/d99/d46/d65/d82/ddb/fed [0,4194304] 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:6/953: dwrite d0/d39/d5b/d65/d53/f5f [0,4194304] 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:9/747: symlink d4/d7/d11/db3/d8a/daa/dce/dde/lec 0 2023-12-16T07:40:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:7/851: mknod d7/c129 0 2023-12-16T07:40:25.820 INFO:tasks.workunit.client.0.smithi049.stdout:3/742: dread d1/d2a/d37/d3f/d5a/d5b/d77/fbf [0,4194304] 0 2023-12-16T07:40:25.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/768: truncate d2/d26/f59 803032 0 2023-12-16T07:40:25.824 INFO:tasks.workunit.client.0.smithi049.stdout:1/903: link d20/d41/dab/ffb d20/d40/f13a 0 2023-12-16T07:40:25.826 INFO:tasks.workunit.client.0.smithi049.stdout:4/785: getdents d2/db/dd/de/d1e/d37/d4e 0 2023-12-16T07:40:25.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/904: dread d20/f28 [0,4194304] 0 2023-12-16T07:40:25.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/905: dread - d20/d45/d47/f133 zero size 2023-12-16T07:40:25.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/906: fdatasync d20/d41/d52/d86/fa8 0 2023-12-16T07:40:25.830 INFO:tasks.workunit.client.0.smithi049.stdout:6/954: symlink d0/d39/d5b/d65/d4c/d4d/d6a/l138 0 2023-12-16T07:40:25.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/907: read d20/d41/d4f/d55/d82/f110 [2206699,12136] 0 2023-12-16T07:40:25.831 INFO:tasks.workunit.client.0.smithi049.stdout:9/748: symlink d4/db2/led 0 2023-12-16T07:40:25.831 INFO:tasks.workunit.client.0.smithi049.stdout:9/749: stat d4/d7/d11/d1d/d69/d76/d83/de4 0 2023-12-16T07:40:25.832 INFO:tasks.workunit.client.0.smithi049.stdout:0/971: dread d13/d21/d99/d46/d65/d82/ddb/f119 [0,4194304] 0 2023-12-16T07:40:25.832 INFO:tasks.workunit.client.0.smithi049.stdout:7/852: creat d7/dc/d2f/d40/f12a x:0 0 0 2023-12-16T07:40:25.836 INFO:tasks.workunit.client.0.smithi049.stdout:3/743: dread d1/d2a/f40 [0,4194304] 0 2023-12-16T07:40:25.836 INFO:tasks.workunit.client.0.smithi049.stdout:8/814: dwrite d0/d13/d42/d5b/f8d [0,4194304] 0 2023-12-16T07:40:25.836 INFO:tasks.workunit.client.0.smithi049.stdout:5/887: dwrite d5/de/d54/d67/f7b [4194304,4194304] 0 2023-12-16T07:40:25.836 INFO:tasks.workunit.client.0.smithi049.stdout:8/815: read d0/d1f/d1c/f52 [490977,28953] 0 2023-12-16T07:40:25.837 INFO:tasks.workunit.client.0.smithi049.stdout:8/816: chown d0/d1f/d56/l5a 639 1 2023-12-16T07:40:25.844 INFO:tasks.workunit.client.0.smithi049.stdout:1/908: creat d20/d41/f13b x:0 0 0 2023-12-16T07:40:25.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/750: dread d4/f34 [0,4194304] 0 2023-12-16T07:40:25.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/972: symlink d13/d21/d27/d2c/d126/l152 0 2023-12-16T07:40:25.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/853: mknod d7/dc/dd/d35/c12b 0 2023-12-16T07:40:25.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/973: fdatasync d13/d39/f3b 0 2023-12-16T07:40:25.850 INFO:tasks.workunit.client.0.smithi049.stdout:4/786: link d2/db/dd/d52/d8c/c94 d2/db/d6b/db9/de4/cf1 0 2023-12-16T07:40:25.851 INFO:tasks.workunit.client.0.smithi049.stdout:4/787: write d2/db/dd/d2a/f1c [1351495,103822] 0 2023-12-16T07:40:25.855 INFO:tasks.workunit.client.0.smithi049.stdout:3/744: rmdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76 39 2023-12-16T07:40:25.855 INFO:tasks.workunit.client.0.smithi049.stdout:3/745: dread - d1/d2a/d37/d3f/fee zero size 2023-12-16T07:40:25.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/817: dwrite d0/d13/d42/d5b/d68/d6b/da2/da5/fa8 [0,4194304] 0 2023-12-16T07:40:25.859 INFO:tasks.workunit.client.0.smithi049.stdout:9/751: dread d4/db/f72 [0,4194304] 0 2023-12-16T07:40:25.861 INFO:tasks.workunit.client.0.smithi049.stdout:9/752: write d4/d7/d11/db3/d8a/fa5 [5243,44764] 0 2023-12-16T07:40:25.869 INFO:tasks.workunit.client.0.smithi049.stdout:0/974: mkdir d13/d21/d27/d2c/d62/d153 0 2023-12-16T07:40:25.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/788: creat d2/db/ff2 x:0 0 0 2023-12-16T07:40:25.881 INFO:tasks.workunit.client.0.smithi049.stdout:0/975: getdents d13/de1 0 2023-12-16T07:40:25.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/789: truncate d2/db/dd/d52/ff0 2527465 0 2023-12-16T07:40:25.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/790: chown d2/db/d6b/f8f 847 1 2023-12-16T07:40:25.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/791: fdatasync d2/db/dd/de/d1e/d21/f9e 0 2023-12-16T07:40:25.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/792: write d2/db/dd/de/d1e/d37/d82/fcc [3377178,17595] 0 2023-12-16T07:40:25.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/793: write d2/db/d6b/faf [572231,13666] 0 2023-12-16T07:40:25.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/794: chown d2/db/dd/d52/d8c 247 1 2023-12-16T07:40:25.885 INFO:tasks.workunit.client.0.smithi049.stdout:6/955: rmdir d0 39 2023-12-16T07:40:25.886 INFO:tasks.workunit.client.0.smithi049.stdout:6/956: chown d0/d2/df/d4e/d5d/d6f/lc6 509 1 2023-12-16T07:40:25.886 INFO:tasks.workunit.client.0.smithi049.stdout:4/795: getdents d2/db/d6b/dad 0 2023-12-16T07:40:25.888 INFO:tasks.workunit.client.0.smithi049.stdout:6/957: unlink d0/f35 0 2023-12-16T07:40:25.890 INFO:tasks.workunit.client.0.smithi049.stdout:4/796: creat d2/db/dd/db7/ff3 x:0 0 0 2023-12-16T07:40:25.890 INFO:tasks.workunit.client.0.smithi049.stdout:4/797: write d2/db/dd/de/d1e/d37/faa [842868,120472] 0 2023-12-16T07:40:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:1/909: dwrite d20/d41/d11c/f12f [0,4194304] 0 2023-12-16T07:40:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/910: write d20/d41/d4f/f51 [2256908,73613] 0 2023-12-16T07:40:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/911: write d20/d45/d47/fb9 [3723784,885] 0 2023-12-16T07:40:25.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/854: dwrite d7/dc/dd/d27/d8e/f90 [0,4194304] 0 2023-12-16T07:40:25.907 INFO:tasks.workunit.client.0.smithi049.stdout:7/855: truncate d7/dc/d6b/f10a 896393 0 2023-12-16T07:40:25.907 INFO:tasks.workunit.client.0.smithi049.stdout:5/888: dwrite d5/de/d54/d57/dfa/d21/d58/f11f [0,4194304] 0 2023-12-16T07:40:25.909 INFO:tasks.workunit.client.0.smithi049.stdout:3/746: dwrite d1/fa5 [0,4194304] 0 2023-12-16T07:40:25.910 INFO:tasks.workunit.client.0.smithi049.stdout:7/856: unlink d7/dc/dd/d37/d5c/db2/d106/f128 0 2023-12-16T07:40:25.912 INFO:tasks.workunit.client.0.smithi049.stdout:5/889: unlink d5/de/d54/d57/dfa/ce7 0 2023-12-16T07:40:25.914 INFO:tasks.workunit.client.0.smithi049.stdout:3/747: mknod d1/d2a/d37/d3f/cf7 0 2023-12-16T07:40:25.914 INFO:tasks.workunit.client.0.smithi049.stdout:9/753: dwrite d4/d7/d11/d1d/d69/d76/d83/db4/fd8 [0,4194304] 0 2023-12-16T07:40:25.914 INFO:tasks.workunit.client.0.smithi049.stdout:8/818: dwrite d0/d1f/d36/f3c [0,4194304] 0 2023-12-16T07:40:25.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/857: symlink d7/dc/d6b/d70/l12c 0 2023-12-16T07:40:25.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/890: creat d5/de/d54/d67/df8/f13a x:0 0 0 2023-12-16T07:40:25.923 INFO:tasks.workunit.client.0.smithi049.stdout:5/891: mkdir d5/de/d54/d57/d3c/d13b 0 2023-12-16T07:40:25.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/976: dwrite fa [0,4194304] 0 2023-12-16T07:40:25.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/958: dwrite d0/d39/d5b/d65/d53/f66 [0,4194304] 0 2023-12-16T07:40:25.925 INFO:tasks.workunit.client.0.smithi049.stdout:8/819: rename d0/d1f/c4b to d0/d1f/db7/dbe/cfa 0 2023-12-16T07:40:25.926 INFO:tasks.workunit.client.0.smithi049.stdout:5/892: creat d5/de/d54/d78/d9b/f13c x:0 0 0 2023-12-16T07:40:25.927 INFO:tasks.workunit.client.0.smithi049.stdout:5/893: write d5/de/f1d [2245075,2517] 0 2023-12-16T07:40:25.930 INFO:tasks.workunit.client.0.smithi049.stdout:1/912: dwrite d20/f37 [0,4194304] 0 2023-12-16T07:40:25.930 INFO:tasks.workunit.client.0.smithi049.stdout:6/959: unlink d0/d39/dd0/fe6 0 2023-12-16T07:40:25.932 INFO:tasks.workunit.client.0.smithi049.stdout:0/977: creat d13/d21/d99/d46/f154 x:0 0 0 2023-12-16T07:40:25.932 INFO:tasks.workunit.client.0.smithi049.stdout:3/748: dwrite d1/d2a/d37/d3f/d5a/d61/d75/fe4 [0,4194304] 0 2023-12-16T07:40:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/754: dwrite d4/d7/f3c [0,4194304] 0 2023-12-16T07:40:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:7/858: rename d7/dc/dd/d27/d8e/f90 to d7/dc/dd/d27/dba/dee/f12d 0 2023-12-16T07:40:25.934 INFO:tasks.workunit.client.0.smithi049.stdout:8/820: mkdir d0/d1f/d36/dfb 0 2023-12-16T07:40:25.935 INFO:tasks.workunit.client.0.smithi049.stdout:5/894: mknod d5/c13d 0 2023-12-16T07:40:25.935 INFO:tasks.workunit.client.0.smithi049.stdout:5/895: chown d5/de/c4b 118 1 2023-12-16T07:40:25.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/913: creat d20/d40/d6f/dac/f13c x:0 0 0 2023-12-16T07:40:25.939 INFO:tasks.workunit.client.0.smithi049.stdout:6/960: mkdir d0/d39/d5b/d65/d4c/d139 0 2023-12-16T07:40:25.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/961: write d0/d39/d5b/d65/d58/f42 [3926782,104] 0 2023-12-16T07:40:25.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/962: chown d0/d39/d5b/d65/d27/d91/d119 0 1 2023-12-16T07:40:25.943 INFO:tasks.workunit.client.0.smithi049.stdout:3/749: unlink d1/d2a/d37/db9/lbc 0 2023-12-16T07:40:25.944 INFO:tasks.workunit.client.0.smithi049.stdout:9/755: symlink d4/d7/d11/db3/dda/lee 0 2023-12-16T07:40:25.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/859: creat d7/dc/dd/d35/f12e x:0 0 0 2023-12-16T07:40:25.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/860: write d7/dc/d2f/d38/fe5 [24941,17159] 0 2023-12-16T07:40:25.947 INFO:tasks.workunit.client.0.smithi049.stdout:8/821: link d0/d13/d42/d5b/d68/d6b/da2/db9/cd4 d0/d1f/d4e/dbb/df7/cfc 0 2023-12-16T07:40:25.947 INFO:tasks.workunit.client.0.smithi049.stdout:8/822: stat d0/d1f/d56/lde 0 2023-12-16T07:40:25.952 INFO:tasks.workunit.client.0.smithi049.stdout:0/978: dwrite d13/d21/d27/d2c/d62/d70/fb9 [0,4194304] 0 2023-12-16T07:40:25.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/896: rename d5/f7c to d5/de/d54/d78/d9b/dd1/f13e 0 2023-12-16T07:40:25.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/897: write d5/de/d54/d57/dfa/d20/d95/fab [4827976,84300] 0 2023-12-16T07:40:25.955 INFO:tasks.workunit.client.0.smithi049.stdout:1/914: mknod d20/d40/d6f/dac/c13d 0 2023-12-16T07:40:25.955 INFO:tasks.workunit.client.0.smithi049.stdout:1/915: fdatasync d20/f3f 0 2023-12-16T07:40:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:25 smithi049 ceph-mon[111939]: pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 108 MiB/s rd, 230 MiB/s wr, 380 op/s 2023-12-16T07:40:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:25 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:25 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:25.962 INFO:tasks.workunit.client.0.smithi049.stdout:9/756: dread d4/d7/f38 [0,4194304] 0 2023-12-16T07:40:25.962 INFO:tasks.workunit.client.0.smithi049.stdout:9/757: dread - d4/d7/d11/db3/d59/fcb zero size 2023-12-16T07:40:25.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/758: write d4/d7/d11/f20 [3644707,102902] 0 2023-12-16T07:40:25.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/759: chown d4/d7/cc 955464226 1 2023-12-16T07:40:25.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/760: readlink d4/l19 0 2023-12-16T07:40:25.964 INFO:tasks.workunit.client.0.smithi049.stdout:8/823: dwrite d0/d13/f66 [0,4194304] 0 2023-12-16T07:40:25.964 INFO:tasks.workunit.client.0.smithi049.stdout:8/824: chown d0/d1f/d56/ld3 7633865 1 2023-12-16T07:40:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/963: symlink d0/d39/d5b/d65/d58/d33/l13a 0 2023-12-16T07:40:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:7/861: truncate d7/dc/d2f/d38/ddb/fe0 600279 0 2023-12-16T07:40:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:2/769: sync 2023-12-16T07:40:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:2/770: chown d2/d1d/d28/d56/d11/da8/c106 55 1 2023-12-16T07:40:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:7/862: write d7/dc/d6b/f84 [1480304,27437] 0 2023-12-16T07:40:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:0/979: creat d13/d39/d78/f155 x:0 0 0 2023-12-16T07:40:25.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/898: link d5/de/d54/d57/dfa/d21/d58/fb0 d5/de/d54/d57/d3c/d82/f13f 0 2023-12-16T07:40:25.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/771: read d2/d1d/f89 [1755698,87979] 0 2023-12-16T07:40:25.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/916: link d20/d43/f75 d20/d41/d4f/d55/d7f/d106/f13e 0 2023-12-16T07:40:25.971 INFO:tasks.workunit.client.0.smithi049.stdout:2/772: read d2/d1d/d28/d56/fae [995131,73140] 0 2023-12-16T07:40:25.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/773: write d2/d1d/d24/d55/d76/f7f [408550,53994] 0 2023-12-16T07:40:25.978 INFO:tasks.workunit.client.0.smithi049.stdout:9/761: symlink d4/d7/d11/d1d/d9b/dae/dc3/de1/lef 0 2023-12-16T07:40:25.988 INFO:tasks.workunit.client.0.smithi049.stdout:8/825: rename d0/d13/c50 to d0/d13/d42/d5b/d68/d6b/dd6/cfd 0 2023-12-16T07:40:25.988 INFO:tasks.workunit.client.0.smithi049.stdout:6/964: mknod d0/d2/df/d4e/c13b 0 2023-12-16T07:40:25.988 INFO:tasks.workunit.client.0.smithi049.stdout:8/826: fsync d0/d13/fd7 0 2023-12-16T07:40:25.988 INFO:tasks.workunit.client.0.smithi049.stdout:6/965: chown d0/d39/d5b/d65/d4c/f8e 607286 1 2023-12-16T07:40:25.988 INFO:tasks.workunit.client.0.smithi049.stdout:7/863: mknod d7/dc/d2f/d38/ddb/c12f 0 2023-12-16T07:40:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/774: creat d2/d26/f10d x:0 0 0 2023-12-16T07:40:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/775: dread - d2/d26/d6e/fc0 zero size 2023-12-16T07:40:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/776: fsync d2/d1d/d24/d55/fe3 0 2023-12-16T07:40:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/777: write d2/d26/f10d [571284,77006] 0 2023-12-16T07:40:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/778: chown d2/d1d/d28/d56/d11/fdd 70613 1 2023-12-16T07:40:25.991 INFO:tasks.workunit.client.0.smithi049.stdout:2/779: write d2/d1d/d28/d56/d66/f7e [1747417,20900] 0 2023-12-16T07:40:25.993 INFO:tasks.workunit.client.0.smithi049.stdout:9/762: symlink d4/d7/d11/d1d/d9b/dae/dc3/de1/lf0 0 2023-12-16T07:40:25.993 INFO:tasks.workunit.client.0.smithi049.stdout:9/763: chown d4/d7/d11/d1d/d5b/dbe/fbf 8336 1 2023-12-16T07:40:25.996 INFO:tasks.workunit.client.0.smithi049.stdout:6/966: rename d0/d39/d8b/deb/lff to d0/d39/d5b/d65/d58/d33/l13c 0 2023-12-16T07:40:25.996 INFO:tasks.workunit.client.0.smithi049.stdout:8/827: write d0/d1f/f18 [2294740,12899] 0 2023-12-16T07:40:25.997 INFO:tasks.workunit.client.0.smithi049.stdout:8/828: chown d0/d1f/f59 8060 1 2023-12-16T07:40:25.997 INFO:tasks.workunit.client.0.smithi049.stdout:0/980: dwrite d13/d39/d78/d83/f137 [0,4194304] 0 2023-12-16T07:40:25.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/917: dwrite d20/f37 [0,4194304] 0 2023-12-16T07:40:25.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/918: dread - d20/d41/d4f/d7c/dfa/f127 zero size 2023-12-16T07:40:25.998 INFO:tasks.workunit.client.0.smithi049.stdout:5/899: dwrite d5/de/d54/d67/da0/ffd [0,4194304] 0 2023-12-16T07:40:25.998 INFO:tasks.workunit.client.0.smithi049.stdout:7/864: creat d7/dc/dd/d35/f130 x:0 0 0 2023-12-16T07:40:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:9/764: creat d4/db2/dcc/ff1 x:0 0 0 2023-12-16T07:40:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:9/765: chown d4/d7/d11/d1d/d69/d76/d83/ddf 704 1 2023-12-16T07:40:26.006 INFO:tasks.workunit.client.0.smithi049.stdout:2/780: rename d2/d1d/d24/f50 to d2/d1d/d24/d55/d7c/f10e 0 2023-12-16T07:40:26.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/967: symlink d0/d2/df/d4e/d5d/d6f/d4a/da4/l13d 0 2023-12-16T07:40:26.009 INFO:tasks.workunit.client.0.smithi049.stdout:9/766: dread d4/d7/d11/f16 [0,4194304] 0 2023-12-16T07:40:26.010 INFO:tasks.workunit.client.0.smithi049.stdout:0/981: truncate d13/d21/d2f/f80 1816017 0 2023-12-16T07:40:26.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/919: creat d20/d41/d4f/d7c/d105/f13f x:0 0 0 2023-12-16T07:40:26.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/900: getdents d5/de/d54/d57/dfa/d21 0 2023-12-16T07:40:26.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/901: chown d5/f19 39 1 2023-12-16T07:40:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/902: readlink d5/de/d54/d67/lf0 0 2023-12-16T07:40:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/982: dread fd [0,4194304] 0 2023-12-16T07:40:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/983: truncate d13/f40 5071986 0 2023-12-16T07:40:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/984: dread - d13/d21/d27/d2c/d62/d70/dff/f114 zero size 2023-12-16T07:40:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:7/865: creat d7/dc/dd/d35/d36/f131 x:0 0 0 2023-12-16T07:40:26.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/985: write d13/d21/d99/d46/f141 [730551,57766] 0 2023-12-16T07:40:26.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/986: write d13/d21/d99/f118 [4852346,117035] 0 2023-12-16T07:40:26.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/987: truncate d13/d39/dfe/f142 747017 0 2023-12-16T07:40:26.021 INFO:tasks.workunit.client.0.smithi049.stdout:7/866: read d7/d2b/f7b [3817051,21946] 0 2023-12-16T07:40:26.022 INFO:tasks.workunit.client.0.smithi049.stdout:8/829: rename d0/d6a/dda/l98 to d0/d1f/d36/dbf/lfe 0 2023-12-16T07:40:26.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/781: truncate d2/d1d/d28/d56/fae 4038695 0 2023-12-16T07:40:26.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/782: write d2/d1d/d28/d56/d11/f95 [652108,47567] 0 2023-12-16T07:40:26.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/783: dread - d2/d1d/d24/d55/fe3 zero size 2023-12-16T07:40:26.027 INFO:tasks.workunit.client.0.smithi049.stdout:6/968: truncate d0/d39/d5b/d65/d4c/fb7 3072084 0 2023-12-16T07:40:26.027 INFO:tasks.workunit.client.0.smithi049.stdout:6/969: fsync d0/d2/df/d4e/f10b 0 2023-12-16T07:40:26.028 INFO:tasks.workunit.client.0.smithi049.stdout:1/920: mkdir d20/d41/de8/d138/d140 0 2023-12-16T07:40:26.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/903: mkdir d5/d140 0 2023-12-16T07:40:26.032 INFO:tasks.workunit.client.0.smithi049.stdout:0/988: creat d13/d21/d2f/f156 x:0 0 0 2023-12-16T07:40:26.034 INFO:tasks.workunit.client.0.smithi049.stdout:7/867: creat d7/dc/d7c/f132 x:0 0 0 2023-12-16T07:40:26.034 INFO:tasks.workunit.client.0.smithi049.stdout:7/868: chown d7/dc/d2f/d38/lbe 157097 1 2023-12-16T07:40:26.035 INFO:tasks.workunit.client.0.smithi049.stdout:9/767: rename d4/db/c15 to d4/d7/d11/d1d/d5b/d8b/cf2 0 2023-12-16T07:40:26.036 INFO:tasks.workunit.client.0.smithi049.stdout:9/768: fdatasync d4/d7/f10 0 2023-12-16T07:40:26.036 INFO:tasks.workunit.client.0.smithi049.stdout:9/769: write d4/d7/d11/d1d/d5b/fb7 [408662,37220] 0 2023-12-16T07:40:26.036 INFO:tasks.workunit.client.0.smithi049.stdout:8/830: truncate d0/d1f/d4e/f8b 109372 0 2023-12-16T07:40:26.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/784: symlink d2/d1d/d24/d55/d7c/l10f 0 2023-12-16T07:40:26.040 INFO:tasks.workunit.client.0.smithi049.stdout:3/750: sync 2023-12-16T07:40:26.040 INFO:tasks.workunit.client.0.smithi049.stdout:3/751: chown d1/d2a/d37/d3f/f93 3 1 2023-12-16T07:40:26.040 INFO:tasks.workunit.client.0.smithi049.stdout:4/798: sync 2023-12-16T07:40:26.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/970: symlink d0/d2/df/d10f/l13e 0 2023-12-16T07:40:26.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/921: symlink d20/d41/d4f/d55/d7f/d106/l141 0 2023-12-16T07:40:26.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/922: truncate d20/d41/d4f/d55/d82/dd2/fe6 1026450 0 2023-12-16T07:40:26.042 INFO:tasks.workunit.client.0.smithi049.stdout:1/923: chown d20/d41/d52/f100 13471 1 2023-12-16T07:40:26.042 INFO:tasks.workunit.client.0.smithi049.stdout:5/904: truncate d5/de/d54/d57/dfa/d21/d58/f11f 61280 0 2023-12-16T07:40:26.043 INFO:tasks.workunit.client.0.smithi049.stdout:0/989: creat d13/d21/d27/f157 x:0 0 0 2023-12-16T07:40:26.044 INFO:tasks.workunit.client.0.smithi049.stdout:6/971: read d0/d39/d5b/d65/d27/d115/f124 [3653087,76120] 0 2023-12-16T07:40:26.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/869: symlink d7/dc/dd/d37/d5c/db2/d106/l133 0 2023-12-16T07:40:26.048 INFO:tasks.workunit.client.0.smithi049.stdout:8/831: creat d0/d1f/db7/fff x:0 0 0 2023-12-16T07:40:26.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/785: rename d2/d26/f30 to d2/d26/d6e/f110 0 2023-12-16T07:40:26.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/786: stat d2/de/d93/laf 0 2023-12-16T07:40:26.053 INFO:tasks.workunit.client.0.smithi049.stdout:6/972: dread d0/d39/d5b/d65/f1d [0,4194304] 0 2023-12-16T07:40:26.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/973: write d0/d39/d5b/d65/dc1/f105 [2965493,44500] 0 2023-12-16T07:40:26.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/974: chown d0/d2/df/d81/ldd 58303026 1 2023-12-16T07:40:26.057 INFO:tasks.workunit.client.0.smithi049.stdout:4/799: creat d2/db/dd/d9f/ff4 x:0 0 0 2023-12-16T07:40:26.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/905: dread d5/de/d54/d57/fa1 [0,4194304] 0 2023-12-16T07:40:26.058 INFO:tasks.workunit.client.0.smithi049.stdout:5/906: chown d5/de/d54/d57/dfa/d21/d5a/l8c 3211155 1 2023-12-16T07:40:26.058 INFO:tasks.workunit.client.0.smithi049.stdout:1/924: unlink d20/d41/d4f/d55/d7f/d84/d113/l132 0 2023-12-16T07:40:26.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/990: creat d13/d39/df3/f158 x:0 0 0 2023-12-16T07:40:26.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/991: stat d13/d39/d78 0 2023-12-16T07:40:26.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/992: truncate d13/d3c/fde 2271328 0 2023-12-16T07:40:26.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/870: creat d7/dc/dd/d37/f134 x:0 0 0 2023-12-16T07:40:26.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/832: mknod d0/d1f/db7/c100 0 2023-12-16T07:40:26.067 INFO:tasks.workunit.client.0.smithi049.stdout:1/925: mkdir d20/d41/d4f/d55/d7f/d106/d142 0 2023-12-16T07:40:26.067 INFO:tasks.workunit.client.0.smithi049.stdout:1/926: chown d20/c3b 6354725 1 2023-12-16T07:40:26.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/907: dread d5/de/d54/d67/da0/fc0 [0,4194304] 0 2023-12-16T07:40:26.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/908: write d5/de/d54/d67/df8/f128 [675231,32552] 0 2023-12-16T07:40:26.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/787: dwrite d2/d26/d6e/fc0 [0,4194304] 0 2023-12-16T07:40:26.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/788: chown d2/d26/f59 22636 1 2023-12-16T07:40:26.070 INFO:tasks.workunit.client.0.smithi049.stdout:0/993: creat d13/d39/d78/d83/dfc/f159 x:0 0 0 2023-12-16T07:40:26.070 INFO:tasks.workunit.client.0.smithi049.stdout:0/994: dread - d13/d21/d99/d46/d65/d82/f116 zero size 2023-12-16T07:40:26.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/752: dwrite d1/d2a/d37/d3f/d5a/d5b/d77/fbf [0,4194304] 0 2023-12-16T07:40:26.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/871: creat d7/dc/d6b/d70/f135 x:0 0 0 2023-12-16T07:40:26.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/833: mkdir d0/d6a/dda/d101 0 2023-12-16T07:40:26.072 INFO:tasks.workunit.client.0.smithi049.stdout:6/975: symlink d0/d39/d5b/d65/d53/l13f 0 2023-12-16T07:40:26.073 INFO:tasks.workunit.client.0.smithi049.stdout:1/927: truncate d20/d41/d4f/d55/d82/fe9 1017851 0 2023-12-16T07:40:26.075 INFO:tasks.workunit.client.0.smithi049.stdout:5/909: creat d5/de/d54/d5c/f141 x:0 0 0 2023-12-16T07:40:26.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/800: dwrite d2/db/dd/de/d1e/d44/fb8 [0,4194304] 0 2023-12-16T07:40:26.080 INFO:tasks.workunit.client.0.smithi049.stdout:7/872: dread d7/db4/fd7 [0,4194304] 0 2023-12-16T07:40:26.080 INFO:tasks.workunit.client.0.smithi049.stdout:7/873: fsync d7/dc/dd/d27/f103 0 2023-12-16T07:40:26.081 INFO:tasks.workunit.client.0.smithi049.stdout:7/874: write d7/dc/dd/d27/dba/fec [328943,128782] 0 2023-12-16T07:40:26.081 INFO:tasks.workunit.client.0.smithi049.stdout:5/910: dread d5/de/d54/d57/dfa/d21/d58/f11f [0,4194304] 0 2023-12-16T07:40:26.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/995: creat d13/d21/d27/d2c/d62/d70/d107/f15a x:0 0 0 2023-12-16T07:40:26.082 INFO:tasks.workunit.client.0.smithi049.stdout:3/753: mknod d1/d2a/d37/d3f/d5a/d61/d75/cf8 0 2023-12-16T07:40:26.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/996: chown d13/d21/d27/d2c/c68 8720493 1 2023-12-16T07:40:26.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/976: dwrite d0/d39/d5b/f10e [0,4194304] 0 2023-12-16T07:40:26.087 INFO:tasks.workunit.client.0.smithi049.stdout:6/977: write d0/d39/d5b/d65/d27/d91/d94/fcd [2745958,45776] 0 2023-12-16T07:40:26.087 INFO:tasks.workunit.client.0.smithi049.stdout:8/834: dread d0/d1f/d56/f74 [0,4194304] 0 2023-12-16T07:40:26.088 INFO:tasks.workunit.client.0.smithi049.stdout:1/928: dread d20/f37 [0,4194304] 0 2023-12-16T07:40:26.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/801: creat d2/db/dd/de/d1e/d37/dcf/ff5 x:0 0 0 2023-12-16T07:40:26.094 INFO:tasks.workunit.client.0.smithi049.stdout:5/911: rmdir d5/de/d54/d57/dfa 39 2023-12-16T07:40:26.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/802: chown d2/db/d6b/db9/de4/f85 63534 1 2023-12-16T07:40:26.094 INFO:tasks.workunit.client.0.smithi049.stdout:3/754: link d1/d2a/f48 d1/d2a/d37/d3f/dcc/ff9 0 2023-12-16T07:40:26.094 INFO:tasks.workunit.client.0.smithi049.stdout:7/875: dread d7/dc/dd/d35/d36/f5f [0,4194304] 0 2023-12-16T07:40:26.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/789: write d2/d26/d6e/fc0 [5098737,66662] 0 2023-12-16T07:40:26.098 INFO:tasks.workunit.client.0.smithi049.stdout:6/978: link d0/d39/d5b/d65/d27/f85 d0/d39/d5b/d65/d27/d91/d94/f140 0 2023-12-16T07:40:26.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/835: creat d0/d13/d42/f102 x:0 0 0 2023-12-16T07:40:26.100 INFO:tasks.workunit.client.0.smithi049.stdout:8/836: write d0/d1f/d56/f72 [44010,20359] 0 2023-12-16T07:40:26.101 INFO:tasks.workunit.client.0.smithi049.stdout:1/929: creat d20/d45/d47/d12c/f143 x:0 0 0 2023-12-16T07:40:26.101 INFO:tasks.workunit.client.0.smithi049.stdout:0/997: dwrite d13/d21/d99/d46/f60 [4194304,4194304] 0 2023-12-16T07:40:26.104 INFO:tasks.workunit.client.0.smithi049.stdout:4/803: mkdir d2/db/dd/de/d1e/d37/da4/de1/df6 0 2023-12-16T07:40:26.104 INFO:tasks.workunit.client.0.smithi049.stdout:4/804: chown d2/db/dd/de/d1e/f34 14 1 2023-12-16T07:40:26.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/790: unlink d2/de/d77/lbd 0 2023-12-16T07:40:26.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/791: chown d2/d1d/d24/d55/lba 2050341 1 2023-12-16T07:40:26.106 INFO:tasks.workunit.client.0.smithi049.stdout:7/876: dread d7/dc/dd/ff [0,4194304] 0 2023-12-16T07:40:26.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/979: creat d0/d39/d5b/d65/d32/f141 x:0 0 0 2023-12-16T07:40:26.108 INFO:tasks.workunit.client.0.smithi049.stdout:8/837: symlink d0/d13/d42/d5b/l103 0 2023-12-16T07:40:26.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/930: link d20/d41/d52/d86/fca d20/d41/de8/f144 0 2023-12-16T07:40:26.111 INFO:tasks.workunit.client.0.smithi049.stdout:5/912: mkdir d5/de/d54/d57/dfa/d21/d4e/dba/d142 0 2023-12-16T07:40:26.112 INFO:tasks.workunit.client.0.smithi049.stdout:1/931: dread d20/d45/d47/fb3 [0,4194304] 0 2023-12-16T07:40:26.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/998: rmdir d13/d39/d38/da7 39 2023-12-16T07:40:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:25 smithi133 ceph-mon[120445]: pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 108 MiB/s rd, 230 MiB/s wr, 380 op/s 2023-12-16T07:40:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:25 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:25 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:26.117 INFO:tasks.workunit.client.0.smithi049.stdout:3/755: mknod d1/cfa 0 2023-12-16T07:40:26.117 INFO:tasks.workunit.client.0.smithi049.stdout:3/756: chown d1/d2a/d37/db9/fdf 998899977 1 2023-12-16T07:40:26.117 INFO:tasks.workunit.client.0.smithi049.stdout:3/757: chown d1/ff 47 1 2023-12-16T07:40:26.118 INFO:tasks.workunit.client.0.smithi049.stdout:4/805: mknod d2/db/dd/de/d1e/d37/d82/cf7 0 2023-12-16T07:40:26.118 INFO:tasks.workunit.client.0.smithi049.stdout:4/806: fdatasync d2/f28 0 2023-12-16T07:40:26.119 INFO:tasks.workunit.client.0.smithi049.stdout:2/792: creat d2/d1d/d24/d55/f111 x:0 0 0 2023-12-16T07:40:26.120 INFO:tasks.workunit.client.0.smithi049.stdout:6/980: dwrite d0/d2/df/d81/fa9 [0,4194304] 0 2023-12-16T07:40:26.120 INFO:tasks.workunit.client.0.smithi049.stdout:7/877: creat d7/dc/d2f/d40/f136 x:0 0 0 2023-12-16T07:40:26.122 INFO:tasks.workunit.client.0.smithi049.stdout:8/838: mknod d0/d1f/d4e/c104 0 2023-12-16T07:40:26.122 INFO:tasks.workunit.client.0.smithi049.stdout:8/839: chown d0/d1f/db7/dbe/cfa 10865202 1 2023-12-16T07:40:26.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/913: creat d5/de/d54/d57/f143 x:0 0 0 2023-12-16T07:40:26.125 INFO:tasks.workunit.client.0.smithi049.stdout:1/932: symlink d20/d7b/d71/l145 0 2023-12-16T07:40:26.125 INFO:tasks.workunit.client.0.smithi049.stdout:1/933: stat d20/d41/d124/cd8 0 2023-12-16T07:40:26.125 INFO:tasks.workunit.client.0.smithi049.stdout:1/934: fdatasync d20/d41/de8/f144 0 2023-12-16T07:40:26.127 INFO:tasks.workunit.client.0.smithi049.stdout:0/999: mknod d13/c15b 0 2023-12-16T07:40:26.128 INFO:tasks.workunit.client.0.smithi049.stdout:3/758: truncate d1/fa5 3311729 0 2023-12-16T07:40:26.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/807: dread d2/db/dd/de/d1e/d21/f25 [0,4194304] 0 2023-12-16T07:40:26.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/808: fsync d2/db/dd/de/d1e/d21/fe9 0 2023-12-16T07:40:26.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/793: rename d2/d26/f58 to d2/d1d/d28/d8b/f112 0 2023-12-16T07:40:26.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/794: readlink d2/d1d/d28/d56/d71/ddf/lc1 0 2023-12-16T07:40:26.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/795: read - d2/d1d/d38/f81 zero size 2023-12-16T07:40:26.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/796: chown d2/d1d/d28/d56/d66/d6b/fb3 42036584 1 2023-12-16T07:40:26.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/797: write d2/de/f46 [5045334,85148] 0 2023-12-16T07:40:26.133 INFO:tasks.workunit.client.0.smithi049.stdout:6/981: symlink d0/d39/d5b/d65/d4c/d4d/d6a/dd6/l142 0 2023-12-16T07:40:26.133 INFO:tasks.workunit.client.0.smithi049.stdout:6/982: fdatasync d0/d39/d5b/d65/f12 0 2023-12-16T07:40:26.133 INFO:tasks.workunit.client.0.smithi049.stdout:1/935: dread d20/d45/d47/f9d [0,4194304] 0 2023-12-16T07:40:26.134 INFO:tasks.workunit.client.0.smithi049.stdout:9/770: sync 2023-12-16T07:40:26.135 INFO:tasks.workunit.client.0.smithi049.stdout:7/878: mkdir d7/dc/dd/d27/d137 0 2023-12-16T07:40:26.135 INFO:tasks.workunit.client.0.smithi049.stdout:8/840: chown d0/d1f/c29 16351 1 2023-12-16T07:40:26.136 INFO:tasks.workunit.client.0.smithi049.stdout:5/914: getdents d5/de/d54/d57/d2f 0 2023-12-16T07:40:26.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/936: dread d20/d41/d4f/f51 [0,4194304] 0 2023-12-16T07:40:26.138 INFO:tasks.workunit.client.0.smithi049.stdout:2/798: dread d2/de/d78/fb4 [0,4194304] 0 2023-12-16T07:40:26.138 INFO:tasks.workunit.client.0.smithi049.stdout:2/799: write d2/d1d/f9a [5032851,121365] 0 2023-12-16T07:40:26.139 INFO:tasks.workunit.client.0.smithi049.stdout:4/809: write d2/db/f15 [5340961,122459] 0 2023-12-16T07:40:26.139 INFO:tasks.workunit.client.0.smithi049.stdout:4/810: getdents d2/db/dd/de/d1e/d37/d82/dd4 0 2023-12-16T07:40:26.141 INFO:tasks.workunit.client.0.smithi049.stdout:6/983: creat d0/d2/df/d81/d123/f143 x:0 0 0 2023-12-16T07:40:26.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/771: unlink d4/l58 0 2023-12-16T07:40:26.143 INFO:tasks.workunit.client.0.smithi049.stdout:7/879: mkdir d7/dc/dd/d35/d138 0 2023-12-16T07:40:26.145 INFO:tasks.workunit.client.0.smithi049.stdout:8/841: creat d0/d6a/f105 x:0 0 0 2023-12-16T07:40:26.145 INFO:tasks.workunit.client.0.smithi049.stdout:8/842: write d0/d1f/d56/f93 [1318335,88467] 0 2023-12-16T07:40:26.146 INFO:tasks.workunit.client.0.smithi049.stdout:5/915: mknod d5/de/d54/d57/dfa/d21/c144 0 2023-12-16T07:40:26.148 INFO:tasks.workunit.client.0.smithi049.stdout:3/759: mknod d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde/cfb 0 2023-12-16T07:40:26.151 INFO:tasks.workunit.client.0.smithi049.stdout:2/800: creat d2/de/de0/f113 x:0 0 0 2023-12-16T07:40:26.153 INFO:tasks.workunit.client.0.smithi049.stdout:4/811: truncate d2/fac 468444 0 2023-12-16T07:40:26.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/984: creat d0/d39/d8b/f144 x:0 0 0 2023-12-16T07:40:26.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/772: link d4/d7/d11/d1d/d5b/fe8 d4/d7/d11/db3/d8a/daa/ff3 0 2023-12-16T07:40:26.163 INFO:tasks.workunit.client.0.smithi049.stdout:7/880: mkdir d7/dc/dd/d14/d139 0 2023-12-16T07:40:26.163 INFO:tasks.workunit.client.0.smithi049.stdout:7/881: chown d7/dc/dd/d14/ff1 222906 1 2023-12-16T07:40:26.163 INFO:tasks.workunit.client.0.smithi049.stdout:8/843: rename d0/f3d to d0/d13/d42/d5b/d68/f106 0 2023-12-16T07:40:26.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/801: unlink d2/d1d/d24/d55/d76/c97 0 2023-12-16T07:40:26.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/844: mkdir d0/d1f/d1c/d107 0 2023-12-16T07:40:26.166 INFO:tasks.workunit.client.0.smithi049.stdout:1/937: dwrite d20/d45/fcd [0,4194304] 0 2023-12-16T07:40:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/812: dread d2/db/dd/de/d1e/d37/d82/fae [0,4194304] 0 2023-12-16T07:40:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/813: dread - d2/db/dd/de/d1e/d37/dcf/ff5 zero size 2023-12-16T07:40:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:1/938: mkdir d20/d41/d4f/d55/d82/dd2/dfc/d146 0 2023-12-16T07:40:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:1/939: fdatasync d20/d41/d124/fc9 0 2023-12-16T07:40:26.170 INFO:tasks.workunit.client.0.smithi049.stdout:1/940: chown d20/d41/d4f/d55/l130 109 1 2023-12-16T07:40:26.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/814: dread d2/db/dd/de/d1e/d37/f5c [0,4194304] 0 2023-12-16T07:40:26.171 INFO:tasks.workunit.client.0.smithi049.stdout:1/941: creat d20/d41/d4f/dec/d102/f147 x:0 0 0 2023-12-16T07:40:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/845: write d0/d13/d42/d5b/f8d [3539192,22783] 0 2023-12-16T07:40:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/815: rename d2/db/dd/de/d1e/d37/da4/lb0 to d2/db/dd/de/d1e/d37/da4/de1/df6/lf8 0 2023-12-16T07:40:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:7/882: dread d7/dc/dd/d37/d5c/ff4 [0,4194304] 0 2023-12-16T07:40:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:7/883: chown d7/dc/d15/d57/cea 485355 1 2023-12-16T07:40:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:8/846: symlink d0/d13/d42/l108 0 2023-12-16T07:40:26.179 INFO:tasks.workunit.client.0.smithi049.stdout:4/816: chown d2/db/dd/d52/cd2 726606 1 2023-12-16T07:40:26.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/884: link d7/dc/d6b/dbf/dd3/f10e d7/dc/dd/d35/d36/f13a 0 2023-12-16T07:40:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:5/916: dwrite d5/de/f40 [4194304,4194304] 0 2023-12-16T07:40:26.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/847: getdents d0/d13 0 2023-12-16T07:40:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:7/885: mknod d7/dc/dd/c13b 0 2023-12-16T07:40:26.194 INFO:tasks.workunit.client.0.smithi049.stdout:8/848: mknod d0/d1f/d4e/c109 0 2023-12-16T07:40:26.200 INFO:tasks.workunit.client.0.smithi049.stdout:3/760: dwrite d1/d2a/d37/d3f/d5a/d5b/f99 [0,4194304] 0 2023-12-16T07:40:26.200 INFO:tasks.workunit.client.0.smithi049.stdout:5/917: dread d5/de/d54/d78/d9b/dd1/f13e [0,4194304] 0 2023-12-16T07:40:26.200 INFO:tasks.workunit.client.0.smithi049.stdout:3/761: read d1/d2a/d37/d3f/d4c/f73 [3351240,102221] 0 2023-12-16T07:40:26.203 INFO:tasks.workunit.client.0.smithi049.stdout:5/918: rename d5/de/d54/d57/d2f to d5/de/d54/d67/dc2/d145 0 2023-12-16T07:40:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/762: rename d1/d2a/d37/d3f/d5a/d5b/d5e/c8f to d1/d2a/d37/d3f/dcc/de8/cfc 0 2023-12-16T07:40:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/763: rename d1/d2a to d1/d2a/d37/d3f/d5a/d61/d75/db7/dfd 22 2023-12-16T07:40:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/764: chown d1/d2a/d37/d3f/d5a/d61/d75/c87 1 1 2023-12-16T07:40:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/765: truncate d1/d2b/f62 378177 0 2023-12-16T07:40:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/766: readlink d1/d2a/d37/d3f/d5a/d6d/lf1 0 2023-12-16T07:40:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:5/919: write d5/de/d54/d67/f7b [2330269,87148] 0 2023-12-16T07:40:26.207 INFO:tasks.workunit.client.0.smithi049.stdout:3/767: mknod d1/d2a/d37/d3f/d5a/cfe 0 2023-12-16T07:40:26.209 INFO:tasks.workunit.client.0.smithi049.stdout:5/920: rmdir d5/de/d54/d5c 39 2023-12-16T07:40:26.209 INFO:tasks.workunit.client.0.smithi049.stdout:5/921: write d5/de/d54/d67/dc2/d145/fa3 [200088,40654] 0 2023-12-16T07:40:26.210 INFO:tasks.workunit.client.0.smithi049.stdout:3/768: creat d1/d2a/d37/d3f/d5a/d6d/fff x:0 0 0 2023-12-16T07:40:26.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/922: symlink d5/de/d54/d78/d9b/l146 0 2023-12-16T07:40:26.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/923: chown d5/de/d54/d57/d3c/f11c 99925 1 2023-12-16T07:40:26.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/924: dread - d5/de/d54/d57/dfa/d21/fad zero size 2023-12-16T07:40:26.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/769: unlink d1/d2a/d37/d3f/d5a/d5b/d5e/fd2 0 2023-12-16T07:40:26.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/770: fsync d1/d2a/d37/d3f/fee 0 2023-12-16T07:40:26.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/771: write d1/d2a/d37/d3f/f59 [565150,36699] 0 2023-12-16T07:40:26.217 INFO:tasks.workunit.client.0.smithi049.stdout:5/925: dread d5/de/d54/d67/fa4 [0,4194304] 0 2023-12-16T07:40:26.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/926: write d5/de/d54/d67/dc2/d145/f10a [2912647,119894] 0 2023-12-16T07:40:26.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/927: write d5/f3e [340783,93059] 0 2023-12-16T07:40:26.229 INFO:tasks.workunit.client.0.smithi049.stdout:2/802: dwrite d2/d26/d6e/fdc [0,4194304] 0 2023-12-16T07:40:26.229 INFO:tasks.workunit.client.0.smithi049.stdout:3/772: dread d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fe5 [0,4194304] 0 2023-12-16T07:40:26.229 INFO:tasks.workunit.client.0.smithi049.stdout:3/773: fdatasync d1/d2a/d37/d3f/d5a/dc2/de0/fec 0 2023-12-16T07:40:26.234 INFO:tasks.workunit.client.0.smithi049.stdout:2/803: mkdir d2/d1d/d28/d56/d71/d114 0 2023-12-16T07:40:26.234 INFO:tasks.workunit.client.0.smithi049.stdout:2/804: chown d2/d1d/d28/d56/d11/d1c/l9b 16833 1 2023-12-16T07:40:26.234 INFO:tasks.workunit.client.0.smithi049.stdout:3/774: creat d1/d2a/d37/d3f/d5a/dc2/f100 x:0 0 0 2023-12-16T07:40:26.234 INFO:tasks.workunit.client.0.smithi049.stdout:2/805: mknod d2/de/d78/c115 0 2023-12-16T07:40:26.234 INFO:tasks.workunit.client.0.smithi049.stdout:2/806: write d2/fa3 [2432103,100746] 0 2023-12-16T07:40:26.235 INFO:tasks.workunit.client.0.smithi049.stdout:4/817: dwrite d2/db/ff2 [0,4194304] 0 2023-12-16T07:40:26.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/942: dwrite d20/d43/f8c [0,4194304] 0 2023-12-16T07:40:26.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/775: symlink d1/d2a/d37/d3f/d5a/d6d/l101 0 2023-12-16T07:40:26.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/886: dwrite d7/dc/d2f/d40/d5d/ff5 [0,4194304] 0 2023-12-16T07:40:26.237 INFO:tasks.workunit.client.0.smithi049.stdout:2/807: mknod d2/de/df2/c116 0 2023-12-16T07:40:26.237 INFO:tasks.workunit.client.0.smithi049.stdout:2/808: write d2/de/d77/f90 [1037362,48078] 0 2023-12-16T07:40:26.237 INFO:tasks.workunit.client.0.smithi049.stdout:2/809: write d2/d1d/d24/d55/d7c/d98/da1/ffb [228836,113657] 0 2023-12-16T07:40:26.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/849: dwrite d0/d1f/d36/fdd [0,4194304] 0 2023-12-16T07:40:26.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/850: truncate d0/d1f/db7/dbe/fcd 344344 0 2023-12-16T07:40:26.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/928: dwrite d5/de/d54/d78/fd8 [0,4194304] 0 2023-12-16T07:40:26.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/929: fsync d5/de/d54/d57/dfa/d21/d58/d65/dae/f12e 0 2023-12-16T07:40:26.242 INFO:tasks.workunit.client.0.smithi049.stdout:1/943: creat d20/d41/d4f/d7c/d105/f148 x:0 0 0 2023-12-16T07:40:26.243 INFO:tasks.workunit.client.0.smithi049.stdout:3/776: mknod d1/d2a/d37/d3f/d5a/d5b/d5e/c102 0 2023-12-16T07:40:26.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/887: rename d7/dc/d15/d57/fa2 to d7/dc/d2f/d40/d104/f13c 0 2023-12-16T07:40:26.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/888: dread - d7/dc/d6b/dbf/dd3/fe1 zero size 2023-12-16T07:40:26.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/889: chown d7/dc/f1d 825856735 1 2023-12-16T07:40:26.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/890: fsync d7/dc/d6b/fa4 0 2023-12-16T07:40:26.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/891: write d7/dc/d6b/dbf/dd3/f10e [262114,66177] 0 2023-12-16T07:40:26.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/892: write d7/dc/dd/d37/d5c/fc5 [189496,75651] 0 2023-12-16T07:40:26.248 INFO:tasks.workunit.client.0.smithi049.stdout:2/810: creat d2/d1d/d28/d56/d11/da8/f117 x:0 0 0 2023-12-16T07:40:26.248 INFO:tasks.workunit.client.0.smithi049.stdout:2/811: readlink d2/d1d/d24/d55/d7c/d98/lf3 0 2023-12-16T07:40:26.249 INFO:tasks.workunit.client.0.smithi049.stdout:4/818: dwrite d2/db/dd/de/d1e/d37/d4e/f9b [0,4194304] 0 2023-12-16T07:40:26.254 INFO:tasks.workunit.client.0.smithi049.stdout:2/812: dread d2/d26/d6e/fc0 [0,4194304] 0 2023-12-16T07:40:26.254 INFO:tasks.workunit.client.0.smithi049.stdout:8/851: creat d0/d13/d42/d5b/d68/d6b/dd6/f10a x:0 0 0 2023-12-16T07:40:26.254 INFO:tasks.workunit.client.0.smithi049.stdout:8/852: chown d0/d1f/d36/db8/de5 119212256 1 2023-12-16T07:40:26.255 INFO:tasks.workunit.client.0.smithi049.stdout:5/930: unlink d5/fb 0 2023-12-16T07:40:26.255 INFO:tasks.workunit.client.0.smithi049.stdout:5/931: chown d5/de/d54/l5e 13 1 2023-12-16T07:40:26.255 INFO:tasks.workunit.client.0.smithi049.stdout:5/932: chown d5/c1f 183 1 2023-12-16T07:40:26.257 INFO:tasks.workunit.client.0.smithi049.stdout:1/944: creat d20/d41/d4f/d55/d7f/d84/f149 x:0 0 0 2023-12-16T07:40:26.257 INFO:tasks.workunit.client.0.smithi049.stdout:1/945: truncate d20/d43/f123 696408 0 2023-12-16T07:40:26.258 INFO:tasks.workunit.client.0.smithi049.stdout:3/777: mknod d1/d2a/d37/d3f/c103 0 2023-12-16T07:40:26.258 INFO:tasks.workunit.client.0.smithi049.stdout:4/819: dread d2/f12 [0,4194304] 0 2023-12-16T07:40:26.259 INFO:tasks.workunit.client.0.smithi049.stdout:7/893: creat d7/dc/d6b/d105/f13d x:0 0 0 2023-12-16T07:40:26.259 INFO:tasks.workunit.client.0.smithi049.stdout:7/894: fsync d7/dc/dd/fae 0 2023-12-16T07:40:26.261 INFO:tasks.workunit.client.0.smithi049.stdout:2/813: mknod d2/d1d/d28/d8b/c118 0 2023-12-16T07:40:26.263 INFO:tasks.workunit.client.0.smithi049.stdout:8/853: rename d0/d1f/d36/fc5 to d0/d13/d42/d5b/dab/f10b 0 2023-12-16T07:40:26.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/814: dread d2/d1d/d28/d56/d66/f88 [0,4194304] 0 2023-12-16T07:40:26.270 INFO:tasks.workunit.client.0.smithi049.stdout:1/946: mknod d20/d41/d4f/c14a 0 2023-12-16T07:40:26.270 INFO:tasks.workunit.client.0.smithi049.stdout:3/778: creat d1/d2a/d37/d3f/d5a/d5b/d5e/f104 x:0 0 0 2023-12-16T07:40:26.271 INFO:tasks.workunit.client.0.smithi049.stdout:3/779: chown d1/l11 3572 1 2023-12-16T07:40:26.271 INFO:tasks.workunit.client.0.smithi049.stdout:7/895: dwrite d7/dc/d2f/f117 [0,4194304] 0 2023-12-16T07:40:26.272 INFO:tasks.workunit.client.0.smithi049.stdout:7/896: fsync d7/db4/f114 0 2023-12-16T07:40:26.272 INFO:tasks.workunit.client.0.smithi049.stdout:4/820: symlink d2/db/dd/de/d1e/d21/de7/lf9 0 2023-12-16T07:40:26.273 INFO:tasks.workunit.client.0.smithi049.stdout:8/854: symlink d0/d1f/d56/l10c 0 2023-12-16T07:40:26.276 INFO:tasks.workunit.client.0.smithi049.stdout:3/780: creat d1/f105 x:0 0 0 2023-12-16T07:40:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:7/897: dread d7/f67 [0,4194304] 0 2023-12-16T07:40:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:5/933: rename d5/de/d54/d78/d9b/dd1 to d5/de/d54/d78/d147 0 2023-12-16T07:40:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:5/934: chown d5/de/d1c/d62/c94 12619 1 2023-12-16T07:40:26.278 INFO:tasks.workunit.client.0.smithi049.stdout:2/815: dread d2/d1d/d24/d55/d7c/f10e [0,4194304] 0 2023-12-16T07:40:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/781: dread d1/d2a/f68 [0,4194304] 0 2023-12-16T07:40:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/782: readlink d1/d2a/d37/l54 0 2023-12-16T07:40:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:4/821: symlink d2/db/dd/de/d1e/d44/lfa 0 2023-12-16T07:40:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:4/822: chown d2/db/dd/de/d1e/ce2 126415 1 2023-12-16T07:40:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:4/823: truncate d2/db/fab 6653771 0 2023-12-16T07:40:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:8/855: mknod d0/d1f/d1c/d107/c10d 0 2023-12-16T07:40:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:8/856: fsync d0/d13/d42/d5b/dab/faa 0 2023-12-16T07:40:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:7/898: creat d7/dc/dd/d27/d8e/f13e x:0 0 0 2023-12-16T07:40:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:7/899: write d7/dc/d6b/d70/f135 [382294,15500] 0 2023-12-16T07:40:26.283 INFO:tasks.workunit.client.0.smithi049.stdout:7/900: rename d7/dc/dd to d7/dc/dd/d35/d138/d13f 22 2023-12-16T07:40:26.283 INFO:tasks.workunit.client.0.smithi049.stdout:7/901: readlink d7/dc/d15/d57/l5a 0 2023-12-16T07:40:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:8/857: rmdir d0/d13/d42/d5b/d68/d6b/da2/da5 39 2023-12-16T07:40:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/902: rmdir d7/dc/d6b/d70/d86 39 2023-12-16T07:40:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/903: truncate d7/dc/d2f/d38/fe5 860284 0 2023-12-16T07:40:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/904: chown d7/dc/dd/d35/lcf 1 1 2023-12-16T07:40:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:1/947: dwrite d20/f3c [0,4194304] 0 2023-12-16T07:40:26.289 INFO:tasks.workunit.client.0.smithi049.stdout:8/858: getdents d0/d1f/d4e 0 2023-12-16T07:40:26.292 INFO:tasks.workunit.client.0.smithi049.stdout:1/948: rename d20/d7b/f8b to d20/d40/f14b 0 2023-12-16T07:40:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/935: dread d5/de/d54/d67/da0/fbc [0,4194304] 0 2023-12-16T07:40:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/936: fsync d5/de/d54/d67/df8/f13a 0 2023-12-16T07:40:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/937: chown d5/de/d54/d57/dfa/d21/d58/c77 233 1 2023-12-16T07:40:26.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/938: write d5/de/d54/d57/dfa/d20/f56 [4706945,90980] 0 2023-12-16T07:40:26.294 INFO:tasks.workunit.client.0.smithi049.stdout:8/859: truncate d0/d13/d42/d5b/d68/d6b/da2/da5/fa8 372269 0 2023-12-16T07:40:26.297 INFO:tasks.workunit.client.0.smithi049.stdout:1/949: symlink d20/d41/d4f/d11e/l14c 0 2023-12-16T07:40:26.303 INFO:tasks.workunit.client.0.smithi049.stdout:5/939: mknod d5/de/d129/c148 0 2023-12-16T07:40:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:5/940: chown d5/de/d54/d57/d3c/d82/f13f 21427 1 2023-12-16T07:40:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:6/985: sync 2023-12-16T07:40:26.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/773: sync 2023-12-16T07:40:26.306 INFO:tasks.workunit.client.0.smithi049.stdout:5/941: mknod d5/de/d54/d78/d147/c149 0 2023-12-16T07:40:26.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/774: mknod d4/d7/d11/d3f/cf4 0 2023-12-16T07:40:26.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/942: mkdir d5/de/d54/d78/d147/d14a 0 2023-12-16T07:40:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:5/943: truncate d5/de/d54/d57/dfa/d21/d4e/dba/fe0 1860148 0 2023-12-16T07:40:26.315 INFO:tasks.workunit.client.0.smithi049.stdout:6/986: dread d0/d2/df/d81/fa9 [0,4194304] 0 2023-12-16T07:40:26.317 INFO:tasks.workunit.client.0.smithi049.stdout:6/987: creat d0/d2/df/dce/f145 x:0 0 0 2023-12-16T07:40:26.318 INFO:tasks.workunit.client.0.smithi049.stdout:1/950: dwrite f1c [0,4194304] 0 2023-12-16T07:40:26.318 INFO:tasks.workunit.client.0.smithi049.stdout:6/988: write d0/d39/d8b/fa5 [54067,83130] 0 2023-12-16T07:40:26.321 INFO:tasks.workunit.client.0.smithi049.stdout:1/951: creat d20/d41/d4f/dec/d102/d11f/f14d x:0 0 0 2023-12-16T07:40:26.321 INFO:tasks.workunit.client.0.smithi049.stdout:9/775: dread d4/d7/d11/d1d/d69/f9c [0,4194304] 0 2023-12-16T07:40:26.322 INFO:tasks.workunit.client.0.smithi049.stdout:2/816: dwrite d2/d26/d6e/f7b [0,4194304] 0 2023-12-16T07:40:26.323 INFO:tasks.workunit.client.0.smithi049.stdout:2/817: write d2/d1d/d28/d56/d71/ddf/fb0 [197528,40603] 0 2023-12-16T07:40:26.323 INFO:tasks.workunit.client.0.smithi049.stdout:6/989: unlink d0/d2/df/d4e/cab 0 2023-12-16T07:40:26.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/860: dwrite d0/d13/d42/d5b/d68/fba [0,4194304] 0 2023-12-16T07:40:26.323 INFO:tasks.workunit.client.0.smithi049.stdout:4/824: dwrite d2/db/dd/f13 [0,4194304] 0 2023-12-16T07:40:26.326 INFO:tasks.workunit.client.0.smithi049.stdout:9/776: truncate d4/d7/d11/f20 2288118 0 2023-12-16T07:40:26.327 INFO:tasks.workunit.client.0.smithi049.stdout:9/777: dread - d4/d7/d11/db3/d59/fcb zero size 2023-12-16T07:40:26.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/783: dwrite d1/d2a/d37/d3f/d5a/d5b/d5e/f5f [0,4194304] 0 2023-12-16T07:40:26.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/784: readlink d1/l8 0 2023-12-16T07:40:26.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/785: dread - d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/fed zero size 2023-12-16T07:40:26.328 INFO:tasks.workunit.client.0.smithi049.stdout:8/861: write d0/fb2 [1748536,123074] 0 2023-12-16T07:40:26.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/818: dread d2/d26/d6e/fc0 [0,4194304] 0 2023-12-16T07:40:26.328 INFO:tasks.workunit.client.0.smithi049.stdout:5/944: dwrite d5/de/d54/d67/f7e [4194304,4194304] 0 2023-12-16T07:40:26.329 INFO:tasks.workunit.client.0.smithi049.stdout:1/952: dread d20/d7b/fba [0,4194304] 0 2023-12-16T07:40:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/990: mkdir d0/d2/df/d81/d135/d146 0 2023-12-16T07:40:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:1/953: chown d20/d45/c6a 2493 1 2023-12-16T07:40:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/991: truncate d0/d39/d5b/d65/d32/f141 649923 0 2023-12-16T07:40:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:1/954: read - d20/d41/d4f/d7c/fb6 zero size 2023-12-16T07:40:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:4/825: mkdir d2/db/dd/de/d1e/d21/dda/dfb 0 2023-12-16T07:40:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:1/955: write d20/d41/d52/f5e [4038099,80467] 0 2023-12-16T07:40:26.331 INFO:tasks.workunit.client.0.smithi049.stdout:1/956: read d20/d41/d4f/dec/ffd [1862928,87448] 0 2023-12-16T07:40:26.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/826: read d2/f6d [1990717,98986] 0 2023-12-16T07:40:26.331 INFO:tasks.workunit.client.0.smithi049.stdout:9/778: link d4/d7/f21 d4/d7/d11/d56/d7f/ff5 0 2023-12-16T07:40:26.337 INFO:tasks.workunit.client.0.smithi049.stdout:3/786: rename d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/fc5 to d1/d2a/d37/d3f/d5a/d61/d6b/f106 0 2023-12-16T07:40:26.337 INFO:tasks.workunit.client.0.smithi049.stdout:3/787: write d1/d2a/d37/d3f/d5a/d6d/f84 [3810450,103920] 0 2023-12-16T07:40:26.340 INFO:tasks.workunit.client.0.smithi049.stdout:8/862: rmdir d0/d13/d42/de6 39 2023-12-16T07:40:26.342 INFO:tasks.workunit.client.0.smithi049.stdout:2/819: link d2/de/d77/la6 d2/d1d/dc2/l119 0 2023-12-16T07:40:26.343 INFO:tasks.workunit.client.0.smithi049.stdout:2/820: stat d2/d26/d6e/l5b 0 2023-12-16T07:40:26.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/945: creat d5/de/d129/f14b x:0 0 0 2023-12-16T07:40:26.345 INFO:tasks.workunit.client.0.smithi049.stdout:6/992: truncate d0/d2/f7d 3539887 0 2023-12-16T07:40:26.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/957: truncate d20/d41/d52/d86/fe5 3393910 0 2023-12-16T07:40:26.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/827: unlink d2/db/dd/de/d1e/c3e 0 2023-12-16T07:40:26.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/779: dwrite d4/d7/d11/d26/f53 [4194304,4194304] 0 2023-12-16T07:40:26.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/780: readlink d4/d7/d11/d1d/d9b/la7 0 2023-12-16T07:40:26.349 INFO:tasks.workunit.client.0.smithi049.stdout:3/788: getdents d1/d2a 0 2023-12-16T07:40:26.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/821: mkdir d2/d1d/d24/d11a 0 2023-12-16T07:40:26.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/822: stat d2/d1d/d28/d56/d11/d1c/dd1 0 2023-12-16T07:40:26.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/823: chown d2/d1d/d28/d56/d11/leb 15875 1 2023-12-16T07:40:26.352 INFO:tasks.workunit.client.0.smithi049.stdout:5/946: symlink d5/de/d54/d67/da0/l14c 0 2023-12-16T07:40:26.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/781: dread d4/d7/d11/d1d/d69/f9c [0,4194304] 0 2023-12-16T07:40:26.353 INFO:tasks.workunit.client.0.smithi049.stdout:6/993: creat d0/d39/dd0/f147 x:0 0 0 2023-12-16T07:40:26.354 INFO:tasks.workunit.client.0.smithi049.stdout:1/958: rmdir d20/d41/de8 39 2023-12-16T07:40:26.355 INFO:tasks.workunit.client.0.smithi049.stdout:4/828: mknod d2/db/dd/db7/cfc 0 2023-12-16T07:40:26.355 INFO:tasks.workunit.client.0.smithi049.stdout:4/829: stat d2/db/c1b 0 2023-12-16T07:40:26.358 INFO:tasks.workunit.client.0.smithi049.stdout:8/863: dwrite d0/d1f/d36/db8/de5/df2/ff8 [0,4194304] 0 2023-12-16T07:40:26.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/994: dread d0/d39/d5b/d65/d4c/d4d/d6a/dd6/f108 [0,4194304] 0 2023-12-16T07:40:26.362 INFO:tasks.workunit.client.0.smithi049.stdout:3/789: symlink d1/d2a/d37/d3f/d5a/d6d/d96/l107 0 2023-12-16T07:40:26.365 INFO:tasks.workunit.client.0.smithi049.stdout:2/824: link d2/d1d/d24/d55/d7c/d98/lad d2/d26/l11b 0 2023-12-16T07:40:26.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/782: dwrite d4/d7/f3c [0,4194304] 0 2023-12-16T07:40:26.367 INFO:tasks.workunit.client.0.smithi049.stdout:5/947: rename d5/de/d54/d57/dfa/d20/d95/fab to d5/de/d54/d78/d147/d14a/f14d 0 2023-12-16T07:40:26.367 INFO:tasks.workunit.client.0.smithi049.stdout:5/948: chown d5/de/d54/d57/dfa/d21/d58/c77 1052216247 1 2023-12-16T07:40:26.371 INFO:tasks.workunit.client.0.smithi049.stdout:4/830: truncate d2/db/dd/de/d1e/d21/f9e 2582298 0 2023-12-16T07:40:26.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/864: mknod d0/d13/d42/d5b/d68/d6b/da2/c10e 0 2023-12-16T07:40:26.375 INFO:tasks.workunit.client.0.smithi049.stdout:3/790: truncate d1/d2a/d37/f55 4127129 0 2023-12-16T07:40:26.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/865: fdatasync d0/d13/d42/d5b/d68/d6b/fc8 0 2023-12-16T07:40:26.376 INFO:tasks.workunit.client.0.smithi049.stdout:2/825: mkdir d2/d1d/d28/d56/d11/d1c/dd1/dfe/d11c 0 2023-12-16T07:40:26.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/783: symlink d4/d7/d11/d1d/d69/d76/d83/db4/de5/lf6 0 2023-12-16T07:40:26.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/995: dwrite d0/d2/df/d81/d123/f143 [0,4194304] 0 2023-12-16T07:40:26.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/996: read - d0/d39/d5b/f117 zero size 2023-12-16T07:40:26.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/959: rename d20/d41/d4f/d55/d82/f116 to d20/d41/d4f/dec/d102/d11f/f14e 0 2023-12-16T07:40:26.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/949: creat d5/de/d54/d78/f14e x:0 0 0 2023-12-16T07:40:26.380 INFO:tasks.workunit.client.0.smithi049.stdout:6/997: write d0/d2/df/d4e/d5d/d6f/d4a/da4/fea [252566,128587] 0 2023-12-16T07:40:26.381 INFO:tasks.workunit.client.0.smithi049.stdout:3/791: mknod d1/d2a/d37/d3f/dcc/c108 0 2023-12-16T07:40:26.381 INFO:tasks.workunit.client.0.smithi049.stdout:8/866: creat d0/d13/d42/de6/df0/f10f x:0 0 0 2023-12-16T07:40:26.384 INFO:tasks.workunit.client.0.smithi049.stdout:9/784: creat d4/d7/d11/d1d/d48/ff7 x:0 0 0 2023-12-16T07:40:26.384 INFO:tasks.workunit.client.0.smithi049.stdout:9/785: chown d4/d7/d11/d56/d7f/ca0 2 1 2023-12-16T07:40:26.384 INFO:tasks.workunit.client.0.smithi049.stdout:9/786: write d4/d7/d11/db3/d8a/daa/ff3 [872041,85281] 0 2023-12-16T07:40:26.385 INFO:tasks.workunit.client.0.smithi049.stdout:7/905: sync 2023-12-16T07:40:26.389 INFO:tasks.workunit.client.0.smithi049.stdout:4/831: rename d2/db/dd/de/d1e/c8d to d2/db/dd/de/d1e/d37/da4/cfd 0 2023-12-16T07:40:26.394 INFO:tasks.workunit.client.0.smithi049.stdout:5/950: creat d5/f14f x:0 0 0 2023-12-16T07:40:26.394 INFO:tasks.workunit.client.0.smithi049.stdout:9/787: dread d4/d7/d11/db3/fab [0,4194304] 0 2023-12-16T07:40:26.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/998: link d0/d39/d5b/d65/d32/f141 d0/d39/d5b/d65/d58/d33/dc2/f148 0 2023-12-16T07:40:26.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/792: creat d1/d2b/f109 x:0 0 0 2023-12-16T07:40:26.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/867: creat d0/d13/d42/de6/df0/f110 x:0 0 0 2023-12-16T07:40:26.401 INFO:tasks.workunit.client.0.smithi049.stdout:4/832: mkdir d2/db/dd/de/d1e/dfe 0 2023-12-16T07:40:26.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/826: dwrite d2/d1d/d28/d56/d66/f88 [0,4194304] 0 2023-12-16T07:40:26.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/827: chown d2/d1d/d24/d55/d7c/ff7 19379 1 2023-12-16T07:40:26.403 INFO:tasks.workunit.client.0.smithi049.stdout:7/906: dwrite d7/dc/dd/d14/fa3 [0,4194304] 0 2023-12-16T07:40:26.406 INFO:tasks.workunit.client.0.smithi049.stdout:5/951: creat d5/de/d54/d57/dfa/d21/d58/f150 x:0 0 0 2023-12-16T07:40:26.409 INFO:tasks.workunit.client.0.smithi049.stdout:7/907: write d7/dc/d6b/ffc [1675944,55704] 0 2023-12-16T07:40:26.410 INFO:tasks.workunit.client.0.smithi049.stdout:1/960: truncate d20/d41/d52/f5e 2003493 0 2023-12-16T07:40:26.413 INFO:tasks.workunit.client.0.smithi049.stdout:7/908: dread d7/dc/d2f/d38/ff6 [0,4194304] 0 2023-12-16T07:40:26.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/868: dwrite d0/d1f/fdb [0,4194304] 0 2023-12-16T07:40:26.440 INFO:tasks.workunit.client.0.smithi049.stdout:9/788: creat d4/d7/d11/d1d/d69/d76/d83/ff8 x:0 0 0 2023-12-16T07:40:26.473 INFO:tasks.workunit.client.0.smithi049.stdout:3/793: creat d1/d2a/d37/d3f/d5a/dc2/f10a x:0 0 0 2023-12-16T07:40:26.476 INFO:tasks.workunit.client.0.smithi049.stdout:2/828: creat d2/d1d/d28/d56/d11/d1c/dd1/dfe/f11d x:0 0 0 2023-12-16T07:40:26.477 INFO:tasks.workunit.client.0.smithi049.stdout:2/829: chown d2/d1d/f9a 44891203 1 2023-12-16T07:40:26.477 INFO:tasks.workunit.client.0.smithi049.stdout:2/830: chown d2/d26/cda 2063 1 2023-12-16T07:40:26.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/794: dread d1/d2a/f40 [0,4194304] 0 2023-12-16T07:40:26.483 INFO:tasks.workunit.client.0.smithi049.stdout:7/909: creat d7/dc/dd/d37/d5c/db2/d109/f140 x:0 0 0 2023-12-16T07:40:26.483 INFO:tasks.workunit.client.0.smithi049.stdout:7/910: stat d7/dc/d6b/d70/d86/f88 0 2023-12-16T07:40:26.487 INFO:tasks.workunit.client.0.smithi049.stdout:8/869: mkdir d0/d1f/db7/d111 0 2023-12-16T07:40:26.487 INFO:tasks.workunit.client.0.smithi049.stdout:8/870: dread - d0/d1f/d4e/dbb/ff4 zero size 2023-12-16T07:40:26.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/831: creat d2/f11e x:0 0 0 2023-12-16T07:40:26.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/832: chown d2/d1d/fc3 54 1 2023-12-16T07:40:26.496 INFO:tasks.workunit.client.0.smithi049.stdout:7/911: symlink d7/dc/dd/d27/dba/l141 0 2023-12-16T07:40:26.496 INFO:tasks.workunit.client.0.smithi049.stdout:7/912: chown d7/dc/dd/d37/c7a 11730115 1 2023-12-16T07:40:26.498 INFO:tasks.workunit.client.0.smithi049.stdout:8/871: creat d0/d13/d42/d5b/d68/d6b/da2/da5/f112 x:0 0 0 2023-12-16T07:40:26.501 INFO:tasks.workunit.client.0.smithi049.stdout:6/999: rmdir d0/d39/d8b/deb 0 2023-12-16T07:40:26.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/872: write d0/f6e [282305,54836] 0 2023-12-16T07:40:26.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/873: write d0/d1f/d4e/f8b [1026231,36730] 0 2023-12-16T07:40:26.539 INFO:tasks.workunit.client.0.smithi049.stdout:3/795: symlink d1/d2a/d37/d3f/d5a/d5b/l10b 0 2023-12-16T07:40:26.541 INFO:tasks.workunit.client.0.smithi049.stdout:3/796: creat d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde/f10c x:0 0 0 2023-12-16T07:40:26.541 INFO:tasks.workunit.client.0.smithi049.stdout:3/797: write d1/d2a/d37/d3f/d5a/dc2/fd7 [363297,42602] 0 2023-12-16T07:40:26.545 INFO:tasks.workunit.client.0.smithi049.stdout:5/952: symlink d5/de/d54/d57/d3c/l151 0 2023-12-16T07:40:26.547 INFO:tasks.workunit.client.0.smithi049.stdout:5/953: creat d5/de/d54/d57/dfa/d21/d58/d65/dae/f152 x:0 0 0 2023-12-16T07:40:26.547 INFO:tasks.workunit.client.0.smithi049.stdout:5/954: stat d5/de/d54/d57/dfa/d21/d58/f11f 0 2023-12-16T07:40:26.547 INFO:tasks.workunit.client.0.smithi049.stdout:5/955: write d5/de/d54/d57/d3c/f11c [609464,47961] 0 2023-12-16T07:40:26.548 INFO:tasks.workunit.client.0.smithi049.stdout:7/913: mkdir d7/dc/d6b/d70/d142 0 2023-12-16T07:40:26.548 INFO:tasks.workunit.client.0.smithi049.stdout:7/914: write d7/dc/f1d [5151285,15711] 0 2023-12-16T07:40:26.550 INFO:tasks.workunit.client.0.smithi049.stdout:7/915: dread d7/dc/dd/d37/f8d [0,4194304] 0 2023-12-16T07:40:26.550 INFO:tasks.workunit.client.0.smithi049.stdout:5/956: symlink d5/de/d54/d57/d3c/d13b/l153 0 2023-12-16T07:40:26.553 INFO:tasks.workunit.client.0.smithi049.stdout:7/916: dread d7/dc/d2f/d40/d104/f113 [0,4194304] 0 2023-12-16T07:40:26.554 INFO:tasks.workunit.client.0.smithi049.stdout:7/917: chown d7/dc/d6b/d70/f135 148375 1 2023-12-16T07:40:26.555 INFO:tasks.workunit.client.0.smithi049.stdout:5/957: dread d5/de/d1c/f25 [0,4194304] 0 2023-12-16T07:40:26.556 INFO:tasks.workunit.client.0.smithi049.stdout:7/918: rename d7/dc/d2f/d40/d5d to d7/dc/dd/d37/d5c/d143 0 2023-12-16T07:40:26.557 INFO:tasks.workunit.client.0.smithi049.stdout:7/919: creat d7/dc/d6b/d70/f144 x:0 0 0 2023-12-16T07:40:26.561 INFO:tasks.workunit.client.0.smithi049.stdout:3/798: dwrite d1/d2b/f65 [0,4194304] 0 2023-12-16T07:40:26.561 INFO:tasks.workunit.client.0.smithi049.stdout:9/789: truncate d4/d7/f3c 2897899 0 2023-12-16T07:40:26.563 INFO:tasks.workunit.client.0.smithi049.stdout:3/799: link d1/d2a/l7d d1/d2a/d37/d3f/d5a/d61/d6b/db5/l10d 0 2023-12-16T07:40:26.563 INFO:tasks.workunit.client.0.smithi049.stdout:7/920: truncate d7/dc/dd/d35/f41 673844 0 2023-12-16T07:40:26.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/800: read d1/d2a/d37/d3f/d5a/d61/d6b/fa6 [2599917,100272] 0 2023-12-16T07:40:26.566 INFO:tasks.workunit.client.0.smithi049.stdout:1/961: unlink d20/d41/d52/f121 0 2023-12-16T07:40:26.566 INFO:tasks.workunit.client.0.smithi049.stdout:1/962: write d20/f3d [690091,37383] 0 2023-12-16T07:40:26.566 INFO:tasks.workunit.client.0.smithi049.stdout:1/963: write f6 [1210351,17398] 0 2023-12-16T07:40:26.566 INFO:tasks.workunit.client.0.smithi049.stdout:1/964: stat f2 0 2023-12-16T07:40:26.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/790: dread d4/d7/d11/d1d/f5c [0,4194304] 0 2023-12-16T07:40:26.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/791: chown d4/d7/d11/d26/c3d 4863440 1 2023-12-16T07:40:26.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/958: dwrite d5/de/d54/d57/f50 [0,4194304] 0 2023-12-16T07:40:26.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/959: readlink d5/l7 0 2023-12-16T07:40:26.572 INFO:tasks.workunit.client.0.smithi049.stdout:3/801: mknod d1/d2a/d37/d3f/d5a/d61/d75/db7/c10e 0 2023-12-16T07:40:26.573 INFO:tasks.workunit.client.0.smithi049.stdout:3/802: fdatasync d1/d2a/d37/d3f/dcc/ff9 0 2023-12-16T07:40:26.573 INFO:tasks.workunit.client.0.smithi049.stdout:1/965: creat d20/d41/d4f/d55/d7f/f14f x:0 0 0 2023-12-16T07:40:26.573 INFO:tasks.workunit.client.0.smithi049.stdout:1/966: fsync d20/d41/d52/d86/ff6 0 2023-12-16T07:40:26.573 INFO:tasks.workunit.client.0.smithi049.stdout:1/967: read d20/d41/d4f/f69 [1171183,69707] 0 2023-12-16T07:40:26.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/792: rename d4/d7/d11/d1d/d69/d76/d83/db4 to d4/d3e/df9 0 2023-12-16T07:40:26.575 INFO:tasks.workunit.client.0.smithi049.stdout:7/921: dwrite f4 [4194304,4194304] 0 2023-12-16T07:40:26.577 INFO:tasks.workunit.client.0.smithi049.stdout:3/803: truncate d1/d2a/d37/d3f/fb1 77801 0 2023-12-16T07:40:26.579 INFO:tasks.workunit.client.0.smithi049.stdout:5/960: rename d5/de/d54/d57/dfa/d21/d4e/dba/d142 to d5/de/d54/d57/dfa/d21/d58/d119/d154 0 2023-12-16T07:40:26.587 INFO:tasks.workunit.client.0.smithi049.stdout:9/793: getdents d4/d7/d11/d1d/d69/d76/d83/ddf 0 2023-12-16T07:40:26.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/794: readlink d4/db/l7b 0 2023-12-16T07:40:26.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/795: chown d4/c98 2 1 2023-12-16T07:40:26.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/796: readlink d4/l2c 0 2023-12-16T07:40:26.589 INFO:tasks.workunit.client.0.smithi049.stdout:7/922: mkdir d7/dc/dd/d35/d138/d145 0 2023-12-16T07:40:26.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/797: symlink d4/d7/d11/d26/d80/dbc/lfa 0 2023-12-16T07:40:26.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/798: write d4/d7/d11/db3/d8a/daa/fca [893304,5383] 0 2023-12-16T07:40:26.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/923: getdents d7/dc/dd/d37/d5c/db2 0 2023-12-16T07:40:26.595 INFO:tasks.workunit.client.0.smithi049.stdout:9/799: dread d4/db/f72 [0,4194304] 0 2023-12-16T07:40:26.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/924: mkdir d7/dc/dd/d37/d5c/d146 0 2023-12-16T07:40:26.601 INFO:tasks.workunit.client.0.smithi049.stdout:9/800: dread d4/d3e/f6e [0,4194304] 0 2023-12-16T07:40:26.605 INFO:tasks.workunit.client.0.smithi049.stdout:7/925: rmdir d7/dc/dd/d35/d36 39 2023-12-16T07:40:26.605 INFO:tasks.workunit.client.0.smithi049.stdout:7/926: fdatasync d7/dc/dd/d37/d5c/db2/d106/f11e 0 2023-12-16T07:40:26.605 INFO:tasks.workunit.client.0.smithi049.stdout:7/927: fsync d7/dc/dd/d35/d36/f7d 0 2023-12-16T07:40:26.606 INFO:tasks.workunit.client.0.smithi049.stdout:7/928: write d7/dc/d15/fa7 [2682768,37783] 0 2023-12-16T07:40:26.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/801: creat d4/d7/d11/d1d/d5b/dbe/ffb x:0 0 0 2023-12-16T07:40:26.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/802: creat d4/d7/d11/d26/ffc x:0 0 0 2023-12-16T07:40:26.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/803: truncate d4/d7/fc0 104328 0 2023-12-16T07:40:26.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/804: truncate d4/db/f97 1045190 0 2023-12-16T07:40:26.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/804: link d1/d2a/d37/d3f/fee d1/d2a/d37/d3f/d5a/f10f 0 2023-12-16T07:40:26.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/805: read d1/d2b/f53 [1554075,57035] 0 2023-12-16T07:40:26.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/806: chown d1/d2b/fba 796 1 2023-12-16T07:40:26.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/807: fdatasync d1/d2a/d37/d3f/d5a/d61/f66 0 2023-12-16T07:40:26.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/805: dread d4/d7/d11/d1d/f25 [0,4194304] 0 2023-12-16T07:40:26.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/806: chown d4/l2c 193594 1 2023-12-16T07:40:26.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/807: fdatasync d4/d7/d11/d1d/d48/ff7 0 2023-12-16T07:40:26.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/874: mknod d0/d13/d42/c113 0 2023-12-16T07:40:26.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/875: mknod d0/d1f/db7/c114 0 2023-12-16T07:40:26.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/876: write d0/d13/d42/de6/df0/f10f [766354,99697] 0 2023-12-16T07:40:26.619 INFO:tasks.workunit.client.0.smithi049.stdout:8/877: mknod d0/d1f/d1c/c115 0 2023-12-16T07:40:26.619 INFO:tasks.workunit.client.0.smithi049.stdout:8/878: fdatasync d0/d1f/fdb 0 2023-12-16T07:40:26.619 INFO:tasks.workunit.client.0.smithi049.stdout:9/808: dread d4/db/f5d [0,4194304] 0 2023-12-16T07:40:26.619 INFO:tasks.workunit.client.0.smithi049.stdout:9/809: read d4/db/f33 [498817,64141] 0 2023-12-16T07:40:26.619 INFO:tasks.workunit.client.0.smithi049.stdout:9/810: fdatasync d4/d7/d11/d1d/d69/d76/f99 0 2023-12-16T07:40:26.620 INFO:tasks.workunit.client.0.smithi049.stdout:9/811: write d4/d7/d11/db3/f4f [3253371,37073] 0 2023-12-16T07:40:26.621 INFO:tasks.workunit.client.0.smithi049.stdout:9/812: write d4/d7/d11/d26/fcf [944669,35423] 0 2023-12-16T07:40:26.622 INFO:tasks.workunit.client.0.smithi049.stdout:7/929: dwrite d7/dc/dd/d27/d8e/f101 [0,4194304] 0 2023-12-16T07:40:26.623 INFO:tasks.workunit.client.0.smithi049.stdout:9/813: creat d4/d7/d11/d1d/d69/d76/d83/ffd x:0 0 0 2023-12-16T07:40:26.623 INFO:tasks.workunit.client.0.smithi049.stdout:9/814: fdatasync d4/db/f41 0 2023-12-16T07:40:26.626 INFO:tasks.workunit.client.0.smithi049.stdout:7/930: creat d7/dc/d15/d57/dc8/f147 x:0 0 0 2023-12-16T07:40:26.630 INFO:tasks.workunit.client.0.smithi049.stdout:7/931: creat d7/dc/dd/d35/d36/f148 x:0 0 0 2023-12-16T07:40:26.630 INFO:tasks.workunit.client.0.smithi049.stdout:1/968: rename d20/d41/d4f/d55/f83 to d20/d41/d4f/d55/d7f/d106/f150 0 2023-12-16T07:40:26.631 INFO:tasks.workunit.client.0.smithi049.stdout:3/808: dwrite d1/d2a/d37/d3f/dcc/fe3 [0,4194304] 0 2023-12-16T07:40:26.631 INFO:tasks.workunit.client.0.smithi049.stdout:3/809: truncate d1/d2a/d37/d3f/d5a/d5b/d5e/f104 970072 0 2023-12-16T07:40:26.637 INFO:tasks.workunit.client.0.smithi049.stdout:4/833: sync 2023-12-16T07:40:26.637 INFO:tasks.workunit.client.0.smithi049.stdout:3/810: symlink d1/d2a/d37/d3f/d5a/dc2/l110 0 2023-12-16T07:40:26.637 INFO:tasks.workunit.client.0.smithi049.stdout:3/811: chown d1/d2a/d37/d3f/d5a/dc2/f100 421 1 2023-12-16T07:40:26.637 INFO:tasks.workunit.client.0.smithi049.stdout:3/812: write d1/d2a/d37/d3f/d5a/d61/f7c [19711,38778] 0 2023-12-16T07:40:26.637 INFO:tasks.workunit.client.0.smithi049.stdout:3/813: stat d1/d2a/d37/d3f/d5a/d61/d75/db7/c10e 0 2023-12-16T07:40:26.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/814: chown d1/d2a/d37/d3f/d5a/d6d 4023034 1 2023-12-16T07:40:26.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/815: dwrite d4/d7/d11/d26/f52 [4194304,4194304] 0 2023-12-16T07:40:26.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/816: read d4/d7/d11/db3/d8a/f61 [2195072,59268] 0 2023-12-16T07:40:26.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/817: rmdir d4/d7/d11/db3/d59 39 2023-12-16T07:40:26.642 INFO:tasks.workunit.client.0.smithi049.stdout:3/815: dread d1/d2a/d37/d3f/d4c/f4d [0,4194304] 0 2023-12-16T07:40:26.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/818: unlink d4/c2f 0 2023-12-16T07:40:26.643 INFO:tasks.workunit.client.0.smithi049.stdout:3/816: mknod d1/d2a/d37/d3f/d5a/d6d/c111 0 2023-12-16T07:40:26.644 INFO:tasks.workunit.client.0.smithi049.stdout:1/969: rmdir d20/d43 39 2023-12-16T07:40:26.646 INFO:tasks.workunit.client.0.smithi049.stdout:1/970: write d20/d40/d6f/dac/fd0 [399359,2871] 0 2023-12-16T07:40:26.646 INFO:tasks.workunit.client.0.smithi049.stdout:1/971: write d20/d41/d4f/d55/d58/f7e [630938,20959] 0 2023-12-16T07:40:26.646 INFO:tasks.workunit.client.0.smithi049.stdout:4/834: dread d2/db/dd/de/d1e/f55 [0,4194304] 0 2023-12-16T07:40:26.649 INFO:tasks.workunit.client.0.smithi049.stdout:1/972: mknod d20/d41/de8/d138/d140/c151 0 2023-12-16T07:40:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/835: getdents d2/db/dd/de/d1e/d21/dda 0 2023-12-16T07:40:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/836: write d2/db/dd/fbb [912155,30072] 0 2023-12-16T07:40:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/837: chown d2/db/dd/de/d1e/d37/cd3 0 1 2023-12-16T07:40:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/838: fdatasync d2/db/dd/de/d1e/d37/d82/f9c 0 2023-12-16T07:40:26.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/973: creat d20/d41/d4f/d55/d82/dd2/f152 x:0 0 0 2023-12-16T07:40:26.656 INFO:tasks.workunit.client.0.smithi049.stdout:4/839: mknod d2/db/d6b/db9/de4/cff 0 2023-12-16T07:40:26.656 INFO:tasks.workunit.client.0.smithi049.stdout:4/840: chown d2/db/dd/de/d1e/d21/cde 54794004 1 2023-12-16T07:40:26.657 INFO:tasks.workunit.client.0.smithi049.stdout:4/841: read d2/db/dd/de/d1e/f2d [2125914,127532] 0 2023-12-16T07:40:26.657 INFO:tasks.workunit.client.0.smithi049.stdout:4/842: chown d2/db/dd/de/d1e/d37/c42 0 1 2023-12-16T07:40:26.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/974: creat d20/d41/d4f/d55/d82/dc5/f153 x:0 0 0 2023-12-16T07:40:26.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/975: dread - d20/d41/dab/f109 zero size 2023-12-16T07:40:26.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/976: readlink d20/d41/d4f/dec/d102/d11f/lbb 0 2023-12-16T07:40:26.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/977: chown d20/l2c 6618 1 2023-12-16T07:40:26.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/978: chown d20/d45 6430666 1 2023-12-16T07:40:26.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/979: dread - d20/d41/d124/fc9 zero size 2023-12-16T07:40:26.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/980: dread - d20/d41/d124/fc9 zero size 2023-12-16T07:40:26.659 INFO:tasks.workunit.client.0.smithi049.stdout:4/843: mknod d2/db/dd/de/d1e/d21/de7/c100 0 2023-12-16T07:40:26.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/817: dread d1/d2a/d37/d3f/f5d [0,4194304] 0 2023-12-16T07:40:26.661 INFO:tasks.workunit.client.0.smithi049.stdout:9/819: dwrite d4/d7/f21 [0,4194304] 0 2023-12-16T07:40:26.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/844: symlink d2/db/dd/de/d1e/d37/da4/l101 0 2023-12-16T07:40:26.661 INFO:tasks.workunit.client.0.smithi049.stdout:4/845: stat d2/db/dd/de/d1e/d21/f4f 0 2023-12-16T07:40:26.669 INFO:tasks.workunit.client.0.smithi049.stdout:4/846: mkdir d2/db/d102 0 2023-12-16T07:40:26.673 INFO:tasks.workunit.client.0.smithi049.stdout:4/847: creat d2/db/d6b/f103 x:0 0 0 2023-12-16T07:40:26.674 INFO:tasks.workunit.client.0.smithi049.stdout:5/961: rename d5/de/d54/d67/l116 to d5/de/d54/l155 0 2023-12-16T07:40:26.681 INFO:tasks.workunit.client.0.smithi049.stdout:4/848: mknod d2/c104 0 2023-12-16T07:40:26.681 INFO:tasks.workunit.client.0.smithi049.stdout:4/849: readlink d2/db/dd/de/d1e/d37/da4/de1/le6 0 2023-12-16T07:40:26.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/981: dwrite d20/d41/d4f/d55/d7f/d106/f13e [0,4194304] 0 2023-12-16T07:40:26.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/982: chown d20/d41/d124/fc9 1530402 1 2023-12-16T07:40:26.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/983: dread - d20/d41/d4f/d55/d7f/ff1 zero size 2023-12-16T07:40:26.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/984: chown d20/d43/cf5 1089467440 1 2023-12-16T07:40:26.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/879: rename d0/d1f/d36/db8/de5/df2/ff8 to d0/d1f/d4e/dbb/df7/f116 0 2023-12-16T07:40:26.685 INFO:tasks.workunit.client.0.smithi049.stdout:5/962: truncate d5/de/d54/d67/da0/fbc 529085 0 2023-12-16T07:40:26.685 INFO:tasks.workunit.client.0.smithi049.stdout:5/963: fsync d5/de/d54/ffb 0 2023-12-16T07:40:26.697 INFO:tasks.workunit.client.0.smithi049.stdout:4/850: creat d2/db/dd/d2a/f105 x:0 0 0 2023-12-16T07:40:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:7/932: rename d7/dc/dd/d27/fab to d7/db4/d10f/f149 0 2023-12-16T07:40:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:7/933: fdatasync d7/dc/dd/d27/dba/fec 0 2023-12-16T07:40:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:7/934: fsync d7/dc/d15/d57/dc8/ff3 0 2023-12-16T07:40:26.700 INFO:tasks.workunit.client.0.smithi049.stdout:4/851: creat d2/db/d6b/db9/de4/f106 x:0 0 0 2023-12-16T07:40:26.703 INFO:tasks.workunit.client.0.smithi049.stdout:3/818: rename d1/d2a/cd8 to d1/d2a/d37/d3f/d5a/d5b/d77/c112 0 2023-12-16T07:40:26.705 INFO:tasks.workunit.client.0.smithi049.stdout:8/880: dwrite d0/d13/fd7 [0,4194304] 0 2023-12-16T07:40:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:7/935: symlink d7/dc/d6b/d70/d86/l14a 0 2023-12-16T07:40:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:4/852: creat d2/db/d102/f107 x:0 0 0 2023-12-16T07:40:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:4/853: chown d2/db/dd/de/d1e/d37/c8e 88 1 2023-12-16T07:40:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:1/985: rename d20/de4/l10c to d20/d41/d4f/d55/d82/dd2/dfc/l154 0 2023-12-16T07:40:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:1/986: chown d20/d41/d4f/d55/d7f/d84 105220625 1 2023-12-16T07:40:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:1/987: write d20/d41/d52/d86/dd9/f107 [145622,122270] 0 2023-12-16T07:40:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:1/988: write d20/d41/d4f/d55/fc1 [922694,68675] 0 2023-12-16T07:40:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:1/989: write d20/d41/d4f/d55/d82/fe9 [1473362,8414] 0 2023-12-16T07:40:26.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/819: mknod d1/d2a/d37/d3f/d5a/dc2/de0/c113 0 2023-12-16T07:40:26.712 INFO:tasks.workunit.client.0.smithi049.stdout:5/964: dwrite d5/de/d54/d57/dfa/d21/f45 [0,4194304] 0 2023-12-16T07:40:26.714 INFO:tasks.workunit.client.0.smithi049.stdout:7/936: unlink d7/dc/dd/d35/l71 0 2023-12-16T07:40:26.714 INFO:tasks.workunit.client.0.smithi049.stdout:7/937: rename d7/dc/d15/d57 to d7/dc/d15/d57/dc8/d14b 22 2023-12-16T07:40:26.716 INFO:tasks.workunit.client.0.smithi049.stdout:4/854: mkdir d2/db/dd/d52/d8c/d108 0 2023-12-16T07:40:26.716 INFO:tasks.workunit.client.0.smithi049.stdout:4/855: write d2/db/d6b/db9/de4/f106 [899101,106064] 0 2023-12-16T07:40:26.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/990: creat d20/d41/de8/f155 x:0 0 0 2023-12-16T07:40:26.721 INFO:tasks.workunit.client.0.smithi049.stdout:3/820: creat d1/d2a/d37/d3f/f114 x:0 0 0 2023-12-16T07:40:26.722 INFO:tasks.workunit.client.0.smithi049.stdout:5/965: creat d5/de/d54/d57/dfa/d21/d58/f156 x:0 0 0 2023-12-16T07:40:26.724 INFO:tasks.workunit.client.0.smithi049.stdout:1/991: symlink d20/d40/l156 0 2023-12-16T07:40:26.724 INFO:tasks.workunit.client.0.smithi049.stdout:2/833: sync 2023-12-16T07:40:26.725 INFO:tasks.workunit.client.0.smithi049.stdout:2/834: read - d2/d1d/d24/d55/d7c/d98/f9d zero size 2023-12-16T07:40:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/966: getdents d5/de/d54/d57/d3c 0 2023-12-16T07:40:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/967: chown d5/de/d54/d78/l10f 193 1 2023-12-16T07:40:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/968: stat d5/de/d54/d67/f137 0 2023-12-16T07:40:26.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/992: symlink d20/d41/d4f/dec/d102/l157 0 2023-12-16T07:40:26.732 INFO:tasks.workunit.client.0.smithi049.stdout:1/993: readlink l1e 0 2023-12-16T07:40:26.734 INFO:tasks.workunit.client.0.smithi049.stdout:2/835: creat d2/d1d/d28/d56/d11/d1c/dd1/f11f x:0 0 0 2023-12-16T07:40:26.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/969: symlink d5/de/d54/d57/dfa/d20/d132/l157 0 2023-12-16T07:40:26.737 INFO:tasks.workunit.client.0.smithi049.stdout:8/881: dwrite d0/d1f/d36/f81 [0,4194304] 0 2023-12-16T07:40:26.738 INFO:tasks.workunit.client.0.smithi049.stdout:2/836: truncate d2/d1d/d28/d56/d71/f80 1899549 0 2023-12-16T07:40:26.738 INFO:tasks.workunit.client.0.smithi049.stdout:2/837: fdatasync d2/d1d/d28/d56/d11/fac 0 2023-12-16T07:40:26.739 INFO:tasks.workunit.client.0.smithi049.stdout:2/838: chown d2/d1d/d24/lff 74405734 1 2023-12-16T07:40:26.739 INFO:tasks.workunit.client.0.smithi049.stdout:5/970: symlink d5/de/d54/d57/dfa/d21/d5a/l158 0 2023-12-16T07:40:26.742 INFO:tasks.workunit.client.0.smithi049.stdout:8/882: mknod d0/d1f/d36/dbf/c117 0 2023-12-16T07:40:26.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/971: write d5/de/d54/d67/da0/fac [819712,83242] 0 2023-12-16T07:40:26.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/972: chown d5/de/d54/d57/dfa/d20/d95/fed 3495910 1 2023-12-16T07:40:26.744 INFO:tasks.workunit.client.0.smithi049.stdout:8/883: symlink d0/d13/d42/de6/l118 0 2023-12-16T07:40:26.746 INFO:tasks.workunit.client.0.smithi049.stdout:5/973: symlink d5/de/d1c/d102/l159 0 2023-12-16T07:40:26.747 INFO:tasks.workunit.client.0.smithi049.stdout:4/856: dwrite d2/db/d6b/db9/de4/f85 [0,4194304] 0 2023-12-16T07:40:26.747 INFO:tasks.workunit.client.0.smithi049.stdout:4/857: truncate d2/db/dd/de/d1e/d37/da4/f7b 894563 0 2023-12-16T07:40:26.748 INFO:tasks.workunit.client.0.smithi049.stdout:5/974: truncate d5/de/d54/d57/f33 3797624 0 2023-12-16T07:40:26.751 INFO:tasks.workunit.client.0.smithi049.stdout:4/858: link d2/db/d6b/db9/de4/f85 d2/db/dd/de/d1e/d37/d82/f109 0 2023-12-16T07:40:26.754 INFO:tasks.workunit.client.0.smithi049.stdout:5/975: mknod d5/de/d54/d57/c15a 0 2023-12-16T07:40:26.754 INFO:tasks.workunit.client.0.smithi049.stdout:3/821: dwrite d1/d2a/d37/d3f/d5a/d5b/d77/dc4/fca [0,4194304] 0 2023-12-16T07:40:26.754 INFO:tasks.workunit.client.0.smithi049.stdout:3/822: fsync d1/f16 0 2023-12-16T07:40:26.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/859: creat d2/db/d6b/dad/de0/f10a x:0 0 0 2023-12-16T07:40:26.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/976: rename d5/de/d1c/d62/c94 to d5/de/d129/c15b 0 2023-12-16T07:40:26.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/977: readlink d5/l80 0 2023-12-16T07:40:26.758 INFO:tasks.workunit.client.0.smithi049.stdout:1/994: dwrite d20/d41/d4f/d55/d82/dc5/fd1 [0,4194304] 0 2023-12-16T07:40:26.761 INFO:tasks.workunit.client.0.smithi049.stdout:5/978: symlink d5/de/d54/d67/d9e/l15c 0 2023-12-16T07:40:26.761 INFO:tasks.workunit.client.0.smithi049.stdout:5/979: chown d5/de/d54/d78/d9b/f13c 394 1 2023-12-16T07:40:26.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/860: mkdir d2/db/dd/d52/d10b 0 2023-12-16T07:40:26.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/861: creat d2/db/f10c x:0 0 0 2023-12-16T07:40:26.768 INFO:tasks.workunit.client.0.smithi049.stdout:8/884: dwrite d0/f19 [0,4194304] 0 2023-12-16T07:40:26.768 INFO:tasks.workunit.client.0.smithi049.stdout:8/885: readlink d0/d13/d42/l87 0 2023-12-16T07:40:26.770 INFO:tasks.workunit.client.0.smithi049.stdout:3/823: dwrite d1/d2a/d37/d3f/d5a/d61/d6b/fa6 [4194304,4194304] 0 2023-12-16T07:40:26.770 INFO:tasks.workunit.client.0.smithi049.stdout:8/886: truncate d0/d1f/d36/f3c 1838989 0 2023-12-16T07:40:26.770 INFO:tasks.workunit.client.0.smithi049.stdout:5/980: dread d5/f2a [0,4194304] 0 2023-12-16T07:40:26.770 INFO:tasks.workunit.client.0.smithi049.stdout:5/981: chown d5/de/d54/d67/d9e/l15c 3 1 2023-12-16T07:40:26.770 INFO:tasks.workunit.client.0.smithi049.stdout:5/982: write d5/de/d129/f14b [958233,35683] 0 2023-12-16T07:40:26.773 INFO:tasks.workunit.client.0.smithi049.stdout:1/995: dread d20/d45/d47/f65 [0,4194304] 0 2023-12-16T07:40:26.774 INFO:tasks.workunit.client.0.smithi049.stdout:1/996: write d20/d41/d4f/d7c/d105/f148 [951042,108685] 0 2023-12-16T07:40:26.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/824: rename d1/d2a/d37/d3f/dcc/ff9 to d1/d2a/d37/d3f/d4c/f115 0 2023-12-16T07:40:26.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/825: chown d1/d2a/d37/d3f/d5a/d5b/f99 443 1 2023-12-16T07:40:26.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/826: readlink d1/d2a/d37/d3f/d5a/d61/d75/la3 0 2023-12-16T07:40:26.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/827: write d1/d2a/d37/d3f/d5a/d5b/d77/fda [588156,34036] 0 2023-12-16T07:40:26.776 INFO:tasks.workunit.client.0.smithi049.stdout:8/887: link d0/d13/l5e d0/d1f/d1c/d107/l119 0 2023-12-16T07:40:26.778 INFO:tasks.workunit.client.0.smithi049.stdout:5/983: creat d5/de/d54/d57/f15d x:0 0 0 2023-12-16T07:40:26.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/828: rmdir d1/d2a/d37/d3f/d5a/d61/d6b 39 2023-12-16T07:40:26.782 INFO:tasks.workunit.client.0.smithi049.stdout:8/888: creat d0/d1f/db7/d111/f11a x:0 0 0 2023-12-16T07:40:26.782 INFO:tasks.workunit.client.0.smithi049.stdout:8/889: readlink d0/d1f/d36/dbf/lfe 0 2023-12-16T07:40:26.783 INFO:tasks.workunit.client.0.smithi049.stdout:3/829: getdents d1/d2a/d37/db9 0 2023-12-16T07:40:26.789 INFO:tasks.workunit.client.0.smithi049.stdout:3/830: mknod d1/d2a/c116 0 2023-12-16T07:40:26.791 INFO:tasks.workunit.client.0.smithi049.stdout:3/831: mknod d1/d2a/d37/d3f/d5a/de7/c117 0 2023-12-16T07:40:26.791 INFO:tasks.workunit.client.0.smithi049.stdout:3/832: fsync d1/d2a/d37/d3f/d5a/dc2/fd7 0 2023-12-16T07:40:26.793 INFO:tasks.workunit.client.0.smithi049.stdout:3/833: creat d1/d2a/f118 x:0 0 0 2023-12-16T07:40:26.794 INFO:tasks.workunit.client.0.smithi049.stdout:3/834: creat d1/d2a/d37/d3f/d5a/d5b/d77/dc4/f119 x:0 0 0 2023-12-16T07:40:26.807 INFO:tasks.workunit.client.0.smithi049.stdout:3/835: dread d1/d2a/d37/d3f/d5a/d5b/f99 [0,4194304] 0 2023-12-16T07:40:26.807 INFO:tasks.workunit.client.0.smithi049.stdout:1/997: dwrite d20/f2d [0,4194304] 0 2023-12-16T07:40:26.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/984: dwrite d5/de/d54/d78/d147/d14a/f14d [0,4194304] 0 2023-12-16T07:40:26.808 INFO:tasks.workunit.client.0.smithi049.stdout:1/998: getdents d20/d45/d47 0 2023-12-16T07:40:26.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/890: dwrite d0/d1f/f59 [0,4194304] 0 2023-12-16T07:40:26.809 INFO:tasks.workunit.client.0.smithi049.stdout:3/836: dread d1/d2a/d37/d3f/f93 [0,4194304] 0 2023-12-16T07:40:26.811 INFO:tasks.workunit.client.0.smithi049.stdout:8/891: mknod d0/d13/c11b 0 2023-12-16T07:40:26.811 INFO:tasks.workunit.client.0.smithi049.stdout:8/892: write d0/d1f/d36/f47 [9065003,124903] 0 2023-12-16T07:40:26.816 INFO:tasks.workunit.client.0.smithi049.stdout:8/893: unlink d0/d1f/d1c/lc3 0 2023-12-16T07:40:26.818 INFO:tasks.workunit.client.0.smithi049.stdout:8/894: mkdir d0/d1f/db7/d11c 0 2023-12-16T07:40:26.819 INFO:tasks.workunit.client.0.smithi049.stdout:8/895: symlink d0/d1f/d36/l11d 0 2023-12-16T07:40:26.819 INFO:tasks.workunit.client.0.smithi049.stdout:8/896: dread - d0/d1f/d4e/dbb/ff4 zero size 2023-12-16T07:40:26.820 INFO:tasks.workunit.client.0.smithi049.stdout:8/897: mknod d0/d1f/db7/dbe/c11e 0 2023-12-16T07:40:26.820 INFO:tasks.workunit.client.0.smithi049.stdout:8/898: chown d0/d1f/f18 13551 1 2023-12-16T07:40:26.825 INFO:tasks.workunit.client.0.smithi049.stdout:3/837: dwrite d1/f26 [0,4194304] 0 2023-12-16T07:40:26.827 INFO:tasks.workunit.client.0.smithi049.stdout:3/838: write d1/d2b/f57 [2260036,118186] 0 2023-12-16T07:40:26.830 INFO:tasks.workunit.client.0.smithi049.stdout:3/839: rename d1/d2a/c31 to d1/d2a/d37/d3f/d5a/d5b/d5e/c11a 0 2023-12-16T07:40:26.830 INFO:tasks.workunit.client.0.smithi049.stdout:3/840: dread - d1/d2a/d37/d3f/d5a/d5b/ff2 zero size 2023-12-16T07:40:26.830 INFO:tasks.workunit.client.0.smithi049.stdout:9/820: sync 2023-12-16T07:40:26.832 INFO:tasks.workunit.client.0.smithi049.stdout:3/841: write d1/d2a/d37/f55 [308874,31606] 0 2023-12-16T07:40:26.835 INFO:tasks.workunit.client.0.smithi049.stdout:9/821: link d4/d7/d11/d1d/c2b d4/d7/d11/db3/d59/cfe 0 2023-12-16T07:40:26.837 INFO:tasks.workunit.client.0.smithi049.stdout:3/842: rename d1/d2b to d1/d2a/d37/d3f/d5a/de7/d11b 0 2023-12-16T07:40:26.839 INFO:tasks.workunit.client.0.smithi049.stdout:9/822: symlink d4/d7/d11/d1d/d9b/dae/lff 0 2023-12-16T07:40:26.840 INFO:tasks.workunit.client.0.smithi049.stdout:3/843: creat d1/d2a/d37/d3f/d5a/d5b/d5e/f11c x:0 0 0 2023-12-16T07:40:26.840 INFO:tasks.workunit.client.0.smithi049.stdout:3/844: write d1/f26 [3581530,36392] 0 2023-12-16T07:40:26.841 INFO:tasks.workunit.client.0.smithi049.stdout:9/823: rename d4/d7/d11/d26/fcf to d4/d7/d11/d1d/d5b/f100 0 2023-12-16T07:40:26.844 INFO:tasks.workunit.client.0.smithi049.stdout:9/824: mknod d4/d7/d11/d3f/c101 0 2023-12-16T07:40:26.864 INFO:tasks.workunit.client.0.smithi049.stdout:3/845: dwrite d1/d2a/d37/d3f/d5a/d6d/d96/fa2 [0,4194304] 0 2023-12-16T07:40:26.864 INFO:tasks.workunit.client.0.smithi049.stdout:9/825: dwrite d4/d7/d11/d1d/d69/feb [0,4194304] 0 2023-12-16T07:40:26.864 INFO:tasks.workunit.client.0.smithi049.stdout:9/826: read d4/d7/d11/f20 [653795,54382] 0 2023-12-16T07:40:26.865 INFO:tasks.workunit.client.0.smithi049.stdout:3/846: getdents d1/d2a/d37 0 2023-12-16T07:40:26.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/827: stat d4/d7/d11/db3/d8a/l6f 0 2023-12-16T07:40:26.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/828: chown d4/d7/d11/db3/d8a/daa/dce 1688 1 2023-12-16T07:40:26.876 INFO:tasks.workunit.client.0.smithi049.stdout:3/847: dread d1/f2c [0,4194304] 0 2023-12-16T07:40:26.876 INFO:tasks.workunit.client.0.smithi049.stdout:3/848: truncate d1/d2a/d37/d3f/fee 813928 0 2023-12-16T07:40:26.877 INFO:tasks.workunit.client.0.smithi049.stdout:3/849: rmdir d1/d2a/d37 39 2023-12-16T07:40:26.879 INFO:tasks.workunit.client.0.smithi049.stdout:3/850: dread d1/d2a/d37/d3f/d5a/d61/d6b/f72 [0,4194304] 0 2023-12-16T07:40:26.880 INFO:tasks.workunit.client.0.smithi049.stdout:3/851: write d1/f26 [2951929,47247] 0 2023-12-16T07:40:26.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/985: sync 2023-12-16T07:40:26.959 INFO:tasks.workunit.client.0.smithi049.stdout:7/938: sync 2023-12-16T07:40:26.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/862: sync 2023-12-16T07:40:26.959 INFO:tasks.workunit.client.0.smithi049.stdout:2/839: sync 2023-12-16T07:40:26.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/863: chown d2/db/dd/de/d1e/d37/da4/c74 12960 1 2023-12-16T07:40:26.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/939: mknod d7/db4/d10f/df7/c14c 0 2023-12-16T07:40:26.960 INFO:tasks.workunit.client.0.smithi049.stdout:2/840: creat d2/d1d/d24/d55/d76/f120 x:0 0 0 2023-12-16T07:40:26.960 INFO:tasks.workunit.client.0.smithi049.stdout:2/841: readlink d2/l5 0 2023-12-16T07:40:26.962 INFO:tasks.workunit.client.0.smithi049.stdout:5/986: rename d5/de/d54/d57/dfa/d21/d5a/l158 to d5/de/d54/da9/l15e 0 2023-12-16T07:40:26.962 INFO:tasks.workunit.client.0.smithi049.stdout:5/987: chown d5/de/d54/d78 440951 1 2023-12-16T07:40:26.963 INFO:tasks.workunit.client.0.smithi049.stdout:4/864: symlink d2/db/dd/d52/d10b/l10d 0 2023-12-16T07:40:26.963 INFO:tasks.workunit.client.0.smithi049.stdout:4/865: chown d2/db/dd/de/d1e/d37/d82/fd1 2 1 2023-12-16T07:40:26.963 INFO:tasks.workunit.client.0.smithi049.stdout:4/866: readlink d2/db/dd/de/d1e/d37/l68 0 2023-12-16T07:40:26.963 INFO:tasks.workunit.client.0.smithi049.stdout:5/988: dread d5/de/d54/d57/dfa/d21/d58/f11f [0,4194304] 0 2023-12-16T07:40:26.963 INFO:tasks.workunit.client.0.smithi049.stdout:2/842: mkdir d2/d1d/d24/d55/d76/d121 0 2023-12-16T07:40:26.964 INFO:tasks.workunit.client.0.smithi049.stdout:4/867: mknod d2/db/dd/d52/d8c/d108/c10e 0 2023-12-16T07:40:26.965 INFO:tasks.workunit.client.0.smithi049.stdout:5/989: rename d5/de/d54/d57/dfa/d21/d5a/l8c to d5/de/d1c/d102/l15f 0 2023-12-16T07:40:26.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/843: creat d2/db8/f122 x:0 0 0 2023-12-16T07:40:26.967 INFO:tasks.workunit.client.0.smithi049.stdout:4/868: creat d2/db/dd/de/d1e/d37/d4e/f10f x:0 0 0 2023-12-16T07:40:26.969 INFO:tasks.workunit.client.0.smithi049.stdout:5/990: rename d5/de/d54/d67/d9e/c126 to d5/de/d54/d57/d3c/d82/c160 0 2023-12-16T07:40:26.971 INFO:tasks.workunit.client.0.smithi049.stdout:5/991: getdents d5 0 2023-12-16T07:40:26.971 INFO:tasks.workunit.client.0.smithi049.stdout:5/992: stat d5/de/d1c/d62/d81/lee 0 2023-12-16T07:40:26.975 INFO:tasks.workunit.client.0.smithi049.stdout:7/940: dwrite d7/dc/dd/d37/ffd [0,4194304] 0 2023-12-16T07:40:26.975 INFO:tasks.workunit.client.0.smithi049.stdout:7/941: chown d7/dc/d6b/d105/c123 3 1 2023-12-16T07:40:26.978 INFO:tasks.workunit.client.0.smithi049.stdout:2/844: dread d2/d1d/d28/d56/fae [0,4194304] 0 2023-12-16T07:40:26.978 INFO:tasks.workunit.client.0.smithi049.stdout:2/845: stat d2/d1d/d24/d55/d7c/d98/da1 0 2023-12-16T07:40:26.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/942: creat d7/dc/dd/d35/d138/f14d x:0 0 0 2023-12-16T07:40:26.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/943: truncate d7/dc/dd/d14/fb7 934708 0 2023-12-16T07:40:26.980 INFO:tasks.workunit.client.0.smithi049.stdout:2/846: symlink d2/d1d/d24/d11a/l123 0 2023-12-16T07:40:26.980 INFO:tasks.workunit.client.0.smithi049.stdout:2/847: readlink d2/de/l4a 0 2023-12-16T07:40:26.982 INFO:tasks.workunit.client.0.smithi049.stdout:2/848: symlink d2/d1d/d28/d56/d11/da8/l124 0 2023-12-16T07:40:26.983 INFO:tasks.workunit.client.0.smithi049.stdout:7/944: write d7/dc/d2f/d40/f74 [397389,120200] 0 2023-12-16T07:40:26.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/869: dwrite d2/db/dd/de/d1e/d21/f40 [0,4194304] 0 2023-12-16T07:40:26.985 INFO:tasks.workunit.client.0.smithi049.stdout:7/945: creat d7/dc/dd/d27/dba/f14e x:0 0 0 2023-12-16T07:40:26.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/870: mkdir d2/db/d6b/dad/d110 0 2023-12-16T07:40:26.995 INFO:tasks.workunit.client.0.smithi049.stdout:2/849: dread d2/d1d/d38/fbf [0,4194304] 0 2023-12-16T07:40:26.996 INFO:tasks.workunit.client.0.smithi049.stdout:2/850: getdents d2/db8 0 2023-12-16T07:40:27.000 INFO:tasks.workunit.client.0.smithi049.stdout:7/946: dwrite d7/dc/d2f/d38/ddb/fe0 [0,4194304] 0 2023-12-16T07:40:27.000 INFO:tasks.workunit.client.0.smithi049.stdout:2/851: read d2/d1d/d28/d56/d66/d6b/fd7 [300510,122193] 0 2023-12-16T07:40:27.004 INFO:tasks.workunit.client.0.smithi049.stdout:4/871: dwrite d2/db/d6b/db9/fc6 [0,4194304] 0 2023-12-16T07:40:27.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/947: rename d7/dc/dd/d27/dba/l141 to d7/dc/dd/d37/d5c/db2/d106/l14f 0 2023-12-16T07:40:27.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/852: rmdir d2/db8/db9 39 2023-12-16T07:40:27.013 INFO:tasks.workunit.client.0.smithi049.stdout:4/872: creat d2/db/dd/de/d1e/d37/f111 x:0 0 0 2023-12-16T07:40:27.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/873: mkdir d2/db/dd/de/d1e/d21/dda/dfb/d112 0 2023-12-16T07:40:27.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/874: chown d2/db/d6b/db9 118752886 1 2023-12-16T07:40:27.015 INFO:tasks.workunit.client.0.smithi049.stdout:4/875: write d2/db/dd/de/d1e/d21/f4f [1739728,124460] 0 2023-12-16T07:40:27.015 INFO:tasks.workunit.client.0.smithi049.stdout:4/876: truncate d2/db/dd/de/d1e/d37/faa 1456968 0 2023-12-16T07:40:27.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/877: getdents d2/db/dd/de/d1e 0 2023-12-16T07:40:27.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/878: dread d2/db/d6b/dc8/fe3 [0,4194304] 0 2023-12-16T07:40:27.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/879: write d2/db/dd/de/d1e/d44/fa6 [1501229,67452] 0 2023-12-16T07:40:27.033 INFO:tasks.workunit.client.0.smithi049.stdout:7/948: dwrite d7/dc/f61 [0,4194304] 0 2023-12-16T07:40:27.033 INFO:tasks.workunit.client.0.smithi049.stdout:2/853: dwrite d2/f11e [0,4194304] 0 2023-12-16T07:40:27.034 INFO:tasks.workunit.client.0.smithi049.stdout:7/949: mkdir d7/db4/d10f/d150 0 2023-12-16T07:40:27.038 INFO:tasks.workunit.client.0.smithi049.stdout:7/950: mkdir d7/dc/d2f/d38/d151 0 2023-12-16T07:40:27.038 INFO:tasks.workunit.client.0.smithi049.stdout:4/880: dread d2/db/dd/de/d1e/d37/d82/f109 [0,4194304] 0 2023-12-16T07:40:27.039 INFO:tasks.workunit.client.0.smithi049.stdout:4/881: chown d2/f86 1 1 2023-12-16T07:40:27.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/951: rmdir d7/dc/dd/d27/d8e 39 2023-12-16T07:40:27.042 INFO:tasks.workunit.client.0.smithi049.stdout:4/882: rmdir d2/db/dd/de 39 2023-12-16T07:40:27.042 INFO:tasks.workunit.client.0.smithi049.stdout:4/883: fsync d2/db/dd/de/d1e/d37/dcf/ff5 0 2023-12-16T07:40:27.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/884: write d2/db/dd/d2a/f43 [1235752,54546] 0 2023-12-16T07:40:27.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/952: mkdir d7/dc/dd/d37/d5c/db2/d109/d152 0 2023-12-16T07:40:27.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/953: write d7/dc/d2f/d38/ff6 [4626730,81582] 0 2023-12-16T07:40:27.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/954: fsync d7/dc/dd/d35/f94 0 2023-12-16T07:40:27.044 INFO:tasks.workunit.client.0.smithi049.stdout:4/885: write d2/db/dd/de/d1e/f2d [3105563,102890] 0 2023-12-16T07:40:27.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/955: write d7/dc/d2f/d38/fe5 [468107,74610] 0 2023-12-16T07:40:27.047 INFO:tasks.workunit.client.0.smithi049.stdout:4/886: dread d2/db/dd/de/fa1 [0,4194304] 0 2023-12-16T07:40:27.047 INFO:tasks.workunit.client.0.smithi049.stdout:4/887: write d2/db/dd/de/d1e/f34 [982418,67340] 0 2023-12-16T07:40:27.048 INFO:tasks.workunit.client.0.smithi049.stdout:4/888: mkdir d2/db/d6b/d113 0 2023-12-16T07:40:27.048 INFO:tasks.workunit.client.0.smithi049.stdout:9/829: sync 2023-12-16T07:40:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:8/899: sync 2023-12-16T07:40:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:1/999: sync 2023-12-16T07:40:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:3/852: sync 2023-12-16T07:40:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:5/993: sync 2023-12-16T07:40:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:5/994: chown d5/de/d1c/d62/d81/f11a 2068285 1 2023-12-16T07:40:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:5/995: dread - d5/de/d54/d57/f15d zero size 2023-12-16T07:40:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:8/900: write d0/d1f/d4e/dbb/df7/f116 [4477970,127001] 0 2023-12-16T07:40:27.052 INFO:tasks.workunit.client.0.smithi049.stdout:4/889: write d2/db/dd/de/d1e/f55 [3845992,116886] 0 2023-12-16T07:40:27.053 INFO:tasks.workunit.client.0.smithi049.stdout:4/890: stat d2/db/d6b/dad/de0/f10a 0 2023-12-16T07:40:27.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/854: dwrite d2/ff [0,4194304] 0 2023-12-16T07:40:27.053 INFO:tasks.workunit.client.0.smithi049.stdout:3/853: rmdir d1/d2a/d37/d3f 39 2023-12-16T07:40:27.054 INFO:tasks.workunit.client.0.smithi049.stdout:2/855: dread d2/d1d/d28/d56/d11/da8/fc5 [0,4194304] 0 2023-12-16T07:40:27.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/856: write d2/d26/d6e/dca/f107 [588840,98213] 0 2023-12-16T07:40:27.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/857: chown d2/d26/d6e/f101 4632047 1 2023-12-16T07:40:27.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/858: chown d2/d1d/d28/d56/d11/da8/f102 41857489 1 2023-12-16T07:40:27.055 INFO:tasks.workunit.client.0.smithi049.stdout:8/901: creat d0/d13/d42/d5b/f11f x:0 0 0 2023-12-16T07:40:27.055 INFO:tasks.workunit.client.0.smithi049.stdout:8/902: chown d0/d1f/db7/fff 11 1 2023-12-16T07:40:27.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/956: rename d7/dc/dd to d7/db4/d10f/d150/d153 0 2023-12-16T07:40:27.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/957: chown d7/db4/d107/c124 710 1 2023-12-16T07:40:27.061 INFO:tasks.workunit.client.0.smithi049.stdout:3/854: creat d1/d2a/d37/d3f/f11d x:0 0 0 2023-12-16T07:40:27.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/903: creat d0/d13/f120 x:0 0 0 2023-12-16T07:40:27.069 INFO:tasks.workunit.client.0.smithi049.stdout:4/891: dread d2/db/dd/de/d1e/d37/d4e/f89 [0,4194304] 0 2023-12-16T07:40:27.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/855: mknod d1/d2a/d37/d3f/d5a/d61/d75/c11e 0 2023-12-16T07:40:27.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/856: readlink d1/d2a/d37/d3f/d5a/d61/d75/db7/lc1 0 2023-12-16T07:40:27.074 INFO:tasks.workunit.client.0.smithi049.stdout:8/904: read d0/d13/d42/d5b/d68/d6b/da2/da5/ff3 [647321,100182] 0 2023-12-16T07:40:27.076 INFO:tasks.workunit.client.0.smithi049.stdout:8/905: mkdir d0/d1f/d4e/d121 0 2023-12-16T07:40:27.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/892: write d2/f12 [3759504,83457] 0 2023-12-16T07:40:27.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/893: dread - d2/db/f10c zero size 2023-12-16T07:40:27.078 INFO:tasks.workunit.client.0.smithi049.stdout:8/906: symlink d0/d1f/db7/l122 0 2023-12-16T07:40:27.078 INFO:tasks.workunit.client.0.smithi049.stdout:8/907: chown d0/d13 58272503 1 2023-12-16T07:40:27.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/908: link d0/d1f/f82 d0/d13/d42/d5b/d68/d6b/da2/db9/f123 0 2023-12-16T07:40:27.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/909: write d0/d13/d42/d5b/dab/f10b [1001748,94296] 0 2023-12-16T07:40:27.088 INFO:tasks.workunit.client.0.smithi049.stdout:8/910: dread d0/d13/d42/d5b/d68/d6b/da2/fc9 [0,4194304] 0 2023-12-16T07:40:27.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/859: dwrite d2/d1d/d28/d56/d11/da8/f117 [0,4194304] 0 2023-12-16T07:40:27.094 INFO:tasks.workunit.client.0.smithi049.stdout:5/996: dwrite d5/de/d54/d57/dfa/d21/d5a/fc5 [0,4194304] 0 2023-12-16T07:40:27.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/860: getdents d2/d1d/d28/d56/d66 0 2023-12-16T07:40:27.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/861: fsync d2/de/f1b 0 2023-12-16T07:40:27.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/862: fdatasync d2/de/de0/f103 0 2023-12-16T07:40:27.098 INFO:tasks.workunit.client.0.smithi049.stdout:5/997: rmdir d5/de/d54/d57/d3c/d13b 39 2023-12-16T07:40:27.098 INFO:tasks.workunit.client.0.smithi049.stdout:7/958: dwrite d7/dc/d2f/d38/fe8 [0,4194304] 0 2023-12-16T07:40:27.098 INFO:tasks.workunit.client.0.smithi049.stdout:7/959: readlink d7/db4/d10f/d150/d153/d37/d5c/d143/ld4 0 2023-12-16T07:40:27.099 INFO:tasks.workunit.client.0.smithi049.stdout:3/857: dwrite d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/fed [0,4194304] 0 2023-12-16T07:40:27.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/894: dwrite d2/db/dd/de/d1e/d44/fb8 [0,4194304] 0 2023-12-16T07:40:27.099 INFO:tasks.workunit.client.0.smithi049.stdout:2/863: creat d2/d1d/d28/d56/d11/da8/f125 x:0 0 0 2023-12-16T07:40:27.099 INFO:tasks.workunit.client.0.smithi049.stdout:2/864: readlink d2/d1d/d24/d55/d7c/d98/lf3 0 2023-12-16T07:40:27.099 INFO:tasks.workunit.client.0.smithi049.stdout:2/865: chown d2/d1d/d24/l53 47479 1 2023-12-16T07:40:27.100 INFO:tasks.workunit.client.0.smithi049.stdout:5/998: write d5/de/d54/d57/dfa/d20/f56 [2096981,85800] 0 2023-12-16T07:40:27.101 INFO:tasks.workunit.client.0.smithi049.stdout:7/960: getdents d7 0 2023-12-16T07:40:27.101 INFO:tasks.workunit.client.0.smithi049.stdout:7/961: write d7/db4/d10f/d150/d153/d37/f8d [109897,63923] 0 2023-12-16T07:40:27.105 INFO:tasks.workunit.client.0.smithi049.stdout:3/858: mknod d1/d2a/d37/d3f/d5a/d61/c11f 0 2023-12-16T07:40:27.105 INFO:tasks.workunit.client.0.smithi049.stdout:4/895: mknod d2/db/dd/de/d1e/d37/d4e/c114 0 2023-12-16T07:40:27.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/866: mkdir d2/d1d/d24/d126 0 2023-12-16T07:40:27.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/867: chown d2/db8 0 1 2023-12-16T07:40:27.107 INFO:tasks.workunit.client.0.smithi049.stdout:5/999: rename d5/de/d54/d57/dfa/d21/d58/d65/cbe to d5/de/d54/d67/c161 0 2023-12-16T07:40:27.108 INFO:tasks.workunit.client.0.smithi049.stdout:7/962: mknod d7/dc/d2f/d38/dd0/c154 0 2023-12-16T07:40:27.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/859: symlink d1/d2a/d37/d3f/dcc/de8/l120 0 2023-12-16T07:40:27.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/860: stat d1/d2a/d37/d3f/d5a/de7/d11b/f109 0 2023-12-16T07:40:27.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/861: fdatasync d1/d2a/d37/d3f/f5d 0 2023-12-16T07:40:27.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/862: fsync d1/d2a/d37/d3f/d4c/f73 0 2023-12-16T07:40:27.110 INFO:tasks.workunit.client.0.smithi049.stdout:4/896: creat d2/db/dd/de/d1e/d37/f115 x:0 0 0 2023-12-16T07:40:27.111 INFO:tasks.workunit.client.0.smithi049.stdout:3/863: read d1/f25 [3429522,34396] 0 2023-12-16T07:40:27.111 INFO:tasks.workunit.client.0.smithi049.stdout:3/864: chown d1/d2a/d37/d3f/d5a/d5b/d5e/c11a 16633104 1 2023-12-16T07:40:27.111 INFO:tasks.workunit.client.0.smithi049.stdout:3/865: fsync d1/d2a/d37/d3f/f5d 0 2023-12-16T07:40:27.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/868: mkdir d2/d1d/d24/d55/df5/d127 0 2023-12-16T07:40:27.115 INFO:tasks.workunit.client.0.smithi049.stdout:3/866: getdents d1/d2a/d37/d3f/d5a/d5b/d5e 0 2023-12-16T07:40:27.115 INFO:tasks.workunit.client.0.smithi049.stdout:3/867: chown d1/d2a/d37/d3f/d5a/d5b/d77/c112 8331125 1 2023-12-16T07:40:27.116 INFO:tasks.workunit.client.0.smithi049.stdout:2/869: getdents d2/d1d/dc2 0 2023-12-16T07:40:27.119 INFO:tasks.workunit.client.0.smithi049.stdout:3/868: creat d1/d2a/d37/db9/f121 x:0 0 0 2023-12-16T07:40:27.119 INFO:tasks.workunit.client.0.smithi049.stdout:2/870: getdents d2/d1d 0 2023-12-16T07:40:27.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/871: write d2/d26/d6e/f7b [4069292,72010] 0 2023-12-16T07:40:27.121 INFO:tasks.workunit.client.0.smithi049.stdout:3/869: mkdir d1/d2a/d37/d3f/d5a/d122 0 2023-12-16T07:40:27.121 INFO:tasks.workunit.client.0.smithi049.stdout:3/870: fdatasync d1/fa5 0 2023-12-16T07:40:27.121 INFO:tasks.workunit.client.0.smithi049.stdout:3/871: fdatasync d1/d2a/d37/d3f/d5a/de7/d11b/f53 0 2023-12-16T07:40:27.122 INFO:tasks.workunit.client.0.smithi049.stdout:3/872: symlink d1/d2a/d37/d3f/d4c/l123 0 2023-12-16T07:40:27.123 INFO:tasks.workunit.client.0.smithi049.stdout:7/963: dwrite d7/dc/d6b/d70/f135 [0,4194304] 0 2023-12-16T07:40:27.139 INFO:tasks.workunit.client.0.smithi049.stdout:2/872: dwrite d2/d1d/d24/f42 [0,4194304] 0 2023-12-16T07:40:27.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/873: dwrite d1/d2a/d37/d3f/fb1 [0,4194304] 0 2023-12-16T07:40:27.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/874: write d1/fc6 [829018,45337] 0 2023-12-16T07:40:27.140 INFO:tasks.workunit.client.0.smithi049.stdout:2/873: mkdir d2/d1d/d24/d11a/d128 0 2023-12-16T07:40:27.140 INFO:tasks.workunit.client.0.smithi049.stdout:2/874: chown d2/d1d/d28/d56/d11/da8/c106 17308 1 2023-12-16T07:40:27.141 INFO:tasks.workunit.client.0.smithi049.stdout:3/875: creat d1/d2a/d37/d3f/d5a/d61/d6b/da1/f124 x:0 0 0 2023-12-16T07:40:27.141 INFO:tasks.workunit.client.0.smithi049.stdout:3/876: chown d1/d2a/d37/d3f/dcc/fe3 89 1 2023-12-16T07:40:27.141 INFO:tasks.workunit.client.0.smithi049.stdout:3/877: write d1/d2a/d37/d3f/d5a/d61/d6b/da1/f124 [167662,102461] 0 2023-12-16T07:40:27.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/875: mkdir d2/d1d/dc2/d129 0 2023-12-16T07:40:27.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/878: creat d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/f125 x:0 0 0 2023-12-16T07:40:27.147 INFO:tasks.workunit.client.0.smithi049.stdout:2/876: rename d2/d1d/d24/d55/lba to d2/d1d/l12a 0 2023-12-16T07:40:27.147 INFO:tasks.workunit.client.0.smithi049.stdout:2/877: fdatasync d2/d1d/d28/d56/d66/fc8 0 2023-12-16T07:40:27.148 INFO:tasks.workunit.client.0.smithi049.stdout:2/878: symlink d2/d1d/d28/d56/d71/ddf/l12b 0 2023-12-16T07:40:27.149 INFO:tasks.workunit.client.0.smithi049.stdout:2/879: mkdir d2/d1d/d28/d56/d11/d1c/d12c 0 2023-12-16T07:40:27.151 INFO:tasks.workunit.client.0.smithi049.stdout:2/880: mknod d2/d1d/d24/d11a/c12d 0 2023-12-16T07:40:27.152 INFO:tasks.workunit.client.0.smithi049.stdout:2/881: rename d2/d1d/d28/d56/d66/d6b/fb3 to d2/db8/db9/f12e 0 2023-12-16T07:40:27.152 INFO:tasks.workunit.client.0.smithi049.stdout:2/882: truncate d2/d1d/d28/d56/d11/f1e 4381182 0 2023-12-16T07:40:27.153 INFO:tasks.workunit.client.0.smithi049.stdout:2/883: write d2/d1d/d24/d55/d7c/d98/da1/fa7 [4799,80790] 0 2023-12-16T07:40:27.158 INFO:tasks.workunit.client.0.smithi049.stdout:3/879: dwrite d1/d2a/d37/d3f/d5a/de7/d11b/f109 [0,4194304] 0 2023-12-16T07:40:27.162 INFO:tasks.workunit.client.0.smithi049.stdout:2/884: dread d2/ff [0,4194304] 0 2023-12-16T07:40:27.162 INFO:tasks.workunit.client.0.smithi049.stdout:2/885: readlink d2/d26/d43/l96 0 2023-12-16T07:40:27.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/880: dread d1/fc6 [0,4194304] 0 2023-12-16T07:40:27.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/881: fsync d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/feb 0 2023-12-16T07:40:27.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/882: chown d1/f26 51567 1 2023-12-16T07:40:27.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/886: mkdir d2/d1d/d24/d11a/d12f 0 2023-12-16T07:40:27.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/883: write d1/d2a/d37/d3f/d5a/de7/d11b/f57 [3708272,100212] 0 2023-12-16T07:40:27.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/884: chown d1/d2a/d37/d3f/d5a/dc2/f100 5114 1 2023-12-16T07:40:27.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/885: truncate d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/fed 487692 0 2023-12-16T07:40:27.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/886: mkdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/d126 0 2023-12-16T07:40:27.169 INFO:tasks.workunit.client.0.smithi049.stdout:3/887: creat d1/d2a/d37/d3f/dcc/f127 x:0 0 0 2023-12-16T07:40:27.170 INFO:tasks.workunit.client.0.smithi049.stdout:3/888: write d1/d2a/d37/d3f/d4c/f4d [972256,44165] 0 2023-12-16T07:40:27.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/889: creat d1/d2a/d37/db9/f128 x:0 0 0 2023-12-16T07:40:27.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/890: readlink d1/d2a/d37/d3f/d5a/l95 0 2023-12-16T07:40:27.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/891: creat d1/d2a/d37/d3f/d5a/d61/d6b/f129 x:0 0 0 2023-12-16T07:40:27.173 INFO:tasks.workunit.client.0.smithi049.stdout:3/892: truncate d1/d2a/d37/d3f/d5a/d61/d6b/f129 178909 0 2023-12-16T07:40:27.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/893: symlink d1/d2a/d37/d3f/d5a/d5b/d5e/l12a 0 2023-12-16T07:40:27.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/894: write d1/d2a/d37/d3f/d5a/d61/d75/fe4 [4479503,35988] 0 2023-12-16T07:40:27.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/895: chown d1/d2a/d37/d3f/d5a/d61/d6b/da1/d76/fed 27504 1 2023-12-16T07:40:27.182 INFO:tasks.workunit.client.0.smithi049.stdout:3/896: dread d1/d2a/d37/d3f/d5a/d5b/d77/dc4/fca [0,4194304] 0 2023-12-16T07:40:27.183 INFO:tasks.workunit.client.0.smithi049.stdout:3/897: creat d1/d2a/f12b x:0 0 0 2023-12-16T07:40:27.184 INFO:tasks.workunit.client.0.smithi049.stdout:3/898: mkdir d1/d2a/d37/d12c 0 2023-12-16T07:40:27.185 INFO:tasks.workunit.client.0.smithi049.stdout:3/899: mkdir d1/d2a/d37/d3f/d5a/d61/d75/db7/d12d 0 2023-12-16T07:40:27.186 INFO:tasks.workunit.client.0.smithi049.stdout:3/900: rename d1/d2a/d37/d3f/d5a/d5b/d5e/f5f to d1/d2a/d37/d3f/d4c/f12e 0 2023-12-16T07:40:27.186 INFO:tasks.workunit.client.0.smithi049.stdout:3/901: chown d1/d2a/d37/d3f/d5a/d61/d75/fe4 4152 1 2023-12-16T07:40:27.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/902: creat d1/d2a/d37/d3f/d5a/d5b/d77/f12f x:0 0 0 2023-12-16T07:40:27.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/903: stat d1/d2a/d37/d3f/d5a/d6d/lf1 0 2023-12-16T07:40:27.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/904: chown d1/d2a/d37/d3f/dcc/de8/cfc 168723501 1 2023-12-16T07:40:27.191 INFO:tasks.workunit.client.0.smithi049.stdout:3/905: creat d1/d2a/d37/d3f/d5a/d61/d75/db7/f130 x:0 0 0 2023-12-16T07:40:27.200 INFO:tasks.workunit.client.0.smithi049.stdout:3/906: dread d1/f18 [0,4194304] 0 2023-12-16T07:40:27.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/907: dwrite d1/d2a/d37/d3f/d5a/d61/d6b/f72 [0,4194304] 0 2023-12-16T07:40:27.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/908: readlink d1/d2a/d37/d3f/l45 0 2023-12-16T07:40:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:3/909: getdents d1/d2a/d37 0 2023-12-16T07:40:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:3/910: truncate d1/d2a/d37/d3f/d5a/de7/d11b/f2d 1723032 0 2023-12-16T07:40:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:3/911: symlink d1/d2a/d37/d3f/d5a/dc2/l131 0 2023-12-16T07:40:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/912: mknod d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/c132 0 2023-12-16T07:40:27.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/913: getdents d1/d2a/d37/d3f/d5a/dc2/de0 0 2023-12-16T07:40:27.225 INFO:tasks.workunit.client.0.smithi049.stdout:3/914: mkdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde/d133 0 2023-12-16T07:40:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:8/911: sync 2023-12-16T07:40:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:9/830: sync 2023-12-16T07:40:27.234 INFO:tasks.workunit.client.0.smithi049.stdout:8/912: write d0/d13/d42/f102 [42996,81963] 0 2023-12-16T07:40:27.238 INFO:tasks.workunit.client.0.smithi049.stdout:9/831: dread d4/d7/d11/d1d/f25 [0,4194304] 0 2023-12-16T07:40:27.239 INFO:tasks.workunit.client.0.smithi049.stdout:9/832: creat d4/f102 x:0 0 0 2023-12-16T07:40:27.239 INFO:tasks.workunit.client.0.smithi049.stdout:9/833: dread - d4/d7/d11/d1d/d69/d76/d83/ff8 zero size 2023-12-16T07:40:27.241 INFO:tasks.workunit.client.0.smithi049.stdout:9/834: rmdir d4/d7/d11/d1d/dd7 0 2023-12-16T07:40:27.242 INFO:tasks.workunit.client.0.smithi049.stdout:3/915: dwrite d1/d2a/d37/d3f/f93 [0,4194304] 0 2023-12-16T07:40:27.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/835: read d4/db/f22 [1805715,43276] 0 2023-12-16T07:40:27.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/836: fdatasync f0 0 2023-12-16T07:40:27.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/837: chown d4/db/l32 0 1 2023-12-16T07:40:27.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/838: chown d4/d7/d11/d26/d80/dbc/lfa 1474 1 2023-12-16T07:40:27.244 INFO:tasks.workunit.client.0.smithi049.stdout:3/916: rmdir d1/d2a/d37/d3f/d4c 39 2023-12-16T07:40:27.245 INFO:tasks.workunit.client.0.smithi049.stdout:3/917: fdatasync d1/d2a/d37/d3f/d5a/d61/f66 0 2023-12-16T07:40:27.245 INFO:tasks.workunit.client.0.smithi049.stdout:3/918: dread - d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/feb zero size 2023-12-16T07:40:27.246 INFO:tasks.workunit.client.0.smithi049.stdout:9/839: symlink d4/d7/d11/d1d/l103 0 2023-12-16T07:40:27.248 INFO:tasks.workunit.client.0.smithi049.stdout:9/840: mknod d4/d3e/df9/de5/c104 0 2023-12-16T07:40:27.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/841: mkdir d4/d3e/d105 0 2023-12-16T07:40:27.250 INFO:tasks.workunit.client.0.smithi049.stdout:9/842: rename d4/l2c to d4/d7/d11/d1d/d5b/l106 0 2023-12-16T07:40:27.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/843: mkdir d4/d7/d11/d1d/d69/d76/d107 0 2023-12-16T07:40:27.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/844: write d4/d7/d11/d26/f74 [1373029,51113] 0 2023-12-16T07:40:27.254 INFO:tasks.workunit.client.0.smithi049.stdout:9/845: creat d4/d7/d11/d56/d7f/f108 x:0 0 0 2023-12-16T07:40:27.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/913: dwrite d0/d1f/d36/f3c [0,4194304] 0 2023-12-16T07:40:27.255 INFO:tasks.workunit.client.0.smithi049.stdout:3/919: dwrite d1/d2a/d37/d3f/d5a/d61/f7c [0,4194304] 0 2023-12-16T07:40:27.256 INFO:tasks.workunit.client.0.smithi049.stdout:9/846: symlink d4/d7/d11/d26/d80/l109 0 2023-12-16T07:40:27.256 INFO:tasks.workunit.client.0.smithi049.stdout:9/847: write d4/db/f97 [2088702,5270] 0 2023-12-16T07:40:27.259 INFO:tasks.workunit.client.0.smithi049.stdout:8/914: link d0/d1f/d36/db8/de5/fe9 d0/d13/d42/d5b/d68/d6b/da2/db9/f124 0 2023-12-16T07:40:27.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/915: truncate d0/f6e 8083279 0 2023-12-16T07:40:27.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/916: write d0/d1f/f7e [85199,114778] 0 2023-12-16T07:40:27.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/917: read - d0/d6a/f105 zero size 2023-12-16T07:40:27.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/918: fdatasync d0/d1f/f18 0 2023-12-16T07:40:27.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/919: readlink d0/d1f/la1 0 2023-12-16T07:40:27.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/920: write d0/d13/d42/d5b/d68/d6b/da2/db9/f123 [1549983,85304] 0 2023-12-16T07:40:27.267 INFO:tasks.workunit.client.0.smithi049.stdout:3/920: dread d1/d2a/d37/d3f/d5a/de7/d11b/f57 [0,4194304] 0 2023-12-16T07:40:27.268 INFO:tasks.workunit.client.0.smithi049.stdout:3/921: symlink d1/d2a/d37/d3f/d5a/d61/d75/db7/d12d/l134 0 2023-12-16T07:40:27.270 INFO:tasks.workunit.client.0.smithi049.stdout:3/922: mkdir d1/d2a/d37/d3f/d5a/d61/d75/db7/d135 0 2023-12-16T07:40:27.271 INFO:tasks.workunit.client.0.smithi049.stdout:3/923: link d1/l21 d1/d2a/d37/d3f/d5a/d61/d6b/l136 0 2023-12-16T07:40:27.272 INFO:tasks.workunit.client.0.smithi049.stdout:9/848: dwrite d4/d7/d11/d1d/d69/f9d [0,4194304] 0 2023-12-16T07:40:27.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/924: write d1/d2a/d37/d3f/faa [15899,31926] 0 2023-12-16T07:40:27.277 INFO:tasks.workunit.client.0.smithi049.stdout:3/925: mknod d1/d2a/d37/db9/c137 0 2023-12-16T07:40:27.278 INFO:tasks.workunit.client.0.smithi049.stdout:3/926: symlink d1/d2a/df4/l138 0 2023-12-16T07:40:27.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/921: dread d0/f6e [4194304,4194304] 0 2023-12-16T07:40:27.279 INFO:tasks.workunit.client.0.smithi049.stdout:3/927: write d1/d2a/d37/d3f/d5a/d5b/f99 [2996303,42179] 0 2023-12-16T07:40:27.279 INFO:tasks.workunit.client.0.smithi049.stdout:3/928: fsync d1/d2a/f48 0 2023-12-16T07:40:27.280 INFO:tasks.workunit.client.0.smithi049.stdout:3/929: write d1/d2a/f40 [1337506,90027] 0 2023-12-16T07:40:27.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/930: mknod d1/d2a/d37/d3f/d5a/d5b/c139 0 2023-12-16T07:40:27.282 INFO:tasks.workunit.client.0.smithi049.stdout:4/897: sync 2023-12-16T07:40:27.282 INFO:tasks.workunit.client.0.smithi049.stdout:2/887: sync 2023-12-16T07:40:27.282 INFO:tasks.workunit.client.0.smithi049.stdout:7/964: sync 2023-12-16T07:40:27.282 INFO:tasks.workunit.client.0.smithi049.stdout:2/888: stat d2/d1d/d28/d56/d66/f88 0 2023-12-16T07:40:27.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/922: dread d0/d13/f31 [0,4194304] 0 2023-12-16T07:40:27.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/923: readlink d0/d1f/d56/lb0 0 2023-12-16T07:40:27.283 INFO:tasks.workunit.client.0.smithi049.stdout:2/889: rmdir d2/d26/de6 39 2023-12-16T07:40:27.283 INFO:tasks.workunit.client.0.smithi049.stdout:7/965: mkdir d7/dc/d15/d57/dc8/d155 0 2023-12-16T07:40:27.284 INFO:tasks.workunit.client.0.smithi049.stdout:4/898: dread d2/db/dd/de/d1e/f34 [0,4194304] 0 2023-12-16T07:40:27.284 INFO:tasks.workunit.client.0.smithi049.stdout:8/924: mkdir d0/d13/d42/de6/df0/d125 0 2023-12-16T07:40:27.284 INFO:tasks.workunit.client.0.smithi049.stdout:8/925: dread - d0/d13/d42/d5b/f11f zero size 2023-12-16T07:40:27.285 INFO:tasks.workunit.client.0.smithi049.stdout:2/890: symlink d2/d1d/d24/d55/d76/l130 0 2023-12-16T07:40:27.285 INFO:tasks.workunit.client.0.smithi049.stdout:2/891: getdents d2/d1d/d24/d55/df5/d127 0 2023-12-16T07:40:27.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/966: rmdir d7/db4/d10f/d150/d153/d27/d137 0 2023-12-16T07:40:27.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/926: creat d0/d13/d42/d5b/d68/d6b/f126 x:0 0 0 2023-12-16T07:40:27.288 INFO:tasks.workunit.client.0.smithi049.stdout:2/892: symlink d2/d1d/d28/d56/d66/d108/l131 0 2023-12-16T07:40:27.289 INFO:tasks.workunit.client.0.smithi049.stdout:4/899: read d2/f9 [3162039,28366] 0 2023-12-16T07:40:27.289 INFO:tasks.workunit.client.0.smithi049.stdout:4/900: chown d2/db/dd/de/d1e/d37/d4e/fee 3 1 2023-12-16T07:40:27.291 INFO:tasks.workunit.client.0.smithi049.stdout:4/901: creat d2/db/dd/de/d1e/d21/de7/f116 x:0 0 0 2023-12-16T07:40:27.291 INFO:tasks.workunit.client.0.smithi049.stdout:4/902: fsync d2/db/dd/de/d1e/d37/d4e/f9b 0 2023-12-16T07:40:27.292 INFO:tasks.workunit.client.0.smithi049.stdout:4/903: dread d2/db/d6b/db9/de4/f106 [0,4194304] 0 2023-12-16T07:40:27.293 INFO:tasks.workunit.client.0.smithi049.stdout:4/904: chown d2/db/dd/de/d1e/d37/da4/de1 2333669 1 2023-12-16T07:40:27.294 INFO:tasks.workunit.client.0.smithi049.stdout:4/905: dread - d2/db/dd/d52/fa8 zero size 2023-12-16T07:40:27.300 INFO:tasks.workunit.client.0.smithi049.stdout:7/967: dread f4 [0,4194304] 0 2023-12-16T07:40:27.302 INFO:tasks.workunit.client.0.smithi049.stdout:3/931: dwrite d1/d2a/d37/d3f/d5a/d5b/d77/dc4/f119 [0,4194304] 0 2023-12-16T07:40:27.305 INFO:tasks.workunit.client.0.smithi049.stdout:3/932: mkdir d1/d2a/d37/d3f/d5a/d61/d75/d13a 0 2023-12-16T07:40:27.307 INFO:tasks.workunit.client.0.smithi049.stdout:3/933: rmdir d1/d2a/d37/d3f/d5a/d61/d75/d13a 0 2023-12-16T07:40:27.309 INFO:tasks.workunit.client.0.smithi049.stdout:3/934: mknod d1/d2a/d37/d3f/d5a/d61/c13b 0 2023-12-16T07:40:27.310 INFO:tasks.workunit.client.0.smithi049.stdout:3/935: mkdir d1/d2a/d37/d3f/d5a/dc2/d13c 0 2023-12-16T07:40:27.311 INFO:tasks.workunit.client.0.smithi049.stdout:3/936: symlink d1/d2a/d37/d3f/d5a/de7/l13d 0 2023-12-16T07:40:27.312 INFO:tasks.workunit.client.0.smithi049.stdout:3/937: link d1/d2a/d37/d3f/d5a/d5b/d77/dc4/fca d1/d2a/d37/d3f/d5a/f13e 0 2023-12-16T07:40:27.313 INFO:tasks.workunit.client.0.smithi049.stdout:3/938: symlink d1/d2a/d37/d3f/d5a/dc2/d13c/l13f 0 2023-12-16T07:40:27.313 INFO:tasks.workunit.client.0.smithi049.stdout:3/939: dread - d1/d2a/d37/d3f/d5a/dc2/f10a zero size 2023-12-16T07:40:27.313 INFO:tasks.workunit.client.0.smithi049.stdout:8/927: dwrite d0/d13/d42/d5b/d68/f8e [0,4194304] 0 2023-12-16T07:40:27.315 INFO:tasks.workunit.client.0.smithi049.stdout:3/940: dread d1/d2a/d37/d3f/f59 [0,4194304] 0 2023-12-16T07:40:27.315 INFO:tasks.workunit.client.0.smithi049.stdout:3/941: chown d1/d2a/d37/d3f/d5a/d5b/d77/dc4/f119 97 1 2023-12-16T07:40:27.317 INFO:tasks.workunit.client.0.smithi049.stdout:2/893: dwrite d2/d1d/d24/d55/d7c/ff7 [0,4194304] 0 2023-12-16T07:40:27.318 INFO:tasks.workunit.client.0.smithi049.stdout:4/906: dwrite d2/db/dd/de/d1e/d37/d4e/f5f [0,4194304] 0 2023-12-16T07:40:27.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/894: getdents d2/de/d93 0 2023-12-16T07:40:27.319 INFO:tasks.workunit.client.0.smithi049.stdout:3/942: read d1/d2a/f32 [1448313,91911] 0 2023-12-16T07:40:27.320 INFO:tasks.workunit.client.0.smithi049.stdout:8/928: dread d0/d1f/f67 [0,4194304] 0 2023-12-16T07:40:27.322 INFO:tasks.workunit.client.0.smithi049.stdout:8/929: dread d0/d1f/d36/f54 [0,4194304] 0 2023-12-16T07:40:27.322 INFO:tasks.workunit.client.0.smithi049.stdout:8/930: chown d0/d1f/d56/l71 0 1 2023-12-16T07:40:27.323 INFO:tasks.workunit.client.0.smithi049.stdout:4/907: rename d2/db/ff2 to d2/db/dd/d52/d8c/d108/f117 0 2023-12-16T07:40:27.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/895: creat d2/d1d/d28/d56/d71/ddf/f132 x:0 0 0 2023-12-16T07:40:27.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/896: truncate d2/d26/d6e/f110 733521 0 2023-12-16T07:40:27.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/943: creat d1/d2a/d37/d3f/d5a/d61/d75/db7/d135/f140 x:0 0 0 2023-12-16T07:40:27.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/931: truncate d0/d1f/d4e/dbb/df7/f116 384359 0 2023-12-16T07:40:27.332 INFO:tasks.workunit.client.0.smithi049.stdout:2/897: rename d2/d26/d6e/f110 to d2/d1d/d28/d56/d11/d1c/f133 0 2023-12-16T07:40:27.333 INFO:tasks.workunit.client.0.smithi049.stdout:2/898: write d2/d1d/f68 [310794,53453] 0 2023-12-16T07:40:27.333 INFO:tasks.workunit.client.0.smithi049.stdout:3/944: creat d1/d2a/d37/d3f/d5a/d5b/d5e/f141 x:0 0 0 2023-12-16T07:40:27.334 INFO:tasks.workunit.client.0.smithi049.stdout:8/932: creat d0/d1f/d36/db8/de5/df2/f127 x:0 0 0 2023-12-16T07:40:27.335 INFO:tasks.workunit.client.0.smithi049.stdout:2/899: mkdir d2/de/d78/d134 0 2023-12-16T07:40:27.337 INFO:tasks.workunit.client.0.smithi049.stdout:2/900: mkdir d2/de/d78/dd9/d135 0 2023-12-16T07:40:27.338 INFO:tasks.workunit.client.0.smithi049.stdout:3/945: mkdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde/d142 0 2023-12-16T07:40:27.341 INFO:tasks.workunit.client.0.smithi049.stdout:4/908: dwrite d2/db/dd/de/d1e/d21/f40 [0,4194304] 0 2023-12-16T07:40:27.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/901: dread d2/d1d/d28/d56/d11/fac [0,4194304] 0 2023-12-16T07:40:27.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/933: dwrite d0/f12 [0,4194304] 0 2023-12-16T07:40:27.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/934: read d0/d13/d42/d5b/d68/d6b/da2/da5/ff3 [1050742,26677] 0 2023-12-16T07:40:27.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/935: dread - d0/d6a/fa4 zero size 2023-12-16T07:40:27.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/936: symlink d0/d1f/d4e/l128 0 2023-12-16T07:40:27.354 INFO:tasks.workunit.client.0.smithi049.stdout:8/937: getdents d0 0 2023-12-16T07:40:27.355 INFO:tasks.workunit.client.0.smithi049.stdout:8/938: creat d0/d1f/d36/db8/de5/f129 x:0 0 0 2023-12-16T07:40:27.356 INFO:tasks.workunit.client.0.smithi049.stdout:8/939: creat d0/d1f/d1c/d107/f12a x:0 0 0 2023-12-16T07:40:27.359 INFO:tasks.workunit.client.0.smithi049.stdout:3/946: dwrite d1/d2a/d37/d3f/d4c/f79 [0,4194304] 0 2023-12-16T07:40:27.361 INFO:tasks.workunit.client.0.smithi049.stdout:3/947: symlink d1/d2a/d37/d3f/d5a/d6d/l143 0 2023-12-16T07:40:27.362 INFO:tasks.workunit.client.0.smithi049.stdout:3/948: chown d1/c20 375896 1 2023-12-16T07:40:27.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/849: sync 2023-12-16T07:40:27.363 INFO:tasks.workunit.client.0.smithi049.stdout:3/949: creat d1/d2a/d37/d3f/d5a/d6d/f144 x:0 0 0 2023-12-16T07:40:27.363 INFO:tasks.workunit.client.0.smithi049.stdout:3/950: fdatasync d1/d2a/d37/db9/f121 0 2023-12-16T07:40:27.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/850: creat d4/db/f10a x:0 0 0 2023-12-16T07:40:27.365 INFO:tasks.workunit.client.0.smithi049.stdout:3/951: creat d1/d2a/d37/d3f/d4c/f145 x:0 0 0 2023-12-16T07:40:27.365 INFO:tasks.workunit.client.0.smithi049.stdout:9/851: mkdir d4/d7/d11/d10b 0 2023-12-16T07:40:27.366 INFO:tasks.workunit.client.0.smithi049.stdout:9/852: chown d4/d7/d11/d1d/d9b/la7 33931 1 2023-12-16T07:40:27.366 INFO:tasks.workunit.client.0.smithi049.stdout:3/952: mknod d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/c146 0 2023-12-16T07:40:27.366 INFO:tasks.workunit.client.0.smithi049.stdout:3/953: stat d1/d2a/d37/d3f/d5a/d5b/l10b 0 2023-12-16T07:40:27.366 INFO:tasks.workunit.client.0.smithi049.stdout:3/954: truncate d1/d2a/d37/d3f/f5d 4988319 0 2023-12-16T07:40:27.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/853: rename d4/d7/d11/db3/d8a/fac to d4/d7/d11/d56/f10c 0 2023-12-16T07:40:27.368 INFO:tasks.workunit.client.0.smithi049.stdout:3/955: unlink d1/d2a/d37/d3f/d5a/d61/c11f 0 2023-12-16T07:40:27.369 INFO:tasks.workunit.client.0.smithi049.stdout:9/854: mkdir d4/d7/d11/d1d/d69/d76/d83/d10d 0 2023-12-16T07:40:27.369 INFO:tasks.workunit.client.0.smithi049.stdout:9/855: fsync d4/d7/d11/db3/d59/fcb 0 2023-12-16T07:40:27.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/956: read d1/d2a/f32 [844354,102191] 0 2023-12-16T07:40:27.370 INFO:tasks.workunit.client.0.smithi049.stdout:9/856: creat d4/d7/d11/d1d/d69/d76/d83/d10d/f10e x:0 0 0 2023-12-16T07:40:27.371 INFO:tasks.workunit.client.0.smithi049.stdout:3/957: link d1/d2a/d37/d3f/d5a/d61/d75/f83 d1/d2a/d37/d3f/d5a/d61/d75/db7/d135/f147 0 2023-12-16T07:40:27.371 INFO:tasks.workunit.client.0.smithi049.stdout:9/857: creat d4/d7/d11/d1d/d9b/f10f x:0 0 0 2023-12-16T07:40:27.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/958: dread d1/d2a/d37/d3f/d5a/d61/d6b/f72 [0,4194304] 0 2023-12-16T07:40:27.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/968: sync 2023-12-16T07:40:27.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/969: write d7/d2b/d59/f5e [579916,130831] 0 2023-12-16T07:40:27.392 INFO:tasks.workunit.client.0.smithi049.stdout:7/970: truncate d7/db4/d10f/d150/d153/d35/d36/f3e 3090618 0 2023-12-16T07:40:27.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/971: mkdir d7/dc/d156 0 2023-12-16T07:40:27.394 INFO:tasks.workunit.client.0.smithi049.stdout:7/972: write d7/fb [2866876,2582] 0 2023-12-16T07:40:27.396 INFO:tasks.workunit.client.0.smithi049.stdout:7/973: creat d7/db4/d10f/d150/d153/d27/f157 x:0 0 0 2023-12-16T07:40:27.400 INFO:tasks.workunit.client.0.smithi049.stdout:3/959: dwrite d1/d2a/d37/d3f/d4c/f12e [0,4194304] 0 2023-12-16T07:40:27.401 INFO:tasks.workunit.client.0.smithi049.stdout:3/960: fdatasync d1/d2a/d37/f55 0 2023-12-16T07:40:27.402 INFO:tasks.workunit.client.0.smithi049.stdout:7/974: dread d7/db4/d10f/d150/d153/d35/d36/f7d [0,4194304] 0 2023-12-16T07:40:27.402 INFO:tasks.workunit.client.0.smithi049.stdout:3/961: mkdir d1/d2a/d37/d3f/d5a/d5b/d77/dd5/d148 0 2023-12-16T07:40:27.404 INFO:tasks.workunit.client.0.smithi049.stdout:3/962: read d1/d2a/d37/d3f/d5a/d61/d6b/f106 [1650387,122570] 0 2023-12-16T07:40:27.405 INFO:tasks.workunit.client.0.smithi049.stdout:3/963: write d1/d2a/d37/d3f/d5a/d5b/d77/dc4/f119 [3160563,51276] 0 2023-12-16T07:40:27.406 INFO:tasks.workunit.client.0.smithi049.stdout:3/964: dread - d1/d2a/d37/d3f/dcc/f127 zero size 2023-12-16T07:40:27.406 INFO:tasks.workunit.client.0.smithi049.stdout:3/965: rmdir d1 39 2023-12-16T07:40:27.408 INFO:tasks.workunit.client.0.smithi049.stdout:3/966: unlink d1/f18 0 2023-12-16T07:40:27.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/967: link d1/d2a/d37/d3f/d5a/d5b/d77/fbf d1/d2a/df4/f149 0 2023-12-16T07:40:27.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/858: sync 2023-12-16T07:40:27.412 INFO:tasks.workunit.client.0.smithi049.stdout:4/909: sync 2023-12-16T07:40:27.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/940: sync 2023-12-16T07:40:27.412 INFO:tasks.workunit.client.0.smithi049.stdout:2/902: sync 2023-12-16T07:40:27.412 INFO:tasks.workunit.client.0.smithi049.stdout:9/859: fsync d4/f85 0 2023-12-16T07:40:27.412 INFO:tasks.workunit.client.0.smithi049.stdout:4/910: chown d2/db/dd/de/d1e/d37/dcf/ff5 22296996 1 2023-12-16T07:40:27.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/941: write d0/fb2 [1821628,55619] 0 2023-12-16T07:40:27.416 INFO:tasks.workunit.client.0.smithi049.stdout:4/911: link d2/db/dd/de/d1e/d37/d4e/cbe d2/db/dd/de/d1e/d37/dcf/c118 0 2023-12-16T07:40:27.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/903: dread d2/d1d/d28/d56/d11/fac [0,4194304] 0 2023-12-16T07:40:27.416 INFO:tasks.workunit.client.0.smithi049.stdout:8/942: write d0/f12 [3061912,111833] 0 2023-12-16T07:40:27.416 INFO:tasks.workunit.client.0.smithi049.stdout:7/975: dwrite d7/dc/d6b/d105/f10d [0,4194304] 0 2023-12-16T07:40:27.416 INFO:tasks.workunit.client.0.smithi049.stdout:7/976: write d7/dc/d6b/dbf/dd3/fe1 [744789,20009] 0 2023-12-16T07:40:27.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/904: mkdir d2/de/df2/d136 0 2023-12-16T07:40:27.417 INFO:tasks.workunit.client.0.smithi049.stdout:8/943: creat d0/d1f/d56/f12b x:0 0 0 2023-12-16T07:40:27.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/977: creat d7/db4/d10f/d150/d153/d37/d5c/d143/f158 x:0 0 0 2023-12-16T07:40:27.424 INFO:tasks.workunit.client.0.smithi049.stdout:2/905: creat d2/de/f137 x:0 0 0 2023-12-16T07:40:27.424 INFO:tasks.workunit.client.0.smithi049.stdout:8/944: creat d0/f12c x:0 0 0 2023-12-16T07:40:27.424 INFO:tasks.workunit.client.0.smithi049.stdout:7/978: stat d7/db4/d10f/d150/d153/d27/d8e/f13e 0 2023-12-16T07:40:27.424 INFO:tasks.workunit.client.0.smithi049.stdout:2/906: dread - d2/d1d/d24/d55/fe3 zero size 2023-12-16T07:40:27.427 INFO:tasks.workunit.client.0.smithi049.stdout:8/945: write d0/d1f/f82 [708178,42603] 0 2023-12-16T07:40:27.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/946: dread d0/d6a/dda/f94 [0,4194304] 0 2023-12-16T07:40:27.429 INFO:tasks.workunit.client.0.smithi049.stdout:2/907: creat d2/d1d/d38/f138 x:0 0 0 2023-12-16T07:40:27.429 INFO:tasks.workunit.client.0.smithi049.stdout:2/908: readlink d2/d1d/d24/d55/d7c/d98/lad 0 2023-12-16T07:40:27.429 INFO:tasks.workunit.client.0.smithi049.stdout:2/909: readlink d2/d1d/d28/d56/d71/ddf/lc1 0 2023-12-16T07:40:27.431 INFO:tasks.workunit.client.0.smithi049.stdout:8/947: truncate d0/d1f/d36/fdd 4163361 0 2023-12-16T07:40:27.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/910: creat d2/d1d/d24/d55/df5/f139 x:0 0 0 2023-12-16T07:40:27.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/911: read - d2/db8/db9/fd0 zero size 2023-12-16T07:40:27.435 INFO:tasks.workunit.client.0.smithi049.stdout:8/948: getdents d0/d13/d42/de6 0 2023-12-16T07:40:27.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/949: chown d0/d1f/c97 0 1 2023-12-16T07:40:27.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/950: fdatasync d0/d13/d42/d5b/d68/d6b/dd6/f10a 0 2023-12-16T07:40:27.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/951: truncate d0/d13/fd 3516500 0 2023-12-16T07:40:27.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/952: creat d0/d13/d42/d5b/d68/d6b/da2/f12d x:0 0 0 2023-12-16T07:40:27.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/953: dread - d0/f12c zero size 2023-12-16T07:40:27.439 INFO:tasks.workunit.client.0.smithi049.stdout:8/954: write d0/d13/d42/d5b/dab/faa [166695,118242] 0 2023-12-16T07:40:27.440 INFO:tasks.workunit.client.0.smithi049.stdout:8/955: unlink d0/d13/d42/de6/l118 0 2023-12-16T07:40:27.440 INFO:tasks.workunit.client.0.smithi049.stdout:8/956: read - d0/d13/f120 zero size 2023-12-16T07:40:27.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/968: dwrite d1/d2a/d37/d3f/d4c/f145 [0,4194304] 0 2023-12-16T07:40:27.445 INFO:tasks.workunit.client.0.smithi049.stdout:4/912: dwrite d2/db/dd/db7/fc1 [0,4194304] 0 2023-12-16T07:40:27.445 INFO:tasks.workunit.client.0.smithi049.stdout:4/913: chown d2/db/d6b/dc8/cdc 37 1 2023-12-16T07:40:27.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/860: dwrite d4/d7/d11/db3/f77 [0,4194304] 0 2023-12-16T07:40:27.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/969: creat d1/d2a/d37/d3f/d5a/d61/d75/db7/d12d/f14a x:0 0 0 2023-12-16T07:40:27.456 INFO:tasks.workunit.client.0.smithi049.stdout:9/861: dread d4/d7/d11/db3/f77 [0,4194304] 0 2023-12-16T07:40:27.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/957: dwrite d0/d1f/d56/f74 [0,4194304] 0 2023-12-16T07:40:27.458 INFO:tasks.workunit.client.0.smithi049.stdout:3/970: mkdir d1/d2a/d37/d3f/d5a/d5b/d77/dd5/d14b 0 2023-12-16T07:40:27.460 INFO:tasks.workunit.client.0.smithi049.stdout:3/971: write d1/d2a/d37/d3f/d5a/d61/d75/db7/d135/f147 [3671182,1] 0 2023-12-16T07:40:27.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/862: write d4/d7/d11/db3/d8a/f5a [545161,43645] 0 2023-12-16T07:40:27.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/863: stat d4/d7/d11/db3/d59/f70 0 2023-12-16T07:40:27.461 INFO:tasks.workunit.client.0.smithi049.stdout:4/914: dwrite d2/db/dd/de/d1e/fce [0,4194304] 0 2023-12-16T07:40:27.461 INFO:tasks.workunit.client.0.smithi049.stdout:4/915: stat d2/db/dd/de/d1e/d37/fbf 0 2023-12-16T07:40:27.461 INFO:tasks.workunit.client.0.smithi049.stdout:8/958: symlink d0/d1f/d36/db8/de5/df2/l12e 0 2023-12-16T07:40:27.464 INFO:tasks.workunit.client.0.smithi049.stdout:9/864: creat d4/db/f110 x:0 0 0 2023-12-16T07:40:27.465 INFO:tasks.workunit.client.0.smithi049.stdout:4/916: creat d2/db/dd/de/d1e/d44/f119 x:0 0 0 2023-12-16T07:40:27.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/959: mkdir d0/d13/d42/d5b/d68/d6b/da2/d12f 0 2023-12-16T07:40:27.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/960: dread - d0/d13/f120 zero size 2023-12-16T07:40:27.470 INFO:tasks.workunit.client.0.smithi049.stdout:4/917: mknod d2/db/dd/de/d1e/d37/c11a 0 2023-12-16T07:40:27.470 INFO:tasks.workunit.client.0.smithi049.stdout:4/918: dread - d2/db/d6b/dad/fd7 zero size 2023-12-16T07:40:27.470 INFO:tasks.workunit.client.0.smithi049.stdout:4/919: fdatasync d2/db/dd/d2a/f43 0 2023-12-16T07:40:27.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/961: mknod d0/d6a/c130 0 2023-12-16T07:40:27.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/962: dread - d0/d1f/d36/fe0 zero size 2023-12-16T07:40:27.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/920: dread d2/fe5 [0,4194304] 0 2023-12-16T07:40:27.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/921: truncate d2/db/dd/d52/fa8 156228 0 2023-12-16T07:40:27.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/922: chown d2/db/dd/d52/fa8 375 1 2023-12-16T07:40:27.481 INFO:tasks.workunit.client.0.smithi049.stdout:4/923: symlink d2/db/d6b/dc8/l11b 0 2023-12-16T07:40:27.481 INFO:tasks.workunit.client.0.smithi049.stdout:4/924: symlink d2/db/d6b/db9/l11c 0 2023-12-16T07:40:27.483 INFO:tasks.workunit.client.0.smithi049.stdout:3/972: dwrite d1/d2a/d37/d3f/dcc/f127 [0,4194304] 0 2023-12-16T07:40:27.486 INFO:tasks.workunit.client.0.smithi049.stdout:9/865: dwrite d4/d7/d11/d1d/d5b/dbe/dc4/fc7 [0,4194304] 0 2023-12-16T07:40:27.486 INFO:tasks.workunit.client.0.smithi049.stdout:9/866: chown d4/d7/d11/d3f/l4b 62729473 1 2023-12-16T07:40:27.489 INFO:tasks.workunit.client.0.smithi049.stdout:9/867: creat d4/db2/f111 x:0 0 0 2023-12-16T07:40:27.490 INFO:tasks.workunit.client.0.smithi049.stdout:9/868: symlink d4/d7/d11/d1d/d5b/l112 0 2023-12-16T07:40:27.491 INFO:tasks.workunit.client.0.smithi049.stdout:7/979: sync 2023-12-16T07:40:27.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/912: sync 2023-12-16T07:40:27.491 INFO:tasks.workunit.client.0.smithi049.stdout:9/869: creat d4/d7/d11/d1d/d48/f113 x:0 0 0 2023-12-16T07:40:27.492 INFO:tasks.workunit.client.0.smithi049.stdout:2/913: truncate d2/de/d77/f99 68324 0 2023-12-16T07:40:27.494 INFO:tasks.workunit.client.0.smithi049.stdout:9/870: unlink d4/d7/d11/d26/d80/fa3 0 2023-12-16T07:40:27.496 INFO:tasks.workunit.client.0.smithi049.stdout:2/914: getdents d2/d26/d6e 0 2023-12-16T07:40:27.496 INFO:tasks.workunit.client.0.smithi049.stdout:2/915: write d2/d1d/d24/d55/d76/fa2 [1159962,90518] 0 2023-12-16T07:40:27.498 INFO:tasks.workunit.client.0.smithi049.stdout:4/925: dwrite d2/db/dd/de/d1e/d37/da4/f7b [0,4194304] 0 2023-12-16T07:40:27.500 INFO:tasks.workunit.client.0.smithi049.stdout:2/916: rmdir d2/d1d/d24/d11a/d12f 0 2023-12-16T07:40:27.501 INFO:tasks.workunit.client.0.smithi049.stdout:4/926: symlink d2/db/dd/de/d1e/d37/d82/dd4/l11d 0 2023-12-16T07:40:27.502 INFO:tasks.workunit.client.0.smithi049.stdout:4/927: rmdir d2/db/dd/de/d1e/d37/d82/dd4 39 2023-12-16T07:40:27.502 INFO:tasks.workunit.client.0.smithi049.stdout:4/928: chown d2/db/dd/de/d1e/d37/da4/l101 117897513 1 2023-12-16T07:40:27.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/929: getdents d2/db/dd/de/d1e/d21 0 2023-12-16T07:40:27.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/871: rename d4/d7/d11/d26/d80 to d4/d7/d11/d1d/d82/d114 0 2023-12-16T07:40:27.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/872: getdents d4/d7/d11/d10b 0 2023-12-16T07:40:27.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/873: write d4/d7/d11/d26/f8c [270153,113226] 0 2023-12-16T07:40:27.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/874: fdatasync d4/db/f97 0 2023-12-16T07:40:27.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/875: creat d4/d7/d11/d10b/f115 x:0 0 0 2023-12-16T07:40:27.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/876: rename d4/d7/d11/d26/c5e to d4/db2/c116 0 2023-12-16T07:40:27.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/980: dwrite d7/db4/d10f/d150/d153/d37/d5c/ff4 [0,4194304] 0 2023-12-16T07:40:27.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/981: dread - d7/dc/d15/d57/f112 zero size 2023-12-16T07:40:27.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/982: dread - d7/db4/d10f/d150/d153/d27/dba/f14e zero size 2023-12-16T07:40:27.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/983: chown d7/db4/d10f/d150/d153/d27/f157 70 1 2023-12-16T07:40:27.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/984: getdents d7 0 2023-12-16T07:40:27.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/985: chown d7/dc/d6b/dbf/dd3/f10e 1636171356 1 2023-12-16T07:40:27.512 INFO:tasks.workunit.client.0.smithi049.stdout:4/930: dread d2/db/dd/de/d1e/fce [0,4194304] 0 2023-12-16T07:40:27.512 INFO:tasks.workunit.client.0.smithi049.stdout:9/877: creat d4/db/f117 x:0 0 0 2023-12-16T07:40:27.512 INFO:tasks.workunit.client.0.smithi049.stdout:4/931: fdatasync d2/db/dd/de/d1e/d44/f119 0 2023-12-16T07:40:27.512 INFO:tasks.workunit.client.0.smithi049.stdout:4/932: chown d2/db/dd/de/d1e/d37/c11a 3 1 2023-12-16T07:40:27.513 INFO:tasks.workunit.client.0.smithi049.stdout:7/986: creat d7/db4/d10f/d150/d153/d37/d5c/db2/d106/f159 x:0 0 0 2023-12-16T07:40:27.513 INFO:tasks.workunit.client.0.smithi049.stdout:7/987: chown d7/db4/d10f/d150/d153/d37/d5c/db2/l11f 16287 1 2023-12-16T07:40:27.513 INFO:tasks.workunit.client.0.smithi049.stdout:9/878: read d4/db/f5d [1085082,94002] 0 2023-12-16T07:40:27.514 INFO:tasks.workunit.client.0.smithi049.stdout:2/917: dread d2/d1d/d38/f4b [0,4194304] 0 2023-12-16T07:40:27.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/988: mknod d7/db4/d10f/d150/d153/d37/d5c/c15a 0 2023-12-16T07:40:27.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/989: write d7/db4/d10f/d150/d153/d27/dba/fe3 [1041982,8436] 0 2023-12-16T07:40:27.533 INFO:tasks.workunit.client.0.smithi049.stdout:7/990: dwrite d7/f67 [0,4194304] 0 2023-12-16T07:40:27.534 INFO:tasks.workunit.client.0.smithi049.stdout:7/991: creat d7/dc/d6b/dbf/f15b x:0 0 0 2023-12-16T07:40:27.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/933: dwrite d2/db/dd/de/d1e/d44/fb8 [0,4194304] 0 2023-12-16T07:40:27.538 INFO:tasks.workunit.client.0.smithi049.stdout:9/879: dwrite d4/d7/d11/d1d/d5b/dbe/ffb [0,4194304] 0 2023-12-16T07:40:27.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/934: mkdir d2/db/dd/de/d1e/d37/da4/de1/df6/d11e 0 2023-12-16T07:40:27.543 INFO:tasks.workunit.client.0.smithi049.stdout:4/935: mkdir d2/db/dd/de/d1e/d37/d4e/d11f 0 2023-12-16T07:40:27.543 INFO:tasks.workunit.client.0.smithi049.stdout:4/936: write d2/db/d6b/db9/fc6 [2963008,92611] 0 2023-12-16T07:40:27.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/937: unlink d2/db/l2e 0 2023-12-16T07:40:27.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/938: fdatasync d2/db/dd/de/d1e/d21/f39 0 2023-12-16T07:40:27.548 INFO:tasks.workunit.client.0.smithi049.stdout:4/939: mknod d2/db/dd/de/d1e/d37/da4/de1/df6/d11e/c120 0 2023-12-16T07:40:27.551 INFO:tasks.workunit.client.0.smithi049.stdout:4/940: read d2/f12 [2127031,85742] 0 2023-12-16T07:40:27.552 INFO:tasks.workunit.client.0.smithi049.stdout:4/941: write d2/db/dd/de/d1e/d37/faa [2343029,28978] 0 2023-12-16T07:40:27.552 INFO:tasks.workunit.client.0.smithi049.stdout:4/942: fdatasync d2/f86 0 2023-12-16T07:40:27.558 INFO:tasks.workunit.client.0.smithi049.stdout:7/992: dwrite d7/dc/d2f/f9f [4194304,4194304] 0 2023-12-16T07:40:27.559 INFO:tasks.workunit.client.0.smithi049.stdout:9/880: dwrite d4/db/f110 [0,4194304] 0 2023-12-16T07:40:27.562 INFO:tasks.workunit.client.0.smithi049.stdout:9/881: truncate d4/f85 696585 0 2023-12-16T07:40:27.563 INFO:tasks.workunit.client.0.smithi049.stdout:9/882: write d4/d3e/f6e [3072598,88815] 0 2023-12-16T07:40:27.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/883: symlink d4/d7/d11/d26/l118 0 2023-12-16T07:40:27.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/884: chown d4/d7/d11/d1d/d5b/d8b 229 1 2023-12-16T07:40:27.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/885: readlink d4/db/lb0 0 2023-12-16T07:40:27.566 INFO:tasks.workunit.client.0.smithi049.stdout:9/886: rmdir d4/d7/d11/d1d/d5b/d8b/dd2 0 2023-12-16T07:40:27.567 INFO:tasks.workunit.client.0.smithi049.stdout:4/943: dwrite d2/db/dd/fbb [0,4194304] 0 2023-12-16T07:40:27.568 INFO:tasks.workunit.client.0.smithi049.stdout:4/944: chown d2/f28 10229961 1 2023-12-16T07:40:27.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/887: rename d4/d7/d11/d1d/d69/d76/d83/faf to d4/d7/d11/db3/f119 0 2023-12-16T07:40:27.572 INFO:tasks.workunit.client.0.smithi049.stdout:4/945: mkdir d2/db/dd/d9f/d121 0 2023-12-16T07:40:27.572 INFO:tasks.workunit.client.0.smithi049.stdout:4/946: chown d2/db/d6b/db9/de4/fea 224 1 2023-12-16T07:40:27.572 INFO:tasks.workunit.client.0.smithi049.stdout:4/947: chown d2/db/dd/de/d1e/d21/de7/lf9 535350 1 2023-12-16T07:40:27.573 INFO:tasks.workunit.client.0.smithi049.stdout:9/888: creat d4/d7/d11/d1d/d69/d76/d83/d10d/f11a x:0 0 0 2023-12-16T07:40:27.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/889: creat d4/db2/f11b x:0 0 0 2023-12-16T07:40:27.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/890: symlink d4/d7/d11/d1d/d69/d76/d83/l11c 0 2023-12-16T07:40:27.580 INFO:tasks.workunit.client.0.smithi049.stdout:9/891: dread d4/d7/d11/db3/f77 [0,4194304] 0 2023-12-16T07:40:27.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/892: mkdir d4/d3e/d11d 0 2023-12-16T07:40:27.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/893: write d4/d7/d11/db3/d8a/fc9 [1568185,82264] 0 2023-12-16T07:40:27.583 INFO:tasks.workunit.client.0.smithi049.stdout:8/963: sync 2023-12-16T07:40:27.583 INFO:tasks.workunit.client.0.smithi049.stdout:3/973: sync 2023-12-16T07:40:27.583 INFO:tasks.workunit.client.0.smithi049.stdout:3/974: readlink d1/l3a 0 2023-12-16T07:40:27.584 INFO:tasks.workunit.client.0.smithi049.stdout:8/964: dread d0/d13/d42/f102 [0,4194304] 0 2023-12-16T07:40:27.586 INFO:tasks.workunit.client.0.smithi049.stdout:9/894: dread d4/db/f97 [0,4194304] 0 2023-12-16T07:40:27.586 INFO:tasks.workunit.client.0.smithi049.stdout:8/965: rename d0/d13/d42/d5b/d68/d6b/fae to d0/d13/d42/d5b/f131 0 2023-12-16T07:40:27.587 INFO:tasks.workunit.client.0.smithi049.stdout:9/895: symlink d4/d7/d11/d56/l11e 0 2023-12-16T07:40:27.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/896: mknod d4/d7/d11/d1d/d9b/c11f 0 2023-12-16T07:40:27.589 INFO:tasks.workunit.client.0.smithi049.stdout:9/897: symlink d4/d7/d11/d1d/d69/d76/d83/ddf/l120 0 2023-12-16T07:40:27.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/898: write d4/d7/d11/db3/d59/f70 [1540171,115021] 0 2023-12-16T07:40:27.592 INFO:tasks.workunit.client.0.smithi049.stdout:9/899: mknod d4/d7/d11/d1d/d69/d76/d83/de4/c121 0 2023-12-16T07:40:27.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/900: chown d4/d7/d11/d1d/d69/d76/d83/l84 14 1 2023-12-16T07:40:27.605 INFO:tasks.workunit.client.0.smithi049.stdout:3/975: dwrite d1/d2a/d37/d3f/d5a/de7/d11b/f109 [0,4194304] 0 2023-12-16T07:40:27.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/966: dwrite d0/d1f/db7/d111/f11a [0,4194304] 0 2023-12-16T07:40:27.607 INFO:tasks.workunit.client.0.smithi049.stdout:3/976: symlink d1/d2a/d37/d12c/l14c 0 2023-12-16T07:40:27.608 INFO:tasks.workunit.client.0.smithi049.stdout:3/977: chown d1/d2a/d37/d3f/d5a/d5b/d77 367 1 2023-12-16T07:40:27.609 INFO:tasks.workunit.client.0.smithi049.stdout:3/978: getdents d1/d2a/d37/d3f/dcc/de8 0 2023-12-16T07:40:27.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/979: symlink d1/d2a/d37/d3f/d5a/d5b/l14d 0 2023-12-16T07:40:27.617 INFO:tasks.workunit.client.0.smithi049.stdout:3/980: fdatasync d1/d2a/d37/d3f/d5a/de7/d11b/f65 0 2023-12-16T07:40:27.620 INFO:tasks.workunit.client.0.smithi049.stdout:3/981: creat d1/d2a/d37/d3f/d5a/d5b/d77/dc4/f14e x:0 0 0 2023-12-16T07:40:27.621 INFO:tasks.workunit.client.0.smithi049.stdout:3/982: creat d1/d2a/d37/d3f/d5a/d5b/d77/dd5/d14b/f14f x:0 0 0 2023-12-16T07:40:27.622 INFO:tasks.workunit.client.0.smithi049.stdout:3/983: chown d1/d2a/d37/d3f/d5a 52435770 1 2023-12-16T07:40:27.622 INFO:tasks.workunit.client.0.smithi049.stdout:3/984: readlink d1/d2a/d37/d3f/d5a/d61/d6b/lbe 0 2023-12-16T07:40:27.622 INFO:tasks.workunit.client.0.smithi049.stdout:3/985: dread d1/d2a/f47 [0,4194304] 0 2023-12-16T07:40:27.624 INFO:tasks.workunit.client.0.smithi049.stdout:3/986: dread d1/f44 [0,4194304] 0 2023-12-16T07:40:27.624 INFO:tasks.workunit.client.0.smithi049.stdout:3/987: fsync d1/f16 0 2023-12-16T07:40:27.625 INFO:tasks.workunit.client.0.smithi049.stdout:3/988: mkdir d1/d2a/d37/d12c/d150 0 2023-12-16T07:40:27.626 INFO:tasks.workunit.client.0.smithi049.stdout:3/989: mkdir d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/dde/d142/d151 0 2023-12-16T07:40:27.626 INFO:tasks.workunit.client.0.smithi049.stdout:3/990: chown d1/d2a/d37/d3f/d5a/d61/d75/db7/d12d/l134 831 1 2023-12-16T07:40:27.630 INFO:tasks.workunit.client.0.smithi049.stdout:9/901: dwrite d4/d7/d11/db3/d59/f70 [0,4194304] 0 2023-12-16T07:40:27.630 INFO:tasks.workunit.client.0.smithi049.stdout:9/902: fdatasync d4/d7/d11/db3/d8a/fa5 0 2023-12-16T07:40:27.630 INFO:tasks.workunit.client.0.smithi049.stdout:9/903: dread - d4/d7/d11/db3/f119 zero size 2023-12-16T07:40:27.630 INFO:tasks.workunit.client.0.smithi049.stdout:8/967: dwrite d0/d1f/d4e/dbb/ff5 [0,4194304] 0 2023-12-16T07:40:27.631 INFO:tasks.workunit.client.0.smithi049.stdout:8/968: chown d0/d13/d42/d5b/f63 645080264 1 2023-12-16T07:40:27.637 INFO:tasks.workunit.client.0.smithi049.stdout:2/918: sync 2023-12-16T07:40:27.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/904: dread d4/d7/d11/d1d/d69/f9d [0,4194304] 0 2023-12-16T07:40:27.638 INFO:tasks.workunit.client.0.smithi049.stdout:9/905: readlink d4/d7/d11/d56/d7f/la8 0 2023-12-16T07:40:27.639 INFO:tasks.workunit.client.0.smithi049.stdout:2/919: mknod d2/de/d78/dd9/c13a 0 2023-12-16T07:40:27.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/906: creat d4/d7/d11/db3/f122 x:0 0 0 2023-12-16T07:40:27.641 INFO:tasks.workunit.client.0.smithi049.stdout:2/920: creat d2/d1d/d24/d11a/d128/f13b x:0 0 0 2023-12-16T07:40:27.641 INFO:tasks.workunit.client.0.smithi049.stdout:2/921: write d2/d1d/d24/fbb [491733,125341] 0 2023-12-16T07:40:27.641 INFO:tasks.workunit.client.0.smithi049.stdout:2/922: stat d2/d26/d6e/l5b 0 2023-12-16T07:40:27.642 INFO:tasks.workunit.client.0.smithi049.stdout:2/923: creat d2/d1d/f13c x:0 0 0 2023-12-16T07:40:27.643 INFO:tasks.workunit.client.0.smithi049.stdout:2/924: link d2/d1d/f9a d2/d26/d43/f13d 0 2023-12-16T07:40:27.644 INFO:tasks.workunit.client.0.smithi049.stdout:2/925: creat d2/d1d/d28/d56/d66/d6b/f13e x:0 0 0 2023-12-16T07:40:27.644 INFO:tasks.workunit.client.0.smithi049.stdout:2/926: truncate d2/d1d/d24/d55/d76/fe2 734342 0 2023-12-16T07:40:27.645 INFO:tasks.workunit.client.0.smithi049.stdout:3/991: dwrite d1/d2a/f32 [0,4194304] 0 2023-12-16T07:40:27.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/927: link d2/d1d/d38/lf6 d2/de/d78/dd9/l13f 0 2023-12-16T07:40:27.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/928: truncate d2/d1d/d28/d56/d11/fac 802658 0 2023-12-16T07:40:27.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/992: symlink d1/d2a/d37/l152 0 2023-12-16T07:40:27.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/993: readlink d1/d2a/d37/d3f/d5a/d61/d6b/da1/d88/d8e/la0 0 2023-12-16T07:40:27.648 INFO:tasks.workunit.client.0.smithi049.stdout:3/994: symlink d1/d2a/d37/d3f/d5a/d6d/d96/l153 0 2023-12-16T07:40:27.649 INFO:tasks.workunit.client.0.smithi049.stdout:3/995: truncate d1/f2c 3917273 0 2023-12-16T07:40:27.649 INFO:tasks.workunit.client.0.smithi049.stdout:3/996: write d1/d2a/d37/d3f/d5a/d6d/fff [310265,81323] 0 2023-12-16T07:40:27.651 INFO:tasks.workunit.client.0.smithi049.stdout:8/969: dwrite d0/d1f/db7/dbe/fcd [0,4194304] 0 2023-12-16T07:40:27.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/997: rename d1/d2a/d37/d3f/d4c/fbb to d1/d2a/d37/d3f/d5a/d61/f154 0 2023-12-16T07:40:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:2/929: dwrite d2/d1d/d28/d56/d11/da8/f102 [0,4194304] 0 2023-12-16T07:40:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/998: unlink d1/d2a/d37/d3f/d4c/l123 0 2023-12-16T07:40:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:8/970: dread d0/d1f/fac [0,4194304] 0 2023-12-16T07:40:27.660 INFO:tasks.workunit.client.0.smithi049.stdout:8/971: truncate d0/d1f/db7/dbe/fcd 4442175 0 2023-12-16T07:40:27.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/930: dread d2/d1d/d24/d55/d7c/d98/da1/fa7 [0,4194304] 0 2023-12-16T07:40:27.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/931: write d2/d1d/d28/d56/d11/f67 [842647,10633] 0 2023-12-16T07:40:27.662 INFO:tasks.workunit.client.0.smithi049.stdout:3/999: truncate d1/d2a/d37/d3f/d5a/d6d/d96/fa2 2674553 0 2023-12-16T07:40:27.664 INFO:tasks.workunit.client.0.smithi049.stdout:8/972: link d0/d13/d42/d5b/d68/d6b/l9e d0/d13/d42/d5b/d68/d6b/dd6/l132 0 2023-12-16T07:40:27.664 INFO:tasks.workunit.client.0.smithi049.stdout:8/973: truncate d0/d13/d42/d5b/f63 1167179 0 2023-12-16T07:40:27.664 INFO:tasks.workunit.client.0.smithi049.stdout:8/974: fdatasync d0/d1f/f22 0 2023-12-16T07:40:27.666 INFO:tasks.workunit.client.0.smithi049.stdout:8/975: mkdir d0/d13/d42/de6/d133 0 2023-12-16T07:40:27.666 INFO:tasks.workunit.client.0.smithi049.stdout:8/976: read d0/f12 [3095197,95450] 0 2023-12-16T07:40:27.668 INFO:tasks.workunit.client.0.smithi049.stdout:8/977: stat d0/d1f/d4e/dbb/df7/cfc 0 2023-12-16T07:40:27.668 INFO:tasks.workunit.client.0.smithi049.stdout:7/993: sync 2023-12-16T07:40:27.671 INFO:tasks.workunit.client.0.smithi049.stdout:7/994: unlink d7/db4/d10f/d150/d153/d35/f126 0 2023-12-16T07:40:27.671 INFO:tasks.workunit.client.0.smithi049.stdout:4/948: sync 2023-12-16T07:40:27.678 INFO:tasks.workunit.client.0.smithi049.stdout:2/932: dwrite d2/d1d/d38/fbf [0,4194304] 0 2023-12-16T07:40:27.681 INFO:tasks.workunit.client.0.smithi049.stdout:2/933: read d2/d1d/fab [3192822,128736] 0 2023-12-16T07:40:27.684 INFO:tasks.workunit.client.0.smithi049.stdout:2/934: creat d2/d1d/d24/d55/f140 x:0 0 0 2023-12-16T07:40:27.684 INFO:tasks.workunit.client.0.smithi049.stdout:2/935: write d2/d1d/d28/d56/d71/ddf/f132 [545600,51817] 0 2023-12-16T07:40:27.684 INFO:tasks.workunit.client.0.smithi049.stdout:7/995: dwrite d7/dc/d6b/d105/f13d [0,4194304] 0 2023-12-16T07:40:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/996: write d7/db4/d10f/d150/d153/d37/d5c/d143/f96 [4534410,29052] 0 2023-12-16T07:40:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/997: chown d7/db4/f114 0 1 2023-12-16T07:40:27.685 INFO:tasks.workunit.client.0.smithi049.stdout:2/936: creat d2/d1d/d28/f141 x:0 0 0 2023-12-16T07:40:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/998: dread d7/dc/d6b/dbf/dd3/f10e [0,4194304] 0 2023-12-16T07:40:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/999: chown d7/dc/c21 55054 1 2023-12-16T07:40:27.687 INFO:tasks.workunit.client.0.smithi049.stdout:2/937: mknod d2/d1d/d24/d55/d7c/d98/da1/c142 0 2023-12-16T07:40:27.705 INFO:tasks.workunit.client.0.smithi049.stdout:9/907: sync 2023-12-16T07:40:27.706 INFO:tasks.workunit.client.0.smithi049.stdout:9/908: symlink d4/d7/d11/d10b/l123 0 2023-12-16T07:40:27.706 INFO:tasks.workunit.client.0.smithi049.stdout:9/909: write d4/db2/f111 [170212,112786] 0 2023-12-16T07:40:27.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/910: link d4/d7/d11/f16 d4/d7/d11/d3f/f124 0 2023-12-16T07:40:27.755 INFO:tasks.workunit.client.0.smithi049.stdout:8/978: sync 2023-12-16T07:40:27.756 INFO:tasks.workunit.client.0.smithi049.stdout:8/979: symlink d0/d6a/dda/d101/l134 0 2023-12-16T07:40:27.756 INFO:tasks.workunit.client.0.smithi049.stdout:8/980: mkdir d0/d1f/db7/d111/d135 0 2023-12-16T07:40:27.757 INFO:tasks.workunit.client.0.smithi049.stdout:8/981: chown d0/d1f/d1c/c4a 13006 1 2023-12-16T07:40:27.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/982: getdents d0/d1f/d36/db8/de5 0 2023-12-16T07:40:27.774 INFO:tasks.workunit.client.0.smithi049.stdout:8/983: dwrite d0/d1f/d4e/f8b [0,4194304] 0 2023-12-16T07:40:27.775 INFO:tasks.workunit.client.0.smithi049.stdout:2/938: sync 2023-12-16T07:40:27.775 INFO:tasks.workunit.client.0.smithi049.stdout:9/911: sync 2023-12-16T07:40:27.775 INFO:tasks.workunit.client.0.smithi049.stdout:4/949: sync 2023-12-16T07:40:27.775 INFO:tasks.workunit.client.0.smithi049.stdout:4/950: getdents d2/db/dd/de/d1e/dfe 0 2023-12-16T07:40:27.776 INFO:tasks.workunit.client.0.smithi049.stdout:2/939: write d2/d1d/d28/d56/d66/f7e [2217187,14089] 0 2023-12-16T07:40:27.777 INFO:tasks.workunit.client.0.smithi049.stdout:9/912: creat d4/d7/d11/d1d/d69/d76/d83/ddf/f125 x:0 0 0 2023-12-16T07:40:27.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/951: unlink d2/db/dd/de/d1e/fce 0 2023-12-16T07:40:27.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/952: truncate d2/db/d6b/db9/de4/fea 439973 0 2023-12-16T07:40:27.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/953: chown d2/db/dd/de/d1e/d44 0 1 2023-12-16T07:40:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:8/984: symlink d0/d1f/l136 0 2023-12-16T07:40:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/985: write d0/d13/f2f [138106,22909] 0 2023-12-16T07:40:27.781 INFO:tasks.workunit.client.0.smithi049.stdout:2/940: rename d2/d1d/d24/lf4 to d2/d1d/d24/d55/d76/l143 0 2023-12-16T07:40:27.782 INFO:tasks.workunit.client.0.smithi049.stdout:2/941: write d2/d26/d43/f13d [3955056,110711] 0 2023-12-16T07:40:27.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/954: mkdir d2/db/dd/de/d1e/d21/dda/d122 0 2023-12-16T07:40:27.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/986: fsync d0/d1f/f65 0 2023-12-16T07:40:27.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/987: dread d0/d13/d42/f102 [0,4194304] 0 2023-12-16T07:40:27.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/988: write d0/d6a/dda/f94 [1117218,47401] 0 2023-12-16T07:40:27.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/942: symlink d2/d1d/d24/d126/l144 0 2023-12-16T07:40:27.785 INFO:tasks.workunit.client.0.smithi049.stdout:4/955: link d2/db/dd/d2a/l66 d2/db/dd/de/d1e/d37/d4e/l123 0 2023-12-16T07:40:27.786 INFO:tasks.workunit.client.0.smithi049.stdout:4/956: write d2/db/dd/de/d1e/d21/de7/f116 [163097,68778] 0 2023-12-16T07:40:27.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/989: mknod d0/d1f/db7/d111/c137 0 2023-12-16T07:40:27.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/943: rename d2/de/d93/cce to d2/de/df2/d136/c145 0 2023-12-16T07:40:27.788 INFO:tasks.workunit.client.0.smithi049.stdout:8/990: mknod d0/d1f/d36/c138 0 2023-12-16T07:40:27.788 INFO:tasks.workunit.client.0.smithi049.stdout:8/991: write d0/d1f/f59 [3302423,55294] 0 2023-12-16T07:40:27.789 INFO:tasks.workunit.client.0.smithi049.stdout:4/957: dread d2/db/d6b/fb4 [0,4194304] 0 2023-12-16T07:40:27.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/992: chown d0/d13/fe 26314 1 2023-12-16T07:40:27.790 INFO:tasks.workunit.client.0.smithi049.stdout:9/913: dwrite d4/db/f22 [0,4194304] 0 2023-12-16T07:40:27.790 INFO:tasks.workunit.client.0.smithi049.stdout:9/914: fdatasync d4/d7/f21 0 2023-12-16T07:40:27.790 INFO:tasks.workunit.client.0.smithi049.stdout:4/958: rename d2/db/dd/d9f/cbc to d2/db/dd/de/d1e/d21/dda/dfb/d112/c124 0 2023-12-16T07:40:27.791 INFO:tasks.workunit.client.0.smithi049.stdout:4/959: dread - d2/db/dd/de/d1e/d44/f119 zero size 2023-12-16T07:40:27.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/960: write d2/f12 [1069271,9004] 0 2023-12-16T07:40:27.792 INFO:tasks.workunit.client.0.smithi049.stdout:9/915: rmdir d4/d7/d11/d1d/d5b/dbe/dc4 39 2023-12-16T07:40:27.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/961: chown d2/db/d6b/fb4 480 1 2023-12-16T07:40:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:4/962: rename d2/db/dd/de/d1e/d37/f3c to d2/db/d6b/f125 0 2023-12-16T07:40:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:4/963: write d2/db/dd/d52/d8c/d108/f117 [5096574,44594] 0 2023-12-16T07:40:27.795 INFO:tasks.workunit.client.0.smithi049.stdout:4/964: chown d2/db/dd/de/f63 2890 1 2023-12-16T07:40:27.795 INFO:tasks.workunit.client.0.smithi049.stdout:4/965: chown d2/db/dd/d2a/c29 403366007 1 2023-12-16T07:40:27.796 INFO:tasks.workunit.client.0.smithi049.stdout:4/966: creat d2/db/dd/d9f/f126 x:0 0 0 2023-12-16T07:40:27.813 INFO:tasks.workunit.client.0.smithi049.stdout:9/916: dread d4/db/f110 [0,4194304] 0 2023-12-16T07:40:27.814 INFO:tasks.workunit.client.0.smithi049.stdout:9/917: chown d4/d7/d11/d1d/d9b/dae/dc3 1873 1 2023-12-16T07:40:27.818 INFO:tasks.workunit.client.0.smithi049.stdout:2/944: dwrite d2/d26/d6e/fef [0,4194304] 0 2023-12-16T07:40:27.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/945: mknod d2/d1d/d28/d56/d11/d1c/dd1/dfe/d11c/c146 0 2023-12-16T07:40:27.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/946: chown d2/d1d/d24/d126/l144 22375 1 2023-12-16T07:40:27.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/993: dwrite d0/d6a/fa4 [0,4194304] 0 2023-12-16T07:40:27.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/994: fsync d0/d13/d42/d5b/d68/f8e 0 2023-12-16T07:40:27.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/995: chown d0/d1f/f67 0 1 2023-12-16T07:40:27.821 INFO:tasks.workunit.client.0.smithi049.stdout:2/947: mkdir d2/de/df2/d136/d147 0 2023-12-16T07:40:27.823 INFO:tasks.workunit.client.0.smithi049.stdout:2/948: dread d2/d26/d6e/dca/f107 [0,4194304] 0 2023-12-16T07:40:27.823 INFO:tasks.workunit.client.0.smithi049.stdout:2/949: read - d2/d1d/d28/d56/d11/d1c/f3c zero size 2023-12-16T07:40:27.823 INFO:tasks.workunit.client.0.smithi049.stdout:8/996: getdents d0/d6a 0 2023-12-16T07:40:27.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/967: dwrite d2/db/dd/de/d1e/d37/d82/f109 [0,4194304] 0 2023-12-16T07:40:27.824 INFO:tasks.workunit.client.0.smithi049.stdout:2/950: symlink d2/d1d/d28/d56/d11/d1c/d12c/l148 0 2023-12-16T07:40:27.825 INFO:tasks.workunit.client.0.smithi049.stdout:8/997: creat d0/d1f/db7/f139 x:0 0 0 2023-12-16T07:40:27.825 INFO:tasks.workunit.client.0.smithi049.stdout:4/968: symlink d2/db/dd/de/d1e/dfe/l127 0 2023-12-16T07:40:27.826 INFO:tasks.workunit.client.0.smithi049.stdout:2/951: write d2/d1d/d28/d56/fb [2091858,12446] 0 2023-12-16T07:40:27.827 INFO:tasks.workunit.client.0.smithi049.stdout:8/998: mkdir d0/d6a/d13a 0 2023-12-16T07:40:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:4/969: mkdir d2/db/dd/d9f/d121/d128 0 2023-12-16T07:40:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/999: symlink d0/d13/d42/de6/d133/l13b 0 2023-12-16T07:40:27.834 INFO:tasks.workunit.client.0.smithi049.stdout:4/970: creat d2/db/dd/de/d1e/d37/da4/f129 x:0 0 0 2023-12-16T07:40:27.835 INFO:tasks.workunit.client.0.smithi049.stdout:4/971: unlink d2/db/dd/de/d1e/d21/c6e 0 2023-12-16T07:40:27.836 INFO:tasks.workunit.client.0.smithi049.stdout:9/918: dwrite d4/d7/d11/db3/fab [0,4194304] 0 2023-12-16T07:40:27.837 INFO:tasks.workunit.client.0.smithi049.stdout:4/972: creat d2/db/d6b/db9/f12a x:0 0 0 2023-12-16T07:40:27.839 INFO:tasks.workunit.client.0.smithi049.stdout:4/973: mkdir d2/db/dd/de/d1e/d12b 0 2023-12-16T07:40:27.839 INFO:tasks.workunit.client.0.smithi049.stdout:4/974: readlink d2/db/dd/de/l7a 0 2023-12-16T07:40:27.839 INFO:tasks.workunit.client.0.smithi049.stdout:4/975: fsync d2/db/dd/de/d1e/d37/f5c 0 2023-12-16T07:40:27.844 INFO:tasks.workunit.client.0.smithi049.stdout:9/919: write d4/d7/d11/db3/d8a/f5a [1337607,120203] 0 2023-12-16T07:40:27.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/920: symlink d4/d7/d11/d10b/l126 0 2023-12-16T07:40:27.847 INFO:tasks.workunit.client.0.smithi049.stdout:9/921: creat d4/d7/d11/d1d/d9b/dae/dc3/f127 x:0 0 0 2023-12-16T07:40:27.851 INFO:tasks.workunit.client.0.smithi049.stdout:2/952: dwrite d2/d1d/d28/d56/d11/da8/f117 [0,4194304] 0 2023-12-16T07:40:27.851 INFO:tasks.workunit.client.0.smithi049.stdout:2/953: readlink d2/d1d/dc2/l119 0 2023-12-16T07:40:27.853 INFO:tasks.workunit.client.0.smithi049.stdout:2/954: write d2/d1d/fab [3925899,83271] 0 2023-12-16T07:40:27.856 INFO:tasks.workunit.client.0.smithi049.stdout:2/955: link d2/d1d/d24/d55/d7c/d98/da1/le4 d2/db8/l149 0 2023-12-16T07:40:27.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/956: creat d2/d1d/d24/d55/f14a x:0 0 0 2023-12-16T07:40:27.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/957: read d2/d1d/f8e [3490013,32255] 0 2023-12-16T07:40:27.858 INFO:tasks.workunit.client.0.smithi049.stdout:2/958: stat d2/f11e 0 2023-12-16T07:40:27.859 INFO:tasks.workunit.client.0.smithi049.stdout:2/959: symlink d2/d1d/d28/d56/d11/d1c/dd1/dfe/l14b 0 2023-12-16T07:40:27.859 INFO:tasks.workunit.client.0.smithi049.stdout:2/960: chown d2/d1d/d24/f42 627532 1 2023-12-16T07:40:27.863 INFO:tasks.workunit.client.0.smithi049.stdout:2/961: dread d2/de/d78/fb4 [0,4194304] 0 2023-12-16T07:40:27.864 INFO:tasks.workunit.client.0.smithi049.stdout:2/962: creat d2/d1d/d28/d56/d11/da8/f14c x:0 0 0 2023-12-16T07:40:27.865 INFO:tasks.workunit.client.0.smithi049.stdout:2/963: dread d2/d1d/d24/d55/d7c/d98/da1/fa7 [0,4194304] 0 2023-12-16T07:40:27.865 INFO:tasks.workunit.client.0.smithi049.stdout:2/964: write d2/d1d/f8e [4972182,76448] 0 2023-12-16T07:40:27.868 INFO:tasks.workunit.client.0.smithi049.stdout:4/976: dwrite d2/fac [0,4194304] 0 2023-12-16T07:40:27.871 INFO:tasks.workunit.client.0.smithi049.stdout:9/922: dwrite d4/d7/d11/d1d/d69/feb [0,4194304] 0 2023-12-16T07:40:27.872 INFO:tasks.workunit.client.0.smithi049.stdout:9/923: write d4/d7/d11/d1d/d48/f113 [782510,47667] 0 2023-12-16T07:40:27.872 INFO:tasks.workunit.client.0.smithi049.stdout:9/924: write d4/d7/d11/d56/d7f/f108 [2709,63412] 0 2023-12-16T07:40:27.874 INFO:tasks.workunit.client.0.smithi049.stdout:9/925: link d4/d7/d11/d10b/l123 d4/d7/d11/d1d/d69/l128 0 2023-12-16T07:40:27.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/926: mknod d4/d7/d11/db3/d8a/daa/dce/c129 0 2023-12-16T07:40:27.881 INFO:tasks.workunit.client.0.smithi049.stdout:9/927: dread d4/d7/d11/db3/f77 [0,4194304] 0 2023-12-16T07:40:27.881 INFO:tasks.workunit.client.0.smithi049.stdout:9/928: fsync d4/db/f31 0 2023-12-16T07:40:27.885 INFO:tasks.workunit.client.0.smithi049.stdout:9/929: write d4/d7/d11/d1d/f79 [101294,50712] 0 2023-12-16T07:40:27.885 INFO:tasks.workunit.client.0.smithi049.stdout:2/965: dwrite d2/d1d/d24/d55/d7c/ff7 [0,4194304] 0 2023-12-16T07:40:27.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/930: mknod d4/d7/d11/d56/c12a 0 2023-12-16T07:40:27.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/966: symlink d2/l14d 0 2023-12-16T07:40:27.888 INFO:tasks.workunit.client.0.smithi049.stdout:9/931: rename d4/d7/d11/d3f/cf4 to d4/d3e/c12b 0 2023-12-16T07:40:27.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/932: truncate d4/d7/d11/db3/d8a/daa/fca 1434276 0 2023-12-16T07:40:27.890 INFO:tasks.workunit.client.0.smithi049.stdout:9/933: unlink d4/d7/d11/d1d/d69/d76/d83/d10d/f10e 0 2023-12-16T07:40:27.891 INFO:tasks.workunit.client.0.smithi049.stdout:9/934: symlink d4/d3e/l12c 0 2023-12-16T07:40:27.891 INFO:tasks.workunit.client.0.smithi049.stdout:9/935: write d4/d7/d11/d1d/f64 [586272,83734] 0 2023-12-16T07:40:27.893 INFO:tasks.workunit.client.0.smithi049.stdout:9/936: creat d4/d7/d11/d1d/d69/d76/d107/f12d x:0 0 0 2023-12-16T07:40:27.901 INFO:tasks.workunit.client.0.smithi049.stdout:2/967: dwrite d2/fb2 [4194304,4194304] 0 2023-12-16T07:40:27.902 INFO:tasks.workunit.client.0.smithi049.stdout:2/968: rename d2/d1d/d38/lf6 to d2/d1d/d28/d56/d66/d6b/l14e 0 2023-12-16T07:40:27.905 INFO:tasks.workunit.client.0.smithi049.stdout:9/937: rmdir d4/d3e 39 2023-12-16T07:40:27.906 INFO:tasks.workunit.client.0.smithi049.stdout:9/938: mkdir d4/d3e/d105/d12e 0 2023-12-16T07:40:27.909 INFO:tasks.workunit.client.0.smithi049.stdout:2/969: dread d2/d1d/d28/d56/d11/f61 [4194304,4194304] 0 2023-12-16T07:40:27.909 INFO:tasks.workunit.client.0.smithi049.stdout:2/970: fsync d2/db8/db9/fd0 0 2023-12-16T07:40:27.909 INFO:tasks.workunit.client.0.smithi049.stdout:9/939: dread d4/d7/d11/db3/d8a/daa/ff3 [0,4194304] 0 2023-12-16T07:40:27.909 INFO:tasks.workunit.client.0.smithi049.stdout:9/940: chown d4/db/l32 915918121 1 2023-12-16T07:40:27.910 INFO:tasks.workunit.client.0.smithi049.stdout:2/971: write d2/de/f86 [4143189,11007] 0 2023-12-16T07:40:27.910 INFO:tasks.workunit.client.0.smithi049.stdout:9/941: symlink d4/d3e/d11d/l12f 0 2023-12-16T07:40:27.913 INFO:tasks.workunit.client.0.smithi049.stdout:9/942: rename d4/d7/d11/db3 to d4/d7/d11/d1d/d69/d76/d83/ddf/d130 0 2023-12-16T07:40:27.920 INFO:tasks.workunit.client.0.smithi049.stdout:2/972: dread d2/de/f86 [0,4194304] 0 2023-12-16T07:40:27.920 INFO:tasks.workunit.client.0.smithi049.stdout:9/943: dread d4/d7/d11/f20 [0,4194304] 0 2023-12-16T07:40:27.920 INFO:tasks.workunit.client.0.smithi049.stdout:9/944: write d4/db/f117 [872230,93636] 0 2023-12-16T07:40:27.921 INFO:tasks.workunit.client.0.smithi049.stdout:9/945: symlink d4/d7/d11/d1d/d9b/dae/l131 0 2023-12-16T07:40:27.921 INFO:tasks.workunit.client.0.smithi049.stdout:2/973: dread d2/d1d/d28/d56/d11/da8/fc5 [0,4194304] 0 2023-12-16T07:40:27.922 INFO:tasks.workunit.client.0.smithi049.stdout:9/946: mknod d4/d7/d11/d1d/c132 0 2023-12-16T07:40:27.923 INFO:tasks.workunit.client.0.smithi049.stdout:2/974: mknod d2/de/df2/d136/c14f 0 2023-12-16T07:40:27.923 INFO:tasks.workunit.client.0.smithi049.stdout:2/975: fsync d2/d1d/d28/d56/d11/d1c/dd1/f11f 0 2023-12-16T07:40:27.924 INFO:tasks.workunit.client.0.smithi049.stdout:2/976: creat d2/f150 x:0 0 0 2023-12-16T07:40:27.924 INFO:tasks.workunit.client.0.smithi049.stdout:2/977: chown d2/d1d/d28/cb1 108945 1 2023-12-16T07:40:27.925 INFO:tasks.workunit.client.0.smithi049.stdout:2/978: creat d2/f151 x:0 0 0 2023-12-16T07:40:27.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/979: write d2/d1d/d28/d8b/f112 [1086567,123347] 0 2023-12-16T07:40:27.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/980: write d2/d1d/d24/d55/d7c/d98/f9d [1007252,33526] 0 2023-12-16T07:40:27.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/981: fsync d2/d26/d6e/faa 0 2023-12-16T07:40:27.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/982: mknod d2/de/d78/dd9/d135/c152 0 2023-12-16T07:40:27.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/983: rename d2/d1d/dc2/f105 to d2/de/d78/dd9/d135/f153 0 2023-12-16T07:40:27.929 INFO:tasks.workunit.client.0.smithi049.stdout:2/984: fdatasync d2/d1d/d24/d55/d76/f120 0 2023-12-16T07:40:27.929 INFO:tasks.workunit.client.0.smithi049.stdout:2/985: write d2/d1d/d28/d56/d11/f3d [4146356,105409] 0 2023-12-16T07:40:27.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/986: mknod d2/d1d/d24/d55/d7c/d98/da1/c154 0 2023-12-16T07:40:27.937 INFO:tasks.workunit.client.0.smithi049.stdout:9/947: dwrite d4/db2/f111 [0,4194304] 0 2023-12-16T07:40:27.940 INFO:tasks.workunit.client.0.smithi049.stdout:9/948: mkdir d4/d7/d11/d1d/d69/d76/d83/d10d/d133 0 2023-12-16T07:40:27.940 INFO:tasks.workunit.client.0.smithi049.stdout:9/949: dread - d4/db/f10a zero size 2023-12-16T07:40:27.944 INFO:tasks.workunit.client.0.smithi049.stdout:9/950: dread d4/d7/d11/d1d/d5b/dbe/fbf [0,4194304] 0 2023-12-16T07:40:27.944 INFO:tasks.workunit.client.0.smithi049.stdout:9/951: fsync d4/f102 0 2023-12-16T07:40:27.946 INFO:tasks.workunit.client.0.smithi049.stdout:2/987: dwrite d2/d1d/d28/d56/ff9 [0,4194304] 0 2023-12-16T07:40:27.946 INFO:tasks.workunit.client.0.smithi049.stdout:2/988: chown d2/d26/d43/f13d 1723710247 1 2023-12-16T07:40:27.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: pgmap v10: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 99 MiB/s rd, 211 MiB/s wr, 348 op/s 2023-12-16T07:40:27.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi049 to 1568M 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:27.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:27 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:27.970 INFO:tasks.workunit.client.0.smithi049.stdout:2/989: dwrite d2/d1d/d28/d56/fb [0,4194304] 0 2023-12-16T07:40:27.970 INFO:tasks.workunit.client.0.smithi049.stdout:9/952: dwrite d4/d7/d11/d26/ffc [0,4194304] 0 2023-12-16T07:40:27.970 INFO:tasks.workunit.client.0.smithi049.stdout:9/953: write d4/db2/dcc/ff1 [573800,35521] 0 2023-12-16T07:40:27.978 INFO:tasks.workunit.client.0.smithi049.stdout:2/990: dread d2/d1d/f9a [0,4194304] 0 2023-12-16T07:40:27.979 INFO:tasks.workunit.client.0.smithi049.stdout:2/991: truncate d2/d26/f10d 597606 0 2023-12-16T07:40:27.980 INFO:tasks.workunit.client.0.smithi049.stdout:2/992: creat d2/d1d/d24/d126/f155 x:0 0 0 2023-12-16T07:40:27.982 INFO:tasks.workunit.client.0.smithi049.stdout:2/993: truncate d2/d1d/d28/d56/d11/da8/f117 3740630 0 2023-12-16T07:40:27.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/994: mkdir d2/d1d/d28/d8b/d156 0 2023-12-16T07:40:27.985 INFO:tasks.workunit.client.0.smithi049.stdout:2/995: rename d2/d1d/d24/d55/d7c/d98/da1/c142 to d2/d26/c157 0 2023-12-16T07:40:27.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/996: truncate d2/d1d/d28/d56/d71/ddf/f132 199960 0 2023-12-16T07:40:27.988 INFO:tasks.workunit.client.0.smithi049.stdout:2/997: creat d2/d1d/d28/d56/d66/f158 x:0 0 0 2023-12-16T07:40:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/998: creat d2/d1d/d28/d56/f159 x:0 0 0 2023-12-16T07:40:27.990 INFO:tasks.workunit.client.0.smithi049.stdout:9/954: dwrite d4/d7/d11/d1d/d69/d76/d83/ddf/d130/d59/f70 [0,4194304] 0 2023-12-16T07:40:27.990 INFO:tasks.workunit.client.0.smithi049.stdout:9/955: chown d4/d7/d11/d1d/d69/d76/d83/ddf/d130/d8a/daa/dce/c129 0 1 2023-12-16T07:40:27.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/999: creat d2/d26/d6e/f15a x:0 0 0 2023-12-16T07:40:27.991 INFO:tasks.workunit.client.0.smithi049.stdout:9/956: mknod d4/d7/d11/d1d/d5b/d8b/c134 0 2023-12-16T07:40:28.007 INFO:tasks.workunit.client.0.smithi049.stdout:9/957: dwrite d4/d7/d11/d1d/d69/d76/d83/ddf/d130/d59/fcb [0,4194304] 0 2023-12-16T07:40:28.009 INFO:tasks.workunit.client.0.smithi049.stdout:9/958: mkdir d4/d7/d11/d1d/d82/d135 0 2023-12-16T07:40:28.011 INFO:tasks.workunit.client.0.smithi049.stdout:9/959: dread d4/d7/d11/d26/f74 [0,4194304] 0 2023-12-16T07:40:28.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/960: dwrite d4/d3e/f6e [0,4194304] 0 2023-12-16T07:40:28.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/961: rename d4/d7/d11/d1d/d69/d76/d83/ffd to d4/d7/d11/d26/f136 0 2023-12-16T07:40:28.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/962: write d4/db2/dcc/ff1 [1617598,109037] 0 2023-12-16T07:40:28.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/963: write d4/d7/d11/d56/f10c [3194268,103508] 0 2023-12-16T07:40:28.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/964: stat d4/d7/d11/d1d/d9b/dae/dc3/de1/lef 0 2023-12-16T07:40:28.028 INFO:tasks.workunit.client.0.smithi049.stdout:9/965: mknod d4/db2/dcc/c137 0 2023-12-16T07:40:28.028 INFO:tasks.workunit.client.0.smithi049.stdout:9/966: link d4/d7/d11/d1d/d69/feb d4/d7/d11/d1d/d69/d76/d83/d10d/f138 0 2023-12-16T07:40:28.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/967: stat d4/d7/d11/d1d/d69/d76/d83/de4/c121 0 2023-12-16T07:40:28.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/968: mkdir d4/d7/d11/d1d/d69/d76/d107/d139 0 2023-12-16T07:40:28.030 INFO:tasks.workunit.client.0.smithi049.stdout:9/969: write d4/d7/d11/d1d/d69/d76/d83/ff8 [826695,122028] 0 2023-12-16T07:40:28.063 INFO:tasks.workunit.client.0.smithi049.stdout:4/977: sync 2023-12-16T07:40:28.081 INFO:tasks.workunit.client.0.smithi049.stdout:4/978: dwrite d2/db/dd/de/d1e/d37/f38 [0,4194304] 0 2023-12-16T07:40:28.082 INFO:tasks.workunit.client.0.smithi049.stdout:4/979: getdents d2/db/dd/de/d1e/d37/da4/de1 0 2023-12-16T07:40:28.083 INFO:tasks.workunit.client.0.smithi049.stdout:4/980: stat d2/db/dd/de/d1e/d37/d4e/l123 0 2023-12-16T07:40:28.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/981: dwrite d2/db/dd/d52/fa8 [0,4194304] 0 2023-12-16T07:40:28.097 INFO:tasks.workunit.client.0.smithi049.stdout:4/982: mknod d2/db/dd/d52/d8c/d108/c12c 0 2023-12-16T07:40:28.097 INFO:tasks.workunit.client.0.smithi049.stdout:4/983: stat d2/db/dd/de/d1e/d37/da4/de1 0 2023-12-16T07:40:28.098 INFO:tasks.workunit.client.0.smithi049.stdout:4/984: creat d2/db/dd/de/d1e/d37/dcf/f12d x:0 0 0 2023-12-16T07:40:28.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/985: truncate d2/fe5 289534 0 2023-12-16T07:40:28.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/986: readlink d2/db/dd/lb2 0 2023-12-16T07:40:28.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/987: write d2/db/dd/db7/fed [463136,61089] 0 2023-12-16T07:40:28.100 INFO:tasks.workunit.client.0.smithi049.stdout:4/988: write d2/db/d6b/dc8/fe3 [1613681,38151] 0 2023-12-16T07:40:28.100 INFO:tasks.workunit.client.0.smithi049.stdout:4/989: fdatasync d2/db/dd/de/d1e/d37/f91 0 2023-12-16T07:40:28.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/990: creat d2/db/dd/de/d1e/d21/de7/f12e x:0 0 0 2023-12-16T07:40:28.102 INFO:tasks.workunit.client.0.smithi049.stdout:4/991: symlink d2/db/dd/de/l12f 0 2023-12-16T07:40:28.102 INFO:tasks.workunit.client.0.smithi049.stdout:4/992: write d2/db/dd/de/d1e/d37/dcf/f12d [405131,63862] 0 2023-12-16T07:40:28.105 INFO:tasks.workunit.client.0.smithi049.stdout:4/993: rename d2/db/dd/de/d1e/d21/f4f to d2/db/dd/de/d1e/d21/dda/dfb/d112/f130 0 2023-12-16T07:40:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/994: mkdir d2/db/d102/d131 0 2023-12-16T07:40:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/995: write d2/db/dd/de/d1e/d37/d4e/f10f [541912,13874] 0 2023-12-16T07:40:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: pgmap v10: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 99 MiB/s rd, 211 MiB/s wr, 348 op/s 2023-12-16T07:40:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi049 to 1568M 2023-12-16T07:40:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:27 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:28.126 INFO:tasks.workunit.client.0.smithi049.stdout:4/996: dwrite d2/f28 [0,4194304] 0 2023-12-16T07:40:28.126 INFO:tasks.workunit.client.0.smithi049.stdout:4/997: dread - d2/db/d6b/db9/de4/fa7 zero size 2023-12-16T07:40:28.126 INFO:tasks.workunit.client.0.smithi049.stdout:4/998: write d2/db/d6b/db9/fe8 [31264,94066] 0 2023-12-16T07:40:28.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/999: creat d2/db/d6b/dad/de0/f132 x:0 0 0 2023-12-16T07:40:28.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/970: sync 2023-12-16T07:40:28.157 INFO:tasks.workunit.client.0.smithi049.stdout:9/971: rename d4/d7/d11/c1e to d4/d7/d11/d1d/d69/c13a 0 2023-12-16T07:40:28.157 INFO:tasks.workunit.client.0.smithi049.stdout:9/972: read - d4/d7/d11/d1d/d69/d76/d83/d10d/f11a zero size 2023-12-16T07:40:28.157 INFO:tasks.workunit.client.0.smithi049.stdout:9/973: creat d4/d7/d11/d1d/d69/d76/d83/f13b x:0 0 0 2023-12-16T07:40:28.158 INFO:tasks.workunit.client.0.smithi049.stdout:9/974: mknod d4/d7/d11/d1d/d69/d76/d83/de4/c13c 0 2023-12-16T07:40:28.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/975: mknod d4/d7/d11/c13d 0 2023-12-16T07:40:28.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/976: readlink d4/d7/d11/d56/d7f/l9f 0 2023-12-16T07:40:28.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/977: stat d4/l7c 0 2023-12-16T07:40:28.160 INFO:tasks.workunit.client.0.smithi049.stdout:9/978: truncate d4/db/f33 36453 0 2023-12-16T07:40:28.160 INFO:tasks.workunit.client.0.smithi049.stdout:9/979: write d4/d7/d11/d1d/d5b/fb7 [1437785,110062] 0 2023-12-16T07:40:28.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/980: dwrite d4/d7/d11/d1d/d5b/f9e [0,4194304] 0 2023-12-16T07:40:28.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/981: dread - d4/d7/d11/d1d/d5b/dbe/fcd zero size 2023-12-16T07:40:28.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/982: creat d4/d3e/d105/f13e x:0 0 0 2023-12-16T07:40:28.192 INFO:tasks.workunit.client.0.smithi049.stdout:9/983: dwrite d4/d7/f7a [0,4194304] 0 2023-12-16T07:40:28.193 INFO:tasks.workunit.client.0.smithi049.stdout:9/984: creat d4/d7/d11/d1d/d69/d76/d107/f13f x:0 0 0 2023-12-16T07:40:28.196 INFO:tasks.workunit.client.0.smithi049.stdout:9/985: write d4/d7/f7a [3062745,127111] 0 2023-12-16T07:40:28.197 INFO:tasks.workunit.client.0.smithi049.stdout:9/986: unlink d4/d7/d11/d1d/d5b/c5f 0 2023-12-16T07:40:28.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/987: dwrite d4/d7/d11/d1d/d69/d76/d83/fd6 [0,4194304] 0 2023-12-16T07:40:28.215 INFO:tasks.workunit.client.0.smithi049.stdout:9/988: link d4/db2/lc6 d4/d3e/l140 0 2023-12-16T07:40:28.217 INFO:tasks.workunit.client.0.smithi049.stdout:9/989: link d4/d7/d11/d1d/d69/d76/d83/ddf/d130/d59/c95 d4/d7/d11/d1d/d5b/dbe/c141 0 2023-12-16T07:40:28.219 INFO:tasks.workunit.client.0.smithi049.stdout:9/990: rename d4/d3e/f6e to d4/d7/d11/d1d/d48/d93/f142 0 2023-12-16T07:40:28.220 INFO:tasks.workunit.client.0.smithi049.stdout:9/991: creat d4/d7/d11/d1d/d69/d76/d83/ddf/d130/f143 x:0 0 0 2023-12-16T07:40:28.222 INFO:tasks.workunit.client.0.smithi049.stdout:9/992: link d4/d7/d11/d1d/d69/d76/d83/ddf/d130/dda/lee d4/d7/d11/d3f/l144 0 2023-12-16T07:40:28.223 INFO:tasks.workunit.client.0.smithi049.stdout:9/993: creat d4/d7/d11/d1d/d5b/dbe/dc4/f145 x:0 0 0 2023-12-16T07:40:28.224 INFO:tasks.workunit.client.0.smithi049.stdout:9/994: unlink d4/d7/d11/d56/f10c 0 2023-12-16T07:40:28.225 INFO:tasks.workunit.client.0.smithi049.stdout:9/995: mkdir d4/d7/d11/d1d/d69/d76/d83/ddf/d130/d8a/daa/dce/d146 0 2023-12-16T07:40:28.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/996: creat d4/d7/d11/d1d/d9b/dae/dc3/f147 x:0 0 0 2023-12-16T07:40:28.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/997: mknod d4/d7/d11/d1d/d5b/dbe/dc4/c148 0 2023-12-16T07:40:28.227 INFO:tasks.workunit.client.0.smithi049.stdout:9/998: mkdir d4/d7/d11/d1d/d69/d76/d83/d10d/d133/d149 0 2023-12-16T07:40:28.238 INFO:tasks.workunit.client.0.smithi049.stdout:9/999: dwrite d4/d7/d11/d1d/d69/d76/d83/fd6 [4194304,4194304] 0 2023-12-16T07:40:28.240 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm -rf -- ./tmp.C0KqtfyeYV 2023-12-16T07:40:29.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:29 smithi049 ceph-mon[111939]: pgmap v11: 65 pgs: 65 active+clean; 1.8 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 247 MiB/s wr, 389 op/s 2023-12-16T07:40:30.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:29 smithi133 ceph-mon[120445]: pgmap v11: 65 pgs: 65 active+clean; 1.8 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 121 MiB/s rd, 247 MiB/s wr, 389 op/s 2023-12-16T07:40:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.164+0000 7fb1df279700 1 -- 172.21.15.49:0/614388012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 msgr2=0x7fb1d81044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.164+0000 7fb1df279700 1 --2- 172.21.15.49:0/614388012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d81044e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8004940 tx=0x7fb1c8009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 -- 172.21.15.49:0/614388012 shutdown_connections 2023-12-16T07:40:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 --2- 172.21.15.49:0/614388012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d81044e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 --2- 172.21.15.49:0/614388012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d8066070 0x7fb1d8101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 -- 172.21.15.49:0/614388012 >> 172.21.15.49:0/614388012 conn(0x7fb1d80f7190 msgr2=0x7fb1d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 -- 172.21.15.49:0/614388012 shutdown_connections 2023-12-16T07:40:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 -- 172.21.15.49:0/614388012 wait complete. 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 Processor -- start 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 -- start start 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d8066070 0x7fb1d810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d81103a0 con 0x7fb1d8102100 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.165+0000 7fb1df279700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8110c40 con 0x7fb1d8066070 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dc814700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dc814700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51258/0 (socket says 172.21.15.49:51258) 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dc814700 1 -- 172.21.15.49:0/962861662 learned_addr learned my addr 172.21.15.49:0/962861662 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dd015700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d8066070 0x7fb1d810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dc814700 1 -- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d8066070 msgr2=0x7fb1d810f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dc814700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d8066070 0x7fb1d810f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dc814700 1 -- 172.21.15.49:0/962861662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8005040 con 0x7fb1d8102100 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1dc814700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d810fda0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8000c00 tx=0x7fb1c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1cdffb700 1 -- 172.21.15.49:0/962861662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c800e040 con 0x7fb1d8102100 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1cdffb700 1 -- 172.21.15.49:0/962861662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1c800bc50 con 0x7fb1d8102100 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d8110ec0 con 0x7fb1d8102100 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.166+0000 7fb1cdffb700 1 -- 172.21.15.49:0/962861662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c801c630 con 0x7fb1d8102100 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.167+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d8111400 con 0x7fb1d8102100 2023-12-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.167+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d8109700 con 0x7fb1d8102100 2023-12-16T07:40:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.168+0000 7fb1cdffb700 1 -- 172.21.15.49:0/962861662 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fb1c8013960 con 0x7fb1d8102100 2023-12-16T07:40:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.168+0000 7fb1cdffb700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fb1c406ae40 0x7fb1c406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.168+0000 7fb1cdffb700 1 -- 172.21.15.49:0/962861662 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb1c808acf0 con 0x7fb1d8102100 2023-12-16T07:40:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.169+0000 7fb1dd015700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fb1c406ae40 0x7fb1c406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.169+0000 7fb1dd015700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fb1c406ae40 0x7fb1c406d2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009fd0 tx=0x7fb1d400b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.173+0000 7fb1cdffb700 1 -- 172.21.15.49:0/962861662 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb1c8058a20 con 0x7fb1d8102100 2023-12-16T07:40:30.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.395+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d8107940 con 0x7fb1c406ae40 2023-12-16T07:40:30.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.396+0000 7fb1cdffb700 1 -- 172.21.15.49:0/962861662 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb1d400f040 con 0x7fb1c406ae40 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fb1c406ae40 msgr2=0x7fb1c406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fb1c406ae40 0x7fb1c406d2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009fd0 tx=0x7fb1d400b040 comp rx=0 tx=0).stop 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 msgr2=0x7fb1d810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d810fda0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8000c00 tx=0x7fb1c8009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 shutdown_connections 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fb1c406ae40 0x7fb1c406d2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1d8066070 0x7fb1d810f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 --2- 172.21.15.49:0/962861662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1d8102100 0x7fb1d810fda0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 >> 172.21.15.49:0/962861662 conn(0x7fb1d80f7190 msgr2=0x7fb1d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 shutdown_connections 2023-12-16T07:40:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.399+0000 7fb1df279700 1 -- 172.21.15.49:0/962861662 wait complete. 2023-12-16T07:40:30.409 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:40:30.508 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 -- 172.21.15.49:0/2642472673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 msgr2=0x7f8530102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2642472673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f8530102440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8518004940 tx=0x7f8518009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 -- 172.21.15.49:0/2642472673 shutdown_connections 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2642472673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f8530102440 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2642472673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85300fd740 0x7f85300ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 -- 172.21.15.49:0/2642472673 >> 172.21.15.49:0/2642472673 conn(0x7f85300f71c0 msgr2=0x7f85300f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 -- 172.21.15.49:0/2642472673 shutdown_connections 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.507+0000 7f8534aaa700 1 -- 172.21.15.49:0/2642472673 wait complete. 2023-12-16T07:40:30.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f8534aaa700 1 Processor -- start 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f8534aaa700 1 -- start start 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f8534aaa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85300fd740 0x7f85300fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f8534aaa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f85300fb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f8534aaa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300fbc50 con 0x7f8530100060 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f8534aaa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300fbdc0 con 0x7f85300fd740 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f852dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f85300fb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f852dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f85300fb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51278/0 (socket says 172.21.15.49:51278) 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f852dd9b700 1 -- 172.21.15.49:0/2018857432 learned_addr learned my addr 172.21.15.49:0/2018857432 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f852e59c700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85300fd740 0x7f85300fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.508+0000 7f852dd9b700 1 -- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85300fd740 msgr2=0x7f85300fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f852dd9b700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85300fd740 0x7f85300fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f852dd9b700 1 -- 172.21.15.49:0/2018857432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518005040 con 0x7f8530100060 2023-12-16T07:40:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f852dd9b700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f85300fb650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8518008f90 tx=0x7f8518009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f8526ffd700 1 -- 172.21.15.49:0/2018857432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8518021070 con 0x7f8530100060 2023-12-16T07:40:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f8526ffd700 1 -- 172.21.15.49:0/2018857432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f851801c400 con 0x7f8530100060 2023-12-16T07:40:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300fc040 con 0x7f8530100060 2023-12-16T07:40:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f8526ffd700 1 -- 172.21.15.49:0/2018857432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851800e030 con 0x7f8530100060 2023-12-16T07:40:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.509+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85301154e0 con 0x7f8530100060 2023-12-16T07:40:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.510+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85301075d0 con 0x7f8530100060 2023-12-16T07:40:30.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.510+0000 7f8526ffd700 1 -- 172.21.15.49:0/2018857432 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f851801ca00 con 0x7f8530100060 2023-12-16T07:40:30.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.511+0000 7f8526ffd700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f851c06ae40 0x7f851c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.511+0000 7f8526ffd700 1 -- 172.21.15.49:0/2018857432 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f851808a8d0 con 0x7f8530100060 2023-12-16T07:40:30.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.511+0000 7f852e59c700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f851c06ae40 0x7f851c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.513 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.511+0000 7f852e59c700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f851c06ae40 0x7f851c06d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f85300fcf60 tx=0x7f852000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.516+0000 7f8526ffd700 1 -- 172.21.15.49:0/2018857432 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8518058860 con 0x7f8530100060 2023-12-16T07:40:30.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.753+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f853002b1f0 con 0x7f851c06ae40 2023-12-16T07:40:30.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.756+0000 7f8526ffd700 1 -- 172.21.15.49:0/2018857432 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f853002b1f0 con 0x7f851c06ae40 2023-12-16T07:40:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.759+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f851c06ae40 msgr2=0x7f851c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.759+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f851c06ae40 0x7f851c06d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f85300fcf60 tx=0x7f852000b040 comp rx=0 tx=0).stop 2023-12-16T07:40:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.759+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 msgr2=0x7f85300fb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.759+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f85300fb650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8518008f90 tx=0x7f8518009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.760+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 shutdown_connections 2023-12-16T07:40:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.760+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f851c06ae40 0x7f851c06d2f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.760 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.760+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85300fd740 0x7f85300fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.760+0000 7f8534aaa700 1 --2- 172.21.15.49:0/2018857432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8530100060 0x7f85300fb650 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8518008f90 tx=0x7f8518009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:30.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.760+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 >> 172.21.15.49:0/2018857432 conn(0x7f85300f71c0 msgr2=0x7f85300f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:30.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.760+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 shutdown_connections 2023-12-16T07:40:30.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.763+0000 7f8534aaa700 1 -- 172.21.15.49:0/2018857432 wait complete. 2023-12-16T07:40:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.920+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/1351187016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd8104400 msgr2=0x7f9cd8104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.920+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/1351187016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd8104400 0x7f9cd8104850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009ce0 tx=0x7f9cc8004d10 comp rx=0 tx=0).stop 2023-12-16T07:40:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.920+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/1351187016 shutdown_connections 2023-12-16T07:40:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.920+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/1351187016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd8104400 0x7f9cd8104850 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.920+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/1351187016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd81031f0 0x7f9cd8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.920+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/1351187016 >> 172.21.15.49:0/1351187016 conn(0x7f9cd8072480 msgr2=0x7f9cd80748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/1351187016 shutdown_connections 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/1351187016 wait complete. 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 Processor -- start 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 -- start start 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd81031f0 0x7f9cd806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd8104400 0x7f9cd806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd806f840 con 0x7f9cd81031f0 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.921+0000 7f9cdd9bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd811d6f0 con 0x7f9cd8104400 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd81031f0 0x7f9cd806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd81031f0 0x7f9cd806ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51292/0 (socket says 172.21.15.49:51292) 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd6ffd700 1 -- 172.21.15.49:0/2173558033 learned_addr learned my addr 172.21.15.49:0/2173558033 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd67fc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd8104400 0x7f9cd806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd6ffd700 1 -- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd8104400 msgr2=0x7f9cd806f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd6ffd700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd8104400 0x7f9cd806f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd6ffd700 1 -- 172.21.15.49:0/2173558033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8009940 con 0x7f9cd81031f0 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cd6ffd700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd81031f0 0x7f9cd806ed00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000eb70 tx=0x7f9cc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9ccf7fe700 1 -- 172.21.15.49:0/2173558033 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc0007cc0 con 0x7f9cd81031f0 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd811d8f0 con 0x7f9cd81031f0 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9ccf7fe700 1 -- 172.21.15.49:0/2173558033 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9cc000f040 con 0x7f9cd81031f0 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9ccf7fe700 1 -- 172.21.15.49:0/2173558033 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc000c9d0 con 0x7f9cd81031f0 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.922+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd811de30 con 0x7f9cd81031f0 2023-12-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.923+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd804bb80 con 0x7f9cd81031f0 2023-12-16T07:40:30.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.924+0000 7f9ccf7fe700 1 -- 172.21.15.49:0/2173558033 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f9cc000cb30 con 0x7f9cd81031f0 2023-12-16T07:40:30.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.925+0000 7f9ccf7fe700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f9cc406ae40 0x7f9cc406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:30.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.925+0000 7f9ccf7fe700 1 -- 172.21.15.49:0/2173558033 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9cc00891d0 con 0x7f9cd81031f0 2023-12-16T07:40:30.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.925+0000 7f9cd67fc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f9cc406ae40 0x7f9cc406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:30.925 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.925+0000 7f9cd67fc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f9cc406ae40 0x7f9cc406d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8015040 tx=0x7f9cc8004d10 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:30.929+0000 7f9ccf7fe700 1 -- 172.21.15.49:0/2173558033 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9cc004ece0 con 0x7f9cd81031f0 2023-12-16T07:40:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.141+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cd811e450 con 0x7f9cc406ae40 2023-12-16T07:40:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.152+0000 7f9ccf7fe700 1 -- 172.21.15.49:0/2173558033 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f9cd811e450 con 0x7f9cc406ae40 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (4m) 5s ago 5m 27.1M - 0.25.0 c8568f914cd2 ac0238c966a8 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 5s ago 6m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (5m) 27s ago 5m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (4m) 5s ago 5m 91.1M - 9.4.7 954c08fa6188 f8fc00abbcaf 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (2m) 5s ago 2m 13.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (2m) 5s ago 2m 14.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (2m) 27s ago 2m 2091M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (2m) 27s ago 2m 15.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:9283 running (7m) 5s ago 7m 425M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ecfbb356bee1 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283 running (31s) 27s ago 5m 55.1M - 19.0.0-191-g6d933094 a29c258b5d6f eb57616ccaf3 2023-12-16T07:40:31.153 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (7m) 5s ago 7m 77.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (5m) 27s ago 5m 51.6M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 5s ago 6m 16.3M - 1.5.0 0da6a335fe13 82ed4cc88c41 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (5m) 27s ago 5m 19.2M - 1.5.0 0da6a335fe13 ecd5d6b45738 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (4m) 5s ago 4m 383M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 5s ago 4m 415M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 5s ago 4m 319M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (3m) 27s ago 3m 293M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (3m) 27s ago 3m 247M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (3m) 27s ago 3m 276M 5323M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:40:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (4m) 5s ago 5m 58.6M - 2.43.0 a07b618ecd1d d2e8b8e4a383 2023-12-16T07:40:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f9cc406ae40 msgr2=0x7f9cc406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f9cc406ae40 0x7f9cc406d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8015040 tx=0x7f9cc8004d10 comp rx=0 tx=0).stop 2023-12-16T07:40:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd81031f0 msgr2=0x7f9cd806ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd81031f0 0x7f9cd806ed00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000eb70 tx=0x7f9cc000b040 comp rx=0 tx=0).stop 2023-12-16T07:40:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 shutdown_connections 2023-12-16T07:40:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f9cc406ae40 0x7f9cc406d2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cd81031f0 0x7f9cd806ed00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.154+0000 7f9cdd9bc700 1 --2- 172.21.15.49:0/2173558033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd8104400 0x7f9cd806f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.155+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 >> 172.21.15.49:0/2173558033 conn(0x7f9cd8072480 msgr2=0x7f9cd8107630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:31.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.155+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 shutdown_connections 2023-12-16T07:40:31.156 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.155+0000 7f9cdd9bc700 1 -- 172.21.15.49:0/2173558033 wait complete. 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 -- 172.21.15.49:0/4015605184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3128066090 msgr2=0x7f31280ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 --2- 172.21.15.49:0/4015605184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3128066090 0x7f31280ff7a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f311c004940 tx=0x7f311c009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 -- 172.21.15.49:0/4015605184 shutdown_connections 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 --2- 172.21.15.49:0/4015605184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280ffd70 0x7f31281021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 --2- 172.21.15.49:0/4015605184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3128066090 0x7f31280ff7a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 -- 172.21.15.49:0/4015605184 >> 172.21.15.49:0/4015605184 conn(0x7f31280f7190 msgr2=0x7f31280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 -- 172.21.15.49:0/4015605184 shutdown_connections 2023-12-16T07:40:31.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.257+0000 7f312ec26700 1 -- 172.21.15.49:0/4015605184 wait complete. 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.258+0000 7f312ec26700 1 Processor -- start 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.258+0000 7f312ec26700 1 -- start start 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f312ec26700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3128066090 0x7f312810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f312ec26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31280ffd70 0x7f312810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f312ec26700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312810e0c0 con 0x7f31280ffd70 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f312ec26700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312810e960 con 0x7f3128066090 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f3127fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31280ffd70 0x7f312810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f3127fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31280ffd70 0x7f312810dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51316/0 (socket says 172.21.15.49:51316) 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f3127fff700 1 -- 172.21.15.49:0/3811097421 learned_addr learned my addr 172.21.15.49:0/3811097421 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f312c9c2700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3128066090 0x7f312810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f3127fff700 1 -- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3128066090 msgr2=0x7f312810d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f3127fff700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3128066090 0x7f312810d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f3127fff700 1 -- 172.21.15.49:0/3811097421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c005040 con 0x7f31280ffd70 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f3127fff700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31280ffd70 0x7f312810dac0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3114002a50 tx=0x7f3114004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f31257fa700 1 -- 172.21.15.49:0/3811097421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3114007cc0 con 0x7f31280ffd70 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f31257fa700 1 -- 172.21.15.49:0/3811097421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f311400f040 con 0x7f31280ffd70 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312810ec40 con 0x7f31280ffd70 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f31257fa700 1 -- 172.21.15.49:0/3811097421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f311400d920 con 0x7f31280ffd70 2023-12-16T07:40:31.261 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.259+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312810f180 con 0x7f31280ffd70 2023-12-16T07:40:31.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.261+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31281075e0 con 0x7f31280ffd70 2023-12-16T07:40:31.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.261+0000 7f31257fa700 1 -- 172.21.15.49:0/3811097421 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f3114009680 con 0x7f31280ffd70 2023-12-16T07:40:31.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.261+0000 7f31257fa700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f311806ae40 0x7f311806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:31.262 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.261+0000 7f31257fa700 1 -- 172.21.15.49:0/3811097421 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f31140894d0 con 0x7f31280ffd70 2023-12-16T07:40:31.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.262+0000 7f312c9c2700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f311806ae40 0x7f311806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:31.263 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.262+0000 7f312c9c2700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f311806ae40 0x7f311806d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f311c00b3b0 tx=0x7f311c009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:31.266 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.266+0000 7f31257fa700 1 -- 172.21.15.49:0/3811097421 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3114057280 con 0x7f31280ffd70 2023-12-16T07:40:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.562+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f312804bb80 con 0x7f31280ffd70 2023-12-16T07:40:31.563 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.563+0000 7f31257fa700 1 -- 172.21.15.49:0/3811097421 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f3114056e10 con 0x7f31280ffd70 2023-12-16T07:40:31.563 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:40:31.563 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:40:31.563 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:40:31.563 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:40:31.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:40:31.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:40:31.565 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:40:31.565 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-16T07:40:31.565 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T07:40:31.565 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:40:31.565 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:40:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f311806ae40 msgr2=0x7f311806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f311806ae40 0x7f311806d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f311c00b3b0 tx=0x7f311c009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31280ffd70 msgr2=0x7f312810dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31280ffd70 0x7f312810dac0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3114002a50 tx=0x7f3114004600 comp rx=0 tx=0).stop 2023-12-16T07:40:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 shutdown_connections 2023-12-16T07:40:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f311806ae40 0x7f311806d2f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.566 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3128066090 0x7f312810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 --2- 172.21.15.49:0/3811097421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31280ffd70 0x7f312810dac0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 >> 172.21.15.49:0/3811097421 conn(0x7f31280f7190 msgr2=0x7f31280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 shutdown_connections 2023-12-16T07:40:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.565+0000 7f312ec26700 1 -- 172.21.15.49:0/3811097421 wait complete. 2023-12-16T07:40:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.678+0000 7f376c6fe700 1 -- 172.21.15.49:0/1308694643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37640660b0 msgr2=0x7f3764101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.678+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1308694643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37640660b0 0x7f3764101b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3760004880 tx=0x7f3760009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.679+0000 7f376c6fe700 1 -- 172.21.15.49:0/1308694643 shutdown_connections 2023-12-16T07:40:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.679+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1308694643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 0x7f37641044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.679+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1308694643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37640660b0 0x7f3764101b80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.679+0000 7f376c6fe700 1 -- 172.21.15.49:0/1308694643 >> 172.21.15.49:0/1308694643 conn(0x7f37640f7190 msgr2=0x7f37640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.679+0000 7f376c6fe700 1 -- 172.21.15.49:0/1308694643 shutdown_connections 2023-12-16T07:40:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.679+0000 7f376c6fe700 1 -- 172.21.15.49:0/1308694643 wait complete. 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.680+0000 7f376c6fe700 1 Processor -- start 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.680+0000 7f376c6fe700 1 -- start start 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.680+0000 7f376c6fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37640660b0 0x7f376410f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f376c6fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 0x7f376410fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f376c6fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764110340 con 0x7f37641020c0 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f376c6fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764110be0 con 0x7f37640660b0 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f3769c99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 0x7f376410fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f3769c99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 0x7f376410fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51334/0 (socket says 172.21.15.49:51334) 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f3769c99700 1 -- 172.21.15.49:0/1767112261 learned_addr learned my addr 172.21.15.49:0/1767112261 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f3769c99700 1 -- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37640660b0 msgr2=0x7f376410f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f3769c99700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37640660b0 0x7f376410f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.681+0000 7f3769c99700 1 -- 172.21.15.49:0/1767112261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760005040 con 0x7f37641020c0 2023-12-16T07:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.682+0000 7f3769c99700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 0x7f376410fd40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f37540041d0 tx=0x7f375400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.682+0000 7f375affd700 1 -- 172.21.15.49:0/1767112261 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3754007cc0 con 0x7f37641020c0 2023-12-16T07:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.682+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3764110e60 con 0x7f37641020c0 2023-12-16T07:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.682+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37641113a0 con 0x7f37641020c0 2023-12-16T07:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.683+0000 7f375affd700 1 -- 172.21.15.49:0/1767112261 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f375400f040 con 0x7f37641020c0 2023-12-16T07:40:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.683+0000 7f375affd700 1 -- 172.21.15.49:0/1767112261 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f375400ca50 con 0x7f37641020c0 2023-12-16T07:40:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.684+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37480052e0 con 0x7f37641020c0 2023-12-16T07:40:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.690+0000 7f375affd700 1 -- 172.21.15.49:0/1767112261 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f3754009780 con 0x7f37641020c0 2023-12-16T07:40:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.691+0000 7f375affd700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f375006ae40 0x7f375006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:40:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.691+0000 7f375affd700 1 -- 172.21.15.49:0/1767112261 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f37540896d0 con 0x7f37641020c0 2023-12-16T07:40:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.691+0000 7f376a49a700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f375006ae40 0x7f375006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:40:31.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.692+0000 7f375affd700 1 -- 172.21.15.49:0/1767112261 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f37540575f0 con 0x7f37641020c0 2023-12-16T07:40:31.692 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.692+0000 7f376a49a700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f375006ae40 0x7f375006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3760009fd0 tx=0x7f3760009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:40:31.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.937+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3748000bf0 con 0x7f375006ae40 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.938+0000 7f375affd700 1 -- 172.21.15.49:0/1767112261 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3748000bf0 con 0x7f375006ae40 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:40:31.939 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f375006ae40 msgr2=0x7f375006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f375006ae40 0x7f375006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3760009fd0 tx=0x7f3760009e30 comp rx=0 tx=0).stop 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 msgr2=0x7f376410fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 0x7f376410fd40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f37540041d0 tx=0x7f375400b040 comp rx=0 tx=0).stop 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 shutdown_connections 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f375006ae40 0x7f375006d2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37640660b0 0x7f376410f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 --2- 172.21.15.49:0/1767112261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37641020c0 0x7f376410fd40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:40:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.940+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 >> 172.21.15.49:0/1767112261 conn(0x7f37640f7190 msgr2=0x7f37640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:40:31.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.941+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 shutdown_connections 2023-12-16T07:40:31.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:40:31.941+0000 7f376c6fe700 1 -- 172.21.15.49:0/1767112261 wait complete. 2023-12-16T07:40:31.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:31 smithi049 ceph-mon[111939]: pgmap v12: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 150 MiB/s rd, 317 MiB/s wr, 515 op/s 2023-12-16T07:40:31.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:31 smithi049 ceph-mon[111939]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:31.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:31 smithi049 ceph-mon[111939]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:31.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:31 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3811097421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:40:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:31 smithi133 ceph-mon[120445]: pgmap v12: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 150 MiB/s rd, 317 MiB/s wr, 515 op/s 2023-12-16T07:40:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:31 smithi133 ceph-mon[120445]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:31 smithi133 ceph-mon[120445]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:31 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3811097421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:40:32.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:32 smithi133 ceph-mon[120445]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:32.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:32 smithi133 ceph-mon[120445]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:32.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:32 smithi049 ceph-mon[111939]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:32.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:32 smithi049 ceph-mon[111939]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:8/63: sync 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:5/2: sync 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:1/48: sync 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:5/3: rename - no filename 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:5/4: dwrite - no filename 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:7/68: sync 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:1/49: chown d0/l2 11041916 1 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:6/28: sync 2023-12-16T07:40:33.721 INFO:tasks.workunit.client.1.smithi133.stdout:4/16: sync 2023-12-16T07:40:33.722 INFO:tasks.workunit.client.1.smithi133.stdout:3/6: sync 2023-12-16T07:40:33.722 INFO:tasks.workunit.client.1.smithi133.stdout:0/41: sync 2023-12-16T07:40:33.722 INFO:tasks.workunit.client.1.smithi133.stdout:0/42: chown d2/d9/lc 48 1 2023-12-16T07:40:33.722 INFO:tasks.workunit.client.1.smithi133.stdout:2/18: sync 2023-12-16T07:40:33.722 INFO:tasks.workunit.client.1.smithi133.stdout:9/13: sync 2023-12-16T07:40:33.722 INFO:tasks.workunit.client.1.smithi133.stdout:5/5: symlink l0 0 2023-12-16T07:40:33.724 INFO:tasks.workunit.client.1.smithi133.stdout:1/50: mknod d0/d12/c13 0 2023-12-16T07:40:33.724 INFO:tasks.workunit.client.1.smithi133.stdout:1/51: fsync d0/da/db/ff 0 2023-12-16T07:40:33.724 INFO:tasks.workunit.client.1.smithi133.stdout:1/52: fdatasync d0/da/db/ff 0 2023-12-16T07:40:33.724 INFO:tasks.workunit.client.1.smithi133.stdout:1/53: getdents d0/da 0 2023-12-16T07:40:33.724 INFO:tasks.workunit.client.1.smithi133.stdout:7/69: dread db/fe [0,4194304] 0 2023-12-16T07:40:33.724 INFO:tasks.workunit.client.1.smithi133.stdout:1/54: write d0/da/db/fd [283856,64099] 0 2023-12-16T07:40:33.724 INFO:tasks.workunit.client.1.smithi133.stdout:0/43: dread d2/f3 [0,4194304] 0 2023-12-16T07:40:33.728 INFO:tasks.workunit.client.1.smithi133.stdout:6/29: rmdir d0 39 2023-12-16T07:40:33.728 INFO:tasks.workunit.client.1.smithi133.stdout:4/17: mknod d3/c6 0 2023-12-16T07:40:33.729 INFO:tasks.workunit.client.1.smithi133.stdout:4/18: dwrite - no filename 2023-12-16T07:40:33.729 INFO:tasks.workunit.client.1.smithi133.stdout:4/19: chown c2 438101 1 2023-12-16T07:40:33.729 INFO:tasks.workunit.client.1.smithi133.stdout:4/20: read - no filename 2023-12-16T07:40:33.729 INFO:tasks.workunit.client.1.smithi133.stdout:3/7: creat f3 x:0 0 0 2023-12-16T07:40:33.729 INFO:tasks.workunit.client.1.smithi133.stdout:2/19: mknod c5 0 2023-12-16T07:40:33.729 INFO:tasks.workunit.client.1.smithi133.stdout:2/20: fsync f4 0 2023-12-16T07:40:33.731 INFO:tasks.workunit.client.1.smithi133.stdout:9/14: symlink l5 0 2023-12-16T07:40:33.732 INFO:tasks.workunit.client.1.smithi133.stdout:9/15: truncate f0 4914797 0 2023-12-16T07:40:33.732 INFO:tasks.workunit.client.1.smithi133.stdout:6/30: write d0/f2 [3091596,59705] 0 2023-12-16T07:40:33.732 INFO:tasks.workunit.client.1.smithi133.stdout:6/31: truncate d0/f3 827410 0 2023-12-16T07:40:33.732 INFO:tasks.workunit.client.1.smithi133.stdout:6/32: fdatasync d0/f3 0 2023-12-16T07:40:33.733 INFO:tasks.workunit.client.1.smithi133.stdout:5/6: mkdir d1 0 2023-12-16T07:40:33.733 INFO:tasks.workunit.client.1.smithi133.stdout:5/7: write - no filename 2023-12-16T07:40:33.734 INFO:tasks.workunit.client.1.smithi133.stdout:1/55: mknod d0/c14 0 2023-12-16T07:40:33.735 INFO:tasks.workunit.client.1.smithi133.stdout:7/70: mknod db/c13 0 2023-12-16T07:40:33.735 INFO:tasks.workunit.client.1.smithi133.stdout:7/71: chown f9 48178271 1 2023-12-16T07:40:33.735 INFO:tasks.workunit.client.1.smithi133.stdout:0/44: getdents d2 0 2023-12-16T07:40:33.735 INFO:tasks.workunit.client.1.smithi133.stdout:0/45: chown d2/d9 77840565 1 2023-12-16T07:40:33.735 INFO:tasks.workunit.client.1.smithi133.stdout:0/46: getdents d2 0 2023-12-16T07:40:33.736 INFO:tasks.workunit.client.1.smithi133.stdout:0/47: stat d2/f3 0 2023-12-16T07:40:33.736 INFO:tasks.workunit.client.1.smithi133.stdout:4/21: mkdir d3/d7 0 2023-12-16T07:40:33.736 INFO:tasks.workunit.client.1.smithi133.stdout:0/48: write d2/f6 [3447894,68037] 0 2023-12-16T07:40:33.737 INFO:tasks.workunit.client.1.smithi133.stdout:0/49: chown d2/f4 71 1 2023-12-16T07:40:33.737 INFO:tasks.workunit.client.1.smithi133.stdout:2/21: symlink l6 0 2023-12-16T07:40:33.737 INFO:tasks.workunit.client.1.smithi133.stdout:2/22: write f4 [279807,93972] 0 2023-12-16T07:40:33.737 INFO:tasks.workunit.client.1.smithi133.stdout:9/16: mknod c6 0 2023-12-16T07:40:33.737 INFO:tasks.workunit.client.1.smithi133.stdout:9/17: chown l4 133570883 1 2023-12-16T07:40:33.737 INFO:tasks.workunit.client.1.smithi133.stdout:9/18: readlink l4 0 2023-12-16T07:40:33.739 INFO:tasks.workunit.client.1.smithi133.stdout:6/33: mknod d0/d4/ca 0 2023-12-16T07:40:33.740 INFO:tasks.workunit.client.1.smithi133.stdout:5/8: creat d1/f2 x:0 0 0 2023-12-16T07:40:33.740 INFO:tasks.workunit.client.1.smithi133.stdout:5/9: write d1/f2 [602018,1857] 0 2023-12-16T07:40:33.740 INFO:tasks.workunit.client.1.smithi133.stdout:5/10: chown d1/f2 0 1 2023-12-16T07:40:33.742 INFO:tasks.workunit.client.1.smithi133.stdout:1/56: symlink d0/da/db/l15 0 2023-12-16T07:40:33.742 INFO:tasks.workunit.client.1.smithi133.stdout:7/72: link c4 db/d12/c14 0 2023-12-16T07:40:33.742 INFO:tasks.workunit.client.1.smithi133.stdout:7/73: chown db/ff 341273053 1 2023-12-16T07:40:33.743 INFO:tasks.workunit.client.1.smithi133.stdout:8/64: dwrite f8 [0,4194304] 0 2023-12-16T07:40:33.743 INFO:tasks.workunit.client.1.smithi133.stdout:8/65: readlink l6 0 2023-12-16T07:40:33.743 INFO:tasks.workunit.client.1.smithi133.stdout:8/66: write d9/fb [979189,121181] 0 2023-12-16T07:40:33.744 INFO:tasks.workunit.client.1.smithi133.stdout:1/57: dread d0/da/db/ff [0,4194304] 0 2023-12-16T07:40:33.746 INFO:tasks.workunit.client.1.smithi133.stdout:4/22: mknod d3/c8 0 2023-12-16T07:40:33.746 INFO:tasks.workunit.client.1.smithi133.stdout:4/23: readlink d3/l5 0 2023-12-16T07:40:33.746 INFO:tasks.workunit.client.1.smithi133.stdout:4/24: dread - no filename 2023-12-16T07:40:33.747 INFO:tasks.workunit.client.1.smithi133.stdout:0/50: link d2/l7 d2/d9/ld 0 2023-12-16T07:40:33.751 INFO:tasks.workunit.client.1.smithi133.stdout:6/34: mkdir d0/db 0 2023-12-16T07:40:33.753 INFO:tasks.workunit.client.1.smithi133.stdout:5/11: rename d1/f2 to d1/f3 0 2023-12-16T07:40:33.753 INFO:tasks.workunit.client.1.smithi133.stdout:5/12: write d1/f3 [772871,104236] 0 2023-12-16T07:40:33.756 INFO:tasks.workunit.client.1.smithi133.stdout:7/74: creat db/d12/f15 x:0 0 0 2023-12-16T07:40:33.757 INFO:tasks.workunit.client.1.smithi133.stdout:7/75: read f9 [1550741,73176] 0 2023-12-16T07:40:33.757 INFO:tasks.workunit.client.1.smithi133.stdout:7/76: write db/f11 [866241,38998] 0 2023-12-16T07:40:33.758 INFO:tasks.workunit.client.1.smithi133.stdout:8/67: fsync d9/dc/de/ff 0 2023-12-16T07:40:33.758 INFO:tasks.workunit.client.1.smithi133.stdout:8/68: chown d9/cd 37384265 1 2023-12-16T07:40:33.759 INFO:tasks.workunit.client.1.smithi133.stdout:4/25: link d3/c6 d3/d7/c9 0 2023-12-16T07:40:33.759 INFO:tasks.workunit.client.1.smithi133.stdout:4/26: write - no filename 2023-12-16T07:40:33.760 INFO:tasks.workunit.client.1.smithi133.stdout:4/27: truncate - no filename 2023-12-16T07:40:33.760 INFO:tasks.workunit.client.1.smithi133.stdout:6/35: creat d0/d4/fc x:0 0 0 2023-12-16T07:40:33.760 INFO:tasks.workunit.client.1.smithi133.stdout:6/36: chown d0 10658 1 2023-12-16T07:40:33.761 INFO:tasks.workunit.client.1.smithi133.stdout:8/69: dread d9/dc/de/ff [0,4194304] 0 2023-12-16T07:40:33.765 INFO:tasks.workunit.client.1.smithi133.stdout:9/19: dwrite f1 [0,4194304] 0 2023-12-16T07:40:33.765 INFO:tasks.workunit.client.1.smithi133.stdout:9/20: chown c6 4647151 1 2023-12-16T07:40:33.765 INFO:tasks.workunit.client.1.smithi133.stdout:7/77: unlink db/l10 0 2023-12-16T07:40:33.766 INFO:tasks.workunit.client.1.smithi133.stdout:7/78: chown f9 31549647 1 2023-12-16T07:40:33.767 INFO:tasks.workunit.client.1.smithi133.stdout:4/28: creat d3/fa x:0 0 0 2023-12-16T07:40:33.768 INFO:tasks.workunit.client.1.smithi133.stdout:8/70: write f8 [1077484,59004] 0 2023-12-16T07:40:33.768 INFO:tasks.workunit.client.1.smithi133.stdout:8/71: readlink l6 0 2023-12-16T07:40:33.770 INFO:tasks.workunit.client.1.smithi133.stdout:6/37: link d0/d4/c7 d0/d4/cd 0 2023-12-16T07:40:33.770 INFO:tasks.workunit.client.1.smithi133.stdout:0/51: dread d2/f6 [0,4194304] 0 2023-12-16T07:40:33.770 INFO:tasks.workunit.client.1.smithi133.stdout:2/23: dwrite f1 [0,4194304] 0 2023-12-16T07:40:33.770 INFO:tasks.workunit.client.1.smithi133.stdout:2/24: stat l6 0 2023-12-16T07:40:33.770 INFO:tasks.workunit.client.1.smithi133.stdout:4/29: creat d3/d7/fb x:0 0 0 2023-12-16T07:40:33.772 INFO:tasks.workunit.client.1.smithi133.stdout:8/72: mkdir d9/d11 0 2023-12-16T07:40:33.772 INFO:tasks.workunit.client.1.smithi133.stdout:8/73: readlink l5 0 2023-12-16T07:40:33.774 INFO:tasks.workunit.client.1.smithi133.stdout:1/58: dwrite d0/da/db/ff [0,4194304] 0 2023-12-16T07:40:33.774 INFO:tasks.workunit.client.1.smithi133.stdout:2/25: dread f4 [0,4194304] 0 2023-12-16T07:40:33.775 INFO:tasks.workunit.client.1.smithi133.stdout:4/30: creat d3/d7/fc x:0 0 0 2023-12-16T07:40:33.775 INFO:tasks.workunit.client.1.smithi133.stdout:4/31: readlink d3/l5 0 2023-12-16T07:40:33.776 INFO:tasks.workunit.client.1.smithi133.stdout:8/74: symlink d9/d11/l12 0 2023-12-16T07:40:33.776 INFO:tasks.workunit.client.1.smithi133.stdout:8/75: chown l6 1 1 2023-12-16T07:40:33.779 INFO:tasks.workunit.client.1.smithi133.stdout:2/26: creat f7 x:0 0 0 2023-12-16T07:40:33.780 INFO:tasks.workunit.client.1.smithi133.stdout:4/32: mknod d3/cd 0 2023-12-16T07:40:33.782 INFO:tasks.workunit.client.1.smithi133.stdout:2/27: creat f8 x:0 0 0 2023-12-16T07:40:33.782 INFO:tasks.workunit.client.1.smithi133.stdout:2/28: write f4 [1095091,99896] 0 2023-12-16T07:40:33.783 INFO:tasks.workunit.client.1.smithi133.stdout:4/33: symlink d3/le 0 2023-12-16T07:40:33.783 INFO:tasks.workunit.client.1.smithi133.stdout:4/34: read - d3/d7/fc zero size 2023-12-16T07:40:33.783 INFO:tasks.workunit.client.1.smithi133.stdout:7/79: fdatasync db/f11 0 2023-12-16T07:40:33.784 INFO:tasks.workunit.client.1.smithi133.stdout:2/29: creat f9 x:0 0 0 2023-12-16T07:40:33.784 INFO:tasks.workunit.client.1.smithi133.stdout:4/35: creat d3/d7/ff x:0 0 0 2023-12-16T07:40:33.785 INFO:tasks.workunit.client.1.smithi133.stdout:4/36: write d3/d7/ff [944547,31835] 0 2023-12-16T07:40:33.785 INFO:tasks.workunit.client.1.smithi133.stdout:9/21: dwrite f0 [4194304,4194304] 0 2023-12-16T07:40:33.785 INFO:tasks.workunit.client.1.smithi133.stdout:9/22: fdatasync f0 0 2023-12-16T07:40:33.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/80: creat db/f16 x:0 0 0 2023-12-16T07:40:33.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/81: chown db/cc 86745 1 2023-12-16T07:40:33.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/82: write db/f16 [928488,122862] 0 2023-12-16T07:40:33.788 INFO:tasks.workunit.client.1.smithi133.stdout:2/30: mkdir da 0 2023-12-16T07:40:33.792 INFO:tasks.workunit.client.1.smithi133.stdout:9/23: rename l2 to l7 0 2023-12-16T07:40:33.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/38: dwrite d0/d4/fc [0,4194304] 0 2023-12-16T07:40:33.795 INFO:tasks.workunit.client.1.smithi133.stdout:4/37: dread d3/d7/ff [0,4194304] 0 2023-12-16T07:40:33.795 INFO:tasks.workunit.client.1.smithi133.stdout:2/31: creat da/fb x:0 0 0 2023-12-16T07:40:33.795 INFO:tasks.workunit.client.1.smithi133.stdout:2/32: rename da to da/dc 22 2023-12-16T07:40:33.800 INFO:tasks.workunit.client.1.smithi133.stdout:4/38: mknod d3/c10 0 2023-12-16T07:40:33.800 INFO:tasks.workunit.client.1.smithi133.stdout:4/39: chown d3/cd 888128938 1 2023-12-16T07:40:33.800 INFO:tasks.workunit.client.1.smithi133.stdout:1/59: dwrite d0/da/db/fd [0,4194304] 0 2023-12-16T07:40:33.803 INFO:tasks.workunit.client.1.smithi133.stdout:9/24: dread f1 [0,4194304] 0 2023-12-16T07:40:33.806 INFO:tasks.workunit.client.1.smithi133.stdout:0/52: dwrite d2/f3 [0,4194304] 0 2023-12-16T07:40:33.807 INFO:tasks.workunit.client.1.smithi133.stdout:4/40: link d3/d7/fc d3/d7/f11 0 2023-12-16T07:40:33.807 INFO:tasks.workunit.client.1.smithi133.stdout:4/41: write d3/d7/fc [248537,116924] 0 2023-12-16T07:40:33.807 INFO:tasks.workunit.client.1.smithi133.stdout:4/42: write d3/d7/ff [1654022,88446] 0 2023-12-16T07:40:33.810 INFO:tasks.workunit.client.1.smithi133.stdout:1/60: rename d0/da/c9 to d0/c16 0 2023-12-16T07:40:33.811 INFO:tasks.workunit.client.1.smithi133.stdout:9/25: symlink l8 0 2023-12-16T07:40:33.812 INFO:tasks.workunit.client.1.smithi133.stdout:6/39: dread d0/d4/fc [0,4194304] 0 2023-12-16T07:40:33.812 INFO:tasks.workunit.client.1.smithi133.stdout:6/40: truncate d0/f6 229954 0 2023-12-16T07:40:33.813 INFO:tasks.workunit.client.1.smithi133.stdout:0/53: creat d2/d9/db/fe x:0 0 0 2023-12-16T07:40:33.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/61: creat d0/f17 x:0 0 0 2023-12-16T07:40:33.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/62: fdatasync d0/da/f10 0 2023-12-16T07:40:33.815 INFO:tasks.workunit.client.1.smithi133.stdout:9/26: creat f9 x:0 0 0 2023-12-16T07:40:33.816 INFO:tasks.workunit.client.1.smithi133.stdout:2/33: dwrite f4 [0,4194304] 0 2023-12-16T07:40:33.816 INFO:tasks.workunit.client.1.smithi133.stdout:2/34: truncate f3 705607 0 2023-12-16T07:40:33.816 INFO:tasks.workunit.client.1.smithi133.stdout:7/83: dwrite f9 [0,4194304] 0 2023-12-16T07:40:33.819 INFO:tasks.workunit.client.1.smithi133.stdout:4/43: dread d3/d7/fc [0,4194304] 0 2023-12-16T07:40:33.819 INFO:tasks.workunit.client.1.smithi133.stdout:7/84: write db/fe [217295,74370] 0 2023-12-16T07:40:33.819 INFO:tasks.workunit.client.1.smithi133.stdout:0/54: link d2/d9/lc d2/d9/db/lf 0 2023-12-16T07:40:33.819 INFO:tasks.workunit.client.1.smithi133.stdout:0/55: readlink d2/d9/ld 0 2023-12-16T07:40:33.823 INFO:tasks.workunit.client.1.smithi133.stdout:9/27: mknod ca 0 2023-12-16T07:40:33.823 INFO:tasks.workunit.client.1.smithi133.stdout:9/28: fsync f0 0 2023-12-16T07:40:33.823 INFO:tasks.workunit.client.1.smithi133.stdout:9/29: write f9 [254519,2415] 0 2023-12-16T07:40:33.833 INFO:tasks.workunit.client.1.smithi133.stdout:9/30: creat fb x:0 0 0 2023-12-16T07:40:33.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/35: dread f1 [0,4194304] 0 2023-12-16T07:40:33.836 INFO:tasks.workunit.client.1.smithi133.stdout:6/41: rmdir d0/d4 39 2023-12-16T07:40:33.836 INFO:tasks.workunit.client.1.smithi133.stdout:9/31: creat fc x:0 0 0 2023-12-16T07:40:33.838 INFO:tasks.workunit.client.1.smithi133.stdout:2/36: rename f8 to da/fd 0 2023-12-16T07:40:33.839 INFO:tasks.workunit.client.1.smithi133.stdout:2/37: readlink l6 0 2023-12-16T07:40:33.841 INFO:tasks.workunit.client.1.smithi133.stdout:9/32: creat fd x:0 0 0 2023-12-16T07:40:33.843 INFO:tasks.workunit.client.1.smithi133.stdout:2/38: creat da/fe x:0 0 0 2023-12-16T07:40:33.844 INFO:tasks.workunit.client.1.smithi133.stdout:9/33: creat fe x:0 0 0 2023-12-16T07:40:33.846 INFO:tasks.workunit.client.1.smithi133.stdout:9/34: mknod cf 0 2023-12-16T07:40:33.848 INFO:tasks.workunit.client.1.smithi133.stdout:6/42: dread d0/f2 [0,4194304] 0 2023-12-16T07:40:33.850 INFO:tasks.workunit.client.1.smithi133.stdout:9/35: mknod c10 0 2023-12-16T07:40:33.852 INFO:tasks.workunit.client.1.smithi133.stdout:7/85: dwrite db/f11 [0,4194304] 0 2023-12-16T07:40:33.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/56: dwrite d2/d9/db/fe [0,4194304] 0 2023-12-16T07:40:33.852 INFO:tasks.workunit.client.1.smithi133.stdout:4/44: dwrite d3/fa [0,4194304] 0 2023-12-16T07:40:33.852 INFO:tasks.workunit.client.1.smithi133.stdout:4/45: write d3/d7/f11 [302653,775] 0 2023-12-16T07:40:33.852 INFO:tasks.workunit.client.1.smithi133.stdout:4/46: truncate d3/d7/ff 2759804 0 2023-12-16T07:40:33.852 INFO:tasks.workunit.client.1.smithi133.stdout:9/36: symlink l11 0 2023-12-16T07:40:33.861 INFO:tasks.workunit.client.1.smithi133.stdout:0/57: mknod d2/d9/db/c10 0 2023-12-16T07:40:33.861 INFO:tasks.workunit.client.1.smithi133.stdout:0/58: fsync d2/f8 0 2023-12-16T07:40:33.862 INFO:tasks.workunit.client.1.smithi133.stdout:4/47: dread d3/fa [0,4194304] 0 2023-12-16T07:40:33.862 INFO:tasks.workunit.client.1.smithi133.stdout:6/43: dread d0/d4/fc [0,4194304] 0 2023-12-16T07:40:33.863 INFO:tasks.workunit.client.1.smithi133.stdout:2/39: dwrite f7 [0,4194304] 0 2023-12-16T07:40:33.865 INFO:tasks.workunit.client.1.smithi133.stdout:9/37: symlink l12 0 2023-12-16T07:40:33.865 INFO:tasks.workunit.client.1.smithi133.stdout:9/38: truncate fb 421545 0 2023-12-16T07:40:33.873 INFO:tasks.workunit.client.1.smithi133.stdout:4/48: write d3/d7/ff [672828,10345] 0 2023-12-16T07:40:33.873 INFO:tasks.workunit.client.1.smithi133.stdout:0/59: dread d2/f4 [0,4194304] 0 2023-12-16T07:40:33.873 INFO:tasks.workunit.client.1.smithi133.stdout:1/63: write d0/da/db/fd [5203784,128979] 0 2023-12-16T07:40:33.873 INFO:tasks.workunit.client.1.smithi133.stdout:1/64: stat d0/da/db/ff 0 2023-12-16T07:40:33.875 INFO:tasks.workunit.client.1.smithi133.stdout:4/49: mkdir d3/d7/d12 0 2023-12-16T07:40:33.875 INFO:tasks.workunit.client.1.smithi133.stdout:4/50: dread - d3/d7/fb zero size 2023-12-16T07:40:33.877 INFO:tasks.workunit.client.1.smithi133.stdout:0/60: rename d2/d9/db/c10 to d2/d9/c11 0 2023-12-16T07:40:33.880 INFO:tasks.workunit.client.1.smithi133.stdout:1/65: rmdir d0/d12 39 2023-12-16T07:40:33.882 INFO:tasks.workunit.client.1.smithi133.stdout:4/51: rename d3/c10 to d3/d7/c13 0 2023-12-16T07:40:33.890 INFO:tasks.workunit.client.1.smithi133.stdout:4/52: rmdir d3/d7/d12 0 2023-12-16T07:40:33.890 INFO:tasks.workunit.client.1.smithi133.stdout:4/53: stat d3/c8 0 2023-12-16T07:40:33.893 INFO:tasks.workunit.client.1.smithi133.stdout:6/44: dwrite d0/f3 [0,4194304] 0 2023-12-16T07:40:33.894 INFO:tasks.workunit.client.1.smithi133.stdout:4/54: rename d3/d7/f11 to d3/f14 0 2023-12-16T07:40:33.899 INFO:tasks.workunit.client.1.smithi133.stdout:2/40: dwrite f9 [0,4194304] 0 2023-12-16T07:40:33.899 INFO:tasks.workunit.client.1.smithi133.stdout:4/55: mknod d3/c15 0 2023-12-16T07:40:33.901 INFO:tasks.workunit.client.1.smithi133.stdout:4/56: write d3/fa [3499442,104015] 0 2023-12-16T07:40:33.901 INFO:tasks.workunit.client.1.smithi133.stdout:9/39: dwrite f9 [0,4194304] 0 2023-12-16T07:40:33.901 INFO:tasks.workunit.client.1.smithi133.stdout:1/66: dwrite d0/da/db/ff [4194304,4194304] 0 2023-12-16T07:40:33.909 INFO:tasks.workunit.client.1.smithi133.stdout:2/41: rename l6 to da/lf 0 2023-12-16T07:40:33.911 INFO:tasks.workunit.client.1.smithi133.stdout:4/57: dread d3/fa [0,4194304] 0 2023-12-16T07:40:33.911 INFO:tasks.workunit.client.1.smithi133.stdout:4/58: truncate d3/d7/fb 686230 0 2023-12-16T07:40:33.911 INFO:tasks.workunit.client.1.smithi133.stdout:4/59: readlink d3/l5 0 2023-12-16T07:40:33.911 INFO:tasks.workunit.client.1.smithi133.stdout:4/60: write d3/d7/ff [3805137,102532] 0 2023-12-16T07:40:33.912 INFO:tasks.workunit.client.1.smithi133.stdout:1/67: dread d0/da/db/ff [0,4194304] 0 2023-12-16T07:40:33.913 INFO:tasks.workunit.client.1.smithi133.stdout:1/68: fsync d0/f1 0 2023-12-16T07:40:33.916 INFO:tasks.workunit.client.1.smithi133.stdout:9/40: creat f13 x:0 0 0 2023-12-16T07:40:33.916 INFO:tasks.workunit.client.1.smithi133.stdout:9/41: readlink l3 0 2023-12-16T07:40:33.916 INFO:tasks.workunit.client.1.smithi133.stdout:9/42: dread - fe zero size 2023-12-16T07:40:33.916 INFO:tasks.workunit.client.1.smithi133.stdout:9/43: dread - f13 zero size 2023-12-16T07:40:33.917 INFO:tasks.workunit.client.1.smithi133.stdout:2/42: truncate f1 1004959 0 2023-12-16T07:40:33.917 INFO:tasks.workunit.client.1.smithi133.stdout:9/44: write f9 [116793,100692] 0 2023-12-16T07:40:33.919 INFO:tasks.workunit.client.1.smithi133.stdout:7/86: truncate db/fe 864447 0 2023-12-16T07:40:33.920 INFO:tasks.workunit.client.1.smithi133.stdout:6/45: dwrite d0/f3 [0,4194304] 0 2023-12-16T07:40:33.922 INFO:tasks.workunit.client.1.smithi133.stdout:4/61: rename d3/cd to d3/c16 0 2023-12-16T07:40:33.926 INFO:tasks.workunit.client.1.smithi133.stdout:1/69: mknod d0/da/c18 0 2023-12-16T07:40:33.929 INFO:tasks.workunit.client.1.smithi133.stdout:0/61: getdents d2/d9 0 2023-12-16T07:40:33.929 INFO:tasks.workunit.client.1.smithi133.stdout:0/62: fdatasync d2/f4 0 2023-12-16T07:40:33.930 INFO:tasks.workunit.client.1.smithi133.stdout:2/43: creat da/f10 x:0 0 0 2023-12-16T07:40:33.932 INFO:tasks.workunit.client.1.smithi133.stdout:9/45: creat f14 x:0 0 0 2023-12-16T07:40:33.932 INFO:tasks.workunit.client.1.smithi133.stdout:9/46: truncate fc 347231 0 2023-12-16T07:40:33.935 INFO:tasks.workunit.client.1.smithi133.stdout:9/47: fsync f9 0 2023-12-16T07:40:33.936 INFO:tasks.workunit.client.1.smithi133.stdout:7/87: rename c4 to db/c17 0 2023-12-16T07:40:33.939 INFO:tasks.workunit.client.1.smithi133.stdout:6/46: mknod d0/ce 0 2023-12-16T07:40:33.941 INFO:tasks.workunit.client.1.smithi133.stdout:1/70: creat d0/da/f19 x:0 0 0 2023-12-16T07:40:33.942 INFO:tasks.workunit.client.1.smithi133.stdout:0/63: mkdir d2/d9/d12 0 2023-12-16T07:40:33.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/64: write d2/f6 [3499412,121003] 0 2023-12-16T07:40:33.944 INFO:tasks.workunit.client.1.smithi133.stdout:2/44: rename da/fb to da/f11 0 2023-12-16T07:40:33.944 INFO:tasks.workunit.client.1.smithi133.stdout:2/45: dread - da/fe zero size 2023-12-16T07:40:33.944 INFO:tasks.workunit.client.1.smithi133.stdout:2/46: write da/f11 [209445,11677] 0 2023-12-16T07:40:33.946 INFO:tasks.workunit.client.1.smithi133.stdout:9/48: mkdir d15 0 2023-12-16T07:40:33.946 INFO:tasks.workunit.client.1.smithi133.stdout:9/49: stat l11 0 2023-12-16T07:40:33.947 INFO:tasks.workunit.client.1.smithi133.stdout:4/62: dwrite d3/d7/ff [0,4194304] 0 2023-12-16T07:40:33.950 INFO:tasks.workunit.client.1.smithi133.stdout:6/47: mknod d0/d4/cf 0 2023-12-16T07:40:33.950 INFO:tasks.workunit.client.1.smithi133.stdout:1/71: creat d0/f1a x:0 0 0 2023-12-16T07:40:33.951 INFO:tasks.workunit.client.1.smithi133.stdout:9/50: write f0 [7329905,119166] 0 2023-12-16T07:40:33.951 INFO:tasks.workunit.client.1.smithi133.stdout:9/51: chown fd 181 1 2023-12-16T07:40:33.951 INFO:tasks.workunit.client.1.smithi133.stdout:9/52: stat l12 0 2023-12-16T07:40:33.952 INFO:tasks.workunit.client.1.smithi133.stdout:7/88: dwrite db/ff [0,4194304] 0 2023-12-16T07:40:33.953 INFO:tasks.workunit.client.1.smithi133.stdout:2/47: read f3 [530255,61954] 0 2023-12-16T07:40:33.953 INFO:tasks.workunit.client.1.smithi133.stdout:2/48: write da/fd [1015024,107159] 0 2023-12-16T07:40:33.954 INFO:tasks.workunit.client.1.smithi133.stdout:4/63: dread d3/d7/fc [0,4194304] 0 2023-12-16T07:40:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:33 smithi049 ceph-mon[111939]: pgmap v13: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 126 MiB/s rd, 263 MiB/s wr, 397 op/s 2023-12-16T07:40:33.961 INFO:tasks.workunit.client.1.smithi133.stdout:1/72: creat d0/d12/f1b x:0 0 0 2023-12-16T07:40:33.961 INFO:tasks.workunit.client.1.smithi133.stdout:2/49: dread f3 [0,4194304] 0 2023-12-16T07:40:33.965 INFO:tasks.workunit.client.1.smithi133.stdout:4/64: getdents d3/d7 0 2023-12-16T07:40:33.970 INFO:tasks.workunit.client.1.smithi133.stdout:9/53: dread f9 [0,4194304] 0 2023-12-16T07:40:33.971 INFO:tasks.workunit.client.1.smithi133.stdout:9/54: getdents d15 0 2023-12-16T07:40:33.976 INFO:tasks.workunit.client.1.smithi133.stdout:4/65: write d3/d7/ff [4525546,13053] 0 2023-12-16T07:40:33.976 INFO:tasks.workunit.client.1.smithi133.stdout:1/73: dread d0/da/db/fd [0,4194304] 0 2023-12-16T07:40:33.976 INFO:tasks.workunit.client.1.smithi133.stdout:1/74: write d0/d12/f1b [581879,67941] 0 2023-12-16T07:40:33.977 INFO:tasks.workunit.client.1.smithi133.stdout:0/65: dwrite d2/d9/db/fe [0,4194304] 0 2023-12-16T07:40:33.977 INFO:tasks.workunit.client.1.smithi133.stdout:0/66: chown d2/d9/db/lf 0 1 2023-12-16T07:40:33.981 INFO:tasks.workunit.client.1.smithi133.stdout:4/66: dread d3/f14 [0,4194304] 0 2023-12-16T07:40:33.983 INFO:tasks.workunit.client.1.smithi133.stdout:0/67: unlink d2/f4 0 2023-12-16T07:40:33.984 INFO:tasks.workunit.client.1.smithi133.stdout:6/48: dwrite d0/d4/fc [4194304,4194304] 0 2023-12-16T07:40:33.984 INFO:tasks.workunit.client.1.smithi133.stdout:6/49: stat d0/d4 0 2023-12-16T07:40:33.985 INFO:tasks.workunit.client.1.smithi133.stdout:6/50: write d0/f2 [1448477,17441] 0 2023-12-16T07:40:33.987 INFO:tasks.workunit.client.1.smithi133.stdout:7/89: dwrite db/f16 [0,4194304] 0 2023-12-16T07:40:33.987 INFO:tasks.workunit.client.1.smithi133.stdout:7/90: truncate db/f16 4977362 0 2023-12-16T07:40:33.989 INFO:tasks.workunit.client.1.smithi133.stdout:2/50: rmdir da 39 2023-12-16T07:40:33.989 INFO:tasks.workunit.client.1.smithi133.stdout:2/51: chown da/fd 25943397 1 2023-12-16T07:40:33.997 INFO:tasks.workunit.client.1.smithi133.stdout:6/51: rename d0/f3 to d0/d4/f10 0 2023-12-16T07:40:34.000 INFO:tasks.workunit.client.1.smithi133.stdout:7/91: creat db/f18 x:0 0 0 2023-12-16T07:40:34.002 INFO:tasks.workunit.client.1.smithi133.stdout:7/92: dread db/fe [0,4194304] 0 2023-12-16T07:40:34.002 INFO:tasks.workunit.client.1.smithi133.stdout:6/52: write d0/d4/f10 [1646946,78096] 0 2023-12-16T07:40:34.004 INFO:tasks.workunit.client.1.smithi133.stdout:9/55: dread f0 [4194304,4194304] 0 2023-12-16T07:40:34.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/53: unlink d0/c5 0 2023-12-16T07:40:34.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/54: write d0/f6 [355668,102517] 0 2023-12-16T07:40:34.009 INFO:tasks.workunit.client.1.smithi133.stdout:4/67: dwrite d3/d7/ff [0,4194304] 0 2023-12-16T07:40:34.014 INFO:tasks.workunit.client.1.smithi133.stdout:6/55: creat d0/d4/f11 x:0 0 0 2023-12-16T07:40:34.014 INFO:tasks.workunit.client.1.smithi133.stdout:6/56: readlink - no filename 2023-12-16T07:40:34.017 INFO:tasks.workunit.client.1.smithi133.stdout:4/68: symlink d3/d7/l17 0 2023-12-16T07:40:34.017 INFO:tasks.workunit.client.1.smithi133.stdout:4/69: chown d3/d7/c9 5 1 2023-12-16T07:40:34.018 INFO:tasks.workunit.client.1.smithi133.stdout:2/52: dread f9 [0,4194304] 0 2023-12-16T07:40:34.018 INFO:tasks.workunit.client.1.smithi133.stdout:0/68: dwrite d2/f3 [0,4194304] 0 2023-12-16T07:40:34.022 INFO:tasks.workunit.client.1.smithi133.stdout:2/53: creat da/f12 x:0 0 0 2023-12-16T07:40:34.022 INFO:tasks.workunit.client.1.smithi133.stdout:2/54: chown da/f10 1230487315 1 2023-12-16T07:40:34.023 INFO:tasks.workunit.client.1.smithi133.stdout:4/70: dread d3/fa [0,4194304] 0 2023-12-16T07:40:34.025 INFO:tasks.workunit.client.1.smithi133.stdout:7/93: dwrite db/fe [0,4194304] 0 2023-12-16T07:40:34.029 INFO:tasks.workunit.client.1.smithi133.stdout:0/69: dread d2/f8 [0,4194304] 0 2023-12-16T07:40:34.033 INFO:tasks.workunit.client.1.smithi133.stdout:0/70: fsync d2/f3 0 2023-12-16T07:40:34.034 INFO:tasks.workunit.client.1.smithi133.stdout:4/71: read d3/d7/ff [3437059,70823] 0 2023-12-16T07:40:34.034 INFO:tasks.workunit.client.1.smithi133.stdout:0/71: chown d2/d9/c11 6507 1 2023-12-16T07:40:34.038 INFO:tasks.workunit.client.1.smithi133.stdout:9/56: dwrite fe [0,4194304] 0 2023-12-16T07:40:34.038 INFO:tasks.workunit.client.1.smithi133.stdout:7/94: dread db/f11 [0,4194304] 0 2023-12-16T07:40:34.041 INFO:tasks.workunit.client.1.smithi133.stdout:6/57: dwrite d0/f6 [0,4194304] 0 2023-12-16T07:40:34.041 INFO:tasks.workunit.client.1.smithi133.stdout:2/55: dread f7 [0,4194304] 0 2023-12-16T07:40:34.042 INFO:tasks.workunit.client.1.smithi133.stdout:2/56: chown da/fd 58 1 2023-12-16T07:40:34.042 INFO:tasks.workunit.client.1.smithi133.stdout:2/57: readlink da/lf 0 2023-12-16T07:40:34.043 INFO:tasks.workunit.client.1.smithi133.stdout:0/72: write d2/f6 [4146112,50525] 0 2023-12-16T07:40:34.045 INFO:tasks.workunit.client.1.smithi133.stdout:9/57: creat d15/f16 x:0 0 0 2023-12-16T07:40:34.045 INFO:tasks.workunit.client.1.smithi133.stdout:9/58: truncate f13 141150 0 2023-12-16T07:40:34.049 INFO:tasks.workunit.client.1.smithi133.stdout:7/95: mknod db/c19 0 2023-12-16T07:40:34.050 INFO:tasks.workunit.client.1.smithi133.stdout:6/58: symlink d0/l12 0 2023-12-16T07:40:34.051 INFO:tasks.workunit.client.1.smithi133.stdout:4/72: dwrite d3/fa [4194304,4194304] 0 2023-12-16T07:40:34.051 INFO:tasks.workunit.client.1.smithi133.stdout:4/73: write d3/d7/ff [5140346,99441] 0 2023-12-16T07:40:34.052 INFO:tasks.workunit.client.1.smithi133.stdout:4/74: readlink d3/d7/l17 0 2023-12-16T07:40:34.052 INFO:tasks.workunit.client.1.smithi133.stdout:4/75: stat d3/c15 0 2023-12-16T07:40:34.052 INFO:tasks.workunit.client.1.smithi133.stdout:4/76: read d3/d7/fc [307455,4426] 0 2023-12-16T07:40:34.052 INFO:tasks.workunit.client.1.smithi133.stdout:2/58: creat da/f13 x:0 0 0 2023-12-16T07:40:34.053 INFO:tasks.workunit.client.1.smithi133.stdout:7/96: write db/fe [3952523,7653] 0 2023-12-16T07:40:34.056 INFO:tasks.workunit.client.1.smithi133.stdout:9/59: creat d15/f17 x:0 0 0 2023-12-16T07:40:34.061 INFO:tasks.workunit.client.1.smithi133.stdout:4/77: rename d3/d7/c13 to d3/d7/c18 0 2023-12-16T07:40:34.066 INFO:tasks.workunit.client.1.smithi133.stdout:7/97: mknod db/d12/c1a 0 2023-12-16T07:40:34.067 INFO:tasks.workunit.client.1.smithi133.stdout:7/98: write db/f16 [3426288,94978] 0 2023-12-16T07:40:34.071 INFO:tasks.workunit.client.1.smithi133.stdout:6/59: rmdir d0 39 2023-12-16T07:40:34.078 INFO:tasks.workunit.client.1.smithi133.stdout:9/60: dwrite f13 [0,4194304] 0 2023-12-16T07:40:34.087 INFO:tasks.workunit.client.1.smithi133.stdout:7/99: dwrite db/fe [0,4194304] 0 2023-12-16T07:40:34.087 INFO:tasks.workunit.client.1.smithi133.stdout:7/100: read - db/d12/f15 zero size 2023-12-16T07:40:34.087 INFO:tasks.workunit.client.1.smithi133.stdout:6/60: dread d0/f2 [0,4194304] 0 2023-12-16T07:40:34.087 INFO:tasks.workunit.client.1.smithi133.stdout:9/61: mkdir d15/d18 0 2023-12-16T07:40:34.088 INFO:tasks.workunit.client.1.smithi133.stdout:4/78: dread d3/d7/fb [0,4194304] 0 2023-12-16T07:40:34.089 INFO:tasks.workunit.client.1.smithi133.stdout:7/101: getdents db 0 2023-12-16T07:40:34.092 INFO:tasks.workunit.client.1.smithi133.stdout:6/61: rmdir d0/db 0 2023-12-16T07:40:34.097 INFO:tasks.workunit.client.1.smithi133.stdout:4/79: creat d3/d7/f19 x:0 0 0 2023-12-16T07:40:34.097 INFO:tasks.workunit.client.1.smithi133.stdout:4/80: fdatasync d3/f14 0 2023-12-16T07:40:34.097 INFO:tasks.workunit.client.1.smithi133.stdout:4/81: stat d3/l5 0 2023-12-16T07:40:34.098 INFO:tasks.workunit.client.1.smithi133.stdout:0/73: truncate d2/d9/db/fe 2598582 0 2023-12-16T07:40:34.100 INFO:tasks.workunit.client.1.smithi133.stdout:7/102: mknod db/c1b 0 2023-12-16T07:40:34.108 INFO:tasks.workunit.client.1.smithi133.stdout:2/59: dwrite f4 [4194304,4194304] 0 2023-12-16T07:40:34.109 INFO:tasks.workunit.client.1.smithi133.stdout:2/60: write f1 [960673,99645] 0 2023-12-16T07:40:34.115 INFO:tasks.workunit.client.1.smithi133.stdout:6/62: creat d0/f13 x:0 0 0 2023-12-16T07:40:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:33 smithi133 ceph-mon[120445]: pgmap v13: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 126 MiB/s rd, 263 MiB/s wr, 397 op/s 2023-12-16T07:40:34.120 INFO:tasks.workunit.client.1.smithi133.stdout:4/82: mkdir d3/d7/d1a 0 2023-12-16T07:40:34.120 INFO:tasks.workunit.client.1.smithi133.stdout:4/83: write d3/d7/fb [1529685,121609] 0 2023-12-16T07:40:34.121 INFO:tasks.workunit.client.1.smithi133.stdout:7/103: write db/d12/f15 [757022,51562] 0 2023-12-16T07:40:34.121 INFO:tasks.workunit.client.1.smithi133.stdout:7/104: readlink l8 0 2023-12-16T07:40:34.125 INFO:tasks.workunit.client.1.smithi133.stdout:2/61: mknod da/c14 0 2023-12-16T07:40:34.126 INFO:tasks.workunit.client.1.smithi133.stdout:4/84: mknod d3/d7/d1a/c1b 0 2023-12-16T07:40:34.127 INFO:tasks.workunit.client.1.smithi133.stdout:4/85: truncate d3/d7/f19 718285 0 2023-12-16T07:40:34.128 INFO:tasks.workunit.client.1.smithi133.stdout:7/105: fsync db/ff 0 2023-12-16T07:40:34.131 INFO:tasks.workunit.client.1.smithi133.stdout:6/63: dwrite d0/f13 [0,4194304] 0 2023-12-16T07:40:34.131 INFO:tasks.workunit.client.1.smithi133.stdout:6/64: fdatasync d0/f2 0 2023-12-16T07:40:34.131 INFO:tasks.workunit.client.1.smithi133.stdout:4/86: mkdir d3/d7/d1c 0 2023-12-16T07:40:34.136 INFO:tasks.workunit.client.1.smithi133.stdout:6/65: symlink d0/d4/l14 0 2023-12-16T07:40:34.137 INFO:tasks.workunit.client.1.smithi133.stdout:4/87: symlink d3/l1d 0 2023-12-16T07:40:34.138 INFO:tasks.workunit.client.1.smithi133.stdout:4/88: fsync d3/d7/ff 0 2023-12-16T07:40:34.138 INFO:tasks.workunit.client.1.smithi133.stdout:4/89: chown d3/fa 70555 1 2023-12-16T07:40:34.138 INFO:tasks.workunit.client.1.smithi133.stdout:4/90: read d3/d7/fc [145769,31753] 0 2023-12-16T07:40:34.141 INFO:tasks.workunit.client.1.smithi133.stdout:6/66: creat d0/d4/f15 x:0 0 0 2023-12-16T07:40:34.141 INFO:tasks.workunit.client.1.smithi133.stdout:2/62: dwrite da/f10 [0,4194304] 0 2023-12-16T07:40:34.142 INFO:tasks.workunit.client.1.smithi133.stdout:6/67: write d0/f6 [2699731,90933] 0 2023-12-16T07:40:34.143 INFO:tasks.workunit.client.1.smithi133.stdout:7/106: link db/f11 db/f1c 0 2023-12-16T07:40:34.146 INFO:tasks.workunit.client.1.smithi133.stdout:2/63: mkdir da/d15 0 2023-12-16T07:40:34.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/68: mknod d0/d4/c16 0 2023-12-16T07:40:34.150 INFO:tasks.workunit.client.1.smithi133.stdout:7/107: symlink db/d12/l1d 0 2023-12-16T07:40:34.152 INFO:tasks.workunit.client.1.smithi133.stdout:2/64: symlink da/l16 0 2023-12-16T07:40:34.152 INFO:tasks.workunit.client.1.smithi133.stdout:2/65: chown da/f12 10645206 1 2023-12-16T07:40:34.152 INFO:tasks.workunit.client.1.smithi133.stdout:2/66: chown f7 132366 1 2023-12-16T07:40:34.157 INFO:tasks.workunit.client.1.smithi133.stdout:2/67: mkdir da/d15/d17 0 2023-12-16T07:40:34.158 INFO:tasks.workunit.client.1.smithi133.stdout:6/69: truncate d0/f6 347455 0 2023-12-16T07:40:34.161 INFO:tasks.workunit.client.1.smithi133.stdout:7/108: rename db/cc to db/d12/c1e 0 2023-12-16T07:40:34.162 INFO:tasks.workunit.client.1.smithi133.stdout:7/109: read db/f1c [3667101,70813] 0 2023-12-16T07:40:34.162 INFO:tasks.workunit.client.1.smithi133.stdout:4/91: truncate d3/d7/f19 385947 0 2023-12-16T07:40:34.162 INFO:tasks.workunit.client.1.smithi133.stdout:4/92: chown d3/l5 7336 1 2023-12-16T07:40:34.165 INFO:tasks.workunit.client.1.smithi133.stdout:2/68: creat da/d15/d17/f18 x:0 0 0 2023-12-16T07:40:34.165 INFO:tasks.workunit.client.1.smithi133.stdout:2/69: write da/f13 [460857,113161] 0 2023-12-16T07:40:34.165 INFO:tasks.workunit.client.1.smithi133.stdout:2/70: truncate da/f10 4855371 0 2023-12-16T07:40:34.167 INFO:tasks.workunit.client.1.smithi133.stdout:7/110: creat db/f1f x:0 0 0 2023-12-16T07:40:34.170 INFO:tasks.workunit.client.1.smithi133.stdout:4/93: link c2 d3/c1e 0 2023-12-16T07:40:34.175 INFO:tasks.workunit.client.1.smithi133.stdout:2/71: link da/l16 da/d15/d17/l19 0 2023-12-16T07:40:34.178 INFO:tasks.workunit.client.1.smithi133.stdout:6/70: dwrite d0/f1 [0,4194304] 0 2023-12-16T07:40:34.182 INFO:tasks.workunit.client.1.smithi133.stdout:6/71: getdents d0 0 2023-12-16T07:40:34.182 INFO:tasks.workunit.client.1.smithi133.stdout:6/72: fdatasync d0/d4/f11 0 2023-12-16T07:40:34.185 INFO:tasks.workunit.client.1.smithi133.stdout:6/73: dread d0/f2 [0,4194304] 0 2023-12-16T07:40:34.185 INFO:tasks.workunit.client.1.smithi133.stdout:6/74: chown d0/f2 105 1 2023-12-16T07:40:34.189 INFO:tasks.workunit.client.1.smithi133.stdout:4/94: dwrite d3/d7/ff [0,4194304] 0 2023-12-16T07:40:34.191 INFO:tasks.workunit.client.1.smithi133.stdout:4/95: unlink d3/d7/f19 0 2023-12-16T07:40:34.191 INFO:tasks.workunit.client.1.smithi133.stdout:4/96: fsync d3/fa 0 2023-12-16T07:40:34.192 INFO:tasks.workunit.client.1.smithi133.stdout:2/72: truncate da/f10 4239187 0 2023-12-16T07:40:34.196 INFO:tasks.workunit.client.1.smithi133.stdout:4/97: rename d3/d7/fc to d3/d7/f1f 0 2023-12-16T07:40:34.197 INFO:tasks.workunit.client.1.smithi133.stdout:4/98: chown d3/c8 563073314 1 2023-12-16T07:40:34.198 INFO:tasks.workunit.client.1.smithi133.stdout:4/99: dread d3/d7/f1f [0,4194304] 0 2023-12-16T07:40:34.202 INFO:tasks.workunit.client.1.smithi133.stdout:7/111: dread db/ff [0,4194304] 0 2023-12-16T07:40:34.203 INFO:tasks.workunit.client.1.smithi133.stdout:2/73: dread f7 [0,4194304] 0 2023-12-16T07:40:34.207 INFO:tasks.workunit.client.1.smithi133.stdout:7/112: rename db/f1f to db/d12/f20 0 2023-12-16T07:40:34.208 INFO:tasks.workunit.client.1.smithi133.stdout:6/75: dwrite d0/d4/fc [0,4194304] 0 2023-12-16T07:40:34.217 INFO:tasks.workunit.client.1.smithi133.stdout:6/76: symlink d0/l17 0 2023-12-16T07:40:34.217 INFO:tasks.workunit.client.1.smithi133.stdout:6/77: chown d0/d4/c16 2 1 2023-12-16T07:40:34.217 INFO:tasks.workunit.client.1.smithi133.stdout:4/100: dwrite d3/d7/ff [0,4194304] 0 2023-12-16T07:40:34.217 INFO:tasks.workunit.client.1.smithi133.stdout:6/78: dread - d0/d4/f11 zero size 2023-12-16T07:40:34.221 INFO:tasks.workunit.client.1.smithi133.stdout:7/113: mkdir db/d21 0 2023-12-16T07:40:34.226 INFO:tasks.workunit.client.1.smithi133.stdout:4/101: link d3/fa d3/d7/d1a/f20 0 2023-12-16T07:40:34.231 INFO:tasks.workunit.client.1.smithi133.stdout:6/79: creat d0/f18 x:0 0 0 2023-12-16T07:40:34.231 INFO:tasks.workunit.client.1.smithi133.stdout:7/114: chown db/c19 418 1 2023-12-16T07:40:34.233 INFO:tasks.workunit.client.1.smithi133.stdout:4/102: unlink d3/l1d 0 2023-12-16T07:40:34.236 INFO:tasks.workunit.client.1.smithi133.stdout:6/80: rename d0/f6 to d0/d4/f19 0 2023-12-16T07:40:34.237 INFO:tasks.workunit.client.1.smithi133.stdout:6/81: write d0/f2 [1493835,51155] 0 2023-12-16T07:40:34.237 INFO:tasks.workunit.client.1.smithi133.stdout:7/115: creat db/f22 x:0 0 0 2023-12-16T07:40:34.240 INFO:tasks.workunit.client.1.smithi133.stdout:6/82: rename d0/d4/c7 to d0/d4/c1a 0 2023-12-16T07:40:34.241 INFO:tasks.workunit.client.1.smithi133.stdout:7/116: creat db/d21/f23 x:0 0 0 2023-12-16T07:40:34.241 INFO:tasks.workunit.client.1.smithi133.stdout:7/117: readlink db/d12/l1d 0 2023-12-16T07:40:34.242 INFO:tasks.workunit.client.1.smithi133.stdout:6/83: rename d0/d4/fc to d0/f1b 0 2023-12-16T07:40:34.242 INFO:tasks.workunit.client.1.smithi133.stdout:7/118: symlink db/d12/l24 0 2023-12-16T07:40:34.243 INFO:tasks.workunit.client.1.smithi133.stdout:6/84: write d0/d4/f10 [829555,130438] 0 2023-12-16T07:40:34.243 INFO:tasks.workunit.client.1.smithi133.stdout:6/85: chown d0/l12 665 1 2023-12-16T07:40:34.245 INFO:tasks.workunit.client.1.smithi133.stdout:6/86: unlink d0/d4/cf 0 2023-12-16T07:40:34.245 INFO:tasks.workunit.client.1.smithi133.stdout:6/87: write d0/d4/f15 [913154,124800] 0 2023-12-16T07:40:34.245 INFO:tasks.workunit.client.1.smithi133.stdout:6/88: chown d0/f1b 25 1 2023-12-16T07:40:34.245 INFO:tasks.workunit.client.1.smithi133.stdout:6/89: stat d0/d4/f11 0 2023-12-16T07:40:34.246 INFO:tasks.workunit.client.1.smithi133.stdout:6/90: read d0/f1b [31079,99076] 0 2023-12-16T07:40:34.246 INFO:tasks.workunit.client.1.smithi133.stdout:6/91: readlink d0/d4/l14 0 2023-12-16T07:40:34.246 INFO:tasks.workunit.client.1.smithi133.stdout:6/92: creat d0/d4/f1c x:0 0 0 2023-12-16T07:40:34.248 INFO:tasks.workunit.client.1.smithi133.stdout:6/93: mknod d0/d4/c1d 0 2023-12-16T07:40:34.248 INFO:tasks.workunit.client.1.smithi133.stdout:6/94: write d0/f18 [134827,81891] 0 2023-12-16T07:40:34.248 INFO:tasks.workunit.client.1.smithi133.stdout:4/103: dwrite d3/f14 [0,4194304] 0 2023-12-16T07:40:34.251 INFO:tasks.workunit.client.1.smithi133.stdout:4/104: mknod d3/c21 0 2023-12-16T07:40:34.252 INFO:tasks.workunit.client.1.smithi133.stdout:4/105: write d3/d7/f1f [1201861,110158] 0 2023-12-16T07:40:34.253 INFO:tasks.workunit.client.1.smithi133.stdout:4/106: rename d3/c21 to d3/c22 0 2023-12-16T07:40:34.257 INFO:tasks.workunit.client.1.smithi133.stdout:4/107: rmdir d3/d7 39 2023-12-16T07:40:34.260 INFO:tasks.workunit.client.1.smithi133.stdout:4/108: write d3/d7/ff [2074521,125989] 0 2023-12-16T07:40:34.264 INFO:tasks.workunit.client.1.smithi133.stdout:6/95: dwrite d0/d4/f1c [0,4194304] 0 2023-12-16T07:40:34.271 INFO:tasks.workunit.client.1.smithi133.stdout:7/119: getdents db 0 2023-12-16T07:40:34.271 INFO:tasks.workunit.client.1.smithi133.stdout:7/120: dread - db/d12/f20 zero size 2023-12-16T07:40:34.271 INFO:tasks.workunit.client.1.smithi133.stdout:7/121: fdatasync db/fe 0 2023-12-16T07:40:34.271 INFO:tasks.workunit.client.1.smithi133.stdout:7/122: read db/f11 [1768581,73174] 0 2023-12-16T07:40:34.274 INFO:tasks.workunit.client.1.smithi133.stdout:7/123: creat db/d21/f25 x:0 0 0 2023-12-16T07:40:34.274 INFO:tasks.workunit.client.1.smithi133.stdout:7/124: read - db/f22 zero size 2023-12-16T07:40:34.276 INFO:tasks.workunit.client.1.smithi133.stdout:4/109: dwrite d3/d7/d1a/f20 [4194304,4194304] 0 2023-12-16T07:40:34.277 INFO:tasks.workunit.client.1.smithi133.stdout:7/125: rename db/d12/f20 to db/d21/f26 0 2023-12-16T07:40:34.277 INFO:tasks.workunit.client.1.smithi133.stdout:7/126: fdatasync db/d21/f25 0 2023-12-16T07:40:34.282 INFO:tasks.workunit.client.1.smithi133.stdout:4/110: creat d3/d7/f23 x:0 0 0 2023-12-16T07:40:34.289 INFO:tasks.workunit.client.1.smithi133.stdout:6/96: dwrite d0/d4/f11 [0,4194304] 0 2023-12-16T07:40:34.302 INFO:tasks.workunit.client.1.smithi133.stdout:7/127: dwrite db/f11 [0,4194304] 0 2023-12-16T07:40:34.302 INFO:tasks.workunit.client.1.smithi133.stdout:4/111: dwrite d3/d7/f23 [0,4194304] 0 2023-12-16T07:40:34.303 INFO:tasks.workunit.client.1.smithi133.stdout:7/128: symlink db/d21/l27 0 2023-12-16T07:40:34.303 INFO:tasks.workunit.client.1.smithi133.stdout:7/129: dread - db/f22 zero size 2023-12-16T07:40:34.307 INFO:tasks.workunit.client.1.smithi133.stdout:4/112: write d3/d7/f23 [3855337,70706] 0 2023-12-16T07:40:34.310 INFO:tasks.workunit.client.1.smithi133.stdout:7/130: creat db/d21/f28 x:0 0 0 2023-12-16T07:40:34.311 INFO:tasks.workunit.client.1.smithi133.stdout:7/131: mknod db/c29 0 2023-12-16T07:40:34.312 INFO:tasks.workunit.client.1.smithi133.stdout:7/132: creat db/d21/f2a x:0 0 0 2023-12-16T07:40:34.312 INFO:tasks.workunit.client.1.smithi133.stdout:7/133: write db/d21/f25 [265649,15376] 0 2023-12-16T07:40:34.312 INFO:tasks.workunit.client.1.smithi133.stdout:7/134: write db/f18 [321298,62439] 0 2023-12-16T07:40:34.312 INFO:tasks.workunit.client.1.smithi133.stdout:7/135: chown db/f16 4 1 2023-12-16T07:40:34.313 INFO:tasks.workunit.client.1.smithi133.stdout:7/136: symlink db/l2b 0 2023-12-16T07:40:34.315 INFO:tasks.workunit.client.1.smithi133.stdout:7/137: mkdir db/d21/d2c 0 2023-12-16T07:40:34.315 INFO:tasks.workunit.client.1.smithi133.stdout:7/138: chown db/f16 634 1 2023-12-16T07:40:34.315 INFO:tasks.workunit.client.1.smithi133.stdout:7/139: write db/d21/f28 [815505,42356] 0 2023-12-16T07:40:34.317 INFO:tasks.workunit.client.1.smithi133.stdout:6/97: dwrite d0/f18 [0,4194304] 0 2023-12-16T07:40:34.320 INFO:tasks.workunit.client.1.smithi133.stdout:6/98: link d0/d4/c1d d0/c1e 0 2023-12-16T07:40:34.327 INFO:tasks.workunit.client.1.smithi133.stdout:4/113: dread d3/d7/f1f [0,4194304] 0 2023-12-16T07:40:34.329 INFO:tasks.workunit.client.1.smithi133.stdout:4/114: rmdir d3 39 2023-12-16T07:40:34.329 INFO:tasks.workunit.client.1.smithi133.stdout:4/115: chown d3/l5 2 1 2023-12-16T07:40:34.331 INFO:tasks.workunit.client.1.smithi133.stdout:4/116: write d3/fa [1445784,104069] 0 2023-12-16T07:40:34.333 INFO:tasks.workunit.client.1.smithi133.stdout:7/140: dwrite db/d21/f28 [0,4194304] 0 2023-12-16T07:40:34.336 INFO:tasks.workunit.client.1.smithi133.stdout:7/141: mknod db/c2d 0 2023-12-16T07:40:34.337 INFO:tasks.workunit.client.1.smithi133.stdout:7/142: write f9 [2471419,83585] 0 2023-12-16T07:40:34.340 INFO:tasks.workunit.client.1.smithi133.stdout:6/99: getdents d0 0 2023-12-16T07:40:34.342 INFO:tasks.workunit.client.1.smithi133.stdout:6/100: rmdir d0 39 2023-12-16T07:40:34.344 INFO:tasks.workunit.client.1.smithi133.stdout:4/117: dread d3/fa [4194304,4194304] 0 2023-12-16T07:40:34.346 INFO:tasks.workunit.client.1.smithi133.stdout:6/101: mknod d0/c1f 0 2023-12-16T07:40:34.359 INFO:tasks.workunit.client.1.smithi133.stdout:4/118: dwrite d3/d7/ff [4194304,4194304] 0 2023-12-16T07:40:34.361 INFO:tasks.workunit.client.1.smithi133.stdout:4/119: link d3/f14 d3/d7/d1a/f24 0 2023-12-16T07:40:34.363 INFO:tasks.workunit.client.1.smithi133.stdout:4/120: stat c2 0 2023-12-16T07:40:34.366 INFO:tasks.workunit.client.1.smithi133.stdout:6/102: dwrite d0/d4/f19 [0,4194304] 0 2023-12-16T07:40:34.367 INFO:tasks.workunit.client.1.smithi133.stdout:6/103: rename d0/d4/cd to d0/d4/c20 0 2023-12-16T07:40:34.373 INFO:tasks.workunit.client.1.smithi133.stdout:6/104: dread d0/d4/f15 [0,4194304] 0 2023-12-16T07:40:34.381 INFO:tasks.workunit.client.1.smithi133.stdout:4/121: dwrite d3/d7/f1f [4194304,4194304] 0 2023-12-16T07:40:34.381 INFO:tasks.workunit.client.1.smithi133.stdout:4/122: chown d3/d7/c9 396721838 1 2023-12-16T07:40:34.381 INFO:tasks.workunit.client.1.smithi133.stdout:4/123: readlink d3/l5 0 2023-12-16T07:40:34.381 INFO:tasks.workunit.client.1.smithi133.stdout:4/124: stat d3/d7/f23 0 2023-12-16T07:40:34.385 INFO:tasks.workunit.client.1.smithi133.stdout:4/125: dread d3/d7/d1a/f20 [0,4194304] 0 2023-12-16T07:40:34.386 INFO:tasks.workunit.client.1.smithi133.stdout:6/105: dread d0/d4/f11 [0,4194304] 0 2023-12-16T07:40:34.386 INFO:tasks.workunit.client.1.smithi133.stdout:6/106: fdatasync d0/d4/f11 0 2023-12-16T07:40:34.386 INFO:tasks.workunit.client.1.smithi133.stdout:6/107: chown d0/d4 411623 1 2023-12-16T07:40:34.387 INFO:tasks.workunit.client.1.smithi133.stdout:4/126: creat d3/f25 x:0 0 0 2023-12-16T07:40:34.387 INFO:tasks.workunit.client.1.smithi133.stdout:4/127: readlink d3/l5 0 2023-12-16T07:40:34.388 INFO:tasks.workunit.client.1.smithi133.stdout:6/108: mkdir d0/d4/d21 0 2023-12-16T07:40:34.398 INFO:tasks.workunit.client.1.smithi133.stdout:6/109: dread d0/d4/f10 [0,4194304] 0 2023-12-16T07:40:34.400 INFO:tasks.workunit.client.1.smithi133.stdout:6/110: mknod d0/d4/d21/c22 0 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:4/128: sync 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:7/143: sync 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:0/74: sync 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:4/129: chown d3 448584 1 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:2/74: sync 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:6/111: sync 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:6/112: truncate d0/f18 4581191 0 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:9/62: sync 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:1/75: sync 2023-12-16T07:40:34.857 INFO:tasks.workunit.client.1.smithi133.stdout:9/63: fsync d15/f17 0 2023-12-16T07:40:34.858 INFO:tasks.workunit.client.1.smithi133.stdout:5/13: sync 2023-12-16T07:40:34.858 INFO:tasks.workunit.client.1.smithi133.stdout:3/8: sync 2023-12-16T07:40:34.858 INFO:tasks.workunit.client.1.smithi133.stdout:9/64: stat d15 0 2023-12-16T07:40:34.858 INFO:tasks.workunit.client.1.smithi133.stdout:1/76: fdatasync d0/da/f10 0 2023-12-16T07:40:34.858 INFO:tasks.workunit.client.1.smithi133.stdout:8/76: sync 2023-12-16T07:40:34.858 INFO:tasks.workunit.client.1.smithi133.stdout:5/14: read d1/f3 [539972,55456] 0 2023-12-16T07:40:34.858 INFO:tasks.workunit.client.1.smithi133.stdout:7/144: mknod db/d21/d2c/c2e 0 2023-12-16T07:40:34.859 INFO:tasks.workunit.client.1.smithi133.stdout:0/75: symlink d2/d9/db/l13 0 2023-12-16T07:40:34.860 INFO:tasks.workunit.client.1.smithi133.stdout:2/75: rmdir da/d15/d17 39 2023-12-16T07:40:34.862 INFO:tasks.workunit.client.1.smithi133.stdout:6/113: creat d0/d4/d21/f23 x:0 0 0 2023-12-16T07:40:34.863 INFO:tasks.workunit.client.1.smithi133.stdout:3/9: symlink l4 0 2023-12-16T07:40:34.865 INFO:tasks.workunit.client.1.smithi133.stdout:1/77: mkdir d0/d1c 0 2023-12-16T07:40:34.866 INFO:tasks.workunit.client.1.smithi133.stdout:1/78: read d0/da/db/ff [20526,32519] 0 2023-12-16T07:40:34.866 INFO:tasks.workunit.client.1.smithi133.stdout:8/77: symlink d9/l13 0 2023-12-16T07:40:34.867 INFO:tasks.workunit.client.1.smithi133.stdout:6/114: mknod d0/c24 0 2023-12-16T07:40:34.873 INFO:tasks.workunit.client.1.smithi133.stdout:7/145: dread db/fe [0,4194304] 0 2023-12-16T07:40:34.874 INFO:tasks.workunit.client.1.smithi133.stdout:8/78: creat d9/d11/f14 x:0 0 0 2023-12-16T07:40:34.874 INFO:tasks.workunit.client.1.smithi133.stdout:8/79: fsync f8 0 2023-12-16T07:40:34.874 INFO:tasks.workunit.client.1.smithi133.stdout:8/80: write d9/d11/f14 [760205,31210] 0 2023-12-16T07:40:34.874 INFO:tasks.workunit.client.1.smithi133.stdout:8/81: rename d9/d11 to d9/d11/d15 22 2023-12-16T07:40:34.876 INFO:tasks.workunit.client.1.smithi133.stdout:4/130: dwrite d3/fa [0,4194304] 0 2023-12-16T07:40:34.877 INFO:tasks.workunit.client.1.smithi133.stdout:6/115: unlink d0/d4/f15 0 2023-12-16T07:40:34.879 INFO:tasks.workunit.client.1.smithi133.stdout:4/131: rename d3/d7/ff to d3/d7/d1a/f26 0 2023-12-16T07:40:34.879 INFO:tasks.workunit.client.1.smithi133.stdout:4/132: fdatasync d3/d7/fb 0 2023-12-16T07:40:34.880 INFO:tasks.workunit.client.1.smithi133.stdout:9/65: dread fe [0,4194304] 0 2023-12-16T07:40:34.881 INFO:tasks.workunit.client.1.smithi133.stdout:6/116: symlink d0/l25 0 2023-12-16T07:40:34.881 INFO:tasks.workunit.client.1.smithi133.stdout:6/117: chown d0/d4/d21/f23 11257 1 2023-12-16T07:40:34.882 INFO:tasks.workunit.client.1.smithi133.stdout:0/76: dread d2/f6 [0,4194304] 0 2023-12-16T07:40:34.883 INFO:tasks.workunit.client.1.smithi133.stdout:4/133: creat d3/d7/d1a/f27 x:0 0 0 2023-12-16T07:40:34.883 INFO:tasks.workunit.client.1.smithi133.stdout:4/134: chown c0 24511766 1 2023-12-16T07:40:34.883 INFO:tasks.workunit.client.1.smithi133.stdout:9/66: write f13 [2619775,66173] 0 2023-12-16T07:40:34.886 INFO:tasks.workunit.client.1.smithi133.stdout:4/135: rename d3/l4 to d3/l28 0 2023-12-16T07:40:34.886 INFO:tasks.workunit.client.1.smithi133.stdout:0/77: write d2/f8 [1318973,19662] 0 2023-12-16T07:40:34.886 INFO:tasks.workunit.client.1.smithi133.stdout:0/78: write d2/f3 [4408432,93743] 0 2023-12-16T07:40:34.888 INFO:tasks.workunit.client.1.smithi133.stdout:3/10: dwrite f3 [0,4194304] 0 2023-12-16T07:40:34.889 INFO:tasks.workunit.client.1.smithi133.stdout:4/136: symlink d3/l29 0 2023-12-16T07:40:34.890 INFO:tasks.workunit.client.1.smithi133.stdout:4/137: dread - d3/f25 zero size 2023-12-16T07:40:34.892 INFO:tasks.workunit.client.1.smithi133.stdout:0/79: creat d2/d9/d12/f14 x:0 0 0 2023-12-16T07:40:34.895 INFO:tasks.workunit.client.1.smithi133.stdout:3/11: mknod c5 0 2023-12-16T07:40:34.896 INFO:tasks.workunit.client.1.smithi133.stdout:4/138: mkdir d3/d7/d1c/d2a 0 2023-12-16T07:40:34.901 INFO:tasks.workunit.client.1.smithi133.stdout:9/67: dwrite d15/f16 [0,4194304] 0 2023-12-16T07:40:34.904 INFO:tasks.workunit.client.1.smithi133.stdout:3/12: write f3 [1658528,29843] 0 2023-12-16T07:40:34.907 INFO:tasks.workunit.client.1.smithi133.stdout:7/146: dwrite db/ff [0,4194304] 0 2023-12-16T07:40:34.908 INFO:tasks.workunit.client.1.smithi133.stdout:6/118: dread d0/f13 [0,4194304] 0 2023-12-16T07:40:34.909 INFO:tasks.workunit.client.1.smithi133.stdout:3/13: rename f2 to f6 0 2023-12-16T07:40:34.910 INFO:tasks.workunit.client.1.smithi133.stdout:4/139: dread d3/d7/d1a/f24 [4194304,4194304] 0 2023-12-16T07:40:34.910 INFO:tasks.workunit.client.1.smithi133.stdout:4/140: chown d3/d7/d1c 4962 1 2023-12-16T07:40:34.912 INFO:tasks.workunit.client.1.smithi133.stdout:6/119: mknod d0/d4/c26 0 2023-12-16T07:40:34.914 INFO:tasks.workunit.client.1.smithi133.stdout:7/147: creat db/d21/f2f x:0 0 0 2023-12-16T07:40:34.917 INFO:tasks.workunit.client.1.smithi133.stdout:3/14: mkdir d7 0 2023-12-16T07:40:34.918 INFO:tasks.workunit.client.1.smithi133.stdout:4/141: mknod d3/d7/d1c/c2b 0 2023-12-16T07:40:34.918 INFO:tasks.workunit.client.1.smithi133.stdout:4/142: fsync d3/d7/d1a/f26 0 2023-12-16T07:40:34.922 INFO:tasks.workunit.client.1.smithi133.stdout:6/120: mknod d0/c27 0 2023-12-16T07:40:34.922 INFO:tasks.workunit.client.1.smithi133.stdout:7/148: mknod db/c30 0 2023-12-16T07:40:34.923 INFO:tasks.workunit.client.1.smithi133.stdout:9/68: dwrite d15/f17 [0,4194304] 0 2023-12-16T07:40:34.923 INFO:tasks.workunit.client.1.smithi133.stdout:9/69: chown cf 12 1 2023-12-16T07:40:34.923 INFO:tasks.workunit.client.1.smithi133.stdout:8/82: dwrite f8 [4194304,4194304] 0 2023-12-16T07:40:34.923 INFO:tasks.workunit.client.1.smithi133.stdout:8/83: chown d9/d11/l12 0 1 2023-12-16T07:40:34.924 INFO:tasks.workunit.client.1.smithi133.stdout:3/15: mkdir d7/d8 0 2023-12-16T07:40:34.924 INFO:tasks.workunit.client.1.smithi133.stdout:6/121: creat d0/d4/f28 x:0 0 0 2023-12-16T07:40:34.926 INFO:tasks.workunit.client.1.smithi133.stdout:7/149: mkdir db/d21/d2c/d31 0 2023-12-16T07:40:34.926 INFO:tasks.workunit.client.1.smithi133.stdout:7/150: write db/d12/f15 [1515179,86814] 0 2023-12-16T07:40:34.927 INFO:tasks.workunit.client.1.smithi133.stdout:7/151: write db/d12/f15 [1052684,33189] 0 2023-12-16T07:40:34.929 INFO:tasks.workunit.client.1.smithi133.stdout:0/80: dwrite d2/f3 [0,4194304] 0 2023-12-16T07:40:34.930 INFO:tasks.workunit.client.1.smithi133.stdout:9/70: rmdir d15 39 2023-12-16T07:40:34.931 INFO:tasks.workunit.client.1.smithi133.stdout:8/84: getdents d9/dc 0 2023-12-16T07:40:34.931 INFO:tasks.workunit.client.1.smithi133.stdout:8/85: truncate d9/fb 2101270 0 2023-12-16T07:40:34.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/143: dwrite d3/d7/d1a/f26 [8388608,4194304] 0 2023-12-16T07:40:34.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/144: stat d3/d7/f1f 0 2023-12-16T07:40:34.934 INFO:tasks.workunit.client.1.smithi133.stdout:3/16: mknod d7/d8/c9 0 2023-12-16T07:40:34.935 INFO:tasks.workunit.client.1.smithi133.stdout:3/17: write f6 [845855,76874] 0 2023-12-16T07:40:34.937 INFO:tasks.workunit.client.1.smithi133.stdout:6/122: symlink d0/l29 0 2023-12-16T07:40:34.938 INFO:tasks.workunit.client.1.smithi133.stdout:7/152: creat db/d21/d2c/d31/f32 x:0 0 0 2023-12-16T07:40:34.938 INFO:tasks.workunit.client.1.smithi133.stdout:7/153: write db/d21/f23 [382145,92709] 0 2023-12-16T07:40:34.941 INFO:tasks.workunit.client.1.smithi133.stdout:0/81: getdents d2/d9/db 0 2023-12-16T07:40:34.942 INFO:tasks.workunit.client.1.smithi133.stdout:9/71: mknod d15/c19 0 2023-12-16T07:40:34.946 INFO:tasks.workunit.client.1.smithi133.stdout:8/86: creat d9/d11/f16 x:0 0 0 2023-12-16T07:40:34.946 INFO:tasks.workunit.client.1.smithi133.stdout:8/87: chown f8 0 1 2023-12-16T07:40:34.946 INFO:tasks.workunit.client.1.smithi133.stdout:8/88: readlink l5 0 2023-12-16T07:40:34.947 INFO:tasks.workunit.client.1.smithi133.stdout:8/89: write d9/d11/f14 [372699,78379] 0 2023-12-16T07:40:34.947 INFO:tasks.workunit.client.1.smithi133.stdout:9/72: dread f1 [0,4194304] 0 2023-12-16T07:40:34.947 INFO:tasks.workunit.client.1.smithi133.stdout:4/145: symlink d3/d7/d1c/l2c 0 2023-12-16T07:40:34.950 INFO:tasks.workunit.client.1.smithi133.stdout:4/146: write d3/f14 [5117178,106901] 0 2023-12-16T07:40:34.956 INFO:tasks.workunit.client.1.smithi133.stdout:3/18: creat d7/d8/fa x:0 0 0 2023-12-16T07:40:34.958 INFO:tasks.workunit.client.1.smithi133.stdout:7/154: truncate f9 1903581 0 2023-12-16T07:40:34.959 INFO:tasks.workunit.client.1.smithi133.stdout:0/82: creat d2/d9/db/f15 x:0 0 0 2023-12-16T07:40:34.960 INFO:tasks.workunit.client.1.smithi133.stdout:3/19: dread f6 [0,4194304] 0 2023-12-16T07:40:34.961 INFO:tasks.workunit.client.1.smithi133.stdout:9/73: link c6 d15/c1a 0 2023-12-16T07:40:34.964 INFO:tasks.workunit.client.1.smithi133.stdout:4/147: rename d3/d7/d1c/c2b to d3/c2d 0 2023-12-16T07:40:34.964 INFO:tasks.workunit.client.1.smithi133.stdout:4/148: readlink d3/l28 0 2023-12-16T07:40:34.968 INFO:tasks.workunit.client.1.smithi133.stdout:0/83: chown d2/d9/db/l13 21836993 1 2023-12-16T07:40:34.969 INFO:tasks.workunit.client.1.smithi133.stdout:3/20: symlink d7/lb 0 2023-12-16T07:40:34.970 INFO:tasks.workunit.client.1.smithi133.stdout:3/21: chown d7/lb 2651 1 2023-12-16T07:40:34.972 INFO:tasks.workunit.client.1.smithi133.stdout:4/149: creat d3/d7/f2e x:0 0 0 2023-12-16T07:40:34.976 INFO:tasks.workunit.client.1.smithi133.stdout:0/84: fsync d2/d9/db/fe 0 2023-12-16T07:40:34.976 INFO:tasks.workunit.client.1.smithi133.stdout:0/85: chown d2/f6 5938 1 2023-12-16T07:40:34.977 INFO:tasks.workunit.client.1.smithi133.stdout:6/123: dwrite d0/d4/f10 [0,4194304] 0 2023-12-16T07:40:34.978 INFO:tasks.workunit.client.1.smithi133.stdout:3/22: mknod d7/d8/cc 0 2023-12-16T07:40:34.978 INFO:tasks.workunit.client.1.smithi133.stdout:7/155: dwrite db/d12/f15 [0,4194304] 0 2023-12-16T07:40:34.979 INFO:tasks.workunit.client.1.smithi133.stdout:4/150: symlink d3/d7/d1c/l2f 0 2023-12-16T07:40:34.981 INFO:tasks.workunit.client.1.smithi133.stdout:9/74: dwrite f13 [4194304,4194304] 0 2023-12-16T07:40:34.981 INFO:tasks.workunit.client.1.smithi133.stdout:6/124: creat d0/d4/d21/f2a x:0 0 0 2023-12-16T07:40:34.982 INFO:tasks.workunit.client.1.smithi133.stdout:3/23: mknod d7/d8/cd 0 2023-12-16T07:40:34.983 INFO:tasks.workunit.client.1.smithi133.stdout:4/151: creat d3/f30 x:0 0 0 2023-12-16T07:40:34.984 INFO:tasks.workunit.client.1.smithi133.stdout:3/24: write f3 [996462,10485] 0 2023-12-16T07:40:34.984 INFO:tasks.workunit.client.1.smithi133.stdout:0/86: mknod d2/d9/c16 0 2023-12-16T07:40:34.987 INFO:tasks.workunit.client.1.smithi133.stdout:9/75: mknod d15/c1b 0 2023-12-16T07:40:34.988 INFO:tasks.workunit.client.1.smithi133.stdout:7/156: dread db/ff [0,4194304] 0 2023-12-16T07:40:34.991 INFO:tasks.workunit.client.1.smithi133.stdout:6/125: link d0/d4/f1c d0/d4/f2b 0 2023-12-16T07:40:34.992 INFO:tasks.workunit.client.1.smithi133.stdout:6/126: write d0/d4/f19 [3435585,27863] 0 2023-12-16T07:40:34.993 INFO:tasks.workunit.client.1.smithi133.stdout:3/25: creat d7/d8/fe x:0 0 0 2023-12-16T07:40:34.994 INFO:tasks.workunit.client.1.smithi133.stdout:6/127: write d0/f13 [1564071,130612] 0 2023-12-16T07:40:34.994 INFO:tasks.workunit.client.1.smithi133.stdout:7/157: truncate f9 782677 0 2023-12-16T07:40:34.994 INFO:tasks.workunit.client.1.smithi133.stdout:7/158: dread - db/d21/d2c/d31/f32 zero size 2023-12-16T07:40:34.997 INFO:tasks.workunit.client.1.smithi133.stdout:3/26: rmdir d7 39 2023-12-16T07:40:34.998 INFO:tasks.workunit.client.1.smithi133.stdout:6/128: mknod d0/c2c 0 2023-12-16T07:40:35.001 INFO:tasks.workunit.client.1.smithi133.stdout:7/159: creat db/f33 x:0 0 0 2023-12-16T07:40:35.002 INFO:tasks.workunit.client.1.smithi133.stdout:0/87: dwrite d2/f8 [4194304,4194304] 0 2023-12-16T07:40:35.011 INFO:tasks.workunit.client.1.smithi133.stdout:3/27: dwrite f3 [0,4194304] 0 2023-12-16T07:40:35.011 INFO:tasks.workunit.client.1.smithi133.stdout:3/28: chown f3 40216 1 2023-12-16T07:40:35.014 INFO:tasks.workunit.client.1.smithi133.stdout:4/152: truncate d3/fa 5111965 0 2023-12-16T07:40:35.018 INFO:tasks.workunit.client.1.smithi133.stdout:6/129: creat d0/f2d x:0 0 0 2023-12-16T07:40:35.018 INFO:tasks.workunit.client.1.smithi133.stdout:6/130: stat d0/f18 0 2023-12-16T07:40:35.020 INFO:tasks.workunit.client.1.smithi133.stdout:7/160: rename db/d12/f15 to db/d12/f34 0 2023-12-16T07:40:35.021 INFO:tasks.workunit.client.1.smithi133.stdout:7/161: dread - db/f22 zero size 2023-12-16T07:40:35.021 INFO:tasks.workunit.client.1.smithi133.stdout:7/162: chown db/d12 11 1 2023-12-16T07:40:35.022 INFO:tasks.workunit.client.1.smithi133.stdout:0/88: mkdir d2/d17 0 2023-12-16T07:40:35.024 INFO:tasks.workunit.client.1.smithi133.stdout:3/29: creat d7/d8/ff x:0 0 0 2023-12-16T07:40:35.024 INFO:tasks.workunit.client.1.smithi133.stdout:3/30: fsync f3 0 2023-12-16T07:40:35.024 INFO:tasks.workunit.client.1.smithi133.stdout:3/31: truncate f6 1528105 0 2023-12-16T07:40:35.024 INFO:tasks.workunit.client.1.smithi133.stdout:3/32: readlink d7/lb 0 2023-12-16T07:40:35.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/153: creat d3/d7/d1c/f31 x:0 0 0 2023-12-16T07:40:35.025 INFO:tasks.workunit.client.1.smithi133.stdout:4/154: write d3/d7/f1f [2241477,51038] 0 2023-12-16T07:40:35.026 INFO:tasks.workunit.client.1.smithi133.stdout:4/155: write d3/d7/d1a/f24 [9250087,26596] 0 2023-12-16T07:40:35.026 INFO:tasks.workunit.client.1.smithi133.stdout:6/131: symlink d0/d4/d21/l2e 0 2023-12-16T07:40:35.026 INFO:tasks.workunit.client.1.smithi133.stdout:6/132: fdatasync d0/f1 0 2023-12-16T07:40:35.027 INFO:tasks.workunit.client.1.smithi133.stdout:7/163: link db/f33 db/d21/d2c/d31/f35 0 2023-12-16T07:40:35.029 INFO:tasks.workunit.client.1.smithi133.stdout:0/89: truncate d2/f6 350674 0 2023-12-16T07:40:35.029 INFO:tasks.workunit.client.1.smithi133.stdout:0/90: chown d2/d9/db/l13 720467671 1 2023-12-16T07:40:35.029 INFO:tasks.workunit.client.1.smithi133.stdout:0/91: readlink d2/d9/db/l13 0 2023-12-16T07:40:35.029 INFO:tasks.workunit.client.1.smithi133.stdout:0/92: read d2/d9/db/fe [357637,11921] 0 2023-12-16T07:40:35.031 INFO:tasks.workunit.client.1.smithi133.stdout:4/156: mknod d3/c32 0 2023-12-16T07:40:35.032 INFO:tasks.workunit.client.1.smithi133.stdout:4/157: truncate d3/f30 392719 0 2023-12-16T07:40:35.032 INFO:tasks.workunit.client.1.smithi133.stdout:4/158: read - d3/f25 zero size 2023-12-16T07:40:35.033 INFO:tasks.workunit.client.1.smithi133.stdout:6/133: rename d0/d4/c1d to d0/d4/c2f 0 2023-12-16T07:40:35.035 INFO:tasks.workunit.client.1.smithi133.stdout:4/159: creat d3/d7/d1a/f33 x:0 0 0 2023-12-16T07:40:35.035 INFO:tasks.workunit.client.1.smithi133.stdout:4/160: truncate d3/d7/fb 2209421 0 2023-12-16T07:40:35.036 INFO:tasks.workunit.client.1.smithi133.stdout:6/134: symlink d0/l30 0 2023-12-16T07:40:35.038 INFO:tasks.workunit.client.1.smithi133.stdout:0/93: mknod d2/d9/db/c18 0 2023-12-16T07:40:35.038 INFO:tasks.workunit.client.1.smithi133.stdout:0/94: chown d2/d9/c11 251 1 2023-12-16T07:40:35.042 INFO:tasks.workunit.client.1.smithi133.stdout:6/135: creat d0/d4/f31 x:0 0 0 2023-12-16T07:40:35.043 INFO:tasks.workunit.client.1.smithi133.stdout:3/33: getdents d7/d8 0 2023-12-16T07:40:35.044 INFO:tasks.workunit.client.1.smithi133.stdout:6/136: creat d0/d4/d21/f32 x:0 0 0 2023-12-16T07:40:35.044 INFO:tasks.workunit.client.1.smithi133.stdout:6/137: stat d0/d4/f10 0 2023-12-16T07:40:35.046 INFO:tasks.workunit.client.1.smithi133.stdout:0/95: dread d2/f8 [4194304,4194304] 0 2023-12-16T07:40:35.046 INFO:tasks.workunit.client.1.smithi133.stdout:7/164: dwrite db/d21/f26 [0,4194304] 0 2023-12-16T07:40:35.048 INFO:tasks.workunit.client.1.smithi133.stdout:3/34: creat d7/d8/f10 x:0 0 0 2023-12-16T07:40:35.049 INFO:tasks.workunit.client.1.smithi133.stdout:6/138: creat d0/d4/d21/f33 x:0 0 0 2023-12-16T07:40:35.053 INFO:tasks.workunit.client.1.smithi133.stdout:7/165: dread db/f16 [0,4194304] 0 2023-12-16T07:40:35.055 INFO:tasks.workunit.client.1.smithi133.stdout:0/96: creat d2/d17/f19 x:0 0 0 2023-12-16T07:40:35.056 INFO:tasks.workunit.client.1.smithi133.stdout:4/161: rmdir d3/d7/d1a 39 2023-12-16T07:40:35.061 INFO:tasks.workunit.client.1.smithi133.stdout:6/139: creat d0/d4/f34 x:0 0 0 2023-12-16T07:40:35.061 INFO:tasks.workunit.client.1.smithi133.stdout:6/140: readlink d0/l30 0 2023-12-16T07:40:35.065 INFO:tasks.workunit.client.1.smithi133.stdout:7/166: creat db/d21/d2c/d31/f36 x:0 0 0 2023-12-16T07:40:35.067 INFO:tasks.workunit.client.1.smithi133.stdout:4/162: link d3/c16 d3/c34 0 2023-12-16T07:40:35.067 INFO:tasks.workunit.client.1.smithi133.stdout:4/163: readlink d3/l5 0 2023-12-16T07:40:35.070 INFO:tasks.workunit.client.1.smithi133.stdout:6/141: truncate d0/d4/f2b 532106 0 2023-12-16T07:40:35.070 INFO:tasks.workunit.client.1.smithi133.stdout:6/142: dread - d0/d4/d21/f33 zero size 2023-12-16T07:40:35.070 INFO:tasks.workunit.client.1.smithi133.stdout:6/143: chown d0/d4/c16 1 1 2023-12-16T07:40:35.071 INFO:tasks.workunit.client.1.smithi133.stdout:7/167: creat db/d21/f37 x:0 0 0 2023-12-16T07:40:35.073 INFO:tasks.workunit.client.1.smithi133.stdout:3/35: dwrite d7/d8/ff [0,4194304] 0 2023-12-16T07:40:35.073 INFO:tasks.workunit.client.1.smithi133.stdout:0/97: link d2/d9/db/l13 d2/d9/db/l1a 0 2023-12-16T07:40:35.080 INFO:tasks.workunit.client.1.smithi133.stdout:6/144: getdents d0/d4 0 2023-12-16T07:40:35.086 INFO:tasks.workunit.client.1.smithi133.stdout:0/98: chown d2/d9/ld 51328 1 2023-12-16T07:40:35.087 INFO:tasks.workunit.client.1.smithi133.stdout:6/145: mkdir d0/d4/d21/d35 0 2023-12-16T07:40:35.090 INFO:tasks.workunit.client.1.smithi133.stdout:4/164: dwrite d3/d7/f1f [0,4194304] 0 2023-12-16T07:40:35.090 INFO:tasks.workunit.client.1.smithi133.stdout:4/165: readlink d3/d7/d1c/l2f 0 2023-12-16T07:40:35.090 INFO:tasks.workunit.client.1.smithi133.stdout:0/99: rmdir d2/d17 39 2023-12-16T07:40:35.093 INFO:tasks.workunit.client.1.smithi133.stdout:7/168: dwrite db/d21/f23 [0,4194304] 0 2023-12-16T07:40:35.099 INFO:tasks.workunit.client.1.smithi133.stdout:0/100: rename d2/f3 to d2/d17/f1b 0 2023-12-16T07:40:35.099 INFO:tasks.workunit.client.1.smithi133.stdout:0/101: write d2/d9/db/f15 [230142,6856] 0 2023-12-16T07:40:35.104 INFO:tasks.workunit.client.1.smithi133.stdout:0/102: mknod d2/c1c 0 2023-12-16T07:40:35.108 INFO:tasks.workunit.client.1.smithi133.stdout:0/103: truncate d2/d17/f1b 3756677 0 2023-12-16T07:40:35.110 INFO:tasks.workunit.client.1.smithi133.stdout:0/104: creat d2/f1d x:0 0 0 2023-12-16T07:40:35.114 INFO:tasks.workunit.client.1.smithi133.stdout:0/105: symlink d2/d17/l1e 0 2023-12-16T07:40:35.114 INFO:tasks.workunit.client.1.smithi133.stdout:0/106: stat d2/d9 0 2023-12-16T07:40:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:34 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:34 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:35.124 INFO:tasks.workunit.client.1.smithi133.stdout:3/36: dwrite d7/d8/fa [0,4194304] 0 2023-12-16T07:40:35.124 INFO:tasks.workunit.client.1.smithi133.stdout:6/146: dwrite d0/d4/f34 [0,4194304] 0 2023-12-16T07:40:35.124 INFO:tasks.workunit.client.1.smithi133.stdout:4/166: dwrite d3/d7/d1a/f20 [0,4194304] 0 2023-12-16T07:40:35.124 INFO:tasks.workunit.client.1.smithi133.stdout:7/169: dwrite db/d12/f34 [4194304,4194304] 0 2023-12-16T07:40:35.128 INFO:tasks.workunit.client.1.smithi133.stdout:3/37: creat d7/d8/f11 x:0 0 0 2023-12-16T07:40:35.128 INFO:tasks.workunit.client.1.smithi133.stdout:3/38: chown d7 1 1 2023-12-16T07:40:35.129 INFO:tasks.workunit.client.1.smithi133.stdout:6/147: mkdir d0/d4/d21/d35/d36 0 2023-12-16T07:40:35.132 INFO:tasks.workunit.client.1.smithi133.stdout:4/167: rename d3/c8 to d3/d7/d1c/c35 0 2023-12-16T07:40:35.132 INFO:tasks.workunit.client.1.smithi133.stdout:4/168: rename d3 to d3/d7/d1c/d2a/d36 22 2023-12-16T07:40:35.136 INFO:tasks.workunit.client.1.smithi133.stdout:7/170: mknod db/d12/c38 0 2023-12-16T07:40:35.140 INFO:tasks.workunit.client.1.smithi133.stdout:6/148: rename d0/d4/f10 to d0/d4/f37 0 2023-12-16T07:40:35.141 INFO:tasks.workunit.client.1.smithi133.stdout:4/169: mknod d3/d7/d1a/c37 0 2023-12-16T07:40:35.141 INFO:tasks.workunit.client.1.smithi133.stdout:4/170: dread - d3/d7/d1c/f31 zero size 2023-12-16T07:40:35.142 INFO:tasks.workunit.client.1.smithi133.stdout:7/171: symlink db/d21/l39 0 2023-12-16T07:40:35.145 INFO:tasks.workunit.client.1.smithi133.stdout:3/39: mkdir d7/d8/d12 0 2023-12-16T07:40:35.146 INFO:tasks.workunit.client.1.smithi133.stdout:6/149: mknod d0/d4/c38 0 2023-12-16T07:40:35.147 INFO:tasks.workunit.client.1.smithi133.stdout:4/171: mkdir d3/d7/d38 0 2023-12-16T07:40:35.148 INFO:tasks.workunit.client.1.smithi133.stdout:7/172: mkdir db/d12/d3a 0 2023-12-16T07:40:35.155 INFO:tasks.workunit.client.1.smithi133.stdout:3/40: fsync d7/d8/fe 0 2023-12-16T07:40:35.156 INFO:tasks.workunit.client.1.smithi133.stdout:6/150: creat d0/d4/d21/f39 x:0 0 0 2023-12-16T07:40:35.158 INFO:tasks.workunit.client.1.smithi133.stdout:4/172: rename d3/l29 to d3/d7/l39 0 2023-12-16T07:40:35.158 INFO:tasks.workunit.client.1.smithi133.stdout:3/41: mknod d7/c13 0 2023-12-16T07:40:35.159 INFO:tasks.workunit.client.1.smithi133.stdout:6/151: creat d0/f3a x:0 0 0 2023-12-16T07:40:35.159 INFO:tasks.workunit.client.1.smithi133.stdout:6/152: chown d0/d4/f28 5019186 1 2023-12-16T07:40:35.160 INFO:tasks.workunit.client.1.smithi133.stdout:4/173: link d3/l5 d3/d7/d38/l3a 0 2023-12-16T07:40:35.163 INFO:tasks.workunit.client.1.smithi133.stdout:6/153: dread d0/d4/f2b [0,4194304] 0 2023-12-16T07:40:35.163 INFO:tasks.workunit.client.1.smithi133.stdout:7/173: dwrite db/d21/d2c/d31/f35 [0,4194304] 0 2023-12-16T07:40:35.164 INFO:tasks.workunit.client.1.smithi133.stdout:4/174: unlink c0 0 2023-12-16T07:40:35.164 INFO:tasks.workunit.client.1.smithi133.stdout:4/175: dread - d3/d7/d1a/f33 zero size 2023-12-16T07:40:35.166 INFO:tasks.workunit.client.1.smithi133.stdout:6/154: unlink d0/f13 0 2023-12-16T07:40:35.168 INFO:tasks.workunit.client.1.smithi133.stdout:7/174: symlink db/l3b 0 2023-12-16T07:40:35.168 INFO:tasks.workunit.client.1.smithi133.stdout:7/175: readlink db/d21/l39 0 2023-12-16T07:40:35.168 INFO:tasks.workunit.client.1.smithi133.stdout:7/176: chown db/d12/c1a 0 1 2023-12-16T07:40:35.169 INFO:tasks.workunit.client.1.smithi133.stdout:4/176: creat d3/f3b x:0 0 0 2023-12-16T07:40:35.170 INFO:tasks.workunit.client.1.smithi133.stdout:4/177: read d3/d7/f1f [2821656,97655] 0 2023-12-16T07:40:35.173 INFO:tasks.workunit.client.1.smithi133.stdout:6/155: unlink d0/l29 0 2023-12-16T07:40:35.173 INFO:tasks.workunit.client.1.smithi133.stdout:6/156: stat d0/d4/f11 0 2023-12-16T07:40:35.173 INFO:tasks.workunit.client.1.smithi133.stdout:6/157: fdatasync d0/d4/f1c 0 2023-12-16T07:40:35.174 INFO:tasks.workunit.client.1.smithi133.stdout:6/158: chown d0/f18 212199419 1 2023-12-16T07:40:35.190 INFO:tasks.workunit.client.1.smithi133.stdout:7/177: dwrite db/d21/f2a [0,4194304] 0 2023-12-16T07:40:35.192 INFO:tasks.workunit.client.1.smithi133.stdout:6/159: dwrite d0/d4/d21/f39 [0,4194304] 0 2023-12-16T07:40:35.193 INFO:tasks.workunit.client.1.smithi133.stdout:7/178: mknod db/d21/d2c/c3c 0 2023-12-16T07:40:35.194 INFO:tasks.workunit.client.1.smithi133.stdout:4/178: dwrite d3/d7/d1a/f24 [4194304,4194304] 0 2023-12-16T07:40:35.199 INFO:tasks.workunit.client.1.smithi133.stdout:6/160: link d0/f3a d0/d4/d21/d35/f3b 0 2023-12-16T07:40:35.201 INFO:tasks.workunit.client.1.smithi133.stdout:7/179: symlink db/d12/d3a/l3d 0 2023-12-16T07:40:35.201 INFO:tasks.workunit.client.1.smithi133.stdout:7/180: chown db/l3b 447 1 2023-12-16T07:40:35.202 INFO:tasks.workunit.client.1.smithi133.stdout:7/181: chown db/d12/f34 1849 1 2023-12-16T07:40:35.202 INFO:tasks.workunit.client.1.smithi133.stdout:4/179: symlink d3/d7/d1a/l3c 0 2023-12-16T07:40:35.202 INFO:tasks.workunit.client.1.smithi133.stdout:4/180: chown d3/c32 2434 1 2023-12-16T07:40:35.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/182: mkdir db/d3e 0 2023-12-16T07:40:35.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/183: write db/d21/f28 [4920288,91001] 0 2023-12-16T07:40:35.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/184: fdatasync db/d21/f26 0 2023-12-16T07:40:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:34 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:35.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:34 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:35.210 INFO:tasks.workunit.client.1.smithi133.stdout:4/181: dread d3/fa [0,4194304] 0 2023-12-16T07:40:35.214 INFO:tasks.workunit.client.1.smithi133.stdout:6/161: dwrite d0/f1 [4194304,4194304] 0 2023-12-16T07:40:35.214 INFO:tasks.workunit.client.1.smithi133.stdout:6/162: chown d0/d4/f2b 784902 1 2023-12-16T07:40:35.214 INFO:tasks.workunit.client.1.smithi133.stdout:6/163: chown d0/d4/d21/c22 252 1 2023-12-16T07:40:35.217 INFO:tasks.workunit.client.1.smithi133.stdout:6/164: creat d0/d4/d21/f3c x:0 0 0 2023-12-16T07:40:35.217 INFO:tasks.workunit.client.1.smithi133.stdout:6/165: chown d0 185334 1 2023-12-16T07:40:35.219 INFO:tasks.workunit.client.1.smithi133.stdout:6/166: mknod d0/c3d 0 2023-12-16T07:40:35.221 INFO:tasks.workunit.client.1.smithi133.stdout:6/167: rename d0/d4/d21/l2e to d0/d4/l3e 0 2023-12-16T07:40:35.224 INFO:tasks.workunit.client.1.smithi133.stdout:6/168: symlink d0/d4/d21/d35/d36/l3f 0 2023-12-16T07:40:35.233 INFO:tasks.workunit.client.1.smithi133.stdout:6/169: getdents d0/d4 0 2023-12-16T07:40:35.234 INFO:tasks.workunit.client.1.smithi133.stdout:6/170: chown d0/d4/c26 0 1 2023-12-16T07:40:35.234 INFO:tasks.workunit.client.1.smithi133.stdout:5/15: sync 2023-12-16T07:40:35.249 INFO:tasks.workunit.client.1.smithi133.stdout:6/171: dwrite d0/d4/d21/f39 [0,4194304] 0 2023-12-16T07:40:35.254 INFO:tasks.workunit.client.1.smithi133.stdout:6/172: creat d0/d4/d21/f40 x:0 0 0 2023-12-16T07:40:35.259 INFO:tasks.workunit.client.1.smithi133.stdout:6/173: read d0/d4/f11 [1348736,22760] 0 2023-12-16T07:40:35.260 INFO:tasks.workunit.client.1.smithi133.stdout:5/16: dwrite d1/f3 [0,4194304] 0 2023-12-16T07:40:35.260 INFO:tasks.workunit.client.1.smithi133.stdout:6/174: link d0/c3d d0/d4/d21/c41 0 2023-12-16T07:40:35.262 INFO:tasks.workunit.client.1.smithi133.stdout:5/17: symlink d1/l4 0 2023-12-16T07:40:35.263 INFO:tasks.workunit.client.1.smithi133.stdout:6/175: creat d0/d4/d21/d35/f42 x:0 0 0 2023-12-16T07:40:35.263 INFO:tasks.workunit.client.1.smithi133.stdout:6/176: dread - d0/d4/d21/f40 zero size 2023-12-16T07:40:35.264 INFO:tasks.workunit.client.1.smithi133.stdout:6/177: write d0/d4/f34 [662719,112414] 0 2023-12-16T07:40:35.264 INFO:tasks.workunit.client.1.smithi133.stdout:6/178: chown d0/d4/f2b 6934 1 2023-12-16T07:40:35.271 INFO:tasks.workunit.client.1.smithi133.stdout:5/18: rmdir d1 39 2023-12-16T07:40:35.271 INFO:tasks.workunit.client.1.smithi133.stdout:5/19: fdatasync d1/f3 0 2023-12-16T07:40:35.278 INFO:tasks.workunit.client.1.smithi133.stdout:6/179: dwrite d0/d4/d21/f32 [0,4194304] 0 2023-12-16T07:40:35.283 INFO:tasks.workunit.client.1.smithi133.stdout:6/180: creat d0/d4/d21/d35/f43 x:0 0 0 2023-12-16T07:40:35.283 INFO:tasks.workunit.client.1.smithi133.stdout:6/181: write d0/f2d [623436,6442] 0 2023-12-16T07:40:35.286 INFO:tasks.workunit.client.1.smithi133.stdout:6/182: mknod d0/d4/d21/d35/d36/c44 0 2023-12-16T07:40:35.295 INFO:tasks.workunit.client.1.smithi133.stdout:5/20: dwrite d1/f3 [0,4194304] 0 2023-12-16T07:40:35.297 INFO:tasks.workunit.client.1.smithi133.stdout:6/183: rmdir d0 39 2023-12-16T07:40:35.307 INFO:tasks.workunit.client.1.smithi133.stdout:5/21: dread d1/f3 [0,4194304] 0 2023-12-16T07:40:35.308 INFO:tasks.workunit.client.1.smithi133.stdout:5/22: creat d1/f5 x:0 0 0 2023-12-16T07:40:35.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/184: dread d0/d4/f19 [0,4194304] 0 2023-12-16T07:40:35.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/185: dread - d0/d4/d21/f33 zero size 2023-12-16T07:40:35.316 INFO:tasks.workunit.client.1.smithi133.stdout:6/186: rename d0/f2d to d0/d4/d21/d35/d36/f45 0 2023-12-16T07:40:35.327 INFO:tasks.workunit.client.1.smithi133.stdout:6/187: getdents d0 0 2023-12-16T07:40:35.327 INFO:tasks.workunit.client.1.smithi133.stdout:6/188: read - d0/d4/f28 zero size 2023-12-16T07:40:35.327 INFO:tasks.workunit.client.1.smithi133.stdout:6/189: dread - d0/d4/d21/d35/f43 zero size 2023-12-16T07:40:35.328 INFO:tasks.workunit.client.1.smithi133.stdout:6/190: creat d0/d4/d21/d35/d36/f46 x:0 0 0 2023-12-16T07:40:35.331 INFO:tasks.workunit.client.1.smithi133.stdout:6/191: write d0/f18 [1594885,66064] 0 2023-12-16T07:40:35.331 INFO:tasks.workunit.client.1.smithi133.stdout:6/192: stat d0/d4/d21 0 2023-12-16T07:40:35.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/23: dwrite d1/f3 [0,4194304] 0 2023-12-16T07:40:35.338 INFO:tasks.workunit.client.1.smithi133.stdout:5/24: mknod d1/c6 0 2023-12-16T07:40:35.339 INFO:tasks.workunit.client.1.smithi133.stdout:5/25: write d1/f3 [2123303,101953] 0 2023-12-16T07:40:35.340 INFO:tasks.workunit.client.1.smithi133.stdout:5/26: chown d1 43 1 2023-12-16T07:40:35.346 INFO:tasks.workunit.client.1.smithi133.stdout:5/27: getdents d1 0 2023-12-16T07:40:35.347 INFO:tasks.workunit.client.1.smithi133.stdout:5/28: creat d1/f7 x:0 0 0 2023-12-16T07:40:35.347 INFO:tasks.workunit.client.1.smithi133.stdout:5/29: fdatasync d1/f5 0 2023-12-16T07:40:35.352 INFO:tasks.workunit.client.1.smithi133.stdout:6/193: dwrite d0/d4/d21/d35/f42 [0,4194304] 0 2023-12-16T07:40:35.365 INFO:tasks.workunit.client.1.smithi133.stdout:5/30: dwrite d1/f3 [4194304,4194304] 0 2023-12-16T07:40:35.368 INFO:tasks.workunit.client.1.smithi133.stdout:5/31: unlink d1/l4 0 2023-12-16T07:40:35.368 INFO:tasks.workunit.client.1.smithi133.stdout:5/32: chown d1/f5 307 1 2023-12-16T07:40:35.369 INFO:tasks.workunit.client.1.smithi133.stdout:5/33: creat d1/f8 x:0 0 0 2023-12-16T07:40:35.383 INFO:tasks.workunit.client.1.smithi133.stdout:5/34: dwrite d1/f8 [0,4194304] 0 2023-12-16T07:40:35.383 INFO:tasks.workunit.client.1.smithi133.stdout:5/35: chown d1/f5 10 1 2023-12-16T07:40:35.400 INFO:tasks.workunit.client.1.smithi133.stdout:5/36: dwrite d1/f5 [0,4194304] 0 2023-12-16T07:40:35.415 INFO:tasks.workunit.client.1.smithi133.stdout:5/37: dwrite d1/f5 [0,4194304] 0 2023-12-16T07:40:35.416 INFO:tasks.workunit.client.1.smithi133.stdout:5/38: chown d1/f7 121 1 2023-12-16T07:40:35.416 INFO:tasks.workunit.client.1.smithi133.stdout:5/39: fsync d1/f8 0 2023-12-16T07:40:35.416 INFO:tasks.workunit.client.1.smithi133.stdout:5/40: stat d1 0 2023-12-16T07:40:35.416 INFO:tasks.workunit.client.1.smithi133.stdout:5/41: mknod d1/c9 0 2023-12-16T07:40:35.417 INFO:tasks.workunit.client.1.smithi133.stdout:5/42: truncate d1/f3 4160110 0 2023-12-16T07:40:35.419 INFO:tasks.workunit.client.1.smithi133.stdout:5/43: link d1/c9 d1/ca 0 2023-12-16T07:40:35.419 INFO:tasks.workunit.client.1.smithi133.stdout:5/44: dread - d1/f7 zero size 2023-12-16T07:40:35.420 INFO:tasks.workunit.client.1.smithi133.stdout:5/45: creat d1/fb x:0 0 0 2023-12-16T07:40:35.447 INFO:tasks.workunit.client.1.smithi133.stdout:5/46: dwrite d1/f3 [0,4194304] 0 2023-12-16T07:40:35.447 INFO:tasks.workunit.client.1.smithi133.stdout:5/47: chown d1/fb 993504 1 2023-12-16T07:40:35.452 INFO:tasks.workunit.client.1.smithi133.stdout:5/48: creat d1/fc x:0 0 0 2023-12-16T07:40:35.452 INFO:tasks.workunit.client.1.smithi133.stdout:5/49: chown d1/ca 638 1 2023-12-16T07:40:35.453 INFO:tasks.workunit.client.1.smithi133.stdout:5/50: write d1/f8 [4013400,125998] 0 2023-12-16T07:40:35.453 INFO:tasks.workunit.client.1.smithi133.stdout:5/51: stat d1/fc 0 2023-12-16T07:40:35.455 INFO:tasks.workunit.client.1.smithi133.stdout:5/52: symlink d1/ld 0 2023-12-16T07:40:35.455 INFO:tasks.workunit.client.1.smithi133.stdout:5/53: chown d1 912 1 2023-12-16T07:40:35.455 INFO:tasks.workunit.client.1.smithi133.stdout:5/54: chown d1/c9 122799 1 2023-12-16T07:40:35.456 INFO:tasks.workunit.client.1.smithi133.stdout:5/55: write d1/fb [279235,68070] 0 2023-12-16T07:40:35.456 INFO:tasks.workunit.client.1.smithi133.stdout:8/90: sync 2023-12-16T07:40:35.456 INFO:tasks.workunit.client.1.smithi133.stdout:2/76: sync 2023-12-16T07:40:35.456 INFO:tasks.workunit.client.1.smithi133.stdout:9/76: sync 2023-12-16T07:40:35.456 INFO:tasks.workunit.client.1.smithi133.stdout:2/77: write da/f12 [948569,25622] 0 2023-12-16T07:40:35.456 INFO:tasks.workunit.client.1.smithi133.stdout:2/78: stat da/fe 0 2023-12-16T07:40:35.458 INFO:tasks.workunit.client.1.smithi133.stdout:8/91: rename c3 to d9/dc/c17 0 2023-12-16T07:40:35.458 INFO:tasks.workunit.client.1.smithi133.stdout:8/92: chown d9/d11/f14 422508 1 2023-12-16T07:40:35.459 INFO:tasks.workunit.client.1.smithi133.stdout:9/77: mknod d15/c1c 0 2023-12-16T07:40:35.459 INFO:tasks.workunit.client.1.smithi133.stdout:9/78: chown f9 53345934 1 2023-12-16T07:40:35.459 INFO:tasks.workunit.client.1.smithi133.stdout:1/79: sync 2023-12-16T07:40:35.462 INFO:tasks.workunit.client.1.smithi133.stdout:2/79: creat da/d15/d17/f1a x:0 0 0 2023-12-16T07:40:35.462 INFO:tasks.workunit.client.1.smithi133.stdout:2/80: readlink da/d15/d17/l19 0 2023-12-16T07:40:35.462 INFO:tasks.workunit.client.1.smithi133.stdout:8/93: rename d9/cd to d9/dc/de/c18 0 2023-12-16T07:40:35.463 INFO:tasks.workunit.client.1.smithi133.stdout:5/56: dread d1/f5 [0,4194304] 0 2023-12-16T07:40:35.463 INFO:tasks.workunit.client.1.smithi133.stdout:5/57: write d1/fb [439517,125990] 0 2023-12-16T07:40:35.464 INFO:tasks.workunit.client.1.smithi133.stdout:1/80: link d0/da/f10 d0/da/f1d 0 2023-12-16T07:40:35.464 INFO:tasks.workunit.client.1.smithi133.stdout:1/81: fsync d0/f1 0 2023-12-16T07:40:35.466 INFO:tasks.workunit.client.1.smithi133.stdout:2/81: truncate da/fd 908612 0 2023-12-16T07:40:35.467 INFO:tasks.workunit.client.1.smithi133.stdout:9/79: getdents d15 0 2023-12-16T07:40:35.469 INFO:tasks.workunit.client.1.smithi133.stdout:8/94: truncate f8 3039732 0 2023-12-16T07:40:35.469 INFO:tasks.workunit.client.1.smithi133.stdout:8/95: read - d9/d11/f16 zero size 2023-12-16T07:40:35.469 INFO:tasks.workunit.client.1.smithi133.stdout:8/96: chown d9/dc/de/c18 188 1 2023-12-16T07:40:35.470 INFO:tasks.workunit.client.1.smithi133.stdout:5/58: getdents d1 0 2023-12-16T07:40:35.475 INFO:tasks.workunit.client.1.smithi133.stdout:2/82: truncate f1 274096 0 2023-12-16T07:40:35.475 INFO:tasks.workunit.client.1.smithi133.stdout:5/59: read d1/f8 [722181,38906] 0 2023-12-16T07:40:35.475 INFO:tasks.workunit.client.1.smithi133.stdout:9/80: creat d15/d18/f1d x:0 0 0 2023-12-16T07:40:35.475 INFO:tasks.workunit.client.1.smithi133.stdout:8/97: mknod d9/d10/c19 0 2023-12-16T07:40:35.476 INFO:tasks.workunit.client.1.smithi133.stdout:8/98: read d9/dc/de/ff [320756,59448] 0 2023-12-16T07:40:35.476 INFO:tasks.workunit.client.1.smithi133.stdout:8/99: write d9/dc/de/ff [548494,60171] 0 2023-12-16T07:40:35.476 INFO:tasks.workunit.client.1.smithi133.stdout:8/100: chown d9/dc/de/ff 11951 1 2023-12-16T07:40:35.476 INFO:tasks.workunit.client.1.smithi133.stdout:5/60: mkdir d1/de 0 2023-12-16T07:40:35.476 INFO:tasks.workunit.client.1.smithi133.stdout:5/61: stat d1/f3 0 2023-12-16T07:40:35.476 INFO:tasks.workunit.client.1.smithi133.stdout:5/62: getdents d1/de 0 2023-12-16T07:40:35.477 INFO:tasks.workunit.client.1.smithi133.stdout:2/83: dread f7 [0,4194304] 0 2023-12-16T07:40:35.477 INFO:tasks.workunit.client.1.smithi133.stdout:1/82: dwrite d0/da/f19 [0,4194304] 0 2023-12-16T07:40:35.479 INFO:tasks.workunit.client.1.smithi133.stdout:9/81: symlink d15/l1e 0 2023-12-16T07:40:35.484 INFO:tasks.workunit.client.1.smithi133.stdout:5/63: creat d1/de/ff x:0 0 0 2023-12-16T07:40:35.485 INFO:tasks.workunit.client.1.smithi133.stdout:9/82: read d15/f17 [3707161,62377] 0 2023-12-16T07:40:35.489 INFO:tasks.workunit.client.1.smithi133.stdout:1/83: symlink d0/da/l1e 0 2023-12-16T07:40:35.494 INFO:tasks.workunit.client.1.smithi133.stdout:2/84: dwrite da/d15/d17/f1a [0,4194304] 0 2023-12-16T07:40:35.495 INFO:tasks.workunit.client.1.smithi133.stdout:5/64: creat d1/f10 x:0 0 0 2023-12-16T07:40:35.496 INFO:tasks.workunit.client.1.smithi133.stdout:1/84: getdents d0 0 2023-12-16T07:40:35.500 INFO:tasks.workunit.client.1.smithi133.stdout:5/65: dread d1/fb [0,4194304] 0 2023-12-16T07:40:35.503 INFO:tasks.workunit.client.1.smithi133.stdout:8/101: truncate d9/fb 978556 0 2023-12-16T07:40:35.506 INFO:tasks.workunit.client.1.smithi133.stdout:1/85: symlink d0/l1f 0 2023-12-16T07:40:35.507 INFO:tasks.workunit.client.1.smithi133.stdout:5/66: creat d1/f11 x:0 0 0 2023-12-16T07:40:35.508 INFO:tasks.workunit.client.1.smithi133.stdout:2/85: dwrite da/f12 [0,4194304] 0 2023-12-16T07:40:35.508 INFO:tasks.workunit.client.1.smithi133.stdout:2/86: stat f2 0 2023-12-16T07:40:35.508 INFO:tasks.workunit.client.1.smithi133.stdout:8/102: mkdir d9/d11/d1a 0 2023-12-16T07:40:35.509 INFO:tasks.workunit.client.1.smithi133.stdout:5/67: creat d1/f12 x:0 0 0 2023-12-16T07:40:35.511 INFO:tasks.workunit.client.1.smithi133.stdout:1/86: mknod d0/c20 0 2023-12-16T07:40:35.515 INFO:tasks.workunit.client.1.smithi133.stdout:1/87: read d0/da/f19 [2159408,41411] 0 2023-12-16T07:40:35.517 INFO:tasks.workunit.client.1.smithi133.stdout:1/88: creat d0/da/db/f21 x:0 0 0 2023-12-16T07:40:35.517 INFO:tasks.workunit.client.1.smithi133.stdout:1/89: write d0/da/f10 [912307,9567] 0 2023-12-16T07:40:35.520 INFO:tasks.workunit.client.1.smithi133.stdout:1/90: rename d0/da/f1d to d0/d1c/f22 0 2023-12-16T07:40:35.522 INFO:tasks.workunit.client.1.smithi133.stdout:1/91: creat d0/da/db/f23 x:0 0 0 2023-12-16T07:40:35.533 INFO:tasks.workunit.client.1.smithi133.stdout:1/92: getdents d0/d1c 0 2023-12-16T07:40:35.533 INFO:tasks.workunit.client.1.smithi133.stdout:1/93: mkdir d0/da/db/d24 0 2023-12-16T07:40:35.534 INFO:tasks.workunit.client.1.smithi133.stdout:1/94: write d0/da/db/f23 [973746,102560] 0 2023-12-16T07:40:35.536 INFO:tasks.workunit.client.1.smithi133.stdout:8/103: dwrite d9/fb [0,4194304] 0 2023-12-16T07:40:35.537 INFO:tasks.workunit.client.1.smithi133.stdout:5/68: dwrite d1/f5 [0,4194304] 0 2023-12-16T07:40:35.537 INFO:tasks.workunit.client.1.smithi133.stdout:5/69: stat d1/de/ff 0 2023-12-16T07:40:35.539 INFO:tasks.workunit.client.1.smithi133.stdout:8/104: rename d9/d11/f14 to d9/d10/f1b 0 2023-12-16T07:40:35.539 INFO:tasks.workunit.client.1.smithi133.stdout:8/105: write d9/d11/f16 [1024414,117952] 0 2023-12-16T07:40:35.541 INFO:tasks.workunit.client.1.smithi133.stdout:5/70: rename d1/f8 to d1/de/f13 0 2023-12-16T07:40:35.543 INFO:tasks.workunit.client.1.smithi133.stdout:8/106: creat d9/f1c x:0 0 0 2023-12-16T07:40:35.545 INFO:tasks.workunit.client.1.smithi133.stdout:5/71: symlink d1/de/l14 0 2023-12-16T07:40:35.545 INFO:tasks.workunit.client.1.smithi133.stdout:8/107: stat c4 0 2023-12-16T07:40:35.546 INFO:tasks.workunit.client.1.smithi133.stdout:5/72: truncate d1/f3 1249442 0 2023-12-16T07:40:35.557 INFO:tasks.workunit.client.1.smithi133.stdout:1/95: dwrite d0/da/db/f23 [0,4194304] 0 2023-12-16T07:40:35.557 INFO:tasks.workunit.client.1.smithi133.stdout:8/108: dread d9/dc/de/ff [0,4194304] 0 2023-12-16T07:40:35.558 INFO:tasks.workunit.client.1.smithi133.stdout:1/96: creat d0/da/db/d24/f25 x:0 0 0 2023-12-16T07:40:35.558 INFO:tasks.workunit.client.1.smithi133.stdout:1/97: write d0/da/db/d24/f25 [178562,109360] 0 2023-12-16T07:40:35.561 INFO:tasks.workunit.client.1.smithi133.stdout:3/42: sync 2023-12-16T07:40:35.561 INFO:tasks.workunit.client.1.smithi133.stdout:7/185: sync 2023-12-16T07:40:35.561 INFO:tasks.workunit.client.1.smithi133.stdout:4/182: sync 2023-12-16T07:40:35.561 INFO:tasks.workunit.client.1.smithi133.stdout:6/194: sync 2023-12-16T07:40:35.561 INFO:tasks.workunit.client.1.smithi133.stdout:1/98: unlink d0/da/l1e 0 2023-12-16T07:40:35.562 INFO:tasks.workunit.client.1.smithi133.stdout:0/107: sync 2023-12-16T07:40:35.562 INFO:tasks.workunit.client.1.smithi133.stdout:0/108: chown d2/d9/db/c18 106 1 2023-12-16T07:40:35.562 INFO:tasks.workunit.client.1.smithi133.stdout:5/73: dwrite d1/f7 [0,4194304] 0 2023-12-16T07:40:35.565 INFO:tasks.workunit.client.1.smithi133.stdout:7/186: creat db/d21/d2c/d31/f3f x:0 0 0 2023-12-16T07:40:35.565 INFO:tasks.workunit.client.1.smithi133.stdout:7/187: stat db/d12/d3a/l3d 0 2023-12-16T07:40:35.565 INFO:tasks.workunit.client.1.smithi133.stdout:7/188: readlink db/l2b 0 2023-12-16T07:40:35.565 INFO:tasks.workunit.client.1.smithi133.stdout:7/189: chown db/fe 2033 1 2023-12-16T07:40:35.565 INFO:tasks.workunit.client.1.smithi133.stdout:7/190: chown l8 22476 1 2023-12-16T07:40:35.565 INFO:tasks.workunit.client.1.smithi133.stdout:8/109: dread d9/dc/de/ff [0,4194304] 0 2023-12-16T07:40:35.566 INFO:tasks.workunit.client.1.smithi133.stdout:4/183: creat d3/d7/d38/f3d x:0 0 0 2023-12-16T07:40:35.566 INFO:tasks.workunit.client.1.smithi133.stdout:4/184: chown d3/c15 5 1 2023-12-16T07:40:35.566 INFO:tasks.workunit.client.1.smithi133.stdout:4/185: chown d3/c1e 3 1 2023-12-16T07:40:35.567 INFO:tasks.workunit.client.1.smithi133.stdout:1/99: fdatasync d0/f1 0 2023-12-16T07:40:35.567 INFO:tasks.workunit.client.1.smithi133.stdout:1/100: write d0/da/db/f21 [590855,68343] 0 2023-12-16T07:40:35.572 INFO:tasks.workunit.client.1.smithi133.stdout:5/74: creat d1/f15 x:0 0 0 2023-12-16T07:40:35.572 INFO:tasks.workunit.client.1.smithi133.stdout:5/75: chown d1/de/f13 3106 1 2023-12-16T07:40:35.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/76: truncate d1/fb 767953 0 2023-12-16T07:40:35.574 INFO:tasks.workunit.client.1.smithi133.stdout:3/43: rename d7/d8/ff to d7/d8/f14 0 2023-12-16T07:40:35.576 INFO:tasks.workunit.client.1.smithi133.stdout:7/191: getdents db/d12/d3a 0 2023-12-16T07:40:35.582 INFO:tasks.workunit.client.1.smithi133.stdout:8/110: rename d9/dc/de/ff to d9/dc/f1d 0 2023-12-16T07:40:35.584 INFO:tasks.workunit.client.1.smithi133.stdout:4/186: mknod d3/d7/d38/c3e 0 2023-12-16T07:40:35.587 INFO:tasks.workunit.client.1.smithi133.stdout:1/101: creat d0/da/db/d24/f26 x:0 0 0 2023-12-16T07:40:35.587 INFO:tasks.workunit.client.1.smithi133.stdout:1/102: chown d0/da/db 0 1 2023-12-16T07:40:35.588 INFO:tasks.workunit.client.1.smithi133.stdout:0/109: symlink d2/d9/db/l1f 0 2023-12-16T07:40:35.588 INFO:tasks.workunit.client.1.smithi133.stdout:0/110: chown d2/d9/db/c18 385208 1 2023-12-16T07:40:35.589 INFO:tasks.workunit.client.1.smithi133.stdout:0/111: truncate d2/d17/f19 358721 0 2023-12-16T07:40:35.589 INFO:tasks.workunit.client.1.smithi133.stdout:3/44: creat d7/d8/d12/f15 x:0 0 0 2023-12-16T07:40:35.590 INFO:tasks.workunit.client.1.smithi133.stdout:7/192: creat db/d3e/f40 x:0 0 0 2023-12-16T07:40:35.591 INFO:tasks.workunit.client.1.smithi133.stdout:0/112: read d2/d9/db/fe [1911224,119550] 0 2023-12-16T07:40:35.591 INFO:tasks.workunit.client.1.smithi133.stdout:4/187: rename d3/d7/d38/c3e to d3/d7/d1a/c3f 0 2023-12-16T07:40:35.592 INFO:tasks.workunit.client.1.smithi133.stdout:3/45: link d7/c13 d7/c16 0 2023-12-16T07:40:35.594 INFO:tasks.workunit.client.1.smithi133.stdout:7/193: mknod db/d12/c41 0 2023-12-16T07:40:35.596 INFO:tasks.workunit.client.1.smithi133.stdout:4/188: mknod d3/d7/d1c/d2a/c40 0 2023-12-16T07:40:35.596 INFO:tasks.workunit.client.1.smithi133.stdout:4/189: chown d3/d7 808958500 1 2023-12-16T07:40:35.596 INFO:tasks.workunit.client.1.smithi133.stdout:4/190: chown d3/c16 140 1 2023-12-16T07:40:35.596 INFO:tasks.workunit.client.1.smithi133.stdout:4/191: chown d3/c1e 44 1 2023-12-16T07:40:35.596 INFO:tasks.workunit.client.1.smithi133.stdout:3/46: stat d7/c13 0 2023-12-16T07:40:35.598 INFO:tasks.workunit.client.1.smithi133.stdout:7/194: mknod db/d21/c42 0 2023-12-16T07:40:35.599 INFO:tasks.workunit.client.1.smithi133.stdout:0/113: mkdir d2/d9/d20 0 2023-12-16T07:40:35.599 INFO:tasks.workunit.client.1.smithi133.stdout:0/114: write d2/d9/d12/f14 [772923,36697] 0 2023-12-16T07:40:35.600 INFO:tasks.workunit.client.1.smithi133.stdout:4/192: creat d3/f41 x:0 0 0 2023-12-16T07:40:35.600 INFO:tasks.workunit.client.1.smithi133.stdout:4/193: fsync d3/f14 0 2023-12-16T07:40:35.600 INFO:tasks.workunit.client.1.smithi133.stdout:4/194: dread - d3/f3b zero size 2023-12-16T07:40:35.600 INFO:tasks.workunit.client.1.smithi133.stdout:3/47: symlink d7/l17 0 2023-12-16T07:40:35.602 INFO:tasks.workunit.client.1.smithi133.stdout:7/195: creat db/d3e/f43 x:0 0 0 2023-12-16T07:40:35.602 INFO:tasks.workunit.client.1.smithi133.stdout:0/115: symlink d2/d17/l21 0 2023-12-16T07:40:35.602 INFO:tasks.workunit.client.1.smithi133.stdout:0/116: fdatasync d2/f6 0 2023-12-16T07:40:35.603 INFO:tasks.workunit.client.1.smithi133.stdout:4/195: truncate d3/d7/d1a/f26 645548 0 2023-12-16T07:40:35.604 INFO:tasks.workunit.client.1.smithi133.stdout:3/48: truncate f6 1128667 0 2023-12-16T07:40:35.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/196: symlink db/l44 0 2023-12-16T07:40:35.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/197: truncate db/d21/d2c/d31/f35 4219162 0 2023-12-16T07:40:35.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/198: fdatasync db/ff 0 2023-12-16T07:40:35.606 INFO:tasks.workunit.client.1.smithi133.stdout:0/117: mknod d2/d9/d20/c22 0 2023-12-16T07:40:35.608 INFO:tasks.workunit.client.1.smithi133.stdout:4/196: mknod d3/d7/c42 0 2023-12-16T07:40:35.613 INFO:tasks.workunit.client.1.smithi133.stdout:7/199: rename db/d3e/f43 to db/d12/f45 0 2023-12-16T07:40:35.616 INFO:tasks.workunit.client.1.smithi133.stdout:0/118: link d2/d9/db/c18 d2/d9/c23 0 2023-12-16T07:40:35.616 INFO:tasks.workunit.client.1.smithi133.stdout:0/119: read d2/d17/f19 [91048,26375] 0 2023-12-16T07:40:35.618 INFO:tasks.workunit.client.1.smithi133.stdout:0/120: truncate d2/f6 219568 0 2023-12-16T07:40:35.618 INFO:tasks.workunit.client.1.smithi133.stdout:0/121: chown d2/d9/d12/f14 2439917 1 2023-12-16T07:40:35.619 INFO:tasks.workunit.client.1.smithi133.stdout:0/122: symlink d2/l24 0 2023-12-16T07:40:35.621 INFO:tasks.workunit.client.1.smithi133.stdout:0/123: symlink d2/d9/db/l25 0 2023-12-16T07:40:35.621 INFO:tasks.workunit.client.1.smithi133.stdout:0/124: chown d2/d9/c23 323 1 2023-12-16T07:40:35.621 INFO:tasks.workunit.client.1.smithi133.stdout:0/125: chown d2/d9/db 39904692 1 2023-12-16T07:40:35.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/126: creat d2/d17/f26 x:0 0 0 2023-12-16T07:40:35.624 INFO:tasks.workunit.client.1.smithi133.stdout:0/127: rename d2/d17/f19 to d2/d17/f27 0 2023-12-16T07:40:35.624 INFO:tasks.workunit.client.1.smithi133.stdout:0/128: symlink d2/d9/d20/l28 0 2023-12-16T07:40:35.625 INFO:tasks.workunit.client.1.smithi133.stdout:4/197: dwrite d3/f41 [0,4194304] 0 2023-12-16T07:40:35.634 INFO:tasks.workunit.client.1.smithi133.stdout:4/198: mkdir d3/d7/d1c/d2a/d43 0 2023-12-16T07:40:35.634 INFO:tasks.workunit.client.1.smithi133.stdout:4/199: write d3/d7/d1c/f31 [48454,47068] 0 2023-12-16T07:40:35.634 INFO:tasks.workunit.client.1.smithi133.stdout:4/200: dread - d3/d7/d1a/f33 zero size 2023-12-16T07:40:35.644 INFO:tasks.workunit.client.1.smithi133.stdout:3/49: dread f3 [0,4194304] 0 2023-12-16T07:40:35.653 INFO:tasks.workunit.client.1.smithi133.stdout:3/50: dread d7/d8/fa [0,4194304] 0 2023-12-16T07:40:35.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/200: dwrite db/fe [4194304,4194304] 0 2023-12-16T07:40:35.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/201: chown db/d12 4 1 2023-12-16T07:40:35.655 INFO:tasks.workunit.client.1.smithi133.stdout:5/77: dwrite d1/f10 [0,4194304] 0 2023-12-16T07:40:35.656 INFO:tasks.workunit.client.1.smithi133.stdout:6/195: dwrite d0/d4/f37 [0,4194304] 0 2023-12-16T07:40:35.656 INFO:tasks.workunit.client.1.smithi133.stdout:0/129: dwrite d2/d9/db/fe [0,4194304] 0 2023-12-16T07:40:35.657 INFO:tasks.workunit.client.1.smithi133.stdout:3/51: mknod d7/c18 0 2023-12-16T07:40:35.658 INFO:tasks.workunit.client.1.smithi133.stdout:8/111: dwrite f8 [0,4194304] 0 2023-12-16T07:40:35.662 INFO:tasks.workunit.client.1.smithi133.stdout:4/201: dwrite d3/d7/f2e [0,4194304] 0 2023-12-16T07:40:35.662 INFO:tasks.workunit.client.1.smithi133.stdout:7/202: mknod db/d21/d2c/d31/c46 0 2023-12-16T07:40:35.662 INFO:tasks.workunit.client.1.smithi133.stdout:7/203: dread - db/f22 zero size 2023-12-16T07:40:35.663 INFO:tasks.workunit.client.1.smithi133.stdout:7/204: chown db/d12/c1a 104298852 1 2023-12-16T07:40:35.665 INFO:tasks.workunit.client.1.smithi133.stdout:7/205: write db/d21/f2a [1715768,43557] 0 2023-12-16T07:40:35.671 INFO:tasks.workunit.client.1.smithi133.stdout:5/78: mkdir d1/d16 0 2023-12-16T07:40:35.671 INFO:tasks.workunit.client.1.smithi133.stdout:8/112: fdatasync d9/d11/f16 0 2023-12-16T07:40:35.671 INFO:tasks.workunit.client.1.smithi133.stdout:8/113: chown d9/d11/f16 8979 1 2023-12-16T07:40:35.671 INFO:tasks.workunit.client.1.smithi133.stdout:6/196: rename d0/d4/d21/f33 to d0/d4/f47 0 2023-12-16T07:40:35.671 INFO:tasks.workunit.client.1.smithi133.stdout:0/130: creat d2/d9/d20/f29 x:0 0 0 2023-12-16T07:40:35.672 INFO:tasks.workunit.client.1.smithi133.stdout:3/52: symlink d7/l19 0 2023-12-16T07:40:35.674 INFO:tasks.workunit.client.1.smithi133.stdout:3/53: write f3 [451633,4469] 0 2023-12-16T07:40:35.674 INFO:tasks.workunit.client.1.smithi133.stdout:1/103: dwrite d0/d1c/f22 [0,4194304] 0 2023-12-16T07:40:35.677 INFO:tasks.workunit.client.1.smithi133.stdout:4/202: mkdir d3/d7/d44 0 2023-12-16T07:40:35.682 INFO:tasks.workunit.client.1.smithi133.stdout:8/114: unlink d9/fb 0 2023-12-16T07:40:35.684 INFO:tasks.workunit.client.1.smithi133.stdout:5/79: rmdir d1 39 2023-12-16T07:40:35.684 INFO:tasks.workunit.client.1.smithi133.stdout:5/80: read - d1/f15 zero size 2023-12-16T07:40:35.686 INFO:tasks.workunit.client.1.smithi133.stdout:7/206: rename l8 to db/d12/l47 0 2023-12-16T07:40:35.687 INFO:tasks.workunit.client.1.smithi133.stdout:6/197: creat d0/d4/d21/d35/f48 x:0 0 0 2023-12-16T07:40:35.687 INFO:tasks.workunit.client.1.smithi133.stdout:1/104: dwrite d0/da/db/ff [0,4194304] 0 2023-12-16T07:40:35.694 INFO:tasks.workunit.client.1.smithi133.stdout:4/203: stat d3/c2d 0 2023-12-16T07:40:35.695 INFO:tasks.workunit.client.1.smithi133.stdout:8/115: creat d9/f1e x:0 0 0 2023-12-16T07:40:35.696 INFO:tasks.workunit.client.1.smithi133.stdout:1/105: dread d0/da/db/fd [0,4194304] 0 2023-12-16T07:40:35.696 INFO:tasks.workunit.client.1.smithi133.stdout:5/81: creat d1/f17 x:0 0 0 2023-12-16T07:40:35.697 INFO:tasks.workunit.client.1.smithi133.stdout:1/106: dread d0/da/db/d24/f25 [0,4194304] 0 2023-12-16T07:40:35.697 INFO:tasks.workunit.client.1.smithi133.stdout:8/116: dread d9/d11/f16 [0,4194304] 0 2023-12-16T07:40:35.698 INFO:tasks.workunit.client.1.smithi133.stdout:1/107: write d0/da/db/fd [4055728,129113] 0 2023-12-16T07:40:35.698 INFO:tasks.workunit.client.1.smithi133.stdout:7/207: unlink db/d21/l27 0 2023-12-16T07:40:35.698 INFO:tasks.workunit.client.1.smithi133.stdout:7/208: write db/d21/d2c/d31/f3f [884690,13747] 0 2023-12-16T07:40:35.699 INFO:tasks.workunit.client.1.smithi133.stdout:6/198: mkdir d0/d4/d21/d35/d36/d49 0 2023-12-16T07:40:35.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/199: write d0/d4/f34 [2655051,4317] 0 2023-12-16T07:40:35.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/200: chown d0/d4/l3e 0 1 2023-12-16T07:40:35.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/201: truncate d0/d4/d21/f40 581360 0 2023-12-16T07:40:35.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/202: dread - d0/d4/d21/f23 zero size 2023-12-16T07:40:35.701 INFO:tasks.workunit.client.1.smithi133.stdout:7/209: dread f9 [0,4194304] 0 2023-12-16T07:40:35.701 INFO:tasks.workunit.client.1.smithi133.stdout:7/210: fdatasync db/d12/f34 0 2023-12-16T07:40:35.701 INFO:tasks.workunit.client.1.smithi133.stdout:7/211: chown db/d21/c42 67703 1 2023-12-16T07:40:35.701 INFO:tasks.workunit.client.1.smithi133.stdout:4/204: rename d3/d7/d1c/d2a/d43 to d3/d7/d38/d45 0 2023-12-16T07:40:35.702 INFO:tasks.workunit.client.1.smithi133.stdout:5/82: rmdir d1/de 39 2023-12-16T07:40:35.704 INFO:tasks.workunit.client.1.smithi133.stdout:1/108: dread - d0/f17 zero size 2023-12-16T07:40:35.704 INFO:tasks.workunit.client.1.smithi133.stdout:1/109: write d0/da/db/f21 [772733,93748] 0 2023-12-16T07:40:35.706 INFO:tasks.workunit.client.1.smithi133.stdout:6/203: symlink d0/d4/d21/d35/d36/d49/l4a 0 2023-12-16T07:40:35.706 INFO:tasks.workunit.client.1.smithi133.stdout:6/204: readlink d0/d4/d21/d35/d36/d49/l4a 0 2023-12-16T07:40:35.707 INFO:tasks.workunit.client.1.smithi133.stdout:5/83: mkdir d1/d18 0 2023-12-16T07:40:35.709 INFO:tasks.workunit.client.1.smithi133.stdout:7/212: dread db/fe [4194304,4194304] 0 2023-12-16T07:40:35.710 INFO:tasks.workunit.client.1.smithi133.stdout:4/205: dread d3/d7/f2e [0,4194304] 0 2023-12-16T07:40:35.710 INFO:tasks.workunit.client.1.smithi133.stdout:1/110: rename d0/da/c18 to d0/da/db/d24/c27 0 2023-12-16T07:40:35.715 INFO:tasks.workunit.client.1.smithi133.stdout:7/213: creat db/d21/d2c/f48 x:0 0 0 2023-12-16T07:40:35.716 INFO:tasks.workunit.client.1.smithi133.stdout:7/214: chown db/d12/c14 132 1 2023-12-16T07:40:35.716 INFO:tasks.workunit.client.1.smithi133.stdout:4/206: creat d3/d7/d1c/f46 x:0 0 0 2023-12-16T07:40:35.717 INFO:tasks.workunit.client.1.smithi133.stdout:1/111: readlink d0/le 0 2023-12-16T07:40:35.720 INFO:tasks.workunit.client.1.smithi133.stdout:7/215: unlink db/d12/c38 0 2023-12-16T07:40:35.720 INFO:tasks.workunit.client.1.smithi133.stdout:7/216: dread - db/d21/d2c/d31/f32 zero size 2023-12-16T07:40:35.720 INFO:tasks.workunit.client.1.smithi133.stdout:7/217: readlink db/l2b 0 2023-12-16T07:40:35.723 INFO:tasks.workunit.client.1.smithi133.stdout:4/207: mknod d3/d7/d38/c47 0 2023-12-16T07:40:35.728 INFO:tasks.workunit.client.1.smithi133.stdout:1/112: mknod d0/da/db/d24/c28 0 2023-12-16T07:40:35.729 INFO:tasks.workunit.client.1.smithi133.stdout:1/113: chown d0/da/f19 0 1 2023-12-16T07:40:35.732 INFO:tasks.workunit.client.1.smithi133.stdout:4/208: unlink d3/d7/d1c/f31 0 2023-12-16T07:40:35.732 INFO:tasks.workunit.client.1.smithi133.stdout:4/209: fdatasync d3/d7/f23 0 2023-12-16T07:40:35.736 INFO:tasks.workunit.client.1.smithi133.stdout:6/205: dwrite d0/d4/d21/f40 [0,4194304] 0 2023-12-16T07:40:35.736 INFO:tasks.workunit.client.1.smithi133.stdout:6/206: fdatasync d0/d4/f2b 0 2023-12-16T07:40:35.742 INFO:tasks.workunit.client.1.smithi133.stdout:5/84: dwrite d1/f15 [0,4194304] 0 2023-12-16T07:40:35.745 INFO:tasks.workunit.client.1.smithi133.stdout:7/218: dwrite db/f16 [0,4194304] 0 2023-12-16T07:40:35.746 INFO:tasks.workunit.client.1.smithi133.stdout:6/207: rename d0/c1e to d0/d4/d21/d35/d36/d49/c4b 0 2023-12-16T07:40:35.753 INFO:tasks.workunit.client.1.smithi133.stdout:6/208: creat d0/d4/d21/f4c x:0 0 0 2023-12-16T07:40:35.760 INFO:tasks.workunit.client.1.smithi133.stdout:7/219: dread db/f11 [0,4194304] 0 2023-12-16T07:40:35.761 INFO:tasks.workunit.client.1.smithi133.stdout:7/220: creat db/d12/f49 x:0 0 0 2023-12-16T07:40:35.762 INFO:tasks.workunit.client.1.smithi133.stdout:7/221: dread - db/d21/f2f zero size 2023-12-16T07:40:35.762 INFO:tasks.workunit.client.1.smithi133.stdout:7/222: write db/fe [3720260,98988] 0 2023-12-16T07:40:35.762 INFO:tasks.workunit.client.1.smithi133.stdout:7/223: dread - db/d21/d2c/d31/f32 zero size 2023-12-16T07:40:35.762 INFO:tasks.workunit.client.1.smithi133.stdout:7/224: truncate db/d21/d2c/d31/f3f 1127151 0 2023-12-16T07:40:35.764 INFO:tasks.workunit.client.1.smithi133.stdout:7/225: mkdir db/d3e/d4a 0 2023-12-16T07:40:35.768 INFO:tasks.workunit.client.1.smithi133.stdout:7/226: creat db/d12/d3a/f4b x:0 0 0 2023-12-16T07:40:35.769 INFO:tasks.workunit.client.1.smithi133.stdout:7/227: write db/fe [2952764,60698] 0 2023-12-16T07:40:35.771 INFO:tasks.workunit.client.1.smithi133.stdout:7/228: symlink db/d21/d2c/d31/l4c 0 2023-12-16T07:40:35.773 INFO:tasks.workunit.client.1.smithi133.stdout:7/229: symlink db/d3e/l4d 0 2023-12-16T07:40:35.774 INFO:tasks.workunit.client.1.smithi133.stdout:7/230: unlink db/c1b 0 2023-12-16T07:40:35.776 INFO:tasks.workunit.client.1.smithi133.stdout:4/210: dwrite d3/f41 [4194304,4194304] 0 2023-12-16T07:40:35.776 INFO:tasks.workunit.client.1.smithi133.stdout:1/114: dwrite d0/d12/f1b [0,4194304] 0 2023-12-16T07:40:35.776 INFO:tasks.workunit.client.1.smithi133.stdout:4/211: readlink d3/d7/d38/l3a 0 2023-12-16T07:40:35.776 INFO:tasks.workunit.client.1.smithi133.stdout:8/117: truncate f8 2388096 0 2023-12-16T07:40:35.777 INFO:tasks.workunit.client.1.smithi133.stdout:5/85: dwrite d1/f10 [0,4194304] 0 2023-12-16T07:40:35.777 INFO:tasks.workunit.client.1.smithi133.stdout:5/86: getdents d1/d18 0 2023-12-16T07:40:35.777 INFO:tasks.workunit.client.1.smithi133.stdout:5/87: chown d1/ca 1195231 1 2023-12-16T07:40:35.780 INFO:tasks.workunit.client.1.smithi133.stdout:8/118: creat d9/d11/f1f x:0 0 0 2023-12-16T07:40:35.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/231: dread db/d21/d2c/d31/f3f [0,4194304] 0 2023-12-16T07:40:35.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/232: fdatasync db/d12/f49 0 2023-12-16T07:40:35.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/233: truncate db/d12/f45 392342 0 2023-12-16T07:40:35.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/234: dread - db/d21/f37 zero size 2023-12-16T07:40:35.782 INFO:tasks.workunit.client.1.smithi133.stdout:5/88: mknod d1/de/c19 0 2023-12-16T07:40:35.785 INFO:tasks.workunit.client.1.smithi133.stdout:7/235: mknod db/d3e/d4a/c4e 0 2023-12-16T07:40:35.787 INFO:tasks.workunit.client.1.smithi133.stdout:6/209: dwrite d0/d4/d21/f3c [0,4194304] 0 2023-12-16T07:40:35.787 INFO:tasks.workunit.client.1.smithi133.stdout:4/212: dread d3/d7/f23 [0,4194304] 0 2023-12-16T07:40:35.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/236: creat db/d3e/f4f x:0 0 0 2023-12-16T07:40:35.792 INFO:tasks.workunit.client.1.smithi133.stdout:5/89: dread d1/f5 [0,4194304] 0 2023-12-16T07:40:35.792 INFO:tasks.workunit.client.1.smithi133.stdout:5/90: chown d1/f5 7562 1 2023-12-16T07:40:35.792 INFO:tasks.workunit.client.1.smithi133.stdout:5/91: dread - d1/f17 zero size 2023-12-16T07:40:35.793 INFO:tasks.workunit.client.1.smithi133.stdout:7/237: creat db/d21/d2c/f50 x:0 0 0 2023-12-16T07:40:35.796 INFO:tasks.workunit.client.1.smithi133.stdout:1/115: dwrite d0/f1a [0,4194304] 0 2023-12-16T07:40:35.797 INFO:tasks.workunit.client.1.smithi133.stdout:1/116: read d0/da/db/fd [385536,93406] 0 2023-12-16T07:40:35.798 INFO:tasks.workunit.client.1.smithi133.stdout:5/92: rename d1/f11 to d1/f1a 0 2023-12-16T07:40:35.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/238: creat db/d21/f51 x:0 0 0 2023-12-16T07:40:35.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/239: write db/f18 [382629,74191] 0 2023-12-16T07:40:35.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/213: rmdir d3/d7/d38 39 2023-12-16T07:40:35.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/214: write d3/d7/d38/f3d [930984,25480] 0 2023-12-16T07:40:35.806 INFO:tasks.workunit.client.1.smithi133.stdout:1/117: creat d0/f29 x:0 0 0 2023-12-16T07:40:35.806 INFO:tasks.workunit.client.1.smithi133.stdout:7/240: creat db/d21/f52 x:0 0 0 2023-12-16T07:40:35.810 INFO:tasks.workunit.client.1.smithi133.stdout:7/241: mkdir db/d53 0 2023-12-16T07:40:35.812 INFO:tasks.workunit.client.1.smithi133.stdout:4/215: dread d3/d7/f1f [0,4194304] 0 2023-12-16T07:40:35.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/242: symlink db/l54 0 2023-12-16T07:40:35.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/243: chown db/d3e/d4a 2346956 1 2023-12-16T07:40:35.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/244: dread - db/d12/f49 zero size 2023-12-16T07:40:35.813 INFO:tasks.workunit.client.1.smithi133.stdout:6/210: dwrite d0/d4/f31 [0,4194304] 0 2023-12-16T07:40:35.814 INFO:tasks.workunit.client.1.smithi133.stdout:6/211: fsync d0/f3a 0 2023-12-16T07:40:35.815 INFO:tasks.workunit.client.1.smithi133.stdout:4/216: rename d3/c2d to d3/d7/c48 0 2023-12-16T07:40:35.816 INFO:tasks.workunit.client.1.smithi133.stdout:7/245: symlink db/d3e/d4a/l55 0 2023-12-16T07:40:35.816 INFO:tasks.workunit.client.1.smithi133.stdout:7/246: write db/d21/d2c/d31/f36 [706881,103524] 0 2023-12-16T07:40:35.819 INFO:tasks.workunit.client.1.smithi133.stdout:6/212: unlink d0/d4/c16 0 2023-12-16T07:40:35.819 INFO:tasks.workunit.client.1.smithi133.stdout:6/213: dread - d0/d4/d21/f23 zero size 2023-12-16T07:40:35.821 INFO:tasks.workunit.client.1.smithi133.stdout:7/247: link db/d21/f2a db/d21/d2c/f56 0 2023-12-16T07:40:35.823 INFO:tasks.workunit.client.1.smithi133.stdout:1/118: dwrite d0/f17 [0,4194304] 0 2023-12-16T07:40:35.824 INFO:tasks.workunit.client.1.smithi133.stdout:7/248: mknod db/d3e/d4a/c57 0 2023-12-16T07:40:35.827 INFO:tasks.workunit.client.1.smithi133.stdout:4/217: dread d3/f41 [0,4194304] 0 2023-12-16T07:40:35.828 INFO:tasks.workunit.client.1.smithi133.stdout:1/119: creat d0/f2a x:0 0 0 2023-12-16T07:40:35.829 INFO:tasks.workunit.client.1.smithi133.stdout:7/249: mkdir db/d3e/d4a/d58 0 2023-12-16T07:40:35.830 INFO:tasks.workunit.client.1.smithi133.stdout:4/218: dread d3/d7/f23 [0,4194304] 0 2023-12-16T07:40:35.835 INFO:tasks.workunit.client.1.smithi133.stdout:1/120: rmdir d0/da/db 39 2023-12-16T07:40:35.840 INFO:tasks.workunit.client.1.smithi133.stdout:7/250: dread db/d21/d2c/f56 [0,4194304] 0 2023-12-16T07:40:35.843 INFO:tasks.workunit.client.1.smithi133.stdout:6/214: dwrite d0/d4/d21/f3c [0,4194304] 0 2023-12-16T07:40:35.845 INFO:tasks.workunit.client.1.smithi133.stdout:1/121: dread d0/da/f10 [0,4194304] 0 2023-12-16T07:40:35.850 INFO:tasks.workunit.client.1.smithi133.stdout:4/219: dwrite d3/d7/d1a/f20 [0,4194304] 0 2023-12-16T07:40:35.850 INFO:tasks.workunit.client.1.smithi133.stdout:4/220: write d3/d7/d1a/f26 [30176,16160] 0 2023-12-16T07:40:35.863 INFO:tasks.workunit.client.1.smithi133.stdout:1/122: dread d0/da/f19 [0,4194304] 0 2023-12-16T07:40:35.863 INFO:tasks.workunit.client.1.smithi133.stdout:6/215: dread d0/d4/d21/f32 [0,4194304] 0 2023-12-16T07:40:35.863 INFO:tasks.workunit.client.1.smithi133.stdout:6/216: chown d0/d4/d21/d35/d36/c44 3 1 2023-12-16T07:40:35.863 INFO:tasks.workunit.client.1.smithi133.stdout:6/217: readlink d0/l30 0 2023-12-16T07:40:35.863 INFO:tasks.workunit.client.1.smithi133.stdout:6/218: write d0/d4/f2b [1076409,31576] 0 2023-12-16T07:40:35.863 INFO:tasks.workunit.client.1.smithi133.stdout:6/219: read - d0/d4/d21/d35/f48 zero size 2023-12-16T07:40:35.869 INFO:tasks.workunit.client.1.smithi133.stdout:4/221: dwrite d3/f25 [0,4194304] 0 2023-12-16T07:40:35.869 INFO:tasks.workunit.client.1.smithi133.stdout:4/222: read - d3/d7/d1a/f27 zero size 2023-12-16T07:40:35.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/123: symlink d0/l2b 0 2023-12-16T07:40:35.876 INFO:tasks.workunit.client.1.smithi133.stdout:8/119: read f8 [895531,20940] 0 2023-12-16T07:40:35.886 INFO:tasks.workunit.client.1.smithi133.stdout:4/223: symlink d3/l49 0 2023-12-16T07:40:35.886 INFO:tasks.workunit.client.1.smithi133.stdout:4/224: read d3/f41 [3631631,3362] 0 2023-12-16T07:40:35.888 INFO:tasks.workunit.client.1.smithi133.stdout:4/225: read d3/d7/f2e [3500099,128379] 0 2023-12-16T07:40:35.892 INFO:tasks.workunit.client.1.smithi133.stdout:6/220: dwrite d0/d4/f11 [0,4194304] 0 2023-12-16T07:40:35.892 INFO:tasks.workunit.client.1.smithi133.stdout:6/221: truncate d0/d4/d21/f23 694908 0 2023-12-16T07:40:35.894 INFO:tasks.workunit.client.1.smithi133.stdout:6/222: write d0/d4/f31 [2771533,10184] 0 2023-12-16T07:40:35.896 INFO:tasks.workunit.client.1.smithi133.stdout:6/223: write d0/f1 [2703741,14117] 0 2023-12-16T07:40:35.896 INFO:tasks.workunit.client.1.smithi133.stdout:6/224: truncate d0/f18 5076555 0 2023-12-16T07:40:35.904 INFO:tasks.workunit.client.1.smithi133.stdout:1/124: rename d0/f1a to d0/da/db/f2c 0 2023-12-16T07:40:35.905 INFO:tasks.workunit.client.1.smithi133.stdout:4/226: mknod d3/d7/c4a 0 2023-12-16T07:40:35.907 INFO:tasks.workunit.client.1.smithi133.stdout:6/225: creat d0/f4d x:0 0 0 2023-12-16T07:40:35.907 INFO:tasks.workunit.client.1.smithi133.stdout:6/226: dread - d0/f4d zero size 2023-12-16T07:40:35.907 INFO:tasks.workunit.client.1.smithi133.stdout:1/125: chown d0/l2 714790571 1 2023-12-16T07:40:35.907 INFO:tasks.workunit.client.1.smithi133.stdout:1/126: rename d0 to d0/da/d2d 22 2023-12-16T07:40:35.910 INFO:tasks.workunit.client.1.smithi133.stdout:1/127: creat d0/da/f2e x:0 0 0 2023-12-16T07:40:35.910 INFO:tasks.workunit.client.1.smithi133.stdout:1/128: dread - d0/da/f2e zero size 2023-12-16T07:40:35.911 INFO:tasks.workunit.client.1.smithi133.stdout:7/251: truncate db/f18 263391 0 2023-12-16T07:40:35.922 INFO:tasks.workunit.client.1.smithi133.stdout:1/129: dread d0/da/db/ff [4194304,4194304] 0 2023-12-16T07:40:35.925 INFO:tasks.workunit.client.1.smithi133.stdout:1/130: chown d0/c16 116999 1 2023-12-16T07:40:35.933 INFO:tasks.workunit.client.1.smithi133.stdout:8/120: dwrite f8 [0,4194304] 0 2023-12-16T07:40:35.933 INFO:tasks.workunit.client.1.smithi133.stdout:8/121: dread - d9/d11/f1f zero size 2023-12-16T07:40:35.934 INFO:tasks.workunit.client.1.smithi133.stdout:8/122: readlink l6 0 2023-12-16T07:40:35.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/227: dwrite d3/f3b [0,4194304] 0 2023-12-16T07:40:35.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/228: chown d3/le 4332536 1 2023-12-16T07:40:35.939 INFO:tasks.workunit.client.1.smithi133.stdout:8/123: unlink d9/f1e 0 2023-12-16T07:40:35.939 INFO:tasks.workunit.client.1.smithi133.stdout:4/229: rmdir d3/d7/d1c/d2a 39 2023-12-16T07:40:35.944 INFO:tasks.workunit.client.1.smithi133.stdout:4/230: rename c2 to d3/d7/c4b 0 2023-12-16T07:40:35.945 INFO:tasks.workunit.client.1.smithi133.stdout:8/124: rename d9/d11/l12 to d9/dc/de/l20 0 2023-12-16T07:40:35.946 INFO:tasks.workunit.client.1.smithi133.stdout:4/231: dread d3/d7/d38/f3d [0,4194304] 0 2023-12-16T07:40:35.946 INFO:tasks.workunit.client.1.smithi133.stdout:4/232: fdatasync d3/d7/d38/f3d 0 2023-12-16T07:40:35.946 INFO:tasks.workunit.client.1.smithi133.stdout:4/233: readlink d3/d7/d38/l3a 0 2023-12-16T07:40:35.946 INFO:tasks.workunit.client.1.smithi133.stdout:8/125: getdents d9/d10 0 2023-12-16T07:40:35.949 INFO:tasks.workunit.client.1.smithi133.stdout:8/126: creat d9/f21 x:0 0 0 2023-12-16T07:40:35.949 INFO:tasks.workunit.client.1.smithi133.stdout:8/127: chown d9/d11/f1f 0 1 2023-12-16T07:40:35.950 INFO:tasks.workunit.client.1.smithi133.stdout:4/234: dread d3/f30 [0,4194304] 0 2023-12-16T07:40:35.951 INFO:tasks.workunit.client.1.smithi133.stdout:8/128: fdatasync d9/dc/f1d 0 2023-12-16T07:40:35.951 INFO:tasks.workunit.client.1.smithi133.stdout:7/252: dwrite db/d12/f49 [0,4194304] 0 2023-12-16T07:40:35.952 INFO:tasks.workunit.client.1.smithi133.stdout:1/131: dwrite d0/da/db/d24/f26 [0,4194304] 0 2023-12-16T07:40:35.958 INFO:tasks.workunit.client.1.smithi133.stdout:6/227: dwrite d0/d4/f19 [0,4194304] 0 2023-12-16T07:40:35.958 INFO:tasks.workunit.client.1.smithi133.stdout:6/228: read - d0/f4d zero size 2023-12-16T07:40:35.959 INFO:tasks.workunit.client.1.smithi133.stdout:6/229: fsync d0/d4/d21/f2a 0 2023-12-16T07:40:35.959 INFO:tasks.workunit.client.1.smithi133.stdout:4/235: write d3/f14 [8311717,60176] 0 2023-12-16T07:40:35.959 INFO:tasks.workunit.client.1.smithi133.stdout:4/236: chown d3/d7/f23 995 1 2023-12-16T07:40:35.964 INFO:tasks.workunit.client.1.smithi133.stdout:6/230: mkdir d0/d4/d21/d35/d4e 0 2023-12-16T07:40:35.968 INFO:tasks.workunit.client.1.smithi133.stdout:4/237: read d3/d7/d1a/f24 [390419,95137] 0 2023-12-16T07:40:35.968 INFO:tasks.workunit.client.1.smithi133.stdout:4/238: dread - d3/d7/d1a/f27 zero size 2023-12-16T07:40:35.969 INFO:tasks.workunit.client.1.smithi133.stdout:6/231: unlink d0/f1 0 2023-12-16T07:40:35.969 INFO:tasks.workunit.client.1.smithi133.stdout:6/232: fsync d0/d4/d21/f40 0 2023-12-16T07:40:35.969 INFO:tasks.workunit.client.1.smithi133.stdout:6/233: dread - d0/d4/d21/d35/f48 zero size 2023-12-16T07:40:35.972 INFO:tasks.workunit.client.1.smithi133.stdout:6/234: write d0/f18 [4967058,62912] 0 2023-12-16T07:40:35.972 INFO:tasks.workunit.client.1.smithi133.stdout:6/235: write d0/d4/d21/d35/f48 [52034,71061] 0 2023-12-16T07:40:35.984 INFO:tasks.workunit.client.1.smithi133.stdout:7/253: dwrite db/fe [0,4194304] 0 2023-12-16T07:40:35.988 INFO:tasks.workunit.client.1.smithi133.stdout:4/239: dwrite d3/f3b [0,4194304] 0 2023-12-16T07:40:35.988 INFO:tasks.workunit.client.1.smithi133.stdout:4/240: fsync d3/f25 0 2023-12-16T07:40:35.988 INFO:tasks.workunit.client.1.smithi133.stdout:4/241: truncate d3/f25 4325602 0 2023-12-16T07:40:35.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/129: dwrite d9/d11/f1f [0,4194304] 0 2023-12-16T07:40:35.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/130: fdatasync d9/f21 0 2023-12-16T07:40:35.993 INFO:tasks.workunit.client.1.smithi133.stdout:4/242: stat d3/c6 0 2023-12-16T07:40:35.997 INFO:tasks.workunit.client.1.smithi133.stdout:8/131: creat d9/f22 x:0 0 0 2023-12-16T07:40:35.997 INFO:tasks.workunit.client.1.smithi133.stdout:8/132: write d9/f1c [89082,52705] 0 2023-12-16T07:40:35.999 INFO:tasks.workunit.client.1.smithi133.stdout:8/133: mkdir d9/d11/d1a/d23 0 2023-12-16T07:40:36.001 INFO:tasks.workunit.client.1.smithi133.stdout:8/134: mknod d9/d11/c24 0 2023-12-16T07:40:36.001 INFO:tasks.workunit.client.1.smithi133.stdout:8/135: fdatasync d9/f21 0 2023-12-16T07:40:36.001 INFO:tasks.workunit.client.1.smithi133.stdout:8/136: getdents d9/d11/d1a/d23 0 2023-12-16T07:40:36.003 INFO:tasks.workunit.client.1.smithi133.stdout:6/236: dread d0/f18 [0,4194304] 0 2023-12-16T07:40:36.004 INFO:tasks.workunit.client.1.smithi133.stdout:4/243: dread d3/f14 [4194304,4194304] 0 2023-12-16T07:40:36.007 INFO:tasks.workunit.client.1.smithi133.stdout:7/254: dwrite db/ff [0,4194304] 0 2023-12-16T07:40:36.009 INFO:tasks.workunit.client.1.smithi133.stdout:4/244: creat d3/d7/d1c/d2a/f4c x:0 0 0 2023-12-16T07:40:36.009 INFO:tasks.workunit.client.1.smithi133.stdout:4/245: chown d3/l5 80 1 2023-12-16T07:40:36.014 INFO:tasks.workunit.client.1.smithi133.stdout:7/255: stat db/d12/c14 0 2023-12-16T07:40:36.018 INFO:tasks.workunit.client.1.smithi133.stdout:7/256: write db/d21/f23 [1961538,97496] 0 2023-12-16T07:40:36.032 INFO:tasks.workunit.client.1.smithi133.stdout:7/257: dread db/d12/f34 [0,4194304] 0 2023-12-16T07:40:36.032 INFO:tasks.workunit.client.1.smithi133.stdout:8/137: dwrite d9/f22 [0,4194304] 0 2023-12-16T07:40:36.032 INFO:tasks.workunit.client.1.smithi133.stdout:8/138: write d9/f21 [390408,49862] 0 2023-12-16T07:40:36.034 INFO:tasks.workunit.client.1.smithi133.stdout:4/246: dwrite d3/f3b [0,4194304] 0 2023-12-16T07:40:36.035 INFO:tasks.workunit.client.1.smithi133.stdout:7/258: mkdir db/d21/d2c/d31/d59 0 2023-12-16T07:40:36.038 INFO:tasks.workunit.client.1.smithi133.stdout:8/139: creat d9/d11/f25 x:0 0 0 2023-12-16T07:40:36.043 INFO:tasks.workunit.client.1.smithi133.stdout:7/259: creat db/d21/d2c/d31/d59/f5a x:0 0 0 2023-12-16T07:40:36.048 INFO:tasks.workunit.client.1.smithi133.stdout:7/260: creat db/d21/f5b x:0 0 0 2023-12-16T07:40:36.051 INFO:tasks.workunit.client.1.smithi133.stdout:7/261: mknod db/d3e/d4a/d58/c5c 0 2023-12-16T07:40:36.058 INFO:tasks.workunit.client.1.smithi133.stdout:7/262: link db/d12/c1e db/d21/d2c/d31/c5d 0 2023-12-16T07:40:36.058 INFO:tasks.workunit.client.1.smithi133.stdout:7/263: truncate db/d21/d2c/d31/f32 803149 0 2023-12-16T07:40:36.061 INFO:tasks.workunit.client.1.smithi133.stdout:8/140: dwrite d9/f1c [0,4194304] 0 2023-12-16T07:40:36.061 INFO:tasks.workunit.client.1.smithi133.stdout:4/247: dwrite d3/f14 [4194304,4194304] 0 2023-12-16T07:40:36.061 INFO:tasks.workunit.client.1.smithi133.stdout:4/248: write d3/d7/d1a/f27 [726726,82097] 0 2023-12-16T07:40:36.062 INFO:tasks.workunit.client.1.smithi133.stdout:4/249: write d3/d7/d1a/f27 [784015,93759] 0 2023-12-16T07:40:36.062 INFO:tasks.workunit.client.1.smithi133.stdout:7/264: rename db/d12/d3a/f4b to db/d12/f5e 0 2023-12-16T07:40:36.062 INFO:tasks.workunit.client.1.smithi133.stdout:7/265: chown db/d12/c1a 38696466 1 2023-12-16T07:40:36.065 INFO:tasks.workunit.client.1.smithi133.stdout:8/141: write f8 [1197788,93824] 0 2023-12-16T07:40:36.067 INFO:tasks.workunit.client.1.smithi133.stdout:4/250: mknod d3/d7/d44/c4d 0 2023-12-16T07:40:36.069 INFO:tasks.workunit.client.1.smithi133.stdout:7/266: symlink db/d53/l5f 0 2023-12-16T07:40:36.074 INFO:tasks.workunit.client.1.smithi133.stdout:4/251: truncate d3/d7/fb 1958952 0 2023-12-16T07:40:36.074 INFO:tasks.workunit.client.1.smithi133.stdout:4/252: truncate d3/d7/d1a/f27 1851470 0 2023-12-16T07:40:36.076 INFO:tasks.workunit.client.1.smithi133.stdout:7/267: creat db/d3e/d4a/f60 x:0 0 0 2023-12-16T07:40:36.076 INFO:tasks.workunit.client.1.smithi133.stdout:7/268: write db/d21/d2c/f56 [4259552,81204] 0 2023-12-16T07:40:36.077 INFO:tasks.workunit.client.1.smithi133.stdout:7/269: dread db/f18 [0,4194304] 0 2023-12-16T07:40:36.079 INFO:tasks.workunit.client.1.smithi133.stdout:8/142: mknod d9/dc/c26 0 2023-12-16T07:40:36.079 INFO:tasks.workunit.client.1.smithi133.stdout:8/143: chown d9/f22 219965 1 2023-12-16T07:40:36.079 INFO:tasks.workunit.client.1.smithi133.stdout:4/253: symlink d3/l4e 0 2023-12-16T07:40:36.082 INFO:tasks.workunit.client.1.smithi133.stdout:7/270: link db/l44 db/d3e/d4a/d58/l61 0 2023-12-16T07:40:36.082 INFO:tasks.workunit.client.1.smithi133.stdout:7/271: fdatasync db/f33 0 2023-12-16T07:40:36.082 INFO:tasks.workunit.client.1.smithi133.stdout:7/272: chown db/d21/f51 0 1 2023-12-16T07:40:36.083 INFO:tasks.workunit.client.1.smithi133.stdout:7/273: dread db/f18 [0,4194304] 0 2023-12-16T07:40:36.085 INFO:tasks.workunit.client.1.smithi133.stdout:4/254: unlink d3/d7/c18 0 2023-12-16T07:40:36.089 INFO:tasks.workunit.client.1.smithi133.stdout:8/144: mkdir d9/dc/d27 0 2023-12-16T07:40:36.089 INFO:tasks.workunit.client.1.smithi133.stdout:7/274: getdents db/d21 0 2023-12-16T07:40:36.093 INFO:tasks.workunit.client.1.smithi133.stdout:7/275: link db/d12/f49 db/d3e/d4a/d58/f62 0 2023-12-16T07:40:36.093 INFO:tasks.workunit.client.1.smithi133.stdout:4/255: dread d3/d7/d1a/f20 [0,4194304] 0 2023-12-16T07:40:36.097 INFO:tasks.workunit.client.1.smithi133.stdout:8/145: rmdir d9/d11/d1a/d23 0 2023-12-16T07:40:36.101 INFO:tasks.workunit.client.1.smithi133.stdout:8/146: creat d9/dc/d27/f28 x:0 0 0 2023-12-16T07:40:36.103 INFO:tasks.workunit.client.1.smithi133.stdout:4/256: dread d3/f41 [4194304,4194304] 0 2023-12-16T07:40:36.108 INFO:tasks.workunit.client.1.smithi133.stdout:7/276: dwrite db/d3e/d4a/f60 [0,4194304] 0 2023-12-16T07:40:36.108 INFO:tasks.workunit.client.1.smithi133.stdout:7/277: chown db/ff 104339167 1 2023-12-16T07:40:36.108 INFO:tasks.workunit.client.1.smithi133.stdout:7/278: dread - db/d21/d2c/f48 zero size 2023-12-16T07:40:36.110 INFO:tasks.workunit.client.1.smithi133.stdout:7/279: truncate db/fe 5323053 0 2023-12-16T07:40:36.112 INFO:tasks.workunit.client.1.smithi133.stdout:7/280: symlink db/d12/l63 0 2023-12-16T07:40:36.113 INFO:tasks.workunit.client.1.smithi133.stdout:7/281: rename db/l2b to db/d3e/d4a/d58/l64 0 2023-12-16T07:40:36.115 INFO:tasks.workunit.client.1.smithi133.stdout:8/147: dwrite d9/d11/f1f [4194304,4194304] 0 2023-12-16T07:40:36.116 INFO:tasks.workunit.client.1.smithi133.stdout:7/282: unlink db/c2d 0 2023-12-16T07:40:36.117 INFO:tasks.workunit.client.1.smithi133.stdout:7/283: readlink db/d3e/l4d 0 2023-12-16T07:40:36.120 INFO:tasks.workunit.client.1.smithi133.stdout:8/148: creat d9/dc/d27/f29 x:0 0 0 2023-12-16T07:40:36.123 INFO:tasks.workunit.client.1.smithi133.stdout:4/257: dwrite d3/f25 [0,4194304] 0 2023-12-16T07:40:36.123 INFO:tasks.workunit.client.1.smithi133.stdout:4/258: chown d3/f41 266 1 2023-12-16T07:40:36.123 INFO:tasks.workunit.client.1.smithi133.stdout:4/259: fsync d3/d7/fb 0 2023-12-16T07:40:36.124 INFO:tasks.workunit.client.1.smithi133.stdout:4/260: mknod d3/d7/d38/d45/c4f 0 2023-12-16T07:40:36.124 INFO:tasks.workunit.client.1.smithi133.stdout:4/261: rename d3 to d3/d7/d38/d50 22 2023-12-16T07:40:36.125 INFO:tasks.workunit.client.1.smithi133.stdout:4/262: creat d3/f51 x:0 0 0 2023-12-16T07:40:36.141 INFO:tasks.workunit.client.1.smithi133.stdout:7/284: dwrite db/d21/f26 [4194304,4194304] 0 2023-12-16T07:40:36.141 INFO:tasks.workunit.client.1.smithi133.stdout:7/285: write db/d12/f5e [371693,76205] 0 2023-12-16T07:40:36.143 INFO:tasks.workunit.client.1.smithi133.stdout:4/263: dwrite d3/f41 [4194304,4194304] 0 2023-12-16T07:40:36.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/286: symlink db/d21/l65 0 2023-12-16T07:40:36.149 INFO:tasks.workunit.client.1.smithi133.stdout:4/264: symlink d3/d7/d1c/l52 0 2023-12-16T07:40:36.150 INFO:tasks.workunit.client.1.smithi133.stdout:7/287: symlink db/d21/d2c/d31/l66 0 2023-12-16T07:40:36.152 INFO:tasks.workunit.client.1.smithi133.stdout:4/265: symlink d3/d7/d1c/l53 0 2023-12-16T07:40:36.152 INFO:tasks.workunit.client.1.smithi133.stdout:4/266: write d3/d7/d1a/f20 [5211975,82553] 0 2023-12-16T07:40:36.154 INFO:tasks.workunit.client.1.smithi133.stdout:7/288: unlink db/d21/d2c/d31/l4c 0 2023-12-16T07:40:36.158 INFO:tasks.workunit.client.1.smithi133.stdout:4/267: rename d3/d7/d1a/c1b to d3/d7/d38/c54 0 2023-12-16T07:40:36.158 INFO:tasks.workunit.client.1.smithi133.stdout:4/268: truncate d3/f25 4824056 0 2023-12-16T07:40:36.162 INFO:tasks.workunit.client.1.smithi133.stdout:4/269: dread d3/f14 [0,4194304] 0 2023-12-16T07:40:36.163 INFO:tasks.workunit.client.1.smithi133.stdout:4/270: write d3/d7/d38/f3d [660563,89547] 0 2023-12-16T07:40:36.163 INFO:tasks.workunit.client.1.smithi133.stdout:4/271: fdatasync d3/d7/f23 0 2023-12-16T07:40:36.163 INFO:tasks.workunit.client.1.smithi133.stdout:4/272: fsync d3/f3b 0 2023-12-16T07:40:36.163 INFO:tasks.workunit.client.1.smithi133.stdout:4/273: chown d3/d7/d1c/l2c 19182 1 2023-12-16T07:40:36.163 INFO:tasks.workunit.client.1.smithi133.stdout:4/274: chown d3/d7/d38/f3d 18 1 2023-12-16T07:40:36.168 INFO:tasks.workunit.client.1.smithi133.stdout:7/289: dwrite db/d21/f28 [0,4194304] 0 2023-12-16T07:40:36.169 INFO:tasks.workunit.client.1.smithi133.stdout:7/290: creat db/f67 x:0 0 0 2023-12-16T07:40:36.170 INFO:tasks.workunit.client.1.smithi133.stdout:7/291: rename db/d12/l24 to db/d3e/l68 0 2023-12-16T07:40:36.175 INFO:tasks.workunit.client.1.smithi133.stdout:9/83: sync 2023-12-16T07:40:36.175 INFO:tasks.workunit.client.1.smithi133.stdout:9/84: dread - d15/d18/f1d zero size 2023-12-16T07:40:36.177 INFO:tasks.workunit.client.1.smithi133.stdout:9/85: mkdir d15/d18/d1f 0 2023-12-16T07:40:36.187 INFO:tasks.workunit.client.1.smithi133.stdout:4/275: dwrite d3/d7/d38/f3d [0,4194304] 0 2023-12-16T07:40:36.187 INFO:tasks.workunit.client.1.smithi133.stdout:7/292: dwrite db/d21/f52 [0,4194304] 0 2023-12-16T07:40:36.189 INFO:tasks.workunit.client.1.smithi133.stdout:7/293: write db/d21/f23 [2854152,107336] 0 2023-12-16T07:40:36.189 INFO:tasks.workunit.client.1.smithi133.stdout:7/294: read - db/f22 zero size 2023-12-16T07:40:36.190 INFO:tasks.workunit.client.1.smithi133.stdout:9/86: dread fe [0,4194304] 0 2023-12-16T07:40:36.190 INFO:tasks.workunit.client.1.smithi133.stdout:7/295: write db/d21/d2c/f56 [3056462,21720] 0 2023-12-16T07:40:36.200 INFO:tasks.workunit.client.1.smithi133.stdout:4/276: dread d3/f25 [0,4194304] 0 2023-12-16T07:40:36.202 INFO:tasks.workunit.client.1.smithi133.stdout:7/296: dread db/f16 [0,4194304] 0 2023-12-16T07:40:36.202 INFO:tasks.workunit.client.1.smithi133.stdout:7/297: chown db/d3e/f40 0 1 2023-12-16T07:40:36.202 INFO:tasks.workunit.client.1.smithi133.stdout:7/298: truncate db/d21/d2c/d31/d59/f5a 687853 0 2023-12-16T07:40:36.202 INFO:tasks.workunit.client.1.smithi133.stdout:4/277: rmdir d3/d7/d44 39 2023-12-16T07:40:36.204 INFO:tasks.workunit.client.1.smithi133.stdout:7/299: link db/ff db/d3e/f69 0 2023-12-16T07:40:36.208 INFO:tasks.workunit.client.1.smithi133.stdout:9/87: dwrite f14 [0,4194304] 0 2023-12-16T07:40:36.208 INFO:tasks.workunit.client.1.smithi133.stdout:9/88: stat d15/l1e 0 2023-12-16T07:40:36.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:35 smithi049 ceph-mon[111939]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 126 MiB/s rd, 264 MiB/s wr, 469 op/s 2023-12-16T07:40:36.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:35 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:36.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:35 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:36.210 INFO:tasks.workunit.client.1.smithi133.stdout:9/89: dread fb [0,4194304] 0 2023-12-16T07:40:36.211 INFO:tasks.workunit.client.1.smithi133.stdout:9/90: chown d15/c1a 1753 1 2023-12-16T07:40:36.212 INFO:tasks.workunit.client.1.smithi133.stdout:9/91: rmdir d15/d18/d1f 0 2023-12-16T07:40:36.213 INFO:tasks.workunit.client.1.smithi133.stdout:3/54: sync 2023-12-16T07:40:36.213 INFO:tasks.workunit.client.1.smithi133.stdout:9/92: mknod d15/d18/c20 0 2023-12-16T07:40:36.215 INFO:tasks.workunit.client.1.smithi133.stdout:3/55: chown d7/d8/c9 3144 1 2023-12-16T07:40:36.215 INFO:tasks.workunit.client.1.smithi133.stdout:3/56: stat d7/d8/d12/f15 0 2023-12-16T07:40:36.216 INFO:tasks.workunit.client.1.smithi133.stdout:9/93: rmdir d15 39 2023-12-16T07:40:36.219 INFO:tasks.workunit.client.1.smithi133.stdout:9/94: creat d15/d18/f21 x:0 0 0 2023-12-16T07:40:36.221 INFO:tasks.workunit.client.1.smithi133.stdout:3/57: symlink d7/d8/l1a 0 2023-12-16T07:40:36.221 INFO:tasks.workunit.client.1.smithi133.stdout:7/300: dwrite db/d21/f23 [0,4194304] 0 2023-12-16T07:40:36.221 INFO:tasks.workunit.client.1.smithi133.stdout:3/58: chown c0 1685444 1 2023-12-16T07:40:36.222 INFO:tasks.workunit.client.1.smithi133.stdout:9/95: link c10 d15/d18/c22 0 2023-12-16T07:40:36.222 INFO:tasks.workunit.client.1.smithi133.stdout:9/96: write fb [341092,122898] 0 2023-12-16T07:40:36.224 INFO:tasks.workunit.client.1.smithi133.stdout:3/59: creat d7/f1b x:0 0 0 2023-12-16T07:40:36.224 INFO:tasks.workunit.client.1.smithi133.stdout:7/301: creat db/d3e/f6a x:0 0 0 2023-12-16T07:40:36.226 INFO:tasks.workunit.client.1.smithi133.stdout:9/97: mknod d15/d18/c23 0 2023-12-16T07:40:36.226 INFO:tasks.workunit.client.1.smithi133.stdout:9/98: readlink l12 0 2023-12-16T07:40:36.226 INFO:tasks.workunit.client.1.smithi133.stdout:9/99: write fc [224245,73165] 0 2023-12-16T07:40:36.226 INFO:tasks.workunit.client.1.smithi133.stdout:3/60: getdents d7/d8/d12 0 2023-12-16T07:40:36.228 INFO:tasks.workunit.client.1.smithi133.stdout:7/302: unlink db/d21/f51 0 2023-12-16T07:40:36.231 INFO:tasks.workunit.client.1.smithi133.stdout:7/303: creat db/d53/f6b x:0 0 0 2023-12-16T07:40:36.233 INFO:tasks.workunit.client.1.smithi133.stdout:3/61: mkdir d7/d8/d1c 0 2023-12-16T07:40:36.234 INFO:tasks.workunit.client.1.smithi133.stdout:9/100: dread f9 [0,4194304] 0 2023-12-16T07:40:36.234 INFO:tasks.workunit.client.1.smithi133.stdout:9/101: readlink l4 0 2023-12-16T07:40:36.237 INFO:tasks.workunit.client.1.smithi133.stdout:7/304: mkdir db/d12/d3a/d6c 0 2023-12-16T07:40:36.237 INFO:tasks.workunit.client.1.smithi133.stdout:7/305: truncate db/f67 603662 0 2023-12-16T07:40:36.238 INFO:tasks.workunit.client.1.smithi133.stdout:9/102: creat d15/d18/f24 x:0 0 0 2023-12-16T07:40:36.240 INFO:tasks.workunit.client.1.smithi133.stdout:7/306: mknod db/c6d 0 2023-12-16T07:40:36.240 INFO:tasks.workunit.client.1.smithi133.stdout:7/307: truncate db/f1c 4529763 0 2023-12-16T07:40:36.241 INFO:tasks.workunit.client.1.smithi133.stdout:9/103: rename d15/d18/c23 to d15/d18/c25 0 2023-12-16T07:40:36.244 INFO:tasks.workunit.client.1.smithi133.stdout:7/308: mkdir db/d21/d2c/d31/d6e 0 2023-12-16T07:40:36.245 INFO:tasks.workunit.client.1.smithi133.stdout:3/62: dwrite d7/f1b [0,4194304] 0 2023-12-16T07:40:36.245 INFO:tasks.workunit.client.1.smithi133.stdout:9/104: link f0 d15/f26 0 2023-12-16T07:40:36.245 INFO:tasks.workunit.client.1.smithi133.stdout:9/105: stat d15/c19 0 2023-12-16T07:40:36.248 INFO:tasks.workunit.client.1.smithi133.stdout:7/309: symlink db/d21/d2c/l6f 0 2023-12-16T07:40:36.249 INFO:tasks.workunit.client.1.smithi133.stdout:7/310: write db/fe [1979807,30264] 0 2023-12-16T07:40:36.251 INFO:tasks.workunit.client.1.smithi133.stdout:3/63: truncate f3 1253783 0 2023-12-16T07:40:36.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/106: rmdir d15/d18 39 2023-12-16T07:40:36.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/107: chown d15/d18/f21 14 1 2023-12-16T07:40:36.268 INFO:tasks.workunit.client.1.smithi133.stdout:7/311: dwrite db/d21/d2c/f48 [0,4194304] 0 2023-12-16T07:40:36.268 INFO:tasks.workunit.client.1.smithi133.stdout:3/64: dwrite d7/d8/fe [0,4194304] 0 2023-12-16T07:40:36.268 INFO:tasks.workunit.client.1.smithi133.stdout:3/65: truncate d7/d8/f11 862181 0 2023-12-16T07:40:36.271 INFO:tasks.workunit.client.1.smithi133.stdout:7/312: write db/d21/f52 [1245679,71500] 0 2023-12-16T07:40:36.271 INFO:tasks.workunit.client.1.smithi133.stdout:7/313: chown db 10550796 1 2023-12-16T07:40:36.273 INFO:tasks.workunit.client.1.smithi133.stdout:7/314: truncate db/d12/f49 1962030 0 2023-12-16T07:40:36.279 INFO:tasks.workunit.client.1.smithi133.stdout:9/108: dwrite d15/d18/f1d [0,4194304] 0 2023-12-16T07:40:36.280 INFO:tasks.workunit.client.1.smithi133.stdout:3/66: mkdir d7/d8/d1d 0 2023-12-16T07:40:36.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/109: link c6 d15/d18/c27 0 2023-12-16T07:40:36.285 INFO:tasks.workunit.client.1.smithi133.stdout:3/67: creat d7/d8/d1d/f1e x:0 0 0 2023-12-16T07:40:36.285 INFO:tasks.workunit.client.1.smithi133.stdout:3/68: chown d7/f1b 3 1 2023-12-16T07:40:36.287 INFO:tasks.workunit.client.1.smithi133.stdout:7/315: dwrite db/d3e/d4a/f60 [0,4194304] 0 2023-12-16T07:40:36.293 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:35 smithi133 ceph-mon[120445]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 126 MiB/s rd, 264 MiB/s wr, 469 op/s 2023-12-16T07:40:36.293 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:35 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:36.293 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:35 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:36.293 INFO:tasks.workunit.client.1.smithi133.stdout:7/316: link db/d12/f45 db/d21/f70 0 2023-12-16T07:40:36.294 INFO:tasks.workunit.client.1.smithi133.stdout:7/317: creat db/d12/f71 x:0 0 0 2023-12-16T07:40:36.296 INFO:tasks.workunit.client.1.smithi133.stdout:3/69: rename d7/d8/cd to d7/d8/c1f 0 2023-12-16T07:40:36.297 INFO:tasks.workunit.client.1.smithi133.stdout:7/318: dread db/f11 [0,4194304] 0 2023-12-16T07:40:36.299 INFO:tasks.workunit.client.1.smithi133.stdout:3/70: creat d7/d8/f20 x:0 0 0 2023-12-16T07:40:36.299 INFO:tasks.workunit.client.1.smithi133.stdout:3/71: write d7/d8/f11 [1263327,6170] 0 2023-12-16T07:40:36.301 INFO:tasks.workunit.client.1.smithi133.stdout:9/110: getdents d15/d18 0 2023-12-16T07:40:36.303 INFO:tasks.workunit.client.1.smithi133.stdout:9/111: symlink d15/d18/l28 0 2023-12-16T07:40:36.304 INFO:tasks.workunit.client.1.smithi133.stdout:5/93: sync 2023-12-16T07:40:36.304 INFO:tasks.workunit.client.1.smithi133.stdout:0/131: sync 2023-12-16T07:40:36.304 INFO:tasks.workunit.client.1.smithi133.stdout:5/94: stat d1/de/l14 0 2023-12-16T07:40:36.304 INFO:tasks.workunit.client.1.smithi133.stdout:5/95: chown d1/c9 44 1 2023-12-16T07:40:36.305 INFO:tasks.workunit.client.1.smithi133.stdout:2/87: sync 2023-12-16T07:40:36.305 INFO:tasks.workunit.client.1.smithi133.stdout:5/96: write d1/f17 [680039,115404] 0 2023-12-16T07:40:36.305 INFO:tasks.workunit.client.1.smithi133.stdout:9/112: creat d15/f29 x:0 0 0 2023-12-16T07:40:36.308 INFO:tasks.workunit.client.1.smithi133.stdout:0/132: mknod d2/d9/db/c2a 0 2023-12-16T07:40:36.308 INFO:tasks.workunit.client.1.smithi133.stdout:0/133: rmdir d2/d9 39 2023-12-16T07:40:36.309 INFO:tasks.workunit.client.1.smithi133.stdout:3/72: dread d7/d8/fa [0,4194304] 0 2023-12-16T07:40:36.309 INFO:tasks.workunit.client.1.smithi133.stdout:3/73: chown l4 35863309 1 2023-12-16T07:40:36.312 INFO:tasks.workunit.client.1.smithi133.stdout:7/319: dwrite db/d21/d2c/d31/d59/f5a [0,4194304] 0 2023-12-16T07:40:36.312 INFO:tasks.workunit.client.1.smithi133.stdout:0/134: mkdir d2/d17/d2b 0 2023-12-16T07:40:36.314 INFO:tasks.workunit.client.1.smithi133.stdout:3/74: mknod d7/c21 0 2023-12-16T07:40:36.314 INFO:tasks.workunit.client.1.smithi133.stdout:3/75: fdatasync d7/d8/fa 0 2023-12-16T07:40:36.314 INFO:tasks.workunit.client.1.smithi133.stdout:9/113: dread fc [0,4194304] 0 2023-12-16T07:40:36.318 INFO:tasks.workunit.client.1.smithi133.stdout:0/135: creat d2/d9/d20/f2c x:0 0 0 2023-12-16T07:40:36.319 INFO:tasks.workunit.client.1.smithi133.stdout:3/76: creat d7/d8/d1c/f22 x:0 0 0 2023-12-16T07:40:36.321 INFO:tasks.workunit.client.1.smithi133.stdout:7/320: write db/d21/f23 [2469244,24387] 0 2023-12-16T07:40:36.321 INFO:tasks.workunit.client.1.smithi133.stdout:7/321: fsync db/d3e/f6a 0 2023-12-16T07:40:36.321 INFO:tasks.workunit.client.1.smithi133.stdout:0/136: creat d2/d17/d2b/f2d x:0 0 0 2023-12-16T07:40:36.326 INFO:tasks.workunit.client.1.smithi133.stdout:2/88: dwrite da/f13 [0,4194304] 0 2023-12-16T07:40:36.326 INFO:tasks.workunit.client.1.smithi133.stdout:2/89: fsync da/f13 0 2023-12-16T07:40:36.326 INFO:tasks.workunit.client.1.smithi133.stdout:2/90: stat da/f13 0 2023-12-16T07:40:36.327 INFO:tasks.workunit.client.1.smithi133.stdout:7/322: link db/d53/l5f db/d3e/d4a/d58/l72 0 2023-12-16T07:40:36.329 INFO:tasks.workunit.client.1.smithi133.stdout:5/97: dwrite d1/de/f13 [0,4194304] 0 2023-12-16T07:40:36.329 INFO:tasks.workunit.client.1.smithi133.stdout:9/114: dread fb [0,4194304] 0 2023-12-16T07:40:36.330 INFO:tasks.workunit.client.1.smithi133.stdout:9/115: chown fc 509624 1 2023-12-16T07:40:36.334 INFO:tasks.workunit.client.1.smithi133.stdout:2/91: mkdir da/d15/d1b 0 2023-12-16T07:40:36.337 INFO:tasks.workunit.client.1.smithi133.stdout:7/323: mknod db/d3e/d4a/c73 0 2023-12-16T07:40:36.339 INFO:tasks.workunit.client.1.smithi133.stdout:9/116: truncate d15/d18/f24 35890 0 2023-12-16T07:40:36.344 INFO:tasks.workunit.client.1.smithi133.stdout:5/98: dread d1/f7 [0,4194304] 0 2023-12-16T07:40:36.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/77: dwrite d7/f1b [4194304,4194304] 0 2023-12-16T07:40:36.345 INFO:tasks.workunit.client.1.smithi133.stdout:2/92: unlink f7 0 2023-12-16T07:40:36.345 INFO:tasks.workunit.client.1.smithi133.stdout:0/137: dwrite d2/d9/d12/f14 [0,4194304] 0 2023-12-16T07:40:36.347 INFO:tasks.workunit.client.1.smithi133.stdout:7/324: link db/d3e/f40 db/d12/d3a/f74 0 2023-12-16T07:40:36.347 INFO:tasks.workunit.client.1.smithi133.stdout:7/325: dread - db/d12/d3a/f74 zero size 2023-12-16T07:40:36.350 INFO:tasks.workunit.client.1.smithi133.stdout:5/99: rename d1/fc to d1/d18/f1b 0 2023-12-16T07:40:36.352 INFO:tasks.workunit.client.1.smithi133.stdout:3/78: creat d7/f23 x:0 0 0 2023-12-16T07:40:36.352 INFO:tasks.workunit.client.1.smithi133.stdout:3/79: dread - d7/d8/d1c/f22 zero size 2023-12-16T07:40:36.352 INFO:tasks.workunit.client.1.smithi133.stdout:3/80: fdatasync d7/f23 0 2023-12-16T07:40:36.356 INFO:tasks.workunit.client.1.smithi133.stdout:2/93: dread da/f12 [0,4194304] 0 2023-12-16T07:40:36.357 INFO:tasks.workunit.client.1.smithi133.stdout:0/138: creat d2/d17/f2e x:0 0 0 2023-12-16T07:40:36.360 INFO:tasks.workunit.client.1.smithi133.stdout:7/326: creat db/d12/d3a/d6c/f75 x:0 0 0 2023-12-16T07:40:36.360 INFO:tasks.workunit.client.1.smithi133.stdout:7/327: readlink db/d21/l65 0 2023-12-16T07:40:36.360 INFO:tasks.workunit.client.1.smithi133.stdout:7/328: truncate db/f22 961337 0 2023-12-16T07:40:36.362 INFO:tasks.workunit.client.1.smithi133.stdout:9/117: symlink d15/d18/l2a 0 2023-12-16T07:40:36.363 INFO:tasks.workunit.client.1.smithi133.stdout:5/100: truncate d1/f15 3572146 0 2023-12-16T07:40:36.364 INFO:tasks.workunit.client.1.smithi133.stdout:9/118: dread fc [0,4194304] 0 2023-12-16T07:40:36.367 INFO:tasks.workunit.client.1.smithi133.stdout:3/81: unlink d7/d8/d1c/f22 0 2023-12-16T07:40:36.367 INFO:tasks.workunit.client.1.smithi133.stdout:3/82: write d7/d8/f20 [1027839,27009] 0 2023-12-16T07:40:36.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/119: creat d15/f2b x:0 0 0 2023-12-16T07:40:36.373 INFO:tasks.workunit.client.1.smithi133.stdout:5/101: dread d1/de/f13 [0,4194304] 0 2023-12-16T07:40:36.373 INFO:tasks.workunit.client.1.smithi133.stdout:7/329: dwrite db/f22 [0,4194304] 0 2023-12-16T07:40:36.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/139: symlink d2/d9/l2f 0 2023-12-16T07:40:36.374 INFO:tasks.workunit.client.1.smithi133.stdout:5/102: dread d1/fb [0,4194304] 0 2023-12-16T07:40:36.375 INFO:tasks.workunit.client.1.smithi133.stdout:0/140: write d2/d9/db/fe [1606268,40086] 0 2023-12-16T07:40:36.375 INFO:tasks.workunit.client.1.smithi133.stdout:0/141: stat d2/d9/db/c2a 0 2023-12-16T07:40:36.379 INFO:tasks.workunit.client.1.smithi133.stdout:7/330: rename db/f11 to db/d3e/d4a/f76 0 2023-12-16T07:40:36.379 INFO:tasks.workunit.client.1.smithi133.stdout:3/83: getdents d7/d8/d1c 0 2023-12-16T07:40:36.382 INFO:tasks.workunit.client.1.smithi133.stdout:0/142: mkdir d2/d9/d12/d30 0 2023-12-16T07:40:36.385 INFO:tasks.workunit.client.1.smithi133.stdout:7/331: dread f9 [0,4194304] 0 2023-12-16T07:40:36.385 INFO:tasks.workunit.client.1.smithi133.stdout:7/332: chown db/f67 10338 1 2023-12-16T07:40:36.385 INFO:tasks.workunit.client.1.smithi133.stdout:7/333: stat db/d12/d3a/f74 0 2023-12-16T07:40:36.385 INFO:tasks.workunit.client.1.smithi133.stdout:7/334: truncate db/d21/f5b 883628 0 2023-12-16T07:40:36.387 INFO:tasks.workunit.client.1.smithi133.stdout:0/143: getdents d2/d9/db 0 2023-12-16T07:40:36.387 INFO:tasks.workunit.client.1.smithi133.stdout:0/144: chown d2/d9/c23 1 1 2023-12-16T07:40:36.402 INFO:tasks.workunit.client.1.smithi133.stdout:7/335: dwrite db/d21/f5b [0,4194304] 0 2023-12-16T07:40:36.403 INFO:tasks.workunit.client.1.smithi133.stdout:9/120: dwrite f9 [0,4194304] 0 2023-12-16T07:40:36.404 INFO:tasks.workunit.client.1.smithi133.stdout:7/336: write db/d3e/d4a/d58/f62 [89294,45072] 0 2023-12-16T07:40:36.404 INFO:tasks.workunit.client.1.smithi133.stdout:7/337: dread - db/d53/f6b zero size 2023-12-16T07:40:36.404 INFO:tasks.workunit.client.1.smithi133.stdout:3/84: dwrite d7/d8/f14 [0,4194304] 0 2023-12-16T07:40:36.404 INFO:tasks.workunit.client.1.smithi133.stdout:3/85: readlink d7/l17 0 2023-12-16T07:40:36.404 INFO:tasks.workunit.client.1.smithi133.stdout:5/103: dwrite d1/f5 [4194304,4194304] 0 2023-12-16T07:40:36.404 INFO:tasks.workunit.client.1.smithi133.stdout:9/121: write fe [166996,107272] 0 2023-12-16T07:40:36.413 INFO:tasks.workunit.client.1.smithi133.stdout:9/122: dread fe [0,4194304] 0 2023-12-16T07:40:36.456 INFO:tasks.workunit.client.1.smithi133.stdout:0/145: mkdir d2/d17/d2b/d31 0 2023-12-16T07:40:36.478 INFO:tasks.workunit.client.1.smithi133.stdout:7/338: symlink db/d21/d2c/d31/d59/l77 0 2023-12-16T07:40:36.478 INFO:tasks.workunit.client.1.smithi133.stdout:7/339: write db/f16 [4211128,71904] 0 2023-12-16T07:40:36.479 INFO:tasks.workunit.client.1.smithi133.stdout:7/340: write db/fe [4377485,8262] 0 2023-12-16T07:40:36.479 INFO:tasks.workunit.client.1.smithi133.stdout:7/341: dread - db/d21/f37 zero size 2023-12-16T07:40:36.480 INFO:tasks.workunit.client.1.smithi133.stdout:3/86: mknod d7/d8/d12/c24 0 2023-12-16T07:40:36.485 INFO:tasks.workunit.client.1.smithi133.stdout:5/104: getdents d1 0 2023-12-16T07:40:36.485 INFO:tasks.workunit.client.1.smithi133.stdout:5/105: getdents d1 0 2023-12-16T07:40:36.499 INFO:tasks.workunit.client.1.smithi133.stdout:0/146: unlink d2/d17/f27 0 2023-12-16T07:40:36.500 INFO:tasks.workunit.client.1.smithi133.stdout:3/87: dwrite d7/d8/d1d/f1e [0,4194304] 0 2023-12-16T07:40:36.500 INFO:tasks.workunit.client.1.smithi133.stdout:7/342: link db/d21/d2c/d31/c46 db/d21/d2c/c78 0 2023-12-16T07:40:36.502 INFO:tasks.workunit.client.1.smithi133.stdout:9/123: mkdir d15/d18/d2c 0 2023-12-16T07:40:36.506 INFO:tasks.workunit.client.1.smithi133.stdout:3/88: creat d7/f25 x:0 0 0 2023-12-16T07:40:36.508 INFO:tasks.workunit.client.1.smithi133.stdout:7/343: mkdir db/d21/d2c/d31/d79 0 2023-12-16T07:40:36.511 INFO:tasks.workunit.client.1.smithi133.stdout:3/89: creat d7/d8/d1c/f26 x:0 0 0 2023-12-16T07:40:36.511 INFO:tasks.workunit.client.1.smithi133.stdout:3/90: fsync d7/d8/fa 0 2023-12-16T07:40:36.512 INFO:tasks.workunit.client.1.smithi133.stdout:0/147: dread d2/d17/f1b [0,4194304] 0 2023-12-16T07:40:36.512 INFO:tasks.workunit.client.1.smithi133.stdout:3/91: symlink d7/d8/l27 0 2023-12-16T07:40:36.513 INFO:tasks.workunit.client.1.smithi133.stdout:0/148: truncate d2/d9/d12/f14 2118273 0 2023-12-16T07:40:36.514 INFO:tasks.workunit.client.1.smithi133.stdout:3/92: creat d7/d8/d1d/f28 x:0 0 0 2023-12-16T07:40:36.515 INFO:tasks.workunit.client.1.smithi133.stdout:3/93: symlink d7/l29 0 2023-12-16T07:40:36.515 INFO:tasks.workunit.client.1.smithi133.stdout:9/124: dwrite d15/f17 [0,4194304] 0 2023-12-16T07:40:36.515 INFO:tasks.workunit.client.1.smithi133.stdout:9/125: write fd [642427,31557] 0 2023-12-16T07:40:36.517 INFO:tasks.workunit.client.1.smithi133.stdout:9/126: creat d15/f2d x:0 0 0 2023-12-16T07:40:36.518 INFO:tasks.workunit.client.1.smithi133.stdout:9/127: rename f1 to d15/d18/d2c/f2e 0 2023-12-16T07:40:36.518 INFO:tasks.workunit.client.1.smithi133.stdout:9/128: write d15/d18/d2c/f2e [4402019,11514] 0 2023-12-16T07:40:36.521 INFO:tasks.workunit.client.1.smithi133.stdout:9/129: link d15/d18/f21 d15/d18/f2f 0 2023-12-16T07:40:36.522 INFO:tasks.workunit.client.1.smithi133.stdout:9/130: creat d15/d18/d2c/f30 x:0 0 0 2023-12-16T07:40:36.522 INFO:tasks.workunit.client.1.smithi133.stdout:9/131: fdatasync d15/f2d 0 2023-12-16T07:40:36.528 INFO:tasks.workunit.client.1.smithi133.stdout:1/132: sync 2023-12-16T07:40:36.528 INFO:tasks.workunit.client.1.smithi133.stdout:6/237: sync 2023-12-16T07:40:36.528 INFO:tasks.workunit.client.1.smithi133.stdout:6/238: rename d0/d4/d21 to d0/d4/d21/d35/d36/d4f 22 2023-12-16T07:40:36.532 INFO:tasks.workunit.client.1.smithi133.stdout:3/94: write d7/f1b [3987598,23326] 0 2023-12-16T07:40:36.532 INFO:tasks.workunit.client.1.smithi133.stdout:3/95: dread - d7/d8/d1d/f28 zero size 2023-12-16T07:40:36.536 INFO:tasks.workunit.client.1.smithi133.stdout:5/106: dwrite d1/f10 [0,4194304] 0 2023-12-16T07:40:36.537 INFO:tasks.workunit.client.1.smithi133.stdout:3/96: mkdir d7/d8/d1d/d2a 0 2023-12-16T07:40:36.538 INFO:tasks.workunit.client.1.smithi133.stdout:1/133: dread d0/da/db/ff [0,4194304] 0 2023-12-16T07:40:36.542 INFO:tasks.workunit.client.1.smithi133.stdout:7/344: dread db/f16 [0,4194304] 0 2023-12-16T07:40:36.543 INFO:tasks.workunit.client.1.smithi133.stdout:6/239: dwrite d0/d4/f34 [0,4194304] 0 2023-12-16T07:40:36.545 INFO:tasks.workunit.client.1.smithi133.stdout:3/97: rename d7/d8/d12 to d7/d8/d1c/d2b 0 2023-12-16T07:40:36.545 INFO:tasks.workunit.client.1.smithi133.stdout:3/98: chown d7/c18 25 1 2023-12-16T07:40:36.545 INFO:tasks.workunit.client.1.smithi133.stdout:3/99: read f6 [452891,55313] 0 2023-12-16T07:40:36.546 INFO:tasks.workunit.client.1.smithi133.stdout:1/134: link d0/f17 d0/da/db/f2f 0 2023-12-16T07:40:36.546 INFO:tasks.workunit.client.1.smithi133.stdout:1/135: truncate d0/f2a 658554 0 2023-12-16T07:40:36.546 INFO:tasks.workunit.client.1.smithi133.stdout:1/136: fdatasync d0/da/db/f21 0 2023-12-16T07:40:36.547 INFO:tasks.workunit.client.1.smithi133.stdout:7/345: truncate db/d12/f45 12932 0 2023-12-16T07:40:36.551 INFO:tasks.workunit.client.1.smithi133.stdout:6/240: dread d0/f1b [0,4194304] 0 2023-12-16T07:40:36.551 INFO:tasks.workunit.client.1.smithi133.stdout:6/241: fdatasync d0/d4/f37 0 2023-12-16T07:40:36.551 INFO:tasks.workunit.client.1.smithi133.stdout:6/242: stat d0/d4/f1c 0 2023-12-16T07:40:36.555 INFO:tasks.workunit.client.1.smithi133.stdout:6/243: dread d0/f2 [0,4194304] 0 2023-12-16T07:40:36.555 INFO:tasks.workunit.client.1.smithi133.stdout:6/244: readlink d0/d4/l14 0 2023-12-16T07:40:36.555 INFO:tasks.workunit.client.1.smithi133.stdout:6/245: write d0/d4/d21/d35/f43 [412859,106557] 0 2023-12-16T07:40:36.555 INFO:tasks.workunit.client.1.smithi133.stdout:6/246: stat d0/d4/ca 0 2023-12-16T07:40:36.555 INFO:tasks.workunit.client.1.smithi133.stdout:6/247: write d0/d4/d21/d35/f43 [471143,123779] 0 2023-12-16T07:40:36.623 INFO:tasks.workunit.client.1.smithi133.stdout:1/137: rename d0/d12/c13 to d0/da/db/d24/c30 0 2023-12-16T07:40:36.624 INFO:tasks.workunit.client.1.smithi133.stdout:7/346: symlink db/d21/d2c/d31/d79/l7a 0 2023-12-16T07:40:36.625 INFO:tasks.workunit.client.1.smithi133.stdout:9/132: truncate d15/d18/d2c/f2e 3456043 0 2023-12-16T07:40:36.629 INFO:tasks.workunit.client.1.smithi133.stdout:6/248: rmdir d0 39 2023-12-16T07:40:36.629 INFO:tasks.workunit.client.1.smithi133.stdout:0/149: dwrite d2/d9/d12/f14 [0,4194304] 0 2023-12-16T07:40:36.635 INFO:tasks.workunit.client.1.smithi133.stdout:7/347: getdents db/d3e/d4a 0 2023-12-16T07:40:36.637 INFO:tasks.workunit.client.1.smithi133.stdout:9/133: link f9 d15/d18/d2c/f31 0 2023-12-16T07:40:36.640 INFO:tasks.workunit.client.1.smithi133.stdout:0/150: mknod d2/d9/d12/c32 0 2023-12-16T07:40:36.641 INFO:tasks.workunit.client.1.smithi133.stdout:1/138: dwrite d0/da/db/f2f [0,4194304] 0 2023-12-16T07:40:36.641 INFO:tasks.workunit.client.1.smithi133.stdout:7/348: dread db/d3e/d4a/d58/f62 [0,4194304] 0 2023-12-16T07:40:36.642 INFO:tasks.workunit.client.1.smithi133.stdout:6/249: dread d0/d4/d21/f23 [0,4194304] 0 2023-12-16T07:40:36.646 INFO:tasks.workunit.client.1.smithi133.stdout:1/139: rename d0/da/db/d24/c28 to d0/da/db/d24/c31 0 2023-12-16T07:40:36.648 INFO:tasks.workunit.client.1.smithi133.stdout:7/349: creat db/f7b x:0 0 0 2023-12-16T07:40:36.651 INFO:tasks.workunit.client.1.smithi133.stdout:6/250: rename d0/d4/d21/f23 to d0/d4/d21/d35/d36/f50 0 2023-12-16T07:40:36.652 INFO:tasks.workunit.client.1.smithi133.stdout:1/140: mkdir d0/da/db/d24/d32 0 2023-12-16T07:40:36.652 INFO:tasks.workunit.client.1.smithi133.stdout:1/141: readlink d0/l2 0 2023-12-16T07:40:36.653 INFO:tasks.workunit.client.1.smithi133.stdout:7/350: creat db/d3e/d4a/f7c x:0 0 0 2023-12-16T07:40:36.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/351: rename db/d53/l5f to db/d21/d2c/d31/d59/l7d 0 2023-12-16T07:40:36.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/352: truncate db/d21/d2c/f48 5093829 0 2023-12-16T07:40:36.660 INFO:tasks.workunit.client.1.smithi133.stdout:0/151: dwrite d2/d9/db/f15 [0,4194304] 0 2023-12-16T07:40:36.660 INFO:tasks.workunit.client.1.smithi133.stdout:0/152: dread - d2/d17/d2b/f2d zero size 2023-12-16T07:40:36.662 INFO:tasks.workunit.client.1.smithi133.stdout:1/142: dread d0/da/db/fd [0,4194304] 0 2023-12-16T07:40:36.665 INFO:tasks.workunit.client.1.smithi133.stdout:7/353: dread db/d3e/f69 [0,4194304] 0 2023-12-16T07:40:36.665 INFO:tasks.workunit.client.1.smithi133.stdout:9/134: dwrite d15/d18/f21 [0,4194304] 0 2023-12-16T07:40:36.665 INFO:tasks.workunit.client.1.smithi133.stdout:7/354: write db/d12/d3a/f74 [1022181,39865] 0 2023-12-16T07:40:36.666 INFO:tasks.workunit.client.1.smithi133.stdout:0/153: mknod d2/d17/d2b/d31/c33 0 2023-12-16T07:40:36.667 INFO:tasks.workunit.client.1.smithi133.stdout:1/143: symlink d0/da/db/l33 0 2023-12-16T07:40:36.670 INFO:tasks.workunit.client.1.smithi133.stdout:6/251: fsync d0/d4/d21/d35/d36/f50 0 2023-12-16T07:40:36.673 INFO:tasks.workunit.client.1.smithi133.stdout:9/135: truncate f0 6841503 0 2023-12-16T07:40:36.673 INFO:tasks.workunit.client.1.smithi133.stdout:9/136: dread - d15/f2b zero size 2023-12-16T07:40:36.679 INFO:tasks.workunit.client.1.smithi133.stdout:1/144: unlink d0/da/db/d24/f26 0 2023-12-16T07:40:36.679 INFO:tasks.workunit.client.1.smithi133.stdout:1/145: readlink d0/l1f 0 2023-12-16T07:40:36.679 INFO:tasks.workunit.client.1.smithi133.stdout:1/146: fdatasync d0/da/f10 0 2023-12-16T07:40:36.681 INFO:tasks.workunit.client.1.smithi133.stdout:0/154: rename d2/d9/db/lf to d2/d9/l34 0 2023-12-16T07:40:36.682 INFO:tasks.workunit.client.1.smithi133.stdout:1/147: mknod d0/da/db/c34 0 2023-12-16T07:40:36.682 INFO:tasks.workunit.client.1.smithi133.stdout:6/252: dread d0/d4/f11 [0,4194304] 0 2023-12-16T07:40:36.683 INFO:tasks.workunit.client.1.smithi133.stdout:0/155: mkdir d2/d9/d12/d35 0 2023-12-16T07:40:36.684 INFO:tasks.workunit.client.1.smithi133.stdout:0/156: write d2/d9/d20/f29 [219363,27758] 0 2023-12-16T07:40:36.685 INFO:tasks.workunit.client.1.smithi133.stdout:6/253: link d0/d4/c26 d0/d4/d21/c51 0 2023-12-16T07:40:36.689 INFO:tasks.workunit.client.1.smithi133.stdout:6/254: symlink d0/l52 0 2023-12-16T07:40:36.691 INFO:tasks.workunit.client.1.smithi133.stdout:9/137: dwrite d15/d18/d2c/f2e [0,4194304] 0 2023-12-16T07:40:36.696 INFO:tasks.workunit.client.1.smithi133.stdout:9/138: rename d15/d18/c20 to d15/d18/d2c/c32 0 2023-12-16T07:40:36.698 INFO:tasks.workunit.client.1.smithi133.stdout:9/139: creat d15/d18/d2c/f33 x:0 0 0 2023-12-16T07:40:36.702 INFO:tasks.workunit.client.1.smithi133.stdout:8/149: sync 2023-12-16T07:40:36.702 INFO:tasks.workunit.client.1.smithi133.stdout:8/150: chown d9/d11/f25 937678 1 2023-12-16T07:40:36.702 INFO:tasks.workunit.client.1.smithi133.stdout:1/148: dwrite d0/da/db/f21 [0,4194304] 0 2023-12-16T07:40:36.702 INFO:tasks.workunit.client.1.smithi133.stdout:1/149: write d0/d12/f1b [4887186,49364] 0 2023-12-16T07:40:36.703 INFO:tasks.workunit.client.1.smithi133.stdout:8/151: getdents d9/dc 0 2023-12-16T07:40:36.705 INFO:tasks.workunit.client.1.smithi133.stdout:8/152: dread d9/d10/f1b [0,4194304] 0 2023-12-16T07:40:36.705 INFO:tasks.workunit.client.1.smithi133.stdout:1/150: creat d0/da/db/f35 x:0 0 0 2023-12-16T07:40:36.711 INFO:tasks.workunit.client.1.smithi133.stdout:0/157: dwrite d2/d9/d20/f2c [0,4194304] 0 2023-12-16T07:40:36.718 INFO:tasks.workunit.client.1.smithi133.stdout:6/255: dwrite d0/d4/f11 [0,4194304] 0 2023-12-16T07:40:36.718 INFO:tasks.workunit.client.1.smithi133.stdout:9/140: dwrite d15/d18/d2c/f2e [0,4194304] 0 2023-12-16T07:40:36.720 INFO:tasks.workunit.client.1.smithi133.stdout:6/256: dread d0/d4/d21/d35/f48 [0,4194304] 0 2023-12-16T07:40:36.721 INFO:tasks.workunit.client.1.smithi133.stdout:9/141: dread fd [0,4194304] 0 2023-12-16T07:40:36.721 INFO:tasks.workunit.client.1.smithi133.stdout:9/142: read fb [243056,24] 0 2023-12-16T07:40:36.721 INFO:tasks.workunit.client.1.smithi133.stdout:9/143: fsync fb 0 2023-12-16T07:40:36.722 INFO:tasks.workunit.client.1.smithi133.stdout:9/144: read d15/d18/f2f [3119441,118847] 0 2023-12-16T07:40:36.722 INFO:tasks.workunit.client.1.smithi133.stdout:9/145: chown d15/d18/f2f 0 1 2023-12-16T07:40:36.722 INFO:tasks.workunit.client.1.smithi133.stdout:9/146: readlink l7 0 2023-12-16T07:40:36.736 INFO:tasks.workunit.client.1.smithi133.stdout:9/147: dwrite fc [0,4194304] 0 2023-12-16T07:40:36.753 INFO:tasks.workunit.client.1.smithi133.stdout:9/148: dwrite d15/d18/d2c/f30 [0,4194304] 0 2023-12-16T07:40:36.753 INFO:tasks.workunit.client.1.smithi133.stdout:9/149: fsync d15/d18/d2c/f2e 0 2023-12-16T07:40:36.784 INFO:tasks.workunit.client.1.smithi133.stdout:1/151: link d0/c20 d0/da/c36 0 2023-12-16T07:40:36.784 INFO:tasks.workunit.client.1.smithi133.stdout:1/152: fdatasync d0/da/db/f21 0 2023-12-16T07:40:36.784 INFO:tasks.workunit.client.1.smithi133.stdout:1/153: stat d0/da/db/f2f 0 2023-12-16T07:40:36.784 INFO:tasks.workunit.client.1.smithi133.stdout:1/154: fsync d0/f1 0 2023-12-16T07:40:36.786 INFO:tasks.workunit.client.1.smithi133.stdout:8/153: symlink d9/l2a 0 2023-12-16T07:40:36.791 INFO:tasks.workunit.client.1.smithi133.stdout:0/158: mkdir d2/d17/d2b/d31/d36 0 2023-12-16T07:40:36.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/257: rmdir d0/d4/d21/d35/d36/d49 39 2023-12-16T07:40:36.793 INFO:tasks.workunit.client.1.smithi133.stdout:1/155: dread d0/d12/f1b [0,4194304] 0 2023-12-16T07:40:36.800 INFO:tasks.workunit.client.1.smithi133.stdout:9/150: creat d15/d18/f34 x:0 0 0 2023-12-16T07:40:36.800 INFO:tasks.workunit.client.1.smithi133.stdout:6/258: dread d0/d4/f34 [0,4194304] 0 2023-12-16T07:40:36.802 INFO:tasks.workunit.client.1.smithi133.stdout:8/154: creat d9/dc/d27/f2b x:0 0 0 2023-12-16T07:40:36.802 INFO:tasks.workunit.client.1.smithi133.stdout:0/159: mkdir d2/d17/d37 0 2023-12-16T07:40:36.804 INFO:tasks.workunit.client.1.smithi133.stdout:1/156: mkdir d0/d1c/d37 0 2023-12-16T07:40:36.806 INFO:tasks.workunit.client.1.smithi133.stdout:9/151: creat d15/f35 x:0 0 0 2023-12-16T07:40:36.808 INFO:tasks.workunit.client.1.smithi133.stdout:6/259: symlink d0/d4/d21/d35/l53 0 2023-12-16T07:40:36.810 INFO:tasks.workunit.client.1.smithi133.stdout:8/155: unlink f8 0 2023-12-16T07:40:36.811 INFO:tasks.workunit.client.1.smithi133.stdout:1/157: creat d0/da/db/f38 x:0 0 0 2023-12-16T07:40:36.812 INFO:tasks.workunit.client.1.smithi133.stdout:9/152: creat d15/d18/f36 x:0 0 0 2023-12-16T07:40:36.813 INFO:tasks.workunit.client.1.smithi133.stdout:6/260: symlink d0/d4/d21/d35/d36/d49/l54 0 2023-12-16T07:40:36.814 INFO:tasks.workunit.client.1.smithi133.stdout:6/261: write d0/d4/f31 [1665172,36200] 0 2023-12-16T07:40:36.815 INFO:tasks.workunit.client.1.smithi133.stdout:8/156: link d9/d10/c19 d9/d10/c2c 0 2023-12-16T07:40:36.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/160: dwrite d2/d17/f26 [0,4194304] 0 2023-12-16T07:40:36.816 INFO:tasks.workunit.client.1.smithi133.stdout:9/153: creat d15/f37 x:0 0 0 2023-12-16T07:40:36.818 INFO:tasks.workunit.client.1.smithi133.stdout:6/262: rmdir d0/d4/d21 39 2023-12-16T07:40:36.823 INFO:tasks.workunit.client.1.smithi133.stdout:8/157: mkdir d9/d2d 0 2023-12-16T07:40:36.824 INFO:tasks.workunit.client.1.smithi133.stdout:0/161: creat d2/f38 x:0 0 0 2023-12-16T07:40:36.825 INFO:tasks.workunit.client.1.smithi133.stdout:0/162: read d2/d9/d12/f14 [820915,119880] 0 2023-12-16T07:40:36.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/263: symlink d0/d4/d21/d35/d4e/l55 0 2023-12-16T07:40:36.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/264: rename d0/d4/d21 to d0/d4/d21/d56 22 2023-12-16T07:40:36.827 INFO:tasks.workunit.client.1.smithi133.stdout:1/158: dwrite d0/f2a [0,4194304] 0 2023-12-16T07:40:36.828 INFO:tasks.workunit.client.1.smithi133.stdout:1/159: dread d0/da/db/d24/f25 [0,4194304] 0 2023-12-16T07:40:36.829 INFO:tasks.workunit.client.1.smithi133.stdout:8/158: creat d9/f2e x:0 0 0 2023-12-16T07:40:36.830 INFO:tasks.workunit.client.1.smithi133.stdout:8/159: write d9/f1c [3867819,86882] 0 2023-12-16T07:40:36.830 INFO:tasks.workunit.client.1.smithi133.stdout:9/154: mknod d15/d18/c38 0 2023-12-16T07:40:36.830 INFO:tasks.workunit.client.1.smithi133.stdout:9/155: write d15/d18/d2c/f33 [446032,71623] 0 2023-12-16T07:40:36.831 INFO:tasks.workunit.client.1.smithi133.stdout:4/278: sync 2023-12-16T07:40:36.831 INFO:tasks.workunit.client.1.smithi133.stdout:2/94: sync 2023-12-16T07:40:36.833 INFO:tasks.workunit.client.1.smithi133.stdout:0/163: symlink d2/d17/d2b/d31/d36/l39 0 2023-12-16T07:40:36.836 INFO:tasks.workunit.client.1.smithi133.stdout:6/265: rename d0/l12 to d0/d4/d21/d35/d4e/l57 0 2023-12-16T07:40:36.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/160: rename d9 to d9/d11/d2f 22 2023-12-16T07:40:36.843 INFO:tasks.workunit.client.1.smithi133.stdout:8/161: write d9/f22 [4137460,68675] 0 2023-12-16T07:40:36.843 INFO:tasks.workunit.client.1.smithi133.stdout:0/164: dread d2/d9/d20/f2c [0,4194304] 0 2023-12-16T07:40:36.843 INFO:tasks.workunit.client.1.smithi133.stdout:0/165: stat d2/f6 0 2023-12-16T07:40:36.843 INFO:tasks.workunit.client.1.smithi133.stdout:0/166: write d2/f1d [548555,91490] 0 2023-12-16T07:40:36.844 INFO:tasks.workunit.client.1.smithi133.stdout:1/160: link d0/c16 d0/d12/c39 0 2023-12-16T07:40:36.847 INFO:tasks.workunit.client.1.smithi133.stdout:9/156: creat d15/f39 x:0 0 0 2023-12-16T07:40:36.848 INFO:tasks.workunit.client.1.smithi133.stdout:4/279: creat d3/d7/d44/f55 x:0 0 0 2023-12-16T07:40:36.852 INFO:tasks.workunit.client.1.smithi133.stdout:2/95: symlink da/l1c 0 2023-12-16T07:40:36.852 INFO:tasks.workunit.client.1.smithi133.stdout:2/96: fdatasync da/f10 0 2023-12-16T07:40:36.852 INFO:tasks.workunit.client.1.smithi133.stdout:2/97: read da/fd [121004,24048] 0 2023-12-16T07:40:36.856 INFO:tasks.workunit.client.1.smithi133.stdout:8/162: dread d9/d11/f1f [4194304,4194304] 0 2023-12-16T07:40:36.857 INFO:tasks.workunit.client.1.smithi133.stdout:6/266: dwrite d0/d4/d21/d35/d36/f50 [0,4194304] 0 2023-12-16T07:40:36.858 INFO:tasks.workunit.client.1.smithi133.stdout:6/267: write d0/f18 [838623,103368] 0 2023-12-16T07:40:36.859 INFO:tasks.workunit.client.1.smithi133.stdout:0/167: symlink d2/d17/l3a 0 2023-12-16T07:40:36.862 INFO:tasks.workunit.client.1.smithi133.stdout:0/168: dread d2/f8 [4194304,4194304] 0 2023-12-16T07:40:36.864 INFO:tasks.workunit.client.1.smithi133.stdout:1/161: rename d0/da/db/d24/f25 to d0/da/f3a 0 2023-12-16T07:40:36.865 INFO:tasks.workunit.client.1.smithi133.stdout:1/162: chown d0/da/f2e 20166161 1 2023-12-16T07:40:36.865 INFO:tasks.workunit.client.1.smithi133.stdout:1/163: fsync d0/da/db/fd 0 2023-12-16T07:40:36.866 INFO:tasks.workunit.client.1.smithi133.stdout:9/157: mkdir d15/d18/d2c/d3a 0 2023-12-16T07:40:36.868 INFO:tasks.workunit.client.1.smithi133.stdout:4/280: mknod d3/d7/d38/c56 0 2023-12-16T07:40:36.868 INFO:tasks.workunit.client.1.smithi133.stdout:4/281: chown d3/d7/d1a/l3c 948382 1 2023-12-16T07:40:36.871 INFO:tasks.workunit.client.1.smithi133.stdout:2/98: rmdir da/d15/d17 39 2023-12-16T07:40:36.871 INFO:tasks.workunit.client.1.smithi133.stdout:2/99: readlink da/l16 0 2023-12-16T07:40:36.873 INFO:tasks.workunit.client.1.smithi133.stdout:8/163: creat d9/dc/f30 x:0 0 0 2023-12-16T07:40:36.873 INFO:tasks.workunit.client.1.smithi133.stdout:8/164: dread - d9/dc/f30 zero size 2023-12-16T07:40:36.873 INFO:tasks.workunit.client.1.smithi133.stdout:8/165: write d9/f2e [1021926,128264] 0 2023-12-16T07:40:36.876 INFO:tasks.workunit.client.1.smithi133.stdout:9/158: dread f14 [0,4194304] 0 2023-12-16T07:40:36.876 INFO:tasks.workunit.client.1.smithi133.stdout:9/159: write d15/d18/f21 [5237161,41692] 0 2023-12-16T07:40:36.876 INFO:tasks.workunit.client.1.smithi133.stdout:9/160: write d15/d18/f24 [613283,22799] 0 2023-12-16T07:40:36.880 INFO:tasks.workunit.client.1.smithi133.stdout:6/268: getdents d0/d4/d21 0 2023-12-16T07:40:36.880 INFO:tasks.workunit.client.1.smithi133.stdout:6/269: readlink d0/d4/d21/d35/d4e/l57 0 2023-12-16T07:40:36.883 INFO:tasks.workunit.client.1.smithi133.stdout:0/169: mknod d2/d17/d2b/c3b 0 2023-12-16T07:40:36.883 INFO:tasks.workunit.client.1.smithi133.stdout:0/170: fsync d2/d17/f2e 0 2023-12-16T07:40:36.885 INFO:tasks.workunit.client.1.smithi133.stdout:1/164: link d0/c16 d0/d1c/d37/c3b 0 2023-12-16T07:40:36.886 INFO:tasks.workunit.client.1.smithi133.stdout:0/171: dread d2/d9/d20/f29 [0,4194304] 0 2023-12-16T07:40:36.889 INFO:tasks.workunit.client.1.smithi133.stdout:1/165: dread d0/d12/f1b [0,4194304] 0 2023-12-16T07:40:36.891 INFO:tasks.workunit.client.1.smithi133.stdout:9/161: mknod d15/c3b 0 2023-12-16T07:40:36.893 INFO:tasks.workunit.client.1.smithi133.stdout:0/172: getdents d2/d9 0 2023-12-16T07:40:36.894 INFO:tasks.workunit.client.1.smithi133.stdout:1/166: mkdir d0/da/d3c 0 2023-12-16T07:40:36.894 INFO:tasks.workunit.client.1.smithi133.stdout:1/167: fsync d0/f29 0 2023-12-16T07:40:36.894 INFO:tasks.workunit.client.1.smithi133.stdout:9/162: fdatasync d15/d18/f2f 0 2023-12-16T07:40:36.895 INFO:tasks.workunit.client.1.smithi133.stdout:9/163: read d15/d18/d2c/f2e [108296,4572] 0 2023-12-16T07:40:36.895 INFO:tasks.workunit.client.1.smithi133.stdout:1/168: mkdir d0/da/d3d 0 2023-12-16T07:40:36.895 INFO:tasks.workunit.client.1.smithi133.stdout:1/169: fdatasync d0/da/db/ff 0 2023-12-16T07:40:36.907 INFO:tasks.workunit.client.1.smithi133.stdout:9/164: getdents d15 0 2023-12-16T07:40:36.907 INFO:tasks.workunit.client.1.smithi133.stdout:9/165: creat d15/d18/d2c/d3a/f3c x:0 0 0 2023-12-16T07:40:36.907 INFO:tasks.workunit.client.1.smithi133.stdout:5/107: sync 2023-12-16T07:40:36.907 INFO:tasks.workunit.client.1.smithi133.stdout:3/100: sync 2023-12-16T07:40:36.907 INFO:tasks.workunit.client.1.smithi133.stdout:3/101: chown d7/lb 85200379 1 2023-12-16T07:40:36.908 INFO:tasks.workunit.client.1.smithi133.stdout:9/166: creat d15/d18/d2c/f3d x:0 0 0 2023-12-16T07:40:36.908 INFO:tasks.workunit.client.1.smithi133.stdout:9/167: stat d15/f37 0 2023-12-16T07:40:36.908 INFO:tasks.workunit.client.1.smithi133.stdout:9/168: readlink l12 0 2023-12-16T07:40:36.908 INFO:tasks.workunit.client.1.smithi133.stdout:5/108: mkdir d1/d1c 0 2023-12-16T07:40:36.908 INFO:tasks.workunit.client.1.smithi133.stdout:9/169: chown d15/d18/c22 6 1 2023-12-16T07:40:36.908 INFO:tasks.workunit.client.1.smithi133.stdout:8/166: dwrite d9/dc/f30 [0,4194304] 0 2023-12-16T07:40:36.908 INFO:tasks.workunit.client.1.smithi133.stdout:5/109: mknod d1/d18/c1d 0 2023-12-16T07:40:36.911 INFO:tasks.workunit.client.1.smithi133.stdout:0/173: write d2/d9/db/fe [1477025,125953] 0 2023-12-16T07:40:36.911 INFO:tasks.workunit.client.1.smithi133.stdout:0/174: chown d2/d17/l1e 4739 1 2023-12-16T07:40:36.912 INFO:tasks.workunit.client.1.smithi133.stdout:0/175: write d2/d9/d20/f2c [5117052,123343] 0 2023-12-16T07:40:36.912 INFO:tasks.workunit.client.1.smithi133.stdout:9/170: unlink d15/f2d 0 2023-12-16T07:40:36.912 INFO:tasks.workunit.client.1.smithi133.stdout:9/171: stat d15/d18/f21 0 2023-12-16T07:40:36.912 INFO:tasks.workunit.client.1.smithi133.stdout:9/172: write d15/d18/f34 [879757,27590] 0 2023-12-16T07:40:36.912 INFO:tasks.workunit.client.1.smithi133.stdout:8/167: truncate d9/f2e 110318 0 2023-12-16T07:40:36.919 INFO:tasks.workunit.client.1.smithi133.stdout:5/110: creat d1/d18/f1e x:0 0 0 2023-12-16T07:40:36.923 INFO:tasks.workunit.client.1.smithi133.stdout:0/176: rename d2/d17/d2b/f2d to d2/d17/d37/f3c 0 2023-12-16T07:40:36.924 INFO:tasks.workunit.client.1.smithi133.stdout:9/173: link fe d15/d18/d2c/f3e 0 2023-12-16T07:40:36.927 INFO:tasks.workunit.client.1.smithi133.stdout:8/168: rename d9/dc/f1d to d9/f31 0 2023-12-16T07:40:36.929 INFO:tasks.workunit.client.1.smithi133.stdout:0/177: creat d2/d17/d37/f3d x:0 0 0 2023-12-16T07:40:36.929 INFO:tasks.workunit.client.1.smithi133.stdout:0/178: dread - d2/f38 zero size 2023-12-16T07:40:36.930 INFO:tasks.workunit.client.1.smithi133.stdout:6/270: dwrite d0/d4/f31 [4194304,4194304] 0 2023-12-16T07:40:36.931 INFO:tasks.workunit.client.1.smithi133.stdout:9/174: symlink d15/d18/d2c/l3f 0 2023-12-16T07:40:36.931 INFO:tasks.workunit.client.1.smithi133.stdout:9/175: chown d15/d18 0 1 2023-12-16T07:40:36.931 INFO:tasks.workunit.client.1.smithi133.stdout:9/176: dread - d15/f35 zero size 2023-12-16T07:40:36.937 INFO:tasks.workunit.client.1.smithi133.stdout:1/170: dwrite d0/f1 [0,4194304] 0 2023-12-16T07:40:36.937 INFO:tasks.workunit.client.1.smithi133.stdout:1/171: chown d0/da/f3a 791 1 2023-12-16T07:40:36.937 INFO:tasks.workunit.client.1.smithi133.stdout:1/172: write d0/da/db/f21 [4876115,66277] 0 2023-12-16T07:40:36.938 INFO:tasks.workunit.client.1.smithi133.stdout:0/179: rmdir d2/d17/d2b 39 2023-12-16T07:40:36.939 INFO:tasks.workunit.client.1.smithi133.stdout:3/102: dwrite d7/d8/f11 [0,4194304] 0 2023-12-16T07:40:36.946 INFO:tasks.workunit.client.1.smithi133.stdout:8/169: dwrite d9/d11/f25 [0,4194304] 0 2023-12-16T07:40:36.946 INFO:tasks.workunit.client.1.smithi133.stdout:6/271: creat d0/d4/d21/d35/d36/d49/f58 x:0 0 0 2023-12-16T07:40:36.948 INFO:tasks.workunit.client.1.smithi133.stdout:9/177: truncate d15/d18/f21 4067720 0 2023-12-16T07:40:36.948 INFO:tasks.workunit.client.1.smithi133.stdout:9/178: write d15/d18/d2c/f2e [5237221,75110] 0 2023-12-16T07:40:36.948 INFO:tasks.workunit.client.1.smithi133.stdout:9/179: stat d15/d18/d2c/f3d 0 2023-12-16T07:40:36.948 INFO:tasks.workunit.client.1.smithi133.stdout:9/180: write fc [4395572,40133] 0 2023-12-16T07:40:36.948 INFO:tasks.workunit.client.1.smithi133.stdout:9/181: fsync d15/d18/d2c/f31 0 2023-12-16T07:40:36.949 INFO:tasks.workunit.client.1.smithi133.stdout:6/272: dread d0/d4/d21/d35/f48 [0,4194304] 0 2023-12-16T07:40:36.949 INFO:tasks.workunit.client.1.smithi133.stdout:6/273: fsync d0/d4/f19 0 2023-12-16T07:40:36.949 INFO:tasks.workunit.client.1.smithi133.stdout:6/274: read d0/d4/d21/d35/d36/f45 [409796,65164] 0 2023-12-16T07:40:36.949 INFO:tasks.workunit.client.1.smithi133.stdout:9/182: read d15/f26 [6243323,47659] 0 2023-12-16T07:40:36.953 INFO:tasks.workunit.client.1.smithi133.stdout:3/103: rename d7/c18 to d7/d8/d1c/c2c 0 2023-12-16T07:40:36.956 INFO:tasks.workunit.client.1.smithi133.stdout:3/104: write d7/f1b [4635340,113639] 0 2023-12-16T07:40:36.956 INFO:tasks.workunit.client.1.smithi133.stdout:3/105: write d7/f23 [1036812,96212] 0 2023-12-16T07:40:36.956 INFO:tasks.workunit.client.1.smithi133.stdout:3/106: chown d7/l17 9 1 2023-12-16T07:40:36.956 INFO:tasks.workunit.client.1.smithi133.stdout:3/107: chown l4 116 1 2023-12-16T07:40:36.957 INFO:tasks.workunit.client.1.smithi133.stdout:8/170: getdents d9/dc 0 2023-12-16T07:40:36.959 INFO:tasks.workunit.client.1.smithi133.stdout:0/180: dwrite d2/d9/db/fe [0,4194304] 0 2023-12-16T07:40:36.960 INFO:tasks.workunit.client.1.smithi133.stdout:1/173: dwrite d0/da/db/f2c [0,4194304] 0 2023-12-16T07:40:36.960 INFO:tasks.workunit.client.1.smithi133.stdout:6/275: creat d0/d4/d21/f59 x:0 0 0 2023-12-16T07:40:36.963 INFO:tasks.workunit.client.1.smithi133.stdout:3/108: stat d7/d8/c1f 0 2023-12-16T07:40:36.963 INFO:tasks.workunit.client.1.smithi133.stdout:3/109: truncate f3 1578225 0 2023-12-16T07:40:36.963 INFO:tasks.workunit.client.1.smithi133.stdout:3/110: chown d7/d8/f10 297699 1 2023-12-16T07:40:36.963 INFO:tasks.workunit.client.1.smithi133.stdout:3/111: write d7/d8/fa [4250090,70388] 0 2023-12-16T07:40:36.967 INFO:tasks.workunit.client.1.smithi133.stdout:8/171: rename d9/d10/c2c to d9/d11/d1a/c32 0 2023-12-16T07:40:36.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/276: creat d0/d4/d21/d35/d36/d49/f5a x:0 0 0 2023-12-16T07:40:36.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/277: fsync d0/d4/f28 0 2023-12-16T07:40:36.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/278: dread - d0/f4d zero size 2023-12-16T07:40:36.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/279: fsync d0/d4/d21/f3c 0 2023-12-16T07:40:36.972 INFO:tasks.workunit.client.1.smithi133.stdout:9/183: symlink d15/d18/l40 0 2023-12-16T07:40:36.975 INFO:tasks.workunit.client.1.smithi133.stdout:3/112: truncate d7/d8/fe 1250456 0 2023-12-16T07:40:36.976 INFO:tasks.workunit.client.1.smithi133.stdout:8/172: mkdir d9/d11/d33 0 2023-12-16T07:40:36.976 INFO:tasks.workunit.client.1.smithi133.stdout:1/174: dwrite d0/da/db/f35 [0,4194304] 0 2023-12-16T07:40:36.978 INFO:tasks.workunit.client.1.smithi133.stdout:3/113: mkdir d7/d8/d1c/d2b/d2d 0 2023-12-16T07:40:36.978 INFO:tasks.workunit.client.1.smithi133.stdout:3/114: dread - d7/d8/d1d/f28 zero size 2023-12-16T07:40:36.978 INFO:tasks.workunit.client.1.smithi133.stdout:3/115: chown d7/l19 5 1 2023-12-16T07:40:36.984 INFO:tasks.workunit.client.1.smithi133.stdout:0/181: dwrite d2/d17/f1b [0,4194304] 0 2023-12-16T07:40:36.985 INFO:tasks.workunit.client.1.smithi133.stdout:8/173: creat d9/d2d/f34 x:0 0 0 2023-12-16T07:40:36.986 INFO:tasks.workunit.client.1.smithi133.stdout:3/116: mkdir d7/d8/d1c/d2e 0 2023-12-16T07:40:36.987 INFO:tasks.workunit.client.1.smithi133.stdout:0/182: truncate d2/f8 5935787 0 2023-12-16T07:40:36.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/174: creat d9/d11/d33/f35 x:0 0 0 2023-12-16T07:40:36.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/175: chown d9/d11/d33/f35 97084187 1 2023-12-16T07:40:36.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/176: readlink l5 0 2023-12-16T07:40:36.991 INFO:tasks.workunit.client.1.smithi133.stdout:3/117: mknod d7/d8/d1c/d2b/c2f 0 2023-12-16T07:40:36.991 INFO:tasks.workunit.client.1.smithi133.stdout:3/118: write d7/d8/d1c/d2b/f15 [573151,11818] 0 2023-12-16T07:40:36.991 INFO:tasks.workunit.client.1.smithi133.stdout:3/119: getdents d7/d8/d1c/d2e 0 2023-12-16T07:40:36.991 INFO:tasks.workunit.client.1.smithi133.stdout:9/184: dread d15/d18/f2f [0,4194304] 0 2023-12-16T07:40:36.993 INFO:tasks.workunit.client.1.smithi133.stdout:1/175: dwrite d0/f17 [0,4194304] 0 2023-12-16T07:40:36.995 INFO:tasks.workunit.client.1.smithi133.stdout:6/280: dwrite d0/d4/f2b [0,4194304] 0 2023-12-16T07:40:36.997 INFO:tasks.workunit.client.1.smithi133.stdout:3/120: mknod d7/d8/d1c/d2b/d2d/c30 0 2023-12-16T07:40:37.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/176: mkdir d0/da/db/d24/d32/d3e 0 2023-12-16T07:40:37.004 INFO:tasks.workunit.client.1.smithi133.stdout:6/281: link d0/d4/d21/d35/d4e/l55 d0/l5b 0 2023-12-16T07:40:37.008 INFO:tasks.workunit.client.1.smithi133.stdout:3/121: creat d7/d8/d1c/f31 x:0 0 0 2023-12-16T07:40:37.009 INFO:tasks.workunit.client.1.smithi133.stdout:3/122: chown d7/d8/f20 13253 1 2023-12-16T07:40:37.009 INFO:tasks.workunit.client.1.smithi133.stdout:3/123: write d7/f25 [931881,111366] 0 2023-12-16T07:40:37.011 INFO:tasks.workunit.client.1.smithi133.stdout:8/177: dwrite d9/d10/f1b [0,4194304] 0 2023-12-16T07:40:37.011 INFO:tasks.workunit.client.1.smithi133.stdout:1/177: rmdir d0/d12 39 2023-12-16T07:40:37.012 INFO:tasks.workunit.client.1.smithi133.stdout:1/178: write d0/da/f19 [4420522,129928] 0 2023-12-16T07:40:37.012 INFO:tasks.workunit.client.1.smithi133.stdout:1/179: write d0/f29 [113360,127895] 0 2023-12-16T07:40:37.012 INFO:tasks.workunit.client.1.smithi133.stdout:1/180: read d0/da/f10 [2267725,117147] 0 2023-12-16T07:40:37.012 INFO:tasks.workunit.client.1.smithi133.stdout:6/282: creat d0/d4/f5c x:0 0 0 2023-12-16T07:40:37.014 INFO:tasks.workunit.client.1.smithi133.stdout:3/124: mknod d7/d8/d1c/d2b/d2d/c32 0 2023-12-16T07:40:37.015 INFO:tasks.workunit.client.1.smithi133.stdout:9/185: dwrite d15/d18/f24 [0,4194304] 0 2023-12-16T07:40:37.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/178: mknod d9/d10/c36 0 2023-12-16T07:40:37.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/179: fsync d9/dc/d27/f2b 0 2023-12-16T07:40:37.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/180: chown d9 43625585 1 2023-12-16T07:40:37.023 INFO:tasks.workunit.client.1.smithi133.stdout:1/181: creat d0/d12/f3f x:0 0 0 2023-12-16T07:40:37.023 INFO:tasks.workunit.client.1.smithi133.stdout:1/182: fsync d0/f2a 0 2023-12-16T07:40:37.023 INFO:tasks.workunit.client.1.smithi133.stdout:1/183: stat d0/da/f3a 0 2023-12-16T07:40:37.023 INFO:tasks.workunit.client.1.smithi133.stdout:6/283: truncate d0/d4/d21/f3c 4056554 0 2023-12-16T07:40:37.025 INFO:tasks.workunit.client.1.smithi133.stdout:3/125: creat d7/d8/d1d/f33 x:0 0 0 2023-12-16T07:40:37.028 INFO:tasks.workunit.client.1.smithi133.stdout:8/181: creat d9/d10/f37 x:0 0 0 2023-12-16T07:40:37.028 INFO:tasks.workunit.client.1.smithi133.stdout:8/182: chown d9/d11/c24 26195615 1 2023-12-16T07:40:37.028 INFO:tasks.workunit.client.1.smithi133.stdout:8/183: write d9/d11/f16 [1246428,86593] 0 2023-12-16T07:40:37.028 INFO:tasks.workunit.client.1.smithi133.stdout:8/184: write d9/d2d/f34 [497850,36265] 0 2023-12-16T07:40:37.030 INFO:tasks.workunit.client.1.smithi133.stdout:6/284: rename d0/d4/d21/d35/f43 to d0/f5d 0 2023-12-16T07:40:37.030 INFO:tasks.workunit.client.1.smithi133.stdout:9/186: dwrite d15/f37 [0,4194304] 0 2023-12-16T07:40:37.030 INFO:tasks.workunit.client.1.smithi133.stdout:9/187: readlink d15/d18/l28 0 2023-12-16T07:40:37.031 INFO:tasks.workunit.client.1.smithi133.stdout:6/285: write d0/d4/d21/d35/f42 [1822407,127734] 0 2023-12-16T07:40:37.031 INFO:tasks.workunit.client.1.smithi133.stdout:0/183: truncate d2/f8 4895182 0 2023-12-16T07:40:37.035 INFO:tasks.workunit.client.1.smithi133.stdout:1/184: dread d0/da/db/f2c [0,4194304] 0 2023-12-16T07:40:37.035 INFO:tasks.workunit.client.1.smithi133.stdout:3/126: creat d7/d8/d1c/d2e/f34 x:0 0 0 2023-12-16T07:40:37.037 INFO:tasks.workunit.client.1.smithi133.stdout:3/127: write d7/d8/d1d/f1e [1782444,56393] 0 2023-12-16T07:40:37.037 INFO:tasks.workunit.client.1.smithi133.stdout:8/185: getdents d9/d11 0 2023-12-16T07:40:37.037 INFO:tasks.workunit.client.1.smithi133.stdout:8/186: stat d9/d2d 0 2023-12-16T07:40:37.037 INFO:tasks.workunit.client.1.smithi133.stdout:8/187: read - d9/d11/d33/f35 zero size 2023-12-16T07:40:37.045 INFO:tasks.workunit.client.1.smithi133.stdout:6/286: mkdir d0/d5e 0 2023-12-16T07:40:37.045 INFO:tasks.workunit.client.1.smithi133.stdout:6/287: chown d0 2955 1 2023-12-16T07:40:37.045 INFO:tasks.workunit.client.1.smithi133.stdout:6/288: readlink d0/l5b 0 2023-12-16T07:40:37.047 INFO:tasks.workunit.client.1.smithi133.stdout:9/188: dwrite d15/f35 [0,4194304] 0 2023-12-16T07:40:37.048 INFO:tasks.workunit.client.1.smithi133.stdout:9/189: read fc [3522898,61786] 0 2023-12-16T07:40:37.050 INFO:tasks.workunit.client.1.smithi133.stdout:0/184: rmdir d2/d17/d37 39 2023-12-16T07:40:37.050 INFO:tasks.workunit.client.1.smithi133.stdout:0/185: write d2/d9/d20/f2c [6181162,107721] 0 2023-12-16T07:40:37.052 INFO:tasks.workunit.client.1.smithi133.stdout:1/185: unlink d0/da/f10 0 2023-12-16T07:40:37.058 INFO:tasks.workunit.client.1.smithi133.stdout:8/188: creat d9/d11/f38 x:0 0 0 2023-12-16T07:40:37.061 INFO:tasks.workunit.client.1.smithi133.stdout:6/289: creat d0/d4/f5f x:0 0 0 2023-12-16T07:40:37.071 INFO:tasks.workunit.client.1.smithi133.stdout:6/290: dread d0/d4/d21/d35/f42 [0,4194304] 0 2023-12-16T07:40:37.087 INFO:tasks.workunit.client.1.smithi133.stdout:0/186: rmdir d2/d9/d12/d30 0 2023-12-16T07:40:37.096 INFO:tasks.workunit.client.1.smithi133.stdout:0/187: mknod d2/d17/d2b/d31/c3e 0 2023-12-16T07:40:37.110 INFO:tasks.workunit.client.1.smithi133.stdout:1/186: dwrite d0/da/db/ff [0,4194304] 0 2023-12-16T07:40:37.110 INFO:tasks.workunit.client.1.smithi133.stdout:3/128: truncate d7/f1b 4191135 0 2023-12-16T07:40:37.110 INFO:tasks.workunit.client.1.smithi133.stdout:3/129: chown f3 83963150 1 2023-12-16T07:40:37.110 INFO:tasks.workunit.client.1.smithi133.stdout:1/187: creat d0/d12/f40 x:0 0 0 2023-12-16T07:40:37.111 INFO:tasks.workunit.client.1.smithi133.stdout:1/188: rename d0/da/d3c to d0/da/d3d/d41 0 2023-12-16T07:40:37.111 INFO:tasks.workunit.client.1.smithi133.stdout:1/189: chown d0/da/db/d24/d32 3 1 2023-12-16T07:40:37.111 INFO:tasks.workunit.client.1.smithi133.stdout:1/190: fdatasync d0/d12/f1b 0 2023-12-16T07:40:37.121 INFO:tasks.workunit.client.1.smithi133.stdout:3/130: dread d7/d8/fa [0,4194304] 0 2023-12-16T07:40:37.121 INFO:tasks.workunit.client.1.smithi133.stdout:3/131: chown d7/d8/d1c/d2b/c2f 1626952 1 2023-12-16T07:40:37.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/132: creat d7/d8/f35 x:0 0 0 2023-12-16T07:40:37.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/133: chown d7/c21 15 1 2023-12-16T07:40:37.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/134: stat d7/d8/d1d/f28 0 2023-12-16T07:40:37.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/135: write d7/d8/d1d/f28 [1043884,92726] 0 2023-12-16T07:40:37.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/136: chown d7/lb 527813 1 2023-12-16T07:40:37.123 INFO:tasks.workunit.client.1.smithi133.stdout:9/190: dwrite d15/d18/d2c/d3a/f3c [0,4194304] 0 2023-12-16T07:40:37.124 INFO:tasks.workunit.client.1.smithi133.stdout:3/137: rename d7/d8/d1c/d2b/d2d/c30 to d7/d8/d1c/c36 0 2023-12-16T07:40:37.124 INFO:tasks.workunit.client.1.smithi133.stdout:3/138: write d7/d8/d1c/d2e/f34 [792075,73433] 0 2023-12-16T07:40:37.124 INFO:tasks.workunit.client.1.smithi133.stdout:3/139: chown d7/d8/f20 57 1 2023-12-16T07:40:37.127 INFO:tasks.workunit.client.1.smithi133.stdout:3/140: mknod d7/d8/d1c/d2b/c37 0 2023-12-16T07:40:37.129 INFO:tasks.workunit.client.1.smithi133.stdout:3/141: creat d7/d8/d1c/f38 x:0 0 0 2023-12-16T07:40:37.132 INFO:tasks.workunit.client.1.smithi133.stdout:3/142: mknod d7/d8/d1c/c39 0 2023-12-16T07:40:37.134 INFO:tasks.workunit.client.1.smithi133.stdout:3/143: write d7/f23 [1026465,15784] 0 2023-12-16T07:40:37.134 INFO:tasks.workunit.client.1.smithi133.stdout:9/191: dread d15/d18/d2c/f2e [0,4194304] 0 2023-12-16T07:40:37.134 INFO:tasks.workunit.client.1.smithi133.stdout:9/192: readlink d15/l1e 0 2023-12-16T07:40:37.135 INFO:tasks.workunit.client.1.smithi133.stdout:6/291: dwrite d0/d4/f34 [0,4194304] 0 2023-12-16T07:40:37.135 INFO:tasks.workunit.client.1.smithi133.stdout:6/292: read - d0/d4/d21/d35/d36/f46 zero size 2023-12-16T07:40:37.135 INFO:tasks.workunit.client.1.smithi133.stdout:0/188: dwrite d2/f38 [0,4194304] 0 2023-12-16T07:40:37.135 INFO:tasks.workunit.client.1.smithi133.stdout:9/193: read d15/d18/d2c/f30 [3747850,59968] 0 2023-12-16T07:40:37.138 INFO:tasks.workunit.client.1.smithi133.stdout:3/144: rename d7/l17 to d7/d8/d1c/l3a 0 2023-12-16T07:40:37.140 INFO:tasks.workunit.client.1.smithi133.stdout:9/194: creat d15/d18/f41 x:0 0 0 2023-12-16T07:40:37.146 INFO:tasks.workunit.client.1.smithi133.stdout:1/191: dwrite d0/f1 [0,4194304] 0 2023-12-16T07:40:37.146 INFO:tasks.workunit.client.1.smithi133.stdout:6/293: dread d0/f2 [0,4194304] 0 2023-12-16T07:40:37.147 INFO:tasks.workunit.client.1.smithi133.stdout:1/192: chown d0/d12/f40 120 1 2023-12-16T07:40:37.147 INFO:tasks.workunit.client.1.smithi133.stdout:6/294: fdatasync d0/d4/d21/d35/d36/f45 0 2023-12-16T07:40:37.149 INFO:tasks.workunit.client.1.smithi133.stdout:1/193: dread d0/f29 [0,4194304] 0 2023-12-16T07:40:37.150 INFO:tasks.workunit.client.1.smithi133.stdout:9/195: mkdir d15/d42 0 2023-12-16T07:40:37.152 INFO:tasks.workunit.client.1.smithi133.stdout:6/295: mkdir d0/d4/d21/d60 0 2023-12-16T07:40:37.153 INFO:tasks.workunit.client.1.smithi133.stdout:1/194: dread d0/d12/f1b [0,4194304] 0 2023-12-16T07:40:37.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/195: mknod d0/da/db/d24/c42 0 2023-12-16T07:40:37.157 INFO:tasks.workunit.client.1.smithi133.stdout:3/145: dwrite d7/d8/d1d/f1e [0,4194304] 0 2023-12-16T07:40:37.158 INFO:tasks.workunit.client.1.smithi133.stdout:1/196: stat d0/c8 0 2023-12-16T07:40:37.159 INFO:tasks.workunit.client.1.smithi133.stdout:0/189: dwrite d2/d17/d37/f3d [0,4194304] 0 2023-12-16T07:40:37.161 INFO:tasks.workunit.client.1.smithi133.stdout:9/196: getdents d15/d18 0 2023-12-16T07:40:37.161 INFO:tasks.workunit.client.1.smithi133.stdout:9/197: chown c10 600465045 1 2023-12-16T07:40:37.169 INFO:tasks.workunit.client.1.smithi133.stdout:9/198: mknod d15/d18/d2c/c43 0 2023-12-16T07:40:37.171 INFO:tasks.workunit.client.1.smithi133.stdout:1/197: creat d0/d1c/d37/f43 x:0 0 0 2023-12-16T07:40:37.175 INFO:tasks.workunit.client.1.smithi133.stdout:6/296: dwrite d0/f3a [0,4194304] 0 2023-12-16T07:40:37.178 INFO:tasks.workunit.client.1.smithi133.stdout:1/198: write d0/da/db/ff [3871534,73524] 0 2023-12-16T07:40:37.178 INFO:tasks.workunit.client.1.smithi133.stdout:3/146: dwrite d7/d8/d1c/f31 [0,4194304] 0 2023-12-16T07:40:37.179 INFO:tasks.workunit.client.1.smithi133.stdout:6/297: rename d0/c24 to d0/d5e/c61 0 2023-12-16T07:40:37.180 INFO:tasks.workunit.client.1.smithi133.stdout:1/199: mknod d0/d1c/d37/c44 0 2023-12-16T07:40:37.180 INFO:tasks.workunit.client.1.smithi133.stdout:1/200: chown d0/da/c36 6620797 1 2023-12-16T07:40:37.181 INFO:tasks.workunit.client.1.smithi133.stdout:0/190: dwrite d2/f1d [0,4194304] 0 2023-12-16T07:40:37.182 INFO:tasks.workunit.client.1.smithi133.stdout:9/199: dread d15/f37 [0,4194304] 0 2023-12-16T07:40:37.182 INFO:tasks.workunit.client.1.smithi133.stdout:9/200: stat d15/d18/c38 0 2023-12-16T07:40:37.182 INFO:tasks.workunit.client.1.smithi133.stdout:9/201: read d15/d18/d2c/f3e [740043,56695] 0 2023-12-16T07:40:37.182 INFO:tasks.workunit.client.1.smithi133.stdout:9/202: write d15/f29 [31219,40765] 0 2023-12-16T07:40:37.185 INFO:tasks.workunit.client.1.smithi133.stdout:6/298: mkdir d0/d4/d21/d62 0 2023-12-16T07:40:37.191 INFO:tasks.workunit.client.1.smithi133.stdout:0/191: unlink d2/d17/d37/f3c 0 2023-12-16T07:40:37.192 INFO:tasks.workunit.client.1.smithi133.stdout:3/147: symlink d7/d8/l3b 0 2023-12-16T07:40:37.192 INFO:tasks.workunit.client.1.smithi133.stdout:9/203: dread fe [0,4194304] 0 2023-12-16T07:40:37.192 INFO:tasks.workunit.client.1.smithi133.stdout:9/204: truncate d15/d18/f34 1546009 0 2023-12-16T07:40:37.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/299: symlink d0/d4/d21/d35/d36/l63 0 2023-12-16T07:40:37.195 INFO:tasks.workunit.client.1.smithi133.stdout:0/192: creat d2/d9/d12/f3f x:0 0 0 2023-12-16T07:40:37.196 INFO:tasks.workunit.client.1.smithi133.stdout:3/148: link d7/d8/d1c/f38 d7/d8/d1d/d2a/f3c 0 2023-12-16T07:40:37.197 INFO:tasks.workunit.client.1.smithi133.stdout:9/205: symlink d15/d18/d2c/d3a/l44 0 2023-12-16T07:40:37.197 INFO:tasks.workunit.client.1.smithi133.stdout:9/206: chown d15/d18/d2c/d3a/l44 71 1 2023-12-16T07:40:37.198 INFO:tasks.workunit.client.1.smithi133.stdout:6/300: creat d0/d4/d21/d35/d36/f64 x:0 0 0 2023-12-16T07:40:37.199 INFO:tasks.workunit.client.1.smithi133.stdout:0/193: mkdir d2/d17/d40 0 2023-12-16T07:40:37.199 INFO:tasks.workunit.client.1.smithi133.stdout:6/301: write d0/d4/f11 [1163997,56817] 0 2023-12-16T07:40:37.200 INFO:tasks.workunit.client.1.smithi133.stdout:3/149: symlink d7/d8/d1c/d2b/l3d 0 2023-12-16T07:40:37.201 INFO:tasks.workunit.client.1.smithi133.stdout:1/201: dwrite d0/da/db/f38 [0,4194304] 0 2023-12-16T07:40:37.201 INFO:tasks.workunit.client.1.smithi133.stdout:9/207: rename d15/d18/f34 to d15/d18/d2c/d3a/f45 0 2023-12-16T07:40:37.205 INFO:tasks.workunit.client.1.smithi133.stdout:0/194: link d2/d9/l34 d2/d9/d20/l41 0 2023-12-16T07:40:37.205 INFO:tasks.workunit.client.1.smithi133.stdout:0/195: chown d2/c1c 164547781 1 2023-12-16T07:40:37.206 INFO:tasks.workunit.client.1.smithi133.stdout:6/302: rmdir d0/d4/d21/d35/d36/d49 39 2023-12-16T07:40:37.207 INFO:tasks.workunit.client.1.smithi133.stdout:7/355: sync 2023-12-16T07:40:37.208 INFO:tasks.workunit.client.1.smithi133.stdout:7/356: write db/d21/d2c/d31/f36 [680280,59056] 0 2023-12-16T07:40:37.208 INFO:tasks.workunit.client.1.smithi133.stdout:3/150: truncate d7/f1b 2894812 0 2023-12-16T07:40:37.214 INFO:tasks.workunit.client.1.smithi133.stdout:0/196: unlink d2/d17/l3a 0 2023-12-16T07:40:37.215 INFO:tasks.workunit.client.1.smithi133.stdout:9/208: dwrite f9 [4194304,4194304] 0 2023-12-16T07:40:37.217 INFO:tasks.workunit.client.1.smithi133.stdout:6/303: dread d0/f1b [4194304,4194304] 0 2023-12-16T07:40:37.223 INFO:tasks.workunit.client.1.smithi133.stdout:7/357: creat db/d12/d3a/f7e x:0 0 0 2023-12-16T07:40:37.228 INFO:tasks.workunit.client.1.smithi133.stdout:7/358: dread db/d3e/d4a/f76 [0,4194304] 0 2023-12-16T07:40:37.228 INFO:tasks.workunit.client.1.smithi133.stdout:3/151: symlink d7/d8/d1c/l3e 0 2023-12-16T07:40:37.233 INFO:tasks.workunit.client.1.smithi133.stdout:9/209: rename d15/f2b to d15/d18/d2c/f46 0 2023-12-16T07:40:37.236 INFO:tasks.workunit.client.1.smithi133.stdout:3/152: link d7/d8/d1c/l3a d7/d8/d1c/d2b/l3f 0 2023-12-16T07:40:37.237 INFO:tasks.workunit.client.1.smithi133.stdout:7/359: dread db/d21/f23 [0,4194304] 0 2023-12-16T07:40:37.240 INFO:tasks.workunit.client.1.smithi133.stdout:7/360: write db/d21/d2c/d31/f35 [2195649,56546] 0 2023-12-16T07:40:37.240 INFO:tasks.workunit.client.1.smithi133.stdout:7/361: chown db/d3e/d4a/c73 12 1 2023-12-16T07:40:37.249 INFO:tasks.workunit.client.1.smithi133.stdout:0/197: dwrite d2/d17/f2e [0,4194304] 0 2023-12-16T07:40:37.249 INFO:tasks.workunit.client.1.smithi133.stdout:9/210: dread d15/f35 [0,4194304] 0 2023-12-16T07:40:37.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/211: read d15/d18/d2c/f30 [1256535,47847] 0 2023-12-16T07:40:37.251 INFO:tasks.workunit.client.1.smithi133.stdout:6/304: dwrite d0/f2 [0,4194304] 0 2023-12-16T07:40:37.251 INFO:tasks.workunit.client.1.smithi133.stdout:6/305: fdatasync d0/d4/d21/d35/d36/d49/f5a 0 2023-12-16T07:40:37.256 INFO:tasks.workunit.client.1.smithi133.stdout:3/153: dwrite d7/d8/f35 [0,4194304] 0 2023-12-16T07:40:37.256 INFO:tasks.workunit.client.1.smithi133.stdout:3/154: chown d7/d8/d1c/f31 41 1 2023-12-16T07:40:37.256 INFO:tasks.workunit.client.1.smithi133.stdout:3/155: readlink d7/d8/l27 0 2023-12-16T07:40:37.256 INFO:tasks.workunit.client.1.smithi133.stdout:3/156: stat d7/d8/d1d/f33 0 2023-12-16T07:40:37.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/212: creat d15/d18/d2c/f47 x:0 0 0 2023-12-16T07:40:37.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/213: chown d15/d18/l28 9928 1 2023-12-16T07:40:37.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/214: readlink d15/d18/l2a 0 2023-12-16T07:40:37.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/215: dread - d15/f39 zero size 2023-12-16T07:40:37.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/216: write d15/d18/d2c/f47 [353767,40414] 0 2023-12-16T07:40:37.260 INFO:tasks.workunit.client.1.smithi133.stdout:7/362: dwrite db/d3e/d4a/f76 [0,4194304] 0 2023-12-16T07:40:37.260 INFO:tasks.workunit.client.1.smithi133.stdout:7/363: readlink db/d21/l39 0 2023-12-16T07:40:37.260 INFO:tasks.workunit.client.1.smithi133.stdout:7/364: readlink db/d21/l39 0 2023-12-16T07:40:37.260 INFO:tasks.workunit.client.1.smithi133.stdout:7/365: stat db/d12/f49 0 2023-12-16T07:40:37.263 INFO:tasks.workunit.client.1.smithi133.stdout:6/306: getdents d0/d4/d21/d35/d36 0 2023-12-16T07:40:37.263 INFO:tasks.workunit.client.1.smithi133.stdout:6/307: chown d0/d4/d21/d62 364680 1 2023-12-16T07:40:37.263 INFO:tasks.workunit.client.1.smithi133.stdout:6/308: chown d0/d4/f47 958 1 2023-12-16T07:40:37.267 INFO:tasks.workunit.client.1.smithi133.stdout:3/157: link d7/d8/d1c/d2e/f34 d7/d8/d1d/f40 0 2023-12-16T07:40:37.271 INFO:tasks.workunit.client.1.smithi133.stdout:9/217: symlink d15/l48 0 2023-12-16T07:40:37.271 INFO:tasks.workunit.client.1.smithi133.stdout:9/218: getdents d15/d42 0 2023-12-16T07:40:37.275 INFO:tasks.workunit.client.1.smithi133.stdout:6/309: rename d0/d4/l3e to d0/d4/d21/d35/d36/d49/l65 0 2023-12-16T07:40:37.277 INFO:tasks.workunit.client.1.smithi133.stdout:7/366: dwrite db/d21/d2c/d31/d59/f5a [0,4194304] 0 2023-12-16T07:40:37.277 INFO:tasks.workunit.client.1.smithi133.stdout:7/367: dread - db/d21/d2c/f50 zero size 2023-12-16T07:40:37.277 INFO:tasks.workunit.client.1.smithi133.stdout:7/368: chown db/d12/f49 1 1 2023-12-16T07:40:37.278 INFO:tasks.workunit.client.1.smithi133.stdout:7/369: write f9 [1400922,32387] 0 2023-12-16T07:40:37.280 INFO:tasks.workunit.client.1.smithi133.stdout:6/310: creat d0/d4/d21/d60/f66 x:0 0 0 2023-12-16T07:40:37.283 INFO:tasks.workunit.client.1.smithi133.stdout:3/158: rmdir d7/d8/d1c 39 2023-12-16T07:40:37.284 INFO:tasks.workunit.client.1.smithi133.stdout:6/311: dread d0/d4/d21/d35/f48 [0,4194304] 0 2023-12-16T07:40:37.284 INFO:tasks.workunit.client.1.smithi133.stdout:6/312: write d0/d4/d21/d35/d36/d49/f5a [68983,54167] 0 2023-12-16T07:40:37.284 INFO:tasks.workunit.client.1.smithi133.stdout:6/313: write d0/f18 [5579510,130478] 0 2023-12-16T07:40:37.288 INFO:tasks.workunit.client.1.smithi133.stdout:6/314: symlink d0/d4/d21/d35/d36/l67 0 2023-12-16T07:40:37.292 INFO:tasks.workunit.client.1.smithi133.stdout:9/219: dwrite d15/d18/d2c/f46 [0,4194304] 0 2023-12-16T07:40:37.305 INFO:tasks.workunit.client.1.smithi133.stdout:7/370: dwrite db/d21/d2c/d31/f32 [0,4194304] 0 2023-12-16T07:40:37.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/159: dwrite f3 [0,4194304] 0 2023-12-16T07:40:37.322 INFO:tasks.workunit.client.1.smithi133.stdout:3/160: dwrite d7/d8/d1c/d2e/f34 [0,4194304] 0 2023-12-16T07:40:37.324 INFO:tasks.workunit.client.1.smithi133.stdout:3/161: dread d7/d8/f20 [0,4194304] 0 2023-12-16T07:40:37.390 INFO:tasks.workunit.client.1.smithi133.stdout:7/371: creat db/d3e/f7f x:0 0 0 2023-12-16T07:40:37.390 INFO:tasks.workunit.client.1.smithi133.stdout:7/372: fdatasync db/d21/d2c/f56 0 2023-12-16T07:40:37.395 INFO:tasks.workunit.client.1.smithi133.stdout:3/162: creat d7/d8/d1c/f41 x:0 0 0 2023-12-16T07:40:37.395 INFO:tasks.workunit.client.1.smithi133.stdout:3/163: chown d7/lb 642466 1 2023-12-16T07:40:37.398 INFO:tasks.workunit.client.1.smithi133.stdout:7/373: dread db/d21/f28 [0,4194304] 0 2023-12-16T07:40:37.405 INFO:tasks.workunit.client.1.smithi133.stdout:3/164: symlink d7/d8/d1c/d2e/l42 0 2023-12-16T07:40:37.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/374: rename db/d12/d3a/d6c/f75 to db/d21/f80 0 2023-12-16T07:40:37.408 INFO:tasks.workunit.client.1.smithi133.stdout:3/165: mkdir d7/d8/d1c/d2e/d43 0 2023-12-16T07:40:37.409 INFO:tasks.workunit.client.1.smithi133.stdout:7/375: creat db/f81 x:0 0 0 2023-12-16T07:40:37.410 INFO:tasks.workunit.client.1.smithi133.stdout:7/376: write db/d3e/d4a/d58/f62 [1931127,85449] 0 2023-12-16T07:40:37.412 INFO:tasks.workunit.client.1.smithi133.stdout:7/377: creat db/d3e/f82 x:0 0 0 2023-12-16T07:40:37.429 INFO:tasks.workunit.client.1.smithi133.stdout:7/378: dwrite db/d21/f26 [4194304,4194304] 0 2023-12-16T07:40:37.435 INFO:tasks.workunit.client.1.smithi133.stdout:7/379: dread db/ff [0,4194304] 0 2023-12-16T07:40:37.435 INFO:tasks.workunit.client.1.smithi133.stdout:7/380: truncate db/d12/d3a/f74 1888782 0 2023-12-16T07:40:37.436 INFO:tasks.workunit.client.1.smithi133.stdout:7/381: getdents db/d21/d2c/d31/d79 0 2023-12-16T07:40:37.436 INFO:tasks.workunit.client.1.smithi133.stdout:7/382: chown db/d21/d2c/f50 22504 1 2023-12-16T07:40:37.437 INFO:tasks.workunit.client.1.smithi133.stdout:7/383: dread db/f18 [0,4194304] 0 2023-12-16T07:40:37.440 INFO:tasks.workunit.client.1.smithi133.stdout:7/384: rename db/d21/d2c/d31/f32 to db/d12/d3a/d6c/f83 0 2023-12-16T07:40:37.441 INFO:tasks.workunit.client.1.smithi133.stdout:7/385: symlink db/d12/l84 0 2023-12-16T07:40:37.444 INFO:tasks.workunit.client.1.smithi133.stdout:7/386: creat db/f85 x:0 0 0 2023-12-16T07:40:37.445 INFO:tasks.workunit.client.1.smithi133.stdout:7/387: dread db/f16 [4194304,4194304] 0 2023-12-16T07:40:37.446 INFO:tasks.workunit.client.1.smithi133.stdout:7/388: mkdir db/d3e/d4a/d58/d86 0 2023-12-16T07:40:37.446 INFO:tasks.workunit.client.1.smithi133.stdout:7/389: dread - db/d12/d3a/f7e zero size 2023-12-16T07:40:37.460 INFO:tasks.workunit.client.1.smithi133.stdout:7/390: dwrite db/f85 [0,4194304] 0 2023-12-16T07:40:37.460 INFO:tasks.workunit.client.1.smithi133.stdout:7/391: write db/d21/f25 [609533,27107] 0 2023-12-16T07:40:37.460 INFO:tasks.workunit.client.1.smithi133.stdout:7/392: truncate db/d21/f70 811389 0 2023-12-16T07:40:37.460 INFO:tasks.workunit.client.1.smithi133.stdout:7/393: chown db/d21/d2c/d31/d59/l7d 574626 1 2023-12-16T07:40:37.464 INFO:tasks.workunit.client.1.smithi133.stdout:7/394: symlink db/d21/d2c/l87 0 2023-12-16T07:40:37.467 INFO:tasks.workunit.client.1.smithi133.stdout:7/395: stat db/d3e/d4a/d58/l61 0 2023-12-16T07:40:37.473 INFO:tasks.workunit.client.1.smithi133.stdout:7/396: dread db/d3e/f69 [0,4194304] 0 2023-12-16T07:40:37.475 INFO:tasks.workunit.client.1.smithi133.stdout:7/397: symlink db/d12/d3a/d6c/l88 0 2023-12-16T07:40:37.475 INFO:tasks.workunit.client.1.smithi133.stdout:7/398: chown db/d21/d2c/c3c 60 1 2023-12-16T07:40:37.476 INFO:tasks.workunit.client.1.smithi133.stdout:7/399: mknod db/d53/c89 0 2023-12-16T07:40:37.492 INFO:tasks.workunit.client.1.smithi133.stdout:7/400: dwrite db/d21/d2c/d31/f3f [0,4194304] 0 2023-12-16T07:40:37.493 INFO:tasks.workunit.client.1.smithi133.stdout:7/401: chown db/d21/d2c/d31/f35 6 1 2023-12-16T07:40:37.493 INFO:tasks.workunit.client.1.smithi133.stdout:7/402: write db/d21/d2c/d31/f36 [909565,65026] 0 2023-12-16T07:40:37.498 INFO:tasks.workunit.client.1.smithi133.stdout:7/403: mknod db/d21/d2c/d31/c8a 0 2023-12-16T07:40:37.511 INFO:tasks.workunit.client.1.smithi133.stdout:7/404: dwrite db/f1c [4194304,4194304] 0 2023-12-16T07:40:37.512 INFO:tasks.workunit.client.1.smithi133.stdout:7/405: mkdir db/d3e/d4a/d58/d86/d8b 0 2023-12-16T07:40:37.514 INFO:tasks.workunit.client.1.smithi133.stdout:7/406: rename db/d21/f28 to db/f8c 0 2023-12-16T07:40:37.514 INFO:tasks.workunit.client.1.smithi133.stdout:7/407: stat db/d21/f26 0 2023-12-16T07:40:37.514 INFO:tasks.workunit.client.1.smithi133.stdout:7/408: stat db/f81 0 2023-12-16T07:40:37.514 INFO:tasks.workunit.client.1.smithi133.stdout:7/409: chown db/d12/c41 47 1 2023-12-16T07:40:37.515 INFO:tasks.workunit.client.1.smithi133.stdout:7/410: write db/d21/d2c/f48 [4267728,104548] 0 2023-12-16T07:40:37.517 INFO:tasks.workunit.client.1.smithi133.stdout:7/411: truncate db/d3e/d4a/d58/f62 1251494 0 2023-12-16T07:40:37.517 INFO:tasks.workunit.client.1.smithi133.stdout:7/412: chown db/l44 11741726 1 2023-12-16T07:40:37.518 INFO:tasks.workunit.client.1.smithi133.stdout:7/413: chown db/l3b 74 1 2023-12-16T07:40:37.518 INFO:tasks.workunit.client.1.smithi133.stdout:7/414: fsync db/d21/d2c/d31/d59/f5a 0 2023-12-16T07:40:37.521 INFO:tasks.workunit.client.1.smithi133.stdout:7/415: mkdir db/d3e/d4a/d58/d86/d8b/d8d 0 2023-12-16T07:40:37.521 INFO:tasks.workunit.client.1.smithi133.stdout:7/416: dread - db/d12/f71 zero size 2023-12-16T07:40:37.584 INFO:tasks.workunit.client.1.smithi133.stdout:5/111: sync 2023-12-16T07:40:37.584 INFO:tasks.workunit.client.1.smithi133.stdout:4/282: sync 2023-12-16T07:40:37.584 INFO:tasks.workunit.client.1.smithi133.stdout:2/100: sync 2023-12-16T07:40:37.586 INFO:tasks.workunit.client.1.smithi133.stdout:5/112: creat d1/f1f x:0 0 0 2023-12-16T07:40:37.587 INFO:tasks.workunit.client.1.smithi133.stdout:5/113: mknod d1/d16/c20 0 2023-12-16T07:40:37.587 INFO:tasks.workunit.client.1.smithi133.stdout:5/114: stat d1/f7 0 2023-12-16T07:40:37.595 INFO:tasks.workunit.client.1.smithi133.stdout:4/283: dread d3/f3b [0,4194304] 0 2023-12-16T07:40:37.595 INFO:tasks.workunit.client.1.smithi133.stdout:4/284: read d3/f30 [63059,74425] 0 2023-12-16T07:40:37.595 INFO:tasks.workunit.client.1.smithi133.stdout:4/285: stat d3/d7/d1a/c37 0 2023-12-16T07:40:37.595 INFO:tasks.workunit.client.1.smithi133.stdout:2/101: dread da/f13 [0,4194304] 0 2023-12-16T07:40:37.597 INFO:tasks.workunit.client.1.smithi133.stdout:4/286: mkdir d3/d7/d38/d57 0 2023-12-16T07:40:37.598 INFO:tasks.workunit.client.1.smithi133.stdout:2/102: mkdir da/d1d 0 2023-12-16T07:40:37.598 INFO:tasks.workunit.client.1.smithi133.stdout:2/103: chown da/f10 66970985 1 2023-12-16T07:40:37.599 INFO:tasks.workunit.client.1.smithi133.stdout:4/287: rename d3/d7/l17 to d3/d7/d1a/l58 0 2023-12-16T07:40:37.599 INFO:tasks.workunit.client.1.smithi133.stdout:4/288: fdatasync d3/d7/d1a/f27 0 2023-12-16T07:40:37.600 INFO:tasks.workunit.client.1.smithi133.stdout:2/104: symlink da/d15/d1b/l1e 0 2023-12-16T07:40:37.600 INFO:tasks.workunit.client.1.smithi133.stdout:2/105: chown da/d15 85557 1 2023-12-16T07:40:37.600 INFO:tasks.workunit.client.1.smithi133.stdout:2/106: write f4 [8584448,2625] 0 2023-12-16T07:40:37.601 INFO:tasks.workunit.client.1.smithi133.stdout:4/289: getdents d3/d7/d44 0 2023-12-16T07:40:37.605 INFO:tasks.workunit.client.1.smithi133.stdout:5/115: dwrite d1/f7 [0,4194304] 0 2023-12-16T07:40:37.605 INFO:tasks.workunit.client.1.smithi133.stdout:2/107: symlink da/d1d/l1f 0 2023-12-16T07:40:37.605 INFO:tasks.workunit.client.1.smithi133.stdout:2/108: dread - da/fe zero size 2023-12-16T07:40:37.605 INFO:tasks.workunit.client.1.smithi133.stdout:2/109: write f2 [265706,23879] 0 2023-12-16T07:40:37.605 INFO:tasks.workunit.client.1.smithi133.stdout:2/110: chown da/d15/d17 18014 1 2023-12-16T07:40:37.605 INFO:tasks.workunit.client.1.smithi133.stdout:2/111: truncate f2 880455 0 2023-12-16T07:40:37.605 INFO:tasks.workunit.client.1.smithi133.stdout:2/112: chown da/f13 1700 1 2023-12-16T07:40:37.606 INFO:tasks.workunit.client.1.smithi133.stdout:5/116: rename d1/c9 to d1/c21 0 2023-12-16T07:40:37.610 INFO:tasks.workunit.client.1.smithi133.stdout:2/113: link f3 da/d1d/f20 0 2023-12-16T07:40:37.613 INFO:tasks.workunit.client.1.smithi133.stdout:2/114: creat da/d1d/f21 x:0 0 0 2023-12-16T07:40:37.618 INFO:tasks.workunit.client.1.smithi133.stdout:2/115: dread da/f13 [0,4194304] 0 2023-12-16T07:40:37.633 INFO:tasks.workunit.client.1.smithi133.stdout:4/290: dwrite d3/d7/fb [0,4194304] 0 2023-12-16T07:40:37.633 INFO:tasks.workunit.client.1.smithi133.stdout:4/291: dread - d3/f51 zero size 2023-12-16T07:40:37.633 INFO:tasks.workunit.client.1.smithi133.stdout:2/116: dwrite da/d15/d17/f18 [0,4194304] 0 2023-12-16T07:40:37.634 INFO:tasks.workunit.client.1.smithi133.stdout:4/292: creat d3/f59 x:0 0 0 2023-12-16T07:40:37.634 INFO:tasks.workunit.client.1.smithi133.stdout:4/293: write d3/d7/d1a/f27 [2322921,75618] 0 2023-12-16T07:40:37.638 INFO:tasks.workunit.client.1.smithi133.stdout:2/117: dread da/d1d/f20 [0,4194304] 0 2023-12-16T07:40:37.638 INFO:tasks.workunit.client.1.smithi133.stdout:2/118: dread - da/d1d/f21 zero size 2023-12-16T07:40:37.639 INFO:tasks.workunit.client.1.smithi133.stdout:2/119: dread f1 [0,4194304] 0 2023-12-16T07:40:37.639 INFO:tasks.workunit.client.1.smithi133.stdout:4/294: creat d3/d7/d38/f5a x:0 0 0 2023-12-16T07:40:37.639 INFO:tasks.workunit.client.1.smithi133.stdout:4/295: write d3/f30 [291774,113554] 0 2023-12-16T07:40:37.639 INFO:tasks.workunit.client.1.smithi133.stdout:4/296: fsync d3/d7/f23 0 2023-12-16T07:40:37.641 INFO:tasks.workunit.client.1.smithi133.stdout:2/120: link f4 da/f22 0 2023-12-16T07:40:37.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/121: write da/f12 [797905,27891] 0 2023-12-16T07:40:37.644 INFO:tasks.workunit.client.1.smithi133.stdout:2/122: creat da/f23 x:0 0 0 2023-12-16T07:40:37.645 INFO:tasks.workunit.client.1.smithi133.stdout:2/123: fdatasync da/d1d/f20 0 2023-12-16T07:40:37.659 INFO:tasks.workunit.client.1.smithi133.stdout:2/124: dwrite da/f13 [0,4194304] 0 2023-12-16T07:40:37.666 INFO:tasks.workunit.client.1.smithi133.stdout:2/125: truncate f9 162343 0 2023-12-16T07:40:37.670 INFO:tasks.workunit.client.1.smithi133.stdout:2/126: mkdir da/d1d/d24 0 2023-12-16T07:40:37.670 INFO:tasks.workunit.client.1.smithi133.stdout:2/127: truncate f3 1200016 0 2023-12-16T07:40:37.670 INFO:tasks.workunit.client.1.smithi133.stdout:2/128: readlink da/l16 0 2023-12-16T07:40:37.670 INFO:tasks.workunit.client.1.smithi133.stdout:2/129: write da/f23 [112204,109241] 0 2023-12-16T07:40:37.671 INFO:tasks.workunit.client.1.smithi133.stdout:2/130: unlink da/d15/d1b/l1e 0 2023-12-16T07:40:37.804 INFO:tasks.workunit.client.1.smithi133.stdout:8/189: sync 2023-12-16T07:40:38.029 INFO:tasks.workunit.client.1.smithi133.stdout:9/220: sync 2023-12-16T07:40:38.030 INFO:tasks.workunit.client.1.smithi133.stdout:1/202: sync 2023-12-16T07:40:38.030 INFO:tasks.workunit.client.1.smithi133.stdout:6/315: sync 2023-12-16T07:40:38.030 INFO:tasks.workunit.client.1.smithi133.stdout:0/198: sync 2023-12-16T07:40:38.031 INFO:tasks.workunit.client.1.smithi133.stdout:9/221: getdents d15/d18/d2c 0 2023-12-16T07:40:38.032 INFO:tasks.workunit.client.1.smithi133.stdout:1/203: truncate d0/da/db/f2c 3991992 0 2023-12-16T07:40:38.032 INFO:tasks.workunit.client.1.smithi133.stdout:1/204: dread - d0/d12/f40 zero size 2023-12-16T07:40:38.033 INFO:tasks.workunit.client.1.smithi133.stdout:6/316: creat d0/d4/f68 x:0 0 0 2023-12-16T07:40:38.034 INFO:tasks.workunit.client.1.smithi133.stdout:6/317: fsync d0/d4/f19 0 2023-12-16T07:40:38.035 INFO:tasks.workunit.client.1.smithi133.stdout:6/318: mkdir d0/d4/d21/d35/d36/d49/d69 0 2023-12-16T07:40:38.035 INFO:tasks.workunit.client.1.smithi133.stdout:6/319: chown d0/d4/d21/d35/d36/l63 434 1 2023-12-16T07:40:38.037 INFO:tasks.workunit.client.1.smithi133.stdout:6/320: dread d0/d4/d21/d35/f48 [0,4194304] 0 2023-12-16T07:40:38.037 INFO:tasks.workunit.client.1.smithi133.stdout:6/321: dread - d0/d4/f47 zero size 2023-12-16T07:40:38.037 INFO:tasks.workunit.client.1.smithi133.stdout:6/322: write d0/d4/d21/f59 [944486,69564] 0 2023-12-16T07:40:38.037 INFO:tasks.workunit.client.1.smithi133.stdout:6/323: dread - d0/d4/d21/f4c zero size 2023-12-16T07:40:38.038 INFO:tasks.workunit.client.1.smithi133.stdout:6/324: write d0/d4/f34 [4563955,18584] 0 2023-12-16T07:40:38.038 INFO:tasks.workunit.client.1.smithi133.stdout:6/325: write d0/d4/d21/f59 [1865353,118553] 0 2023-12-16T07:40:38.038 INFO:tasks.workunit.client.1.smithi133.stdout:1/205: write d0/da/db/f2c [4234569,61357] 0 2023-12-16T07:40:38.038 INFO:tasks.workunit.client.1.smithi133.stdout:6/326: symlink d0/d4/d21/d62/l6a 0 2023-12-16T07:40:38.039 INFO:tasks.workunit.client.1.smithi133.stdout:1/206: mknod d0/da/c45 0 2023-12-16T07:40:38.042 INFO:tasks.workunit.client.1.smithi133.stdout:6/327: symlink d0/d5e/l6b 0 2023-12-16T07:40:38.047 INFO:tasks.workunit.client.1.smithi133.stdout:6/328: rename d0/d4/d21/f32 to d0/d4/d21/d35/f6c 0 2023-12-16T07:40:38.048 INFO:tasks.workunit.client.1.smithi133.stdout:0/199: dwrite d2/d9/d20/f29 [0,4194304] 0 2023-12-16T07:40:38.050 INFO:tasks.workunit.client.1.smithi133.stdout:6/329: rename d0/d4/d21/d35/d36/d49/l65 to d0/l6d 0 2023-12-16T07:40:38.050 INFO:tasks.workunit.client.1.smithi133.stdout:6/330: write d0/d4/d21/d35/f3b [4269934,52161] 0 2023-12-16T07:40:38.053 INFO:tasks.workunit.client.1.smithi133.stdout:9/222: dwrite d15/d18/d2c/d3a/f45 [0,4194304] 0 2023-12-16T07:40:38.056 INFO:tasks.workunit.client.1.smithi133.stdout:6/331: dread d0/f5d [0,4194304] 0 2023-12-16T07:40:38.057 INFO:tasks.workunit.client.1.smithi133.stdout:1/207: rmdir d0/da 39 2023-12-16T07:40:38.057 INFO:tasks.workunit.client.1.smithi133.stdout:1/208: write d0/d12/f1b [5187455,50053] 0 2023-12-16T07:40:38.061 INFO:tasks.workunit.client.1.smithi133.stdout:9/223: creat d15/d18/d2c/d3a/f49 x:0 0 0 2023-12-16T07:40:38.062 INFO:tasks.workunit.client.1.smithi133.stdout:9/224: getdents d15/d18/d2c 0 2023-12-16T07:40:38.062 INFO:tasks.workunit.client.1.smithi133.stdout:9/225: fsync d15/d18/d2c/d3a/f45 0 2023-12-16T07:40:38.062 INFO:tasks.workunit.client.1.smithi133.stdout:6/332: mkdir d0/d5e/d6e 0 2023-12-16T07:40:38.063 INFO:tasks.workunit.client.1.smithi133.stdout:9/226: rmdir d15/d18 39 2023-12-16T07:40:38.063 INFO:tasks.workunit.client.1.smithi133.stdout:9/227: fdatasync d15/d18/d2c/f2e 0 2023-12-16T07:40:38.065 INFO:tasks.workunit.client.1.smithi133.stdout:1/209: rename d0/f1 to d0/f46 0 2023-12-16T07:40:38.065 INFO:tasks.workunit.client.1.smithi133.stdout:1/210: write d0/d12/f40 [554688,79434] 0 2023-12-16T07:40:38.065 INFO:tasks.workunit.client.1.smithi133.stdout:1/211: fsync d0/da/db/f35 0 2023-12-16T07:40:38.071 INFO:tasks.workunit.client.1.smithi133.stdout:0/200: dwrite d2/d17/f26 [0,4194304] 0 2023-12-16T07:40:38.090 INFO:tasks.workunit.client.1.smithi133.stdout:6/333: dwrite d0/d4/f31 [4194304,4194304] 0 2023-12-16T07:40:38.090 INFO:tasks.workunit.client.1.smithi133.stdout:6/334: write d0/f5d [641433,113722] 0 2023-12-16T07:40:38.091 INFO:tasks.workunit.client.1.smithi133.stdout:9/228: dwrite f9 [4194304,4194304] 0 2023-12-16T07:40:38.092 INFO:tasks.workunit.client.1.smithi133.stdout:6/335: creat d0/d5e/f6f x:0 0 0 2023-12-16T07:40:38.093 INFO:tasks.workunit.client.1.smithi133.stdout:6/336: getdents d0/d4/d21/d35 0 2023-12-16T07:40:38.093 INFO:tasks.workunit.client.1.smithi133.stdout:6/337: fdatasync d0/d4/d21/d35/d36/f64 0 2023-12-16T07:40:38.094 INFO:tasks.workunit.client.1.smithi133.stdout:6/338: creat d0/d4/d21/d35/d36/d49/f70 x:0 0 0 2023-12-16T07:40:38.096 INFO:tasks.workunit.client.1.smithi133.stdout:6/339: symlink d0/d4/d21/d35/d36/d49/l71 0 2023-12-16T07:40:38.097 INFO:tasks.workunit.client.1.smithi133.stdout:1/212: dwrite d0/d1c/f22 [0,4194304] 0 2023-12-16T07:40:38.100 INFO:tasks.workunit.client.1.smithi133.stdout:0/201: dwrite d2/d17/d37/f3d [4194304,4194304] 0 2023-12-16T07:40:38.100 INFO:tasks.workunit.client.1.smithi133.stdout:6/340: rename d0/d4/d21/d35/d36/l67 to d0/d5e/l72 0 2023-12-16T07:40:38.103 INFO:tasks.workunit.client.1.smithi133.stdout:0/202: write d2/d9/d12/f14 [637947,98491] 0 2023-12-16T07:40:38.112 INFO:tasks.workunit.client.1.smithi133.stdout:1/213: dwrite d0/d12/f3f [0,4194304] 0 2023-12-16T07:40:38.113 INFO:tasks.workunit.client.1.smithi133.stdout:6/341: mknod d0/d4/d21/d35/d36/c73 0 2023-12-16T07:40:38.117 INFO:tasks.workunit.client.1.smithi133.stdout:0/203: getdents d2/d9/d20 0 2023-12-16T07:40:38.123 INFO:tasks.workunit.client.1.smithi133.stdout:6/342: creat d0/f74 x:0 0 0 2023-12-16T07:40:38.123 INFO:tasks.workunit.client.1.smithi133.stdout:6/343: fsync d0/d4/d21/f40 0 2023-12-16T07:40:38.125 INFO:tasks.workunit.client.1.smithi133.stdout:0/204: dread d2/d17/f26 [0,4194304] 0 2023-12-16T07:40:38.126 INFO:tasks.workunit.client.1.smithi133.stdout:6/344: mkdir d0/d5e/d75 0 2023-12-16T07:40:38.126 INFO:tasks.workunit.client.1.smithi133.stdout:6/345: fsync d0/d5e/f6f 0 2023-12-16T07:40:38.129 INFO:tasks.workunit.client.1.smithi133.stdout:0/205: mknod d2/d9/c42 0 2023-12-16T07:40:38.130 INFO:tasks.workunit.client.1.smithi133.stdout:1/214: dwrite d0/f29 [0,4194304] 0 2023-12-16T07:40:38.134 INFO:tasks.workunit.client.1.smithi133.stdout:6/346: rename d0/d4/d21/d35/f3b to d0/d5e/f76 0 2023-12-16T07:40:38.134 INFO:tasks.workunit.client.1.smithi133.stdout:0/206: getdents d2/d9/d12 0 2023-12-16T07:40:38.136 INFO:tasks.workunit.client.1.smithi133.stdout:1/215: unlink d0/d1c/f22 0 2023-12-16T07:40:38.137 INFO:tasks.workunit.client.1.smithi133.stdout:6/347: truncate d0/d4/f2b 897095 0 2023-12-16T07:40:38.138 INFO:tasks.workunit.client.1.smithi133.stdout:0/207: mkdir d2/d9/db/d43 0 2023-12-16T07:40:38.139 INFO:tasks.workunit.client.1.smithi133.stdout:1/216: getdents d0/d12 0 2023-12-16T07:40:38.141 INFO:tasks.workunit.client.1.smithi133.stdout:6/348: rmdir d0/d5e/d6e 0 2023-12-16T07:40:38.141 INFO:tasks.workunit.client.1.smithi133.stdout:6/349: chown d0/d4/d21/f4c 48806551 1 2023-12-16T07:40:38.141 INFO:tasks.workunit.client.1.smithi133.stdout:6/350: chown d0/l5b 41848120 1 2023-12-16T07:40:38.141 INFO:tasks.workunit.client.1.smithi133.stdout:6/351: read - d0/d4/f5c zero size 2023-12-16T07:40:38.142 INFO:tasks.workunit.client.1.smithi133.stdout:1/217: link d0/c8 d0/da/d3d/d41/c47 0 2023-12-16T07:40:38.142 INFO:tasks.workunit.client.1.smithi133.stdout:1/218: dread - d0/da/f2e zero size 2023-12-16T07:40:38.143 INFO:tasks.workunit.client.1.smithi133.stdout:1/219: read d0/f46 [1210325,39485] 0 2023-12-16T07:40:38.144 INFO:tasks.workunit.client.1.smithi133.stdout:1/220: write d0/da/db/f2c [3519709,99202] 0 2023-12-16T07:40:38.144 INFO:tasks.workunit.client.1.smithi133.stdout:1/221: chown d0/da/db/d24/c42 71 1 2023-12-16T07:40:38.147 INFO:tasks.workunit.client.1.smithi133.stdout:1/222: rmdir d0/da 39 2023-12-16T07:40:38.147 INFO:tasks.workunit.client.1.smithi133.stdout:1/223: fdatasync d0/f29 0 2023-12-16T07:40:38.157 INFO:tasks.workunit.client.1.smithi133.stdout:6/352: dwrite d0/d4/d21/d35/d36/f46 [0,4194304] 0 2023-12-16T07:40:38.160 INFO:tasks.workunit.client.1.smithi133.stdout:6/353: mknod d0/c77 0 2023-12-16T07:40:38.160 INFO:tasks.workunit.client.1.smithi133.stdout:6/354: write d0/d4/d21/d35/f48 [772257,22267] 0 2023-12-16T07:40:38.161 INFO:tasks.workunit.client.1.smithi133.stdout:6/355: unlink d0/f5d 0 2023-12-16T07:40:38.162 INFO:tasks.workunit.client.1.smithi133.stdout:1/224: dwrite d0/f29 [4194304,4194304] 0 2023-12-16T07:40:38.162 INFO:tasks.workunit.client.1.smithi133.stdout:1/225: write d0/d1c/d37/f43 [360574,98449] 0 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:6/356: creat d0/d5e/f78 x:0 0 0 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:6/357: read d0/d4/d21/d35/d36/d49/f5a [84053,19525] 0 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:7/417: sync 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:8/190: sync 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:4/297: sync 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:2/131: sync 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:3/166: sync 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:4/298: truncate d3/f51 9386 0 2023-12-16T07:40:38.164 INFO:tasks.workunit.client.1.smithi133.stdout:5/117: sync 2023-12-16T07:40:38.165 INFO:tasks.workunit.client.1.smithi133.stdout:5/118: chown d1/f15 124829573 1 2023-12-16T07:40:38.165 INFO:tasks.workunit.client.1.smithi133.stdout:1/226: write d0/da/db/ff [1613219,76319] 0 2023-12-16T07:40:38.179 INFO:tasks.workunit.client.1.smithi133.stdout:1/227: dwrite d0/d12/f3f [4194304,4194304] 0 2023-12-16T07:40:38.192 INFO:tasks.workunit.client.1.smithi133.stdout:6/358: creat d0/d4/d21/d35/f79 x:0 0 0 2023-12-16T07:40:38.195 INFO:tasks.workunit.client.1.smithi133.stdout:7/418: link db/d3e/d4a/d58/c5c db/d21/d2c/d31/d79/c8e 0 2023-12-16T07:40:38.195 INFO:tasks.workunit.client.1.smithi133.stdout:7/419: write db/d12/f45 [1732093,45495] 0 2023-12-16T07:40:38.196 INFO:tasks.workunit.client.1.smithi133.stdout:8/191: dread d9/d11/f16 [0,4194304] 0 2023-12-16T07:40:38.197 INFO:tasks.workunit.client.1.smithi133.stdout:7/420: dread db/f18 [0,4194304] 0 2023-12-16T07:40:38.197 INFO:tasks.workunit.client.1.smithi133.stdout:7/421: chown db/d3e/l68 75972 1 2023-12-16T07:40:38.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:37 smithi049 ceph-mon[111939]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 65 MiB/s rd, 130 MiB/s wr, 266 op/s 2023-12-16T07:40:38.282 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:37 smithi133 ceph-mon[120445]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 65 MiB/s rd, 130 MiB/s wr, 266 op/s 2023-12-16T07:40:38.285 INFO:tasks.workunit.client.1.smithi133.stdout:4/299: truncate d3/d7/d1a/f27 605675 0 2023-12-16T07:40:38.285 INFO:tasks.workunit.client.1.smithi133.stdout:4/300: readlink d3/d7/d1c/l2f 0 2023-12-16T07:40:38.287 INFO:tasks.workunit.client.1.smithi133.stdout:2/132: rename da/f13 to da/d1d/f25 0 2023-12-16T07:40:38.288 INFO:tasks.workunit.client.1.smithi133.stdout:5/119: mknod d1/d1c/c22 0 2023-12-16T07:40:38.292 INFO:tasks.workunit.client.1.smithi133.stdout:3/167: symlink d7/d8/d1c/d2e/l44 0 2023-12-16T07:40:38.295 INFO:tasks.workunit.client.1.smithi133.stdout:1/228: symlink d0/da/db/d24/l48 0 2023-12-16T07:40:38.297 INFO:tasks.workunit.client.1.smithi133.stdout:8/192: unlink d9/l2a 0 2023-12-16T07:40:38.299 INFO:tasks.workunit.client.1.smithi133.stdout:4/301: mknod d3/d7/d38/d45/c5b 0 2023-12-16T07:40:38.299 INFO:tasks.workunit.client.1.smithi133.stdout:4/302: readlink d3/d7/d1c/l2c 0 2023-12-16T07:40:38.302 INFO:tasks.workunit.client.1.smithi133.stdout:6/359: rename d0/d4/d21/c41 to d0/d4/d21/d60/c7a 0 2023-12-16T07:40:38.302 INFO:tasks.workunit.client.1.smithi133.stdout:6/360: dread - d0/d4/d21/d35/d36/d49/f70 zero size 2023-12-16T07:40:38.302 INFO:tasks.workunit.client.1.smithi133.stdout:6/361: truncate d0/d4/d21/f3c 4812586 0 2023-12-16T07:40:38.306 INFO:tasks.workunit.client.1.smithi133.stdout:6/362: write d0/d4/d21/f40 [1193130,54499] 0 2023-12-16T07:40:38.307 INFO:tasks.workunit.client.1.smithi133.stdout:6/363: write d0/d4/f31 [7655979,55162] 0 2023-12-16T07:40:38.307 INFO:tasks.workunit.client.1.smithi133.stdout:5/120: creat d1/de/f23 x:0 0 0 2023-12-16T07:40:38.307 INFO:tasks.workunit.client.1.smithi133.stdout:5/121: truncate d1/f10 4967660 0 2023-12-16T07:40:38.319 INFO:tasks.workunit.client.1.smithi133.stdout:3/168: symlink d7/d8/d1d/l45 0 2023-12-16T07:40:38.321 INFO:tasks.workunit.client.1.smithi133.stdout:7/422: rename db/d3e/f6a to db/d3e/d4a/d58/f8f 0 2023-12-16T07:40:38.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/169: rename d7/d8/d1c to d7/d8/d1c/d46 22 2023-12-16T07:40:38.321 INFO:tasks.workunit.client.1.smithi133.stdout:7/423: dread - db/d53/f6b zero size 2023-12-16T07:40:38.322 INFO:tasks.workunit.client.1.smithi133.stdout:6/364: mknod d0/d4/d21/d35/d36/c7b 0 2023-12-16T07:40:38.322 INFO:tasks.workunit.client.1.smithi133.stdout:6/365: fsync d0/d4/d21/d35/d36/f46 0 2023-12-16T07:40:38.323 INFO:tasks.workunit.client.1.smithi133.stdout:5/122: creat d1/f24 x:0 0 0 2023-12-16T07:40:38.323 INFO:tasks.workunit.client.1.smithi133.stdout:4/303: dwrite d3/d7/fb [0,4194304] 0 2023-12-16T07:40:38.323 INFO:tasks.workunit.client.1.smithi133.stdout:5/123: write d1/f3 [1866233,1964] 0 2023-12-16T07:40:38.325 INFO:tasks.workunit.client.1.smithi133.stdout:7/424: rename db/f81 to db/d3e/d4a/d58/d86/d8b/f90 0 2023-12-16T07:40:38.327 INFO:tasks.workunit.client.1.smithi133.stdout:6/366: mkdir d0/d4/d21/d35/d36/d49/d69/d7c 0 2023-12-16T07:40:38.327 INFO:tasks.workunit.client.1.smithi133.stdout:6/367: fdatasync d0/d4/d21/d35/d36/f45 0 2023-12-16T07:40:38.328 INFO:tasks.workunit.client.1.smithi133.stdout:5/124: symlink d1/d18/l25 0 2023-12-16T07:40:38.329 INFO:tasks.workunit.client.1.smithi133.stdout:7/425: creat db/d3e/d4a/f91 x:0 0 0 2023-12-16T07:40:38.330 INFO:tasks.workunit.client.1.smithi133.stdout:6/368: symlink d0/l7d 0 2023-12-16T07:40:38.330 INFO:tasks.workunit.client.1.smithi133.stdout:6/369: fdatasync d0/d4/f19 0 2023-12-16T07:40:38.332 INFO:tasks.workunit.client.1.smithi133.stdout:5/125: mkdir d1/d18/d26 0 2023-12-16T07:40:38.335 INFO:tasks.workunit.client.1.smithi133.stdout:7/426: rename db/d21/d2c/d31/c8a to db/d3e/d4a/d58/d86/d8b/c92 0 2023-12-16T07:40:38.336 INFO:tasks.workunit.client.1.smithi133.stdout:5/126: mknod d1/de/c27 0 2023-12-16T07:40:38.341 INFO:tasks.workunit.client.1.smithi133.stdout:5/127: symlink d1/d1c/l28 0 2023-12-16T07:40:38.341 INFO:tasks.workunit.client.1.smithi133.stdout:7/427: read db/d21/f52 [2485940,126533] 0 2023-12-16T07:40:38.341 INFO:tasks.workunit.client.1.smithi133.stdout:7/428: write db/d3e/d4a/f91 [25510,117221] 0 2023-12-16T07:40:38.341 INFO:tasks.workunit.client.1.smithi133.stdout:5/128: mknod d1/d16/c29 0 2023-12-16T07:40:38.341 INFO:tasks.workunit.client.1.smithi133.stdout:5/129: readlink d1/d18/l25 0 2023-12-16T07:40:38.342 INFO:tasks.workunit.client.1.smithi133.stdout:3/170: dwrite d7/f23 [0,4194304] 0 2023-12-16T07:40:38.342 INFO:tasks.workunit.client.1.smithi133.stdout:7/429: write db/d21/f26 [6449976,72645] 0 2023-12-16T07:40:38.342 INFO:tasks.workunit.client.1.smithi133.stdout:5/130: creat d1/d16/f2a x:0 0 0 2023-12-16T07:40:38.343 INFO:tasks.workunit.client.1.smithi133.stdout:7/430: write db/d21/d2c/d31/d59/f5a [1172961,64347] 0 2023-12-16T07:40:38.347 INFO:tasks.workunit.client.1.smithi133.stdout:4/304: dwrite d3/f59 [0,4194304] 0 2023-12-16T07:40:38.347 INFO:tasks.workunit.client.1.smithi133.stdout:6/370: dread d0/d4/f31 [0,4194304] 0 2023-12-16T07:40:38.353 INFO:tasks.workunit.client.1.smithi133.stdout:3/171: creat d7/f47 x:0 0 0 2023-12-16T07:40:38.357 INFO:tasks.workunit.client.1.smithi133.stdout:5/131: creat d1/d16/f2b x:0 0 0 2023-12-16T07:40:38.358 INFO:tasks.workunit.client.1.smithi133.stdout:7/431: creat db/d21/d2c/d31/d6e/f93 x:0 0 0 2023-12-16T07:40:38.358 INFO:tasks.workunit.client.1.smithi133.stdout:7/432: truncate db/d12/f49 1561459 0 2023-12-16T07:40:38.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/305: link d3/d7/d38/f3d d3/d7/f5c 0 2023-12-16T07:40:38.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/306: write d3/d7/d1a/f33 [502643,116339] 0 2023-12-16T07:40:38.372 INFO:tasks.workunit.client.1.smithi133.stdout:3/172: dwrite d7/d8/d1d/f40 [0,4194304] 0 2023-12-16T07:40:38.377 INFO:tasks.workunit.client.1.smithi133.stdout:7/433: dwrite db/d21/f2f [0,4194304] 0 2023-12-16T07:40:38.384 INFO:tasks.workunit.client.1.smithi133.stdout:7/434: dread db/fe [0,4194304] 0 2023-12-16T07:40:38.384 INFO:tasks.workunit.client.1.smithi133.stdout:7/435: chown db/d21/c42 6626893 1 2023-12-16T07:40:38.389 INFO:tasks.workunit.client.1.smithi133.stdout:6/371: mkdir d0/d4/d21/d35/d7e 0 2023-12-16T07:40:38.392 INFO:tasks.workunit.client.1.smithi133.stdout:5/132: mkdir d1/d18/d2c 0 2023-12-16T07:40:38.395 INFO:tasks.workunit.client.1.smithi133.stdout:4/307: creat d3/f5d x:0 0 0 2023-12-16T07:40:38.398 INFO:tasks.workunit.client.1.smithi133.stdout:3/173: creat d7/d8/d1c/f48 x:0 0 0 2023-12-16T07:40:38.404 INFO:tasks.workunit.client.1.smithi133.stdout:7/436: rmdir db/d3e/d4a 39 2023-12-16T07:40:38.409 INFO:tasks.workunit.client.1.smithi133.stdout:6/372: symlink d0/d4/d21/d35/d4e/l7f 0 2023-12-16T07:40:38.409 INFO:tasks.workunit.client.1.smithi133.stdout:6/373: write d0/d4/d21/d35/f48 [1066826,118253] 0 2023-12-16T07:40:38.411 INFO:tasks.workunit.client.1.smithi133.stdout:4/308: link d3/d7/d38/f3d d3/d7/d44/f5e 0 2023-12-16T07:40:38.413 INFO:tasks.workunit.client.1.smithi133.stdout:7/437: dread db/ff [0,4194304] 0 2023-12-16T07:40:38.414 INFO:tasks.workunit.client.1.smithi133.stdout:5/133: dwrite d1/f1a [0,4194304] 0 2023-12-16T07:40:38.417 INFO:tasks.workunit.client.1.smithi133.stdout:4/309: creat d3/d7/d38/d57/f5f x:0 0 0 2023-12-16T07:40:38.417 INFO:tasks.workunit.client.1.smithi133.stdout:6/374: getdents d0/d4/d21/d35 0 2023-12-16T07:40:38.421 INFO:tasks.workunit.client.1.smithi133.stdout:7/438: symlink db/d21/d2c/d31/d6e/l94 0 2023-12-16T07:40:38.421 INFO:tasks.workunit.client.1.smithi133.stdout:7/439: truncate db/d21/d2c/f50 467195 0 2023-12-16T07:40:38.422 INFO:tasks.workunit.client.1.smithi133.stdout:7/440: write db/d21/f23 [4029608,66585] 0 2023-12-16T07:40:38.422 INFO:tasks.workunit.client.1.smithi133.stdout:3/174: rename d7/d8/d1c/d2b/c37 to d7/d8/c49 0 2023-12-16T07:40:38.429 INFO:tasks.workunit.client.1.smithi133.stdout:5/134: symlink d1/d16/l2d 0 2023-12-16T07:40:38.430 INFO:tasks.workunit.client.1.smithi133.stdout:7/441: dread db/d12/d3a/d6c/f83 [0,4194304] 0 2023-12-16T07:40:38.431 INFO:tasks.workunit.client.1.smithi133.stdout:4/310: mknod d3/d7/d38/d57/c60 0 2023-12-16T07:40:38.432 INFO:tasks.workunit.client.1.smithi133.stdout:6/375: creat d0/d5e/d75/f80 x:0 0 0 2023-12-16T07:40:38.432 INFO:tasks.workunit.client.1.smithi133.stdout:6/376: write d0/d4/d21/d35/d36/f64 [394113,111240] 0 2023-12-16T07:40:38.434 INFO:tasks.workunit.client.1.smithi133.stdout:5/135: symlink d1/d18/d2c/l2e 0 2023-12-16T07:40:38.437 INFO:tasks.workunit.client.1.smithi133.stdout:4/311: unlink d3/f30 0 2023-12-16T07:40:38.437 INFO:tasks.workunit.client.1.smithi133.stdout:4/312: read d3/fa [331892,71932] 0 2023-12-16T07:40:38.438 INFO:tasks.workunit.client.1.smithi133.stdout:3/175: dwrite d7/d8/f10 [0,4194304] 0 2023-12-16T07:40:38.439 INFO:tasks.workunit.client.1.smithi133.stdout:6/377: mkdir d0/d5e/d75/d81 0 2023-12-16T07:40:38.442 INFO:tasks.workunit.client.1.smithi133.stdout:5/136: mknod d1/d18/c2f 0 2023-12-16T07:40:38.442 INFO:tasks.workunit.client.1.smithi133.stdout:5/137: readlink d1/d16/l2d 0 2023-12-16T07:40:38.443 INFO:tasks.workunit.client.1.smithi133.stdout:4/313: mknod d3/d7/d38/c61 0 2023-12-16T07:40:38.446 INFO:tasks.workunit.client.1.smithi133.stdout:7/442: dwrite db/f85 [0,4194304] 0 2023-12-16T07:40:38.446 INFO:tasks.workunit.client.1.smithi133.stdout:7/443: fdatasync db/d3e/d4a/d58/d86/d8b/f90 0 2023-12-16T07:40:38.452 INFO:tasks.workunit.client.1.smithi133.stdout:3/176: mknod d7/d8/d1c/d2e/d43/c4a 0 2023-12-16T07:40:38.452 INFO:tasks.workunit.client.1.smithi133.stdout:3/177: dread - d7/d8/d1c/f26 zero size 2023-12-16T07:40:38.452 INFO:tasks.workunit.client.1.smithi133.stdout:3/178: write d7/d8/d1c/d2b/f15 [1284246,108072] 0 2023-12-16T07:40:38.454 INFO:tasks.workunit.client.1.smithi133.stdout:6/378: link d0/d4/d21/d35/f48 d0/d4/d21/d35/d36/d49/d69/d7c/f82 0 2023-12-16T07:40:38.456 INFO:tasks.workunit.client.1.smithi133.stdout:5/138: mknod d1/d16/c30 0 2023-12-16T07:40:38.456 INFO:tasks.workunit.client.1.smithi133.stdout:5/139: readlink d1/d18/l25 0 2023-12-16T07:40:38.456 INFO:tasks.workunit.client.1.smithi133.stdout:5/140: dread - d1/f24 zero size 2023-12-16T07:40:38.458 INFO:tasks.workunit.client.1.smithi133.stdout:4/314: dwrite d3/d7/d1c/f46 [0,4194304] 0 2023-12-16T07:40:38.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/315: chown d3/f14 5 1 2023-12-16T07:40:38.460 INFO:tasks.workunit.client.1.smithi133.stdout:7/444: link db/f8c db/d3e/d4a/d58/d86/d8b/d8d/f95 0 2023-12-16T07:40:38.461 INFO:tasks.workunit.client.1.smithi133.stdout:7/445: read db/f18 [223880,161] 0 2023-12-16T07:40:38.465 INFO:tasks.workunit.client.1.smithi133.stdout:3/179: creat d7/d8/d1c/f4b x:0 0 0 2023-12-16T07:40:38.465 INFO:tasks.workunit.client.1.smithi133.stdout:3/180: chown d7/d8/d1c/d2b/c24 3905630 1 2023-12-16T07:40:38.466 INFO:tasks.workunit.client.1.smithi133.stdout:6/379: mknod d0/c83 0 2023-12-16T07:40:38.466 INFO:tasks.workunit.client.1.smithi133.stdout:6/380: write d0/d5e/f6f [714124,52085] 0 2023-12-16T07:40:38.469 INFO:tasks.workunit.client.1.smithi133.stdout:5/141: unlink d1/f5 0 2023-12-16T07:40:38.472 INFO:tasks.workunit.client.1.smithi133.stdout:6/381: dread d0/d4/d21/d35/f48 [0,4194304] 0 2023-12-16T07:40:38.473 INFO:tasks.workunit.client.1.smithi133.stdout:4/316: getdents d3/d7/d38 0 2023-12-16T07:40:38.473 INFO:tasks.workunit.client.1.smithi133.stdout:6/382: dread d0/d4/d21/d35/d36/d49/f5a [0,4194304] 0 2023-12-16T07:40:38.473 INFO:tasks.workunit.client.1.smithi133.stdout:6/383: dread - d0/d4/d21/d35/d36/d49/f58 zero size 2023-12-16T07:40:38.476 INFO:tasks.workunit.client.1.smithi133.stdout:7/446: symlink db/d3e/d4a/d58/l96 0 2023-12-16T07:40:38.479 INFO:tasks.workunit.client.1.smithi133.stdout:3/181: stat d7/d8/d1c/l3a 0 2023-12-16T07:40:38.481 INFO:tasks.workunit.client.1.smithi133.stdout:5/142: truncate d1/f7 463992 0 2023-12-16T07:40:38.483 INFO:tasks.workunit.client.1.smithi133.stdout:5/143: dread d1/f17 [0,4194304] 0 2023-12-16T07:40:38.484 INFO:tasks.workunit.client.1.smithi133.stdout:9/229: sync 2023-12-16T07:40:38.484 INFO:tasks.workunit.client.1.smithi133.stdout:6/384: rename d0/d4/d21/d35/d36/d49 to d0/d4/d21/d35/d4e/d84 0 2023-12-16T07:40:38.485 INFO:tasks.workunit.client.1.smithi133.stdout:7/447: creat db/d21/d2c/d31/d6e/f97 x:0 0 0 2023-12-16T07:40:38.488 INFO:tasks.workunit.client.1.smithi133.stdout:1/229: sync 2023-12-16T07:40:38.488 INFO:tasks.workunit.client.1.smithi133.stdout:8/193: sync 2023-12-16T07:40:38.488 INFO:tasks.workunit.client.1.smithi133.stdout:2/133: sync 2023-12-16T07:40:38.488 INFO:tasks.workunit.client.1.smithi133.stdout:0/208: sync 2023-12-16T07:40:38.488 INFO:tasks.workunit.client.1.smithi133.stdout:4/317: dwrite d3/d7/d1a/f20 [0,4194304] 0 2023-12-16T07:40:38.489 INFO:tasks.workunit.client.1.smithi133.stdout:3/182: mknod d7/d8/d1c/c4c 0 2023-12-16T07:40:38.490 INFO:tasks.workunit.client.1.smithi133.stdout:9/230: link f0 d15/d18/f4a 0 2023-12-16T07:40:38.493 INFO:tasks.workunit.client.1.smithi133.stdout:5/144: rename d1/d18/c1d to d1/d18/d26/c31 0 2023-12-16T07:40:38.493 INFO:tasks.workunit.client.1.smithi133.stdout:7/448: truncate db/d21/d2c/f56 422861 0 2023-12-16T07:40:38.495 INFO:tasks.workunit.client.1.smithi133.stdout:8/194: mkdir d9/d10/d39 0 2023-12-16T07:40:38.496 INFO:tasks.workunit.client.1.smithi133.stdout:2/134: symlink da/d1d/d24/l26 0 2023-12-16T07:40:38.500 INFO:tasks.workunit.client.1.smithi133.stdout:0/209: link d2/d9/d12/f3f d2/d9/d20/f44 0 2023-12-16T07:40:38.501 INFO:tasks.workunit.client.1.smithi133.stdout:3/183: mknod d7/d8/d1c/c4d 0 2023-12-16T07:40:38.503 INFO:tasks.workunit.client.1.smithi133.stdout:9/231: stat d15/c1a 0 2023-12-16T07:40:38.504 INFO:tasks.workunit.client.1.smithi133.stdout:9/232: write d15/d18/d2c/f47 [128252,10996] 0 2023-12-16T07:40:38.504 INFO:tasks.workunit.client.1.smithi133.stdout:1/230: dwrite d0/f29 [0,4194304] 0 2023-12-16T07:40:38.505 INFO:tasks.workunit.client.1.smithi133.stdout:6/385: rename d0/d4/d21/d35/d36/c7b to d0/d4/d21/d35/d7e/c85 0 2023-12-16T07:40:38.508 INFO:tasks.workunit.client.1.smithi133.stdout:5/145: creat d1/de/f32 x:0 0 0 2023-12-16T07:40:38.513 INFO:tasks.workunit.client.1.smithi133.stdout:2/135: symlink da/d1d/l27 0 2023-12-16T07:40:38.514 INFO:tasks.workunit.client.1.smithi133.stdout:0/210: mkdir d2/d9/d12/d45 0 2023-12-16T07:40:38.517 INFO:tasks.workunit.client.1.smithi133.stdout:3/184: unlink d7/d8/d1c/c4d 0 2023-12-16T07:40:38.518 INFO:tasks.workunit.client.1.smithi133.stdout:9/233: mknod d15/d18/d2c/d3a/c4b 0 2023-12-16T07:40:38.519 INFO:tasks.workunit.client.1.smithi133.stdout:9/234: write d15/f37 [1706357,74278] 0 2023-12-16T07:40:38.520 INFO:tasks.workunit.client.1.smithi133.stdout:1/231: mknod d0/d12/c49 0 2023-12-16T07:40:38.520 INFO:tasks.workunit.client.1.smithi133.stdout:1/232: write d0/da/f3a [754573,92243] 0 2023-12-16T07:40:38.522 INFO:tasks.workunit.client.1.smithi133.stdout:4/318: rename d3/l5 to d3/d7/d1a/l62 0 2023-12-16T07:40:38.522 INFO:tasks.workunit.client.1.smithi133.stdout:4/319: write d3/d7/d38/f3d [4942675,112328] 0 2023-12-16T07:40:38.524 INFO:tasks.workunit.client.1.smithi133.stdout:5/146: link d1/d18/l25 d1/d18/l33 0 2023-12-16T07:40:38.524 INFO:tasks.workunit.client.1.smithi133.stdout:0/211: truncate d2/d9/db/fe 1275524 0 2023-12-16T07:40:38.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/185: symlink d7/d8/d1c/d2e/l4e 0 2023-12-16T07:40:38.527 INFO:tasks.workunit.client.1.smithi133.stdout:7/449: dwrite db/d21/d2c/f56 [0,4194304] 0 2023-12-16T07:40:38.528 INFO:tasks.workunit.client.1.smithi133.stdout:6/386: dwrite d0/d4/f47 [0,4194304] 0 2023-12-16T07:40:38.528 INFO:tasks.workunit.client.1.smithi133.stdout:7/450: write db/fe [5153316,3874] 0 2023-12-16T07:40:38.529 INFO:tasks.workunit.client.1.smithi133.stdout:9/235: creat d15/d18/d2c/f4c x:0 0 0 2023-12-16T07:40:38.531 INFO:tasks.workunit.client.1.smithi133.stdout:1/233: truncate d0/f17 2113989 0 2023-12-16T07:40:38.537 INFO:tasks.workunit.client.1.smithi133.stdout:8/195: rename d9/d11/d33/f35 to d9/d10/f3a 0 2023-12-16T07:40:38.540 INFO:tasks.workunit.client.1.smithi133.stdout:1/234: dread d0/d12/f3f [0,4194304] 0 2023-12-16T07:40:38.541 INFO:tasks.workunit.client.1.smithi133.stdout:4/320: mkdir d3/d7/d44/d63 0 2023-12-16T07:40:38.545 INFO:tasks.workunit.client.1.smithi133.stdout:5/147: rename d1/f15 to d1/f34 0 2023-12-16T07:40:38.545 INFO:tasks.workunit.client.1.smithi133.stdout:5/148: truncate d1/de/ff 847544 0 2023-12-16T07:40:38.545 INFO:tasks.workunit.client.1.smithi133.stdout:0/212: mknod d2/d17/d37/c46 0 2023-12-16T07:40:38.546 INFO:tasks.workunit.client.1.smithi133.stdout:6/387: dwrite d0/d4/f11 [0,4194304] 0 2023-12-16T07:40:38.546 INFO:tasks.workunit.client.1.smithi133.stdout:6/388: chown d0/d4/d21/d35/d4e/d84/d69/d7c 1295 1 2023-12-16T07:40:38.546 INFO:tasks.workunit.client.1.smithi133.stdout:6/389: fdatasync d0/d4/d21/f39 0 2023-12-16T07:40:38.555 INFO:tasks.workunit.client.1.smithi133.stdout:4/321: dread d3/f59 [0,4194304] 0 2023-12-16T07:40:38.555 INFO:tasks.workunit.client.1.smithi133.stdout:4/322: chown d3/d7/d44 376 1 2023-12-16T07:40:38.555 INFO:tasks.workunit.client.1.smithi133.stdout:8/196: dwrite d9/f2e [0,4194304] 0 2023-12-16T07:40:38.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/451: mkdir db/d12/d98 0 2023-12-16T07:40:38.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/452: fsync db/d3e/d4a/f60 0 2023-12-16T07:40:38.558 INFO:tasks.workunit.client.1.smithi133.stdout:9/236: mkdir d15/d18/d4d 0 2023-12-16T07:40:38.560 INFO:tasks.workunit.client.1.smithi133.stdout:1/235: creat d0/d1c/d37/f4a x:0 0 0 2023-12-16T07:40:38.560 INFO:tasks.workunit.client.1.smithi133.stdout:1/236: read d0/da/db/f21 [4203774,123420] 0 2023-12-16T07:40:38.562 INFO:tasks.workunit.client.1.smithi133.stdout:5/149: unlink d1/d18/d26/c31 0 2023-12-16T07:40:38.564 INFO:tasks.workunit.client.1.smithi133.stdout:0/213: creat d2/d9/f47 x:0 0 0 2023-12-16T07:40:38.564 INFO:tasks.workunit.client.1.smithi133.stdout:0/214: chown d2/d9/db/c2a 3957 1 2023-12-16T07:40:38.566 INFO:tasks.workunit.client.1.smithi133.stdout:6/390: rename d0/f2 to d0/d5e/d75/d81/f86 0 2023-12-16T07:40:38.568 INFO:tasks.workunit.client.1.smithi133.stdout:3/186: symlink d7/d8/l4f 0 2023-12-16T07:40:38.568 INFO:tasks.workunit.client.1.smithi133.stdout:3/187: truncate d7/d8/d1d/d2a/f3c 229378 0 2023-12-16T07:40:38.569 INFO:tasks.workunit.client.1.smithi133.stdout:9/237: dread d15/d18/d2c/f46 [0,4194304] 0 2023-12-16T07:40:38.570 INFO:tasks.workunit.client.1.smithi133.stdout:4/323: mknod d3/d7/d38/c64 0 2023-12-16T07:40:38.572 INFO:tasks.workunit.client.1.smithi133.stdout:0/215: dread d2/d9/d12/f14 [0,4194304] 0 2023-12-16T07:40:38.573 INFO:tasks.workunit.client.1.smithi133.stdout:8/197: mknod d9/d10/d39/c3b 0 2023-12-16T07:40:38.575 INFO:tasks.workunit.client.1.smithi133.stdout:1/237: creat d0/da/f4b x:0 0 0 2023-12-16T07:40:38.576 INFO:tasks.workunit.client.1.smithi133.stdout:7/453: dwrite db/d21/f26 [0,4194304] 0 2023-12-16T07:40:38.576 INFO:tasks.workunit.client.1.smithi133.stdout:5/150: mkdir d1/de/d35 0 2023-12-16T07:40:38.577 INFO:tasks.workunit.client.1.smithi133.stdout:5/151: chown d1/d1c/l28 24645002 1 2023-12-16T07:40:38.578 INFO:tasks.workunit.client.1.smithi133.stdout:5/152: dread d1/f17 [0,4194304] 0 2023-12-16T07:40:38.580 INFO:tasks.workunit.client.1.smithi133.stdout:3/188: creat d7/d8/d1c/f50 x:0 0 0 2023-12-16T07:40:38.580 INFO:tasks.workunit.client.1.smithi133.stdout:4/324: creat d3/d7/d38/d45/f65 x:0 0 0 2023-12-16T07:40:38.583 INFO:tasks.workunit.client.1.smithi133.stdout:0/216: rename d2/d17/d37 to d2/d9/d12/d35/d48 0 2023-12-16T07:40:38.583 INFO:tasks.workunit.client.1.smithi133.stdout:0/217: truncate d2/f8 5640367 0 2023-12-16T07:40:38.585 INFO:tasks.workunit.client.1.smithi133.stdout:8/198: creat d9/dc/f3c x:0 0 0 2023-12-16T07:40:38.588 INFO:tasks.workunit.client.1.smithi133.stdout:1/238: link d0/da/c45 d0/da/db/d24/d32/c4c 0 2023-12-16T07:40:38.592 INFO:tasks.workunit.client.1.smithi133.stdout:7/454: mkdir db/d3e/d4a/d58/d86/d8b/d8d/d99 0 2023-12-16T07:40:38.592 INFO:tasks.workunit.client.1.smithi133.stdout:7/455: readlink db/d21/d2c/l6f 0 2023-12-16T07:40:38.592 INFO:tasks.workunit.client.1.smithi133.stdout:7/456: chown db/d12/d3a 1755 1 2023-12-16T07:40:38.592 INFO:tasks.workunit.client.1.smithi133.stdout:7/457: read db/f18 [242683,100819] 0 2023-12-16T07:40:38.593 INFO:tasks.workunit.client.1.smithi133.stdout:6/391: getdents d0/d5e/d75/d81 0 2023-12-16T07:40:38.598 INFO:tasks.workunit.client.1.smithi133.stdout:5/153: mknod d1/de/c36 0 2023-12-16T07:40:38.598 INFO:tasks.workunit.client.1.smithi133.stdout:5/154: chown d1 6554790 1 2023-12-16T07:40:38.598 INFO:tasks.workunit.client.1.smithi133.stdout:3/189: symlink d7/l51 0 2023-12-16T07:40:38.602 INFO:tasks.workunit.client.1.smithi133.stdout:4/325: rename d3/d7/d1a/f20 to d3/d7/d38/d57/f66 0 2023-12-16T07:40:38.603 INFO:tasks.workunit.client.1.smithi133.stdout:0/218: creat d2/d17/d40/f49 x:0 0 0 2023-12-16T07:40:38.606 INFO:tasks.workunit.client.1.smithi133.stdout:8/199: truncate d9/dc/f30 2373433 0 2023-12-16T07:40:38.609 INFO:tasks.workunit.client.1.smithi133.stdout:1/239: dwrite d0/da/db/fd [4194304,4194304] 0 2023-12-16T07:40:38.610 INFO:tasks.workunit.client.1.smithi133.stdout:6/392: link d0/d4/f37 d0/d4/d21/f87 0 2023-12-16T07:40:38.611 INFO:tasks.workunit.client.1.smithi133.stdout:7/458: dwrite db/d12/f45 [0,4194304] 0 2023-12-16T07:40:38.613 INFO:tasks.workunit.client.1.smithi133.stdout:5/155: creat d1/de/d35/f37 x:0 0 0 2023-12-16T07:40:38.613 INFO:tasks.workunit.client.1.smithi133.stdout:5/156: write d1/de/f32 [725160,21382] 0 2023-12-16T07:40:38.614 INFO:tasks.workunit.client.1.smithi133.stdout:3/190: creat d7/d8/d1d/f52 x:0 0 0 2023-12-16T07:40:38.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/219: dwrite d2/d17/f2e [0,4194304] 0 2023-12-16T07:40:38.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/220: chown d2/d9/c11 753787437 1 2023-12-16T07:40:38.627 INFO:tasks.workunit.client.1.smithi133.stdout:8/200: link l5 d9/dc/l3d 0 2023-12-16T07:40:38.627 INFO:tasks.workunit.client.1.smithi133.stdout:8/201: chown d9/dc/f30 268077 1 2023-12-16T07:40:38.627 INFO:tasks.workunit.client.1.smithi133.stdout:8/202: chown d9/d11/f16 305304 1 2023-12-16T07:40:38.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/221: write d2/d17/f26 [568239,69588] 0 2023-12-16T07:40:38.628 INFO:tasks.workunit.client.1.smithi133.stdout:8/203: dread d9/d11/f16 [0,4194304] 0 2023-12-16T07:40:38.630 INFO:tasks.workunit.client.1.smithi133.stdout:6/393: creat d0/d4/d21/d35/d4e/d84/d69/d7c/f88 x:0 0 0 2023-12-16T07:40:38.632 INFO:tasks.workunit.client.1.smithi133.stdout:8/204: write d9/f22 [2949853,66945] 0 2023-12-16T07:40:38.634 INFO:tasks.workunit.client.1.smithi133.stdout:4/326: rmdir d3 39 2023-12-16T07:40:38.635 INFO:tasks.workunit.client.1.smithi133.stdout:0/222: dread d2/f8 [0,4194304] 0 2023-12-16T07:40:38.636 INFO:tasks.workunit.client.1.smithi133.stdout:7/459: rename db/d12/d3a/f74 to db/d3e/d4a/f9a 0 2023-12-16T07:40:38.637 INFO:tasks.workunit.client.1.smithi133.stdout:3/191: dwrite d7/d8/d1c/f31 [0,4194304] 0 2023-12-16T07:40:38.637 INFO:tasks.workunit.client.1.smithi133.stdout:5/157: dwrite d1/f10 [0,4194304] 0 2023-12-16T07:40:38.637 INFO:tasks.workunit.client.1.smithi133.stdout:5/158: chown d1/d18/c2f 1062236822 1 2023-12-16T07:40:38.638 INFO:tasks.workunit.client.1.smithi133.stdout:5/159: readlink d1/d16/l2d 0 2023-12-16T07:40:38.638 INFO:tasks.workunit.client.1.smithi133.stdout:5/160: truncate d1/de/f13 5050780 0 2023-12-16T07:40:38.638 INFO:tasks.workunit.client.1.smithi133.stdout:5/161: chown d1/f10 1 1 2023-12-16T07:40:38.642 INFO:tasks.workunit.client.1.smithi133.stdout:4/327: dread d3/fa [4194304,4194304] 0 2023-12-16T07:40:38.642 INFO:tasks.workunit.client.1.smithi133.stdout:3/192: read d7/d8/f14 [3390496,57457] 0 2023-12-16T07:40:38.643 INFO:tasks.workunit.client.1.smithi133.stdout:3/193: write d7/f47 [269682,55748] 0 2023-12-16T07:40:38.643 INFO:tasks.workunit.client.1.smithi133.stdout:1/240: symlink d0/l4d 0 2023-12-16T07:40:38.645 INFO:tasks.workunit.client.1.smithi133.stdout:0/223: rmdir d2/d17/d2b/d31 39 2023-12-16T07:40:38.647 INFO:tasks.workunit.client.1.smithi133.stdout:7/460: rmdir db/d3e/d4a/d58 39 2023-12-16T07:40:38.649 INFO:tasks.workunit.client.1.smithi133.stdout:4/328: mkdir d3/d7/d38/d57/d67 0 2023-12-16T07:40:38.651 INFO:tasks.workunit.client.1.smithi133.stdout:3/194: symlink d7/d8/d1c/d2e/l53 0 2023-12-16T07:40:38.652 INFO:tasks.workunit.client.1.smithi133.stdout:8/205: unlink d9/d11/d1a/c32 0 2023-12-16T07:40:38.654 INFO:tasks.workunit.client.1.smithi133.stdout:7/461: symlink db/d21/d2c/l9b 0 2023-12-16T07:40:38.656 INFO:tasks.workunit.client.1.smithi133.stdout:4/329: creat d3/d7/d38/d45/f68 x:0 0 0 2023-12-16T07:40:38.656 INFO:tasks.workunit.client.1.smithi133.stdout:5/162: dwrite d1/f24 [0,4194304] 0 2023-12-16T07:40:38.656 INFO:tasks.workunit.client.1.smithi133.stdout:6/394: dwrite d0/d4/d21/d35/f79 [0,4194304] 0 2023-12-16T07:40:38.656 INFO:tasks.workunit.client.1.smithi133.stdout:6/395: chown d0/l7d 356 1 2023-12-16T07:40:38.656 INFO:tasks.workunit.client.1.smithi133.stdout:6/396: truncate d0/d5e/f78 347659 0 2023-12-16T07:40:38.656 INFO:tasks.workunit.client.1.smithi133.stdout:6/397: write d0/d4/d21/d35/d36/f64 [1472345,24545] 0 2023-12-16T07:40:38.657 INFO:tasks.workunit.client.1.smithi133.stdout:6/398: dread - d0/d4/f5c zero size 2023-12-16T07:40:38.657 INFO:tasks.workunit.client.1.smithi133.stdout:8/206: creat d9/f3e x:0 0 0 2023-12-16T07:40:38.658 INFO:tasks.workunit.client.1.smithi133.stdout:1/241: dread d0/f2a [0,4194304] 0 2023-12-16T07:40:38.658 INFO:tasks.workunit.client.1.smithi133.stdout:7/462: creat db/d53/f9c x:0 0 0 2023-12-16T07:40:38.659 INFO:tasks.workunit.client.1.smithi133.stdout:7/463: truncate db/f16 5098175 0 2023-12-16T07:40:38.659 INFO:tasks.workunit.client.1.smithi133.stdout:7/464: fsync db/d3e/d4a/d58/d86/d8b/f90 0 2023-12-16T07:40:38.659 INFO:tasks.workunit.client.1.smithi133.stdout:7/465: chown db/d3e/f4f 980879 1 2023-12-16T07:40:38.660 INFO:tasks.workunit.client.1.smithi133.stdout:4/330: creat d3/d7/d1c/f69 x:0 0 0 2023-12-16T07:40:38.660 INFO:tasks.workunit.client.1.smithi133.stdout:4/331: readlink d3/d7/d1c/l2c 0 2023-12-16T07:40:38.673 INFO:tasks.workunit.client.1.smithi133.stdout:7/466: rename db/l3b to db/d21/l9d 0 2023-12-16T07:40:38.675 INFO:tasks.workunit.client.1.smithi133.stdout:4/332: creat d3/d7/d38/d57/d67/f6a x:0 0 0 2023-12-16T07:40:38.677 INFO:tasks.workunit.client.1.smithi133.stdout:0/224: dwrite d2/d9/d20/f29 [0,4194304] 0 2023-12-16T07:40:38.677 INFO:tasks.workunit.client.1.smithi133.stdout:6/399: dread d0/d5e/f78 [0,4194304] 0 2023-12-16T07:40:38.679 INFO:tasks.workunit.client.1.smithi133.stdout:1/242: rename d0/l1f to d0/l4e 0 2023-12-16T07:40:38.679 INFO:tasks.workunit.client.1.smithi133.stdout:1/243: stat d0/da/db/d24/d32/d3e 0 2023-12-16T07:40:38.682 INFO:tasks.workunit.client.1.smithi133.stdout:5/163: dwrite d1/fb [0,4194304] 0 2023-12-16T07:40:38.683 INFO:tasks.workunit.client.1.smithi133.stdout:8/207: dwrite d9/d10/f37 [0,4194304] 0 2023-12-16T07:40:38.683 INFO:tasks.workunit.client.1.smithi133.stdout:8/208: fsync d9/f31 0 2023-12-16T07:40:38.685 INFO:tasks.workunit.client.1.smithi133.stdout:7/467: symlink db/d12/d98/l9e 0 2023-12-16T07:40:38.689 INFO:tasks.workunit.client.1.smithi133.stdout:4/333: creat d3/d7/f6b x:0 0 0 2023-12-16T07:40:38.689 INFO:tasks.workunit.client.1.smithi133.stdout:4/334: dread - d3/d7/d38/d57/d67/f6a zero size 2023-12-16T07:40:38.689 INFO:tasks.workunit.client.1.smithi133.stdout:4/335: truncate d3/d7/d44/f5e 5191163 0 2023-12-16T07:40:38.690 INFO:tasks.workunit.client.1.smithi133.stdout:4/336: chown d3/c32 25237 1 2023-12-16T07:40:38.690 INFO:tasks.workunit.client.1.smithi133.stdout:1/244: symlink d0/da/d3d/d41/l4f 0 2023-12-16T07:40:38.695 INFO:tasks.workunit.client.1.smithi133.stdout:5/164: creat d1/d1c/f38 x:0 0 0 2023-12-16T07:40:38.697 INFO:tasks.workunit.client.1.smithi133.stdout:8/209: rmdir d9/d2d 39 2023-12-16T07:40:38.698 INFO:tasks.workunit.client.1.smithi133.stdout:8/210: write d9/d11/f16 [647425,121114] 0 2023-12-16T07:40:38.699 INFO:tasks.workunit.client.1.smithi133.stdout:7/468: truncate db/d21/f52 280955 0 2023-12-16T07:40:38.700 INFO:tasks.workunit.client.1.smithi133.stdout:1/245: creat d0/da/d3d/f50 x:0 0 0 2023-12-16T07:40:38.701 INFO:tasks.workunit.client.1.smithi133.stdout:5/165: unlink d1/f12 0 2023-12-16T07:40:38.702 INFO:tasks.workunit.client.1.smithi133.stdout:0/225: dwrite d2/d9/d20/f2c [0,4194304] 0 2023-12-16T07:40:38.702 INFO:tasks.workunit.client.1.smithi133.stdout:6/400: dwrite d0/d4/d21/f3c [0,4194304] 0 2023-12-16T07:40:38.702 INFO:tasks.workunit.client.1.smithi133.stdout:6/401: chown d0/d4/f28 224961557 1 2023-12-16T07:40:38.702 INFO:tasks.workunit.client.1.smithi133.stdout:6/402: write d0/d4/d21/d35/d4e/d84/d69/d7c/f88 [924345,98023] 0 2023-12-16T07:40:38.703 INFO:tasks.workunit.client.1.smithi133.stdout:6/403: chown d0/d4/d21/f40 225584 1 2023-12-16T07:40:38.703 INFO:tasks.workunit.client.1.smithi133.stdout:8/211: mkdir d9/d3f 0 2023-12-16T07:40:38.703 INFO:tasks.workunit.client.1.smithi133.stdout:6/404: write d0/d4/d21/d35/f48 [197034,127818] 0 2023-12-16T07:40:38.703 INFO:tasks.workunit.client.1.smithi133.stdout:7/469: truncate f9 1401110 0 2023-12-16T07:40:38.703 INFO:tasks.workunit.client.1.smithi133.stdout:7/470: fdatasync db/d21/f25 0 2023-12-16T07:40:38.705 INFO:tasks.workunit.client.1.smithi133.stdout:1/246: mkdir d0/d12/d51 0 2023-12-16T07:40:38.709 INFO:tasks.workunit.client.1.smithi133.stdout:4/337: dwrite d3/f14 [0,4194304] 0 2023-12-16T07:40:38.709 INFO:tasks.workunit.client.1.smithi133.stdout:7/471: mknod db/d3e/d4a/d58/d86/d8b/d8d/d99/c9f 0 2023-12-16T07:40:38.712 INFO:tasks.workunit.client.1.smithi133.stdout:4/338: link d3/l49 d3/d7/d1c/d2a/l6c 0 2023-12-16T07:40:38.714 INFO:tasks.workunit.client.1.smithi133.stdout:4/339: mkdir d3/d7/d6d 0 2023-12-16T07:40:38.715 INFO:tasks.workunit.client.1.smithi133.stdout:6/405: dread d0/d4/d21/d35/d36/f46 [0,4194304] 0 2023-12-16T07:40:38.716 INFO:tasks.workunit.client.1.smithi133.stdout:5/166: dwrite d1/f7 [0,4194304] 0 2023-12-16T07:40:38.716 INFO:tasks.workunit.client.1.smithi133.stdout:4/340: rmdir d3/d7/d38 39 2023-12-16T07:40:38.716 INFO:tasks.workunit.client.1.smithi133.stdout:7/472: dread db/d12/d3a/d6c/f83 [0,4194304] 0 2023-12-16T07:40:38.720 INFO:tasks.workunit.client.1.smithi133.stdout:6/406: creat d0/d4/d21/d60/f89 x:0 0 0 2023-12-16T07:40:38.730 INFO:tasks.workunit.client.1.smithi133.stdout:6/407: dread d0/d4/f1c [0,4194304] 0 2023-12-16T07:40:38.730 INFO:tasks.workunit.client.1.smithi133.stdout:6/408: chown d0/d5e/l72 8469 1 2023-12-16T07:40:38.734 INFO:tasks.workunit.client.1.smithi133.stdout:4/341: dwrite d3/f51 [0,4194304] 0 2023-12-16T07:40:38.735 INFO:tasks.workunit.client.1.smithi133.stdout:7/473: dwrite db/d21/f37 [0,4194304] 0 2023-12-16T07:40:38.746 INFO:tasks.workunit.client.1.smithi133.stdout:6/409: dread d0/d4/f19 [0,4194304] 0 2023-12-16T07:40:38.746 INFO:tasks.workunit.client.1.smithi133.stdout:6/410: read d0/d4/d21/d35/f6c [2479114,93990] 0 2023-12-16T07:40:38.755 INFO:tasks.workunit.client.1.smithi133.stdout:7/474: dwrite db/d12/d3a/f7e [0,4194304] 0 2023-12-16T07:40:38.755 INFO:tasks.workunit.client.1.smithi133.stdout:7/475: chown db/d12/d3a/d6c/l88 429 1 2023-12-16T07:40:38.761 INFO:tasks.workunit.client.1.smithi133.stdout:6/411: dread d0/d4/d21/d35/f79 [0,4194304] 0 2023-12-16T07:40:38.761 INFO:tasks.workunit.client.1.smithi133.stdout:6/412: dread - d0/d4/d21/d60/f66 zero size 2023-12-16T07:40:38.762 INFO:tasks.workunit.client.1.smithi133.stdout:6/413: truncate d0/d4/d21/f2a 244654 0 2023-12-16T07:40:38.762 INFO:tasks.workunit.client.1.smithi133.stdout:4/342: dwrite d3/d7/f23 [0,4194304] 0 2023-12-16T07:40:38.772 INFO:tasks.workunit.client.1.smithi133.stdout:7/476: dwrite db/d12/f49 [0,4194304] 0 2023-12-16T07:40:38.772 INFO:tasks.workunit.client.1.smithi133.stdout:7/477: read - db/d21/d2c/d31/d6e/f97 zero size 2023-12-16T07:40:38.781 INFO:tasks.workunit.client.1.smithi133.stdout:6/414: mkdir d0/d4/d21/d8a 0 2023-12-16T07:40:38.785 INFO:tasks.workunit.client.1.smithi133.stdout:6/415: dread d0/d4/d21/f59 [0,4194304] 0 2023-12-16T07:40:38.786 INFO:tasks.workunit.client.1.smithi133.stdout:4/343: mkdir d3/d7/d1a/d6e 0 2023-12-16T07:40:38.791 INFO:tasks.workunit.client.1.smithi133.stdout:4/344: mknod d3/d7/d1a/c6f 0 2023-12-16T07:40:38.791 INFO:tasks.workunit.client.1.smithi133.stdout:7/478: dwrite db/d21/f25 [0,4194304] 0 2023-12-16T07:40:38.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/479: creat db/fa0 x:0 0 0 2023-12-16T07:40:38.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/480: truncate db/d3e/d4a/f91 806848 0 2023-12-16T07:40:38.801 INFO:tasks.workunit.client.1.smithi133.stdout:7/481: creat db/d3e/d4a/d58/d86/fa1 x:0 0 0 2023-12-16T07:40:38.801 INFO:tasks.workunit.client.1.smithi133.stdout:1/247: getdents d0/d12 0 2023-12-16T07:40:38.809 INFO:tasks.workunit.client.1.smithi133.stdout:6/416: dwrite d0/d4/d21/d35/d4e/d84/d69/d7c/f82 [0,4194304] 0 2023-12-16T07:40:38.812 INFO:tasks.workunit.client.1.smithi133.stdout:7/482: write f9 [5293,129545] 0 2023-12-16T07:40:38.813 INFO:tasks.workunit.client.1.smithi133.stdout:6/417: truncate d0/d4/d21/d35/f6c 674187 0 2023-12-16T07:40:38.814 INFO:tasks.workunit.client.1.smithi133.stdout:4/345: dwrite d3/d7/d38/d57/f5f [0,4194304] 0 2023-12-16T07:40:38.819 INFO:tasks.workunit.client.1.smithi133.stdout:6/418: rename d0/d4/d21/d35/d4e/d84/d69/d7c to d0/d5e/d75/d81/d8b 0 2023-12-16T07:40:38.820 INFO:tasks.workunit.client.1.smithi133.stdout:6/419: readlink d0/d4/d21/d35/d36/l3f 0 2023-12-16T07:40:38.826 INFO:tasks.workunit.client.1.smithi133.stdout:7/483: dread db/d21/d2c/d31/f35 [0,4194304] 0 2023-12-16T07:40:38.828 INFO:tasks.workunit.client.1.smithi133.stdout:4/346: getdents d3/d7/d38/d57/d67 0 2023-12-16T07:40:38.829 INFO:tasks.workunit.client.1.smithi133.stdout:6/420: mkdir d0/d5e/d8c 0 2023-12-16T07:40:38.831 INFO:tasks.workunit.client.1.smithi133.stdout:4/347: getdents d3 0 2023-12-16T07:40:38.834 INFO:tasks.workunit.client.1.smithi133.stdout:4/348: link d3/l49 d3/d7/d1c/l70 0 2023-12-16T07:40:38.838 INFO:tasks.workunit.client.1.smithi133.stdout:7/484: dread db/d21/f37 [0,4194304] 0 2023-12-16T07:40:38.839 INFO:tasks.workunit.client.1.smithi133.stdout:7/485: chown db/d21/d2c/d31/d6e/f97 1 1 2023-12-16T07:40:38.849 INFO:tasks.workunit.client.1.smithi133.stdout:7/486: getdents db 0 2023-12-16T07:40:38.849 INFO:tasks.workunit.client.1.smithi133.stdout:7/487: fdatasync db/d3e/f82 0 2023-12-16T07:40:38.854 INFO:tasks.workunit.client.1.smithi133.stdout:6/421: dwrite d0/d4/f5f [0,4194304] 0 2023-12-16T07:40:38.856 INFO:tasks.workunit.client.1.smithi133.stdout:7/488: creat db/d12/d98/fa2 x:0 0 0 2023-12-16T07:40:38.858 INFO:tasks.workunit.client.1.smithi133.stdout:7/489: dread db/d12/f5e [0,4194304] 0 2023-12-16T07:40:38.858 INFO:tasks.workunit.client.1.smithi133.stdout:7/490: chown db/d3e/d4a/f7c 144466 1 2023-12-16T07:40:38.858 INFO:tasks.workunit.client.1.smithi133.stdout:7/491: chown db/d3e/d4a/f60 2342 1 2023-12-16T07:40:38.859 INFO:tasks.workunit.client.1.smithi133.stdout:4/349: dwrite d3/f3b [0,4194304] 0 2023-12-16T07:40:38.859 INFO:tasks.workunit.client.1.smithi133.stdout:4/350: getdents d3/d7/d6d 0 2023-12-16T07:40:38.876 INFO:tasks.workunit.client.1.smithi133.stdout:6/422: dwrite d0/d4/d21/d35/d36/f50 [0,4194304] 0 2023-12-16T07:40:38.879 INFO:tasks.workunit.client.1.smithi133.stdout:4/351: symlink d3/d7/d38/l71 0 2023-12-16T07:40:38.879 INFO:tasks.workunit.client.1.smithi133.stdout:4/352: truncate d3/d7/d38/f5a 363261 0 2023-12-16T07:40:38.879 INFO:tasks.workunit.client.1.smithi133.stdout:7/492: mknod db/d21/d2c/ca3 0 2023-12-16T07:40:38.886 INFO:tasks.workunit.client.1.smithi133.stdout:7/493: creat db/d3e/d4a/d58/d86/fa4 x:0 0 0 2023-12-16T07:40:38.886 INFO:tasks.workunit.client.1.smithi133.stdout:7/494: chown db/d3e 103538 1 2023-12-16T07:40:38.886 INFO:tasks.workunit.client.1.smithi133.stdout:7/495: chown db/d3e 2516 1 2023-12-16T07:40:38.903 INFO:tasks.workunit.client.1.smithi133.stdout:6/423: dwrite d0/d5e/d75/d81/f86 [0,4194304] 0 2023-12-16T07:40:38.903 INFO:tasks.workunit.client.1.smithi133.stdout:7/496: dwrite db/d12/f71 [0,4194304] 0 2023-12-16T07:40:38.906 INFO:tasks.workunit.client.1.smithi133.stdout:7/497: mknod db/d21/d2c/d31/d59/ca5 0 2023-12-16T07:40:38.907 INFO:tasks.workunit.client.1.smithi133.stdout:6/424: dread d0/d4/d21/d35/d36/f46 [0,4194304] 0 2023-12-16T07:40:38.907 INFO:tasks.workunit.client.1.smithi133.stdout:6/425: dread - d0/d4/d21/d60/f66 zero size 2023-12-16T07:40:38.907 INFO:tasks.workunit.client.1.smithi133.stdout:7/498: mknod db/d21/ca6 0 2023-12-16T07:40:38.908 INFO:tasks.workunit.client.1.smithi133.stdout:7/499: chown db/d53/c89 13 1 2023-12-16T07:40:38.909 INFO:tasks.workunit.client.1.smithi133.stdout:4/353: truncate d3/d7/d38/f5a 159662 0 2023-12-16T07:40:38.910 INFO:tasks.workunit.client.1.smithi133.stdout:6/426: creat d0/d4/d21/f8d x:0 0 0 2023-12-16T07:40:38.911 INFO:tasks.workunit.client.1.smithi133.stdout:7/500: rename db/d21/d2c/d31/l66 to db/la7 0 2023-12-16T07:40:38.913 INFO:tasks.workunit.client.1.smithi133.stdout:4/354: mknod d3/d7/d1c/d2a/c72 0 2023-12-16T07:40:38.913 INFO:tasks.workunit.client.1.smithi133.stdout:4/355: fsync d3/fa 0 2023-12-16T07:40:38.915 INFO:tasks.workunit.client.1.smithi133.stdout:7/501: truncate db/d21/d2c/f48 6188 0 2023-12-16T07:40:38.916 INFO:tasks.workunit.client.1.smithi133.stdout:4/356: creat d3/d7/d1c/f73 x:0 0 0 2023-12-16T07:40:38.918 INFO:tasks.workunit.client.1.smithi133.stdout:7/502: getdents db/d3e/d4a/d58/d86/d8b/d8d/d99 0 2023-12-16T07:40:38.919 INFO:tasks.workunit.client.1.smithi133.stdout:4/357: mknod d3/d7/d1c/c74 0 2023-12-16T07:40:38.919 INFO:tasks.workunit.client.1.smithi133.stdout:7/503: write db/d21/f23 [3331025,120711] 0 2023-12-16T07:40:38.920 INFO:tasks.workunit.client.1.smithi133.stdout:4/358: mkdir d3/d7/d38/d57/d75 0 2023-12-16T07:40:38.920 INFO:tasks.workunit.client.1.smithi133.stdout:4/359: write d3/d7/d1a/f27 [806752,96002] 0 2023-12-16T07:40:38.922 INFO:tasks.workunit.client.1.smithi133.stdout:7/504: rmdir db/d21/d2c/d31 39 2023-12-16T07:40:38.924 INFO:tasks.workunit.client.1.smithi133.stdout:4/360: symlink d3/d7/l76 0 2023-12-16T07:40:38.924 INFO:tasks.workunit.client.1.smithi133.stdout:4/361: write d3/d7/d1c/f69 [276766,88536] 0 2023-12-16T07:40:38.924 INFO:tasks.workunit.client.1.smithi133.stdout:4/362: truncate d3/f5d 347391 0 2023-12-16T07:40:38.925 INFO:tasks.workunit.client.1.smithi133.stdout:7/505: truncate db/d12/f45 1308302 0 2023-12-16T07:40:38.925 INFO:tasks.workunit.client.1.smithi133.stdout:7/506: chown db/d3e/d4a/d58/d86/fa1 1026291 1 2023-12-16T07:40:38.926 INFO:tasks.workunit.client.1.smithi133.stdout:4/363: creat d3/d7/d44/f77 x:0 0 0 2023-12-16T07:40:38.926 INFO:tasks.workunit.client.1.smithi133.stdout:4/364: dread - d3/d7/d38/d45/f65 zero size 2023-12-16T07:40:38.928 INFO:tasks.workunit.client.1.smithi133.stdout:4/365: creat d3/d7/d44/f78 x:0 0 0 2023-12-16T07:40:38.928 INFO:tasks.workunit.client.1.smithi133.stdout:4/366: stat d3/d7 0 2023-12-16T07:40:38.928 INFO:tasks.workunit.client.1.smithi133.stdout:6/427: truncate d0/d5e/d75/d81/f86 1626096 0 2023-12-16T07:40:38.930 INFO:tasks.workunit.client.1.smithi133.stdout:7/507: dread db/d21/d2c/f50 [0,4194304] 0 2023-12-16T07:40:38.931 INFO:tasks.workunit.client.1.smithi133.stdout:6/428: mkdir d0/d5e/d75/d81/d8b/d8e 0 2023-12-16T07:40:38.937 INFO:tasks.workunit.client.1.smithi133.stdout:6/429: symlink d0/d5e/d75/d81/d8b/d8e/l8f 0 2023-12-16T07:40:38.940 INFO:tasks.workunit.client.1.smithi133.stdout:7/508: dread db/d21/d2c/d31/d59/f5a [0,4194304] 0 2023-12-16T07:40:38.957 INFO:tasks.workunit.client.1.smithi133.stdout:6/430: dwrite d0/d4/d21/d35/f79 [0,4194304] 0 2023-12-16T07:40:38.958 INFO:tasks.workunit.client.1.smithi133.stdout:6/431: unlink d0/d4/f19 0 2023-12-16T07:40:38.967 INFO:tasks.workunit.client.1.smithi133.stdout:7/509: dwrite db/d21/f23 [0,4194304] 0 2023-12-16T07:40:38.968 INFO:tasks.workunit.client.1.smithi133.stdout:6/432: dread d0/d4/d21/d35/f79 [0,4194304] 0 2023-12-16T07:40:38.976 INFO:tasks.workunit.client.1.smithi133.stdout:7/510: dread db/f22 [0,4194304] 0 2023-12-16T07:40:38.977 INFO:tasks.workunit.client.1.smithi133.stdout:7/511: mkdir db/d3e/d4a/d58/d86/da8 0 2023-12-16T07:40:38.978 INFO:tasks.workunit.client.1.smithi133.stdout:7/512: stat db/d3e/d4a/d58/d86/d8b/c92 0 2023-12-16T07:40:38.979 INFO:tasks.workunit.client.1.smithi133.stdout:7/513: chown db/d3e/d4a/d58/d86/d8b/f90 33977 1 2023-12-16T07:40:38.983 INFO:tasks.workunit.client.1.smithi133.stdout:6/433: dwrite d0/d5e/d75/f80 [0,4194304] 0 2023-12-16T07:40:38.988 INFO:tasks.workunit.client.1.smithi133.stdout:7/514: dread db/d21/f25 [0,4194304] 0 2023-12-16T07:40:38.989 INFO:tasks.workunit.client.1.smithi133.stdout:6/434: link d0/d4/d21/d60/c7a d0/d4/d21/c90 0 2023-12-16T07:40:38.992 INFO:tasks.workunit.client.1.smithi133.stdout:7/515: mkdir db/d3e/d4a/d58/d86/da9 0 2023-12-16T07:40:38.993 INFO:tasks.workunit.client.1.smithi133.stdout:7/516: getdents db/d12/d3a 0 2023-12-16T07:40:38.995 INFO:tasks.workunit.client.1.smithi133.stdout:7/517: creat db/d3e/faa x:0 0 0 2023-12-16T07:40:38.997 INFO:tasks.workunit.client.1.smithi133.stdout:7/518: dread db/d21/d2c/d31/f36 [0,4194304] 0 2023-12-16T07:40:38.999 INFO:tasks.workunit.client.1.smithi133.stdout:7/519: getdents db/d3e/d4a/d58 0 2023-12-16T07:40:39.003 INFO:tasks.workunit.client.1.smithi133.stdout:7/520: creat db/d21/d2c/d31/fab x:0 0 0 2023-12-16T07:40:39.003 INFO:tasks.workunit.client.1.smithi133.stdout:7/521: fsync db/d3e/f40 0 2023-12-16T07:40:39.003 INFO:tasks.workunit.client.1.smithi133.stdout:7/522: chown db/f8c 6 1 2023-12-16T07:40:39.003 INFO:tasks.workunit.client.1.smithi133.stdout:7/523: symlink db/d21/d2c/d31/lac 0 2023-12-16T07:40:39.004 INFO:tasks.workunit.client.1.smithi133.stdout:6/435: dwrite d0/d4/f47 [0,4194304] 0 2023-12-16T07:40:39.004 INFO:tasks.workunit.client.1.smithi133.stdout:6/436: chown d0/d4/d21/d35/d4e/d84/c4b 46303076 1 2023-12-16T07:40:39.004 INFO:tasks.workunit.client.1.smithi133.stdout:6/437: fdatasync d0/d5e/f6f 0 2023-12-16T07:40:39.005 INFO:tasks.workunit.client.1.smithi133.stdout:7/524: mkdir db/d21/d2c/d31/d6e/dad 0 2023-12-16T07:40:39.005 INFO:tasks.workunit.client.1.smithi133.stdout:7/525: stat db/f33 0 2023-12-16T07:40:39.006 INFO:tasks.workunit.client.1.smithi133.stdout:6/438: mknod d0/d4/d21/d8a/c91 0 2023-12-16T07:40:39.007 INFO:tasks.workunit.client.1.smithi133.stdout:7/526: mknod db/d3e/d4a/d58/d86/d8b/cae 0 2023-12-16T07:40:39.010 INFO:tasks.workunit.client.1.smithi133.stdout:6/439: symlink d0/d4/d21/d35/d7e/l92 0 2023-12-16T07:40:39.014 INFO:tasks.workunit.client.1.smithi133.stdout:2/136: sync 2023-12-16T07:40:39.014 INFO:tasks.workunit.client.1.smithi133.stdout:9/238: sync 2023-12-16T07:40:39.014 INFO:tasks.workunit.client.1.smithi133.stdout:9/239: chown ca 794 1 2023-12-16T07:40:39.014 INFO:tasks.workunit.client.1.smithi133.stdout:9/240: dread - d15/d18/d2c/d3a/f49 zero size 2023-12-16T07:40:39.014 INFO:tasks.workunit.client.1.smithi133.stdout:6/440: rename d0/d5e/d75/d81/d8b to d0/d4/d21/d8a/d93 0 2023-12-16T07:40:39.015 INFO:tasks.workunit.client.1.smithi133.stdout:9/241: write d15/f26 [1623337,12792] 0 2023-12-16T07:40:39.015 INFO:tasks.workunit.client.1.smithi133.stdout:9/242: write d15/d18/f24 [2453046,103364] 0 2023-12-16T07:40:39.019 INFO:tasks.workunit.client.1.smithi133.stdout:2/137: mknod da/d15/d1b/c28 0 2023-12-16T07:40:39.019 INFO:tasks.workunit.client.1.smithi133.stdout:2/138: stat f4 0 2023-12-16T07:40:39.020 INFO:tasks.workunit.client.1.smithi133.stdout:6/441: mknod d0/d4/c94 0 2023-12-16T07:40:39.021 INFO:tasks.workunit.client.1.smithi133.stdout:9/243: truncate f9 3697899 0 2023-12-16T07:40:39.022 INFO:tasks.workunit.client.1.smithi133.stdout:2/139: truncate f1 98713 0 2023-12-16T07:40:39.022 INFO:tasks.workunit.client.1.smithi133.stdout:2/140: chown da/d15/d17/f1a 442900870 1 2023-12-16T07:40:39.023 INFO:tasks.workunit.client.1.smithi133.stdout:6/442: unlink d0/d4/f5f 0 2023-12-16T07:40:39.024 INFO:tasks.workunit.client.1.smithi133.stdout:9/244: rmdir d15/d18/d2c 39 2023-12-16T07:40:39.026 INFO:tasks.workunit.client.1.smithi133.stdout:2/141: getdents da/d15 0 2023-12-16T07:40:39.028 INFO:tasks.workunit.client.1.smithi133.stdout:6/443: creat d0/d4/d21/d35/f95 x:0 0 0 2023-12-16T07:40:39.029 INFO:tasks.workunit.client.1.smithi133.stdout:9/245: unlink d15/d18/l28 0 2023-12-16T07:40:39.030 INFO:tasks.workunit.client.1.smithi133.stdout:9/246: dread - d15/d18/f41 zero size 2023-12-16T07:40:39.031 INFO:tasks.workunit.client.1.smithi133.stdout:2/142: unlink f9 0 2023-12-16T07:40:39.033 INFO:tasks.workunit.client.1.smithi133.stdout:6/444: rename d0/d4/d21/d35/d7e/l92 to d0/d4/d21/d35/d4e/l96 0 2023-12-16T07:40:39.037 INFO:tasks.workunit.client.1.smithi133.stdout:8/212: sync 2023-12-16T07:40:39.038 INFO:tasks.workunit.client.1.smithi133.stdout:3/195: sync 2023-12-16T07:40:39.038 INFO:tasks.workunit.client.1.smithi133.stdout:5/167: sync 2023-12-16T07:40:39.038 INFO:tasks.workunit.client.1.smithi133.stdout:8/213: fsync d9/f21 0 2023-12-16T07:40:39.038 INFO:tasks.workunit.client.1.smithi133.stdout:5/168: chown d1/ca 128957527 1 2023-12-16T07:40:39.038 INFO:tasks.workunit.client.1.smithi133.stdout:5/169: read - d1/f1f zero size 2023-12-16T07:40:39.038 INFO:tasks.workunit.client.1.smithi133.stdout:5/170: chown d1/d18/l33 3 1 2023-12-16T07:40:39.038 INFO:tasks.workunit.client.1.smithi133.stdout:9/247: rename d15/d18/d2c/d3a/f45 to d15/d18/f4e 0 2023-12-16T07:40:39.039 INFO:tasks.workunit.client.1.smithi133.stdout:6/445: creat d0/d5e/d8c/f97 x:0 0 0 2023-12-16T07:40:39.048 INFO:tasks.workunit.client.1.smithi133.stdout:3/196: creat d7/d8/f54 x:0 0 0 2023-12-16T07:40:39.050 INFO:tasks.workunit.client.1.smithi133.stdout:8/214: creat d9/d2d/f40 x:0 0 0 2023-12-16T07:40:39.050 INFO:tasks.workunit.client.1.smithi133.stdout:8/215: readlink l7 0 2023-12-16T07:40:39.050 INFO:tasks.workunit.client.1.smithi133.stdout:8/216: chown d9/d11/f38 6956 1 2023-12-16T07:40:39.053 INFO:tasks.workunit.client.1.smithi133.stdout:6/446: dwrite d0/d5e/d8c/f97 [0,4194304] 0 2023-12-16T07:40:39.053 INFO:tasks.workunit.client.1.smithi133.stdout:5/171: link d1/f34 d1/d18/d2c/f39 0 2023-12-16T07:40:39.053 INFO:tasks.workunit.client.1.smithi133.stdout:5/172: fdatasync d1/de/f23 0 2023-12-16T07:40:39.053 INFO:tasks.workunit.client.1.smithi133.stdout:5/173: stat d1/f1a 0 2023-12-16T07:40:39.053 INFO:tasks.workunit.client.1.smithi133.stdout:5/174: chown d1/f10 12303461 1 2023-12-16T07:40:39.056 INFO:tasks.workunit.client.1.smithi133.stdout:2/143: rename da/d15/d17/f1a to da/d1d/f29 0 2023-12-16T07:40:39.057 INFO:tasks.workunit.client.1.smithi133.stdout:2/144: write da/d15/d17/f18 [215321,2471] 0 2023-12-16T07:40:39.058 INFO:tasks.workunit.client.1.smithi133.stdout:9/248: link d15/c1a d15/c4f 0 2023-12-16T07:40:39.061 INFO:tasks.workunit.client.1.smithi133.stdout:3/197: link d7/d8/c49 d7/c55 0 2023-12-16T07:40:39.064 INFO:tasks.workunit.client.1.smithi133.stdout:2/145: dread da/d1d/f29 [0,4194304] 0 2023-12-16T07:40:39.065 INFO:tasks.workunit.client.1.smithi133.stdout:8/217: link d9/d10/f1b d9/f41 0 2023-12-16T07:40:39.071 INFO:tasks.workunit.client.1.smithi133.stdout:3/198: dread d7/d8/d1c/d2e/f34 [0,4194304] 0 2023-12-16T07:40:39.073 INFO:tasks.workunit.client.1.smithi133.stdout:6/447: rename d0/d4/d21/f3c to d0/d4/d21/f98 0 2023-12-16T07:40:39.073 INFO:tasks.workunit.client.1.smithi133.stdout:6/448: chown d0/d4/l14 1 1 2023-12-16T07:40:39.073 INFO:tasks.workunit.client.1.smithi133.stdout:6/449: fsync d0/d4/d21/f4c 0 2023-12-16T07:40:39.076 INFO:tasks.workunit.client.1.smithi133.stdout:5/175: rmdir d1 39 2023-12-16T07:40:39.078 INFO:tasks.workunit.client.1.smithi133.stdout:5/176: dread d1/f17 [0,4194304] 0 2023-12-16T07:40:39.078 INFO:tasks.workunit.client.1.smithi133.stdout:5/177: fdatasync d1/fb 0 2023-12-16T07:40:39.078 INFO:tasks.workunit.client.1.smithi133.stdout:5/178: rename d1/d16 to d1/d16/d3a 22 2023-12-16T07:40:39.079 INFO:tasks.workunit.client.1.smithi133.stdout:9/249: mkdir d15/d18/d2c/d3a/d50 0 2023-12-16T07:40:39.082 INFO:tasks.workunit.client.1.smithi133.stdout:2/146: rename da/d1d/d24/l26 to da/d1d/d24/l2a 0 2023-12-16T07:40:39.084 INFO:tasks.workunit.client.1.smithi133.stdout:3/199: mkdir d7/d8/d1d/d2a/d56 0 2023-12-16T07:40:39.085 INFO:tasks.workunit.client.1.smithi133.stdout:3/200: chown d7/d8/c9 130790186 1 2023-12-16T07:40:39.086 INFO:tasks.workunit.client.1.smithi133.stdout:6/450: mkdir d0/d5e/d75/d81/d99 0 2023-12-16T07:40:39.087 INFO:tasks.workunit.client.1.smithi133.stdout:5/179: creat d1/d1c/f3b x:0 0 0 2023-12-16T07:40:39.089 INFO:tasks.workunit.client.1.smithi133.stdout:0/226: sync 2023-12-16T07:40:39.089 INFO:tasks.workunit.client.1.smithi133.stdout:9/250: creat d15/d18/d4d/f51 x:0 0 0 2023-12-16T07:40:39.091 INFO:tasks.workunit.client.1.smithi133.stdout:2/147: rmdir da/d15/d17 39 2023-12-16T07:40:39.092 INFO:tasks.workunit.client.1.smithi133.stdout:0/227: write d2/d9/d20/f29 [3328026,24393] 0 2023-12-16T07:40:39.092 INFO:tasks.workunit.client.1.smithi133.stdout:8/218: mkdir d9/d11/d42 0 2023-12-16T07:40:39.092 INFO:tasks.workunit.client.1.smithi133.stdout:0/228: write d2/d9/d12/d35/d48/f3d [8925494,108429] 0 2023-12-16T07:40:39.092 INFO:tasks.workunit.client.1.smithi133.stdout:0/229: dread - d2/d9/d12/f3f zero size 2023-12-16T07:40:39.094 INFO:tasks.workunit.client.1.smithi133.stdout:3/201: creat d7/d8/d1d/f57 x:0 0 0 2023-12-16T07:40:39.094 INFO:tasks.workunit.client.1.smithi133.stdout:3/202: truncate d7/f47 1010068 0 2023-12-16T07:40:39.094 INFO:tasks.workunit.client.1.smithi133.stdout:3/203: write d7/d8/d1c/f4b [160252,32159] 0 2023-12-16T07:40:39.095 INFO:tasks.workunit.client.1.smithi133.stdout:9/251: symlink d15/d18/d2c/l52 0 2023-12-16T07:40:39.097 INFO:tasks.workunit.client.1.smithi133.stdout:2/148: mknod da/d1d/d24/c2b 0 2023-12-16T07:40:39.098 INFO:tasks.workunit.client.1.smithi133.stdout:8/219: symlink d9/d11/d33/l43 0 2023-12-16T07:40:39.100 INFO:tasks.workunit.client.1.smithi133.stdout:9/252: symlink d15/d18/d2c/d3a/l53 0 2023-12-16T07:40:39.101 INFO:tasks.workunit.client.1.smithi133.stdout:2/149: dread da/d1d/f29 [0,4194304] 0 2023-12-16T07:40:39.101 INFO:tasks.workunit.client.1.smithi133.stdout:6/451: dwrite d0/d5e/f6f [0,4194304] 0 2023-12-16T07:40:39.102 INFO:tasks.workunit.client.1.smithi133.stdout:6/452: fsync d0/f18 0 2023-12-16T07:40:39.102 INFO:tasks.workunit.client.1.smithi133.stdout:3/204: dread d7/d8/f20 [0,4194304] 0 2023-12-16T07:40:39.102 INFO:tasks.workunit.client.1.smithi133.stdout:3/205: fsync d7/d8/d1c/f50 0 2023-12-16T07:40:39.102 INFO:tasks.workunit.client.1.smithi133.stdout:8/220: unlink d9/d10/d39/c3b 0 2023-12-16T07:40:39.103 INFO:tasks.workunit.client.1.smithi133.stdout:2/150: dread da/f23 [0,4194304] 0 2023-12-16T07:40:39.103 INFO:tasks.workunit.client.1.smithi133.stdout:9/253: link f0 d15/d18/f54 0 2023-12-16T07:40:39.107 INFO:tasks.workunit.client.1.smithi133.stdout:6/453: truncate d0/d4/d21/f59 403032 0 2023-12-16T07:40:39.108 INFO:tasks.workunit.client.1.smithi133.stdout:0/230: dwrite d2/d17/f26 [0,4194304] 0 2023-12-16T07:40:39.109 INFO:tasks.workunit.client.1.smithi133.stdout:3/206: rmdir d7/d8/d1d/d2a/d56 0 2023-12-16T07:40:39.111 INFO:tasks.workunit.client.1.smithi133.stdout:8/221: mkdir d9/d11/d1a/d44 0 2023-12-16T07:40:39.111 INFO:tasks.workunit.client.1.smithi133.stdout:8/222: dread - d9/dc/d27/f28 zero size 2023-12-16T07:40:39.112 INFO:tasks.workunit.client.1.smithi133.stdout:2/151: dread f3 [0,4194304] 0 2023-12-16T07:40:39.114 INFO:tasks.workunit.client.1.smithi133.stdout:9/254: rename d15/d18/l2a to d15/l55 0 2023-12-16T07:40:39.115 INFO:tasks.workunit.client.1.smithi133.stdout:9/255: dread - d15/d18/d2c/f4c zero size 2023-12-16T07:40:39.118 INFO:tasks.workunit.client.1.smithi133.stdout:0/231: unlink d2/d17/d2b/d31/d36/l39 0 2023-12-16T07:40:39.118 INFO:tasks.workunit.client.1.smithi133.stdout:3/207: dread d7/d8/f10 [0,4194304] 0 2023-12-16T07:40:39.119 INFO:tasks.workunit.client.1.smithi133.stdout:8/223: creat d9/d10/f45 x:0 0 0 2023-12-16T07:40:39.122 INFO:tasks.workunit.client.1.smithi133.stdout:2/152: link da/d15/d17/f18 da/f2c 0 2023-12-16T07:40:39.122 INFO:tasks.workunit.client.1.smithi133.stdout:2/153: truncate da/fe 421649 0 2023-12-16T07:40:39.122 INFO:tasks.workunit.client.1.smithi133.stdout:2/154: stat da/f2c 0 2023-12-16T07:40:39.122 INFO:tasks.workunit.client.1.smithi133.stdout:9/256: creat d15/d18/d4d/f56 x:0 0 0 2023-12-16T07:40:39.122 INFO:tasks.workunit.client.1.smithi133.stdout:6/454: write d0/d4/d21/f59 [133298,98660] 0 2023-12-16T07:40:39.123 INFO:tasks.workunit.client.1.smithi133.stdout:0/232: stat d2/d9/d20/l41 0 2023-12-16T07:40:39.125 INFO:tasks.workunit.client.1.smithi133.stdout:3/208: truncate d7/d8/d1c/f31 735628 0 2023-12-16T07:40:39.126 INFO:tasks.workunit.client.1.smithi133.stdout:8/224: creat d9/d11/d1a/d44/f46 x:0 0 0 2023-12-16T07:40:39.126 INFO:tasks.workunit.client.1.smithi133.stdout:8/225: getdents d9/d3f 0 2023-12-16T07:40:39.127 INFO:tasks.workunit.client.1.smithi133.stdout:2/155: creat da/d15/d17/f2d x:0 0 0 2023-12-16T07:40:39.128 INFO:tasks.workunit.client.1.smithi133.stdout:0/233: truncate d2/d9/db/f15 1510178 0 2023-12-16T07:40:39.128 INFO:tasks.workunit.client.1.smithi133.stdout:0/234: chown d2/d9/c11 6 1 2023-12-16T07:40:39.128 INFO:tasks.workunit.client.1.smithi133.stdout:0/235: write d2/d9/db/fe [2085178,94897] 0 2023-12-16T07:40:39.129 INFO:tasks.workunit.client.1.smithi133.stdout:0/236: truncate d2/d9/d12/f3f 270645 0 2023-12-16T07:40:39.129 INFO:tasks.workunit.client.1.smithi133.stdout:0/237: read - d2/d9/f47 zero size 2023-12-16T07:40:39.129 INFO:tasks.workunit.client.1.smithi133.stdout:3/209: creat d7/d8/f58 x:0 0 0 2023-12-16T07:40:39.129 INFO:tasks.workunit.client.1.smithi133.stdout:3/210: fsync d7/d8/fa 0 2023-12-16T07:40:39.129 INFO:tasks.workunit.client.1.smithi133.stdout:3/211: write d7/d8/f20 [1536790,27999] 0 2023-12-16T07:40:39.130 INFO:tasks.workunit.client.1.smithi133.stdout:8/226: symlink d9/d3f/l47 0 2023-12-16T07:40:39.131 INFO:tasks.workunit.client.1.smithi133.stdout:2/156: dread da/d1d/f20 [0,4194304] 0 2023-12-16T07:40:39.131 INFO:tasks.workunit.client.1.smithi133.stdout:0/238: mknod d2/d17/c4a 0 2023-12-16T07:40:39.131 INFO:tasks.workunit.client.1.smithi133.stdout:0/239: truncate d2/d9/d20/f44 1036052 0 2023-12-16T07:40:39.131 INFO:tasks.workunit.client.1.smithi133.stdout:6/455: dread d0/d4/d21/f98 [0,4194304] 0 2023-12-16T07:40:39.133 INFO:tasks.workunit.client.1.smithi133.stdout:0/240: truncate d2/d9/d20/f2c 4326002 0 2023-12-16T07:40:39.135 INFO:tasks.workunit.client.1.smithi133.stdout:6/456: symlink d0/d4/d21/d35/d7e/l9a 0 2023-12-16T07:40:39.135 INFO:tasks.workunit.client.1.smithi133.stdout:6/457: readlink d0/d4/d21/d35/d4e/d84/l71 0 2023-12-16T07:40:39.137 INFO:tasks.workunit.client.1.smithi133.stdout:0/241: creat d2/d17/d2b/f4b x:0 0 0 2023-12-16T07:40:39.139 INFO:tasks.workunit.client.1.smithi133.stdout:6/458: mkdir d0/d4/d21/d60/d9b 0 2023-12-16T07:40:39.144 INFO:tasks.workunit.client.1.smithi133.stdout:0/242: mkdir d2/d9/d4c 0 2023-12-16T07:40:39.146 INFO:tasks.workunit.client.1.smithi133.stdout:6/459: creat d0/d4/d21/d8a/d93/d8e/f9c x:0 0 0 2023-12-16T07:40:39.146 INFO:tasks.workunit.client.1.smithi133.stdout:6/460: chown d0/d4/f68 95289 1 2023-12-16T07:40:39.149 INFO:tasks.workunit.client.1.smithi133.stdout:2/157: dwrite da/d15/d17/f2d [0,4194304] 0 2023-12-16T07:40:39.149 INFO:tasks.workunit.client.1.smithi133.stdout:9/257: dwrite f14 [0,4194304] 0 2023-12-16T07:40:39.151 INFO:tasks.workunit.client.1.smithi133.stdout:6/461: creat d0/d4/d21/d60/f9d x:0 0 0 2023-12-16T07:40:39.153 INFO:tasks.workunit.client.1.smithi133.stdout:8/227: rename d9/d11/d1a to d9/d10/d39/d48 0 2023-12-16T07:40:39.161 INFO:tasks.workunit.client.1.smithi133.stdout:9/258: truncate fc 460591 0 2023-12-16T07:40:39.161 INFO:tasks.workunit.client.1.smithi133.stdout:9/259: write fd [1276390,46018] 0 2023-12-16T07:40:39.161 INFO:tasks.workunit.client.1.smithi133.stdout:9/260: chown d15/d18/c22 39 1 2023-12-16T07:40:39.162 INFO:tasks.workunit.client.1.smithi133.stdout:9/261: readlink l5 0 2023-12-16T07:40:39.162 INFO:tasks.workunit.client.1.smithi133.stdout:0/243: dread d2/d9/d12/f3f [0,4194304] 0 2023-12-16T07:40:39.162 INFO:tasks.workunit.client.1.smithi133.stdout:0/244: write d2/d9/db/f15 [2089333,69463] 0 2023-12-16T07:40:39.163 INFO:tasks.workunit.client.1.smithi133.stdout:6/462: mknod d0/d4/d21/d8a/d93/d8e/c9e 0 2023-12-16T07:40:39.165 INFO:tasks.workunit.client.1.smithi133.stdout:8/228: mknod d9/d2d/c49 0 2023-12-16T07:40:39.169 INFO:tasks.workunit.client.1.smithi133.stdout:0/245: dread d2/d9/d12/f14 [0,4194304] 0 2023-12-16T07:40:39.170 INFO:tasks.workunit.client.1.smithi133.stdout:0/246: mkdir d2/d17/d2b/d31/d4d 0 2023-12-16T07:40:39.171 INFO:tasks.workunit.client.1.smithi133.stdout:8/229: write d9/d11/f1f [8066925,77727] 0 2023-12-16T07:40:39.171 INFO:tasks.workunit.client.1.smithi133.stdout:2/158: dwrite f3 [0,4194304] 0 2023-12-16T07:40:39.171 INFO:tasks.workunit.client.1.smithi133.stdout:9/262: dread d15/d18/d2c/f30 [0,4194304] 0 2023-12-16T07:40:39.172 INFO:tasks.workunit.client.1.smithi133.stdout:9/263: fdatasync d15/f26 0 2023-12-16T07:40:39.173 INFO:tasks.workunit.client.1.smithi133.stdout:0/247: rename d2/l24 to d2/d9/d4c/l4e 0 2023-12-16T07:40:39.175 INFO:tasks.workunit.client.1.smithi133.stdout:8/230: unlink d9/f21 0 2023-12-16T07:40:39.175 INFO:tasks.workunit.client.1.smithi133.stdout:8/231: dread - d9/dc/f3c zero size 2023-12-16T07:40:39.178 INFO:tasks.workunit.client.1.smithi133.stdout:2/159: mkdir da/d1d/d24/d2e 0 2023-12-16T07:40:39.179 INFO:tasks.workunit.client.1.smithi133.stdout:9/264: getdents d15/d18/d2c 0 2023-12-16T07:40:39.179 INFO:tasks.workunit.client.1.smithi133.stdout:9/265: chown d15/d18/d2c/f3d 18 1 2023-12-16T07:40:39.182 INFO:tasks.workunit.client.1.smithi133.stdout:8/232: creat d9/d10/d39/d48/f4a x:0 0 0 2023-12-16T07:40:39.182 INFO:tasks.workunit.client.1.smithi133.stdout:8/233: dread - d9/f3e zero size 2023-12-16T07:40:39.182 INFO:tasks.workunit.client.1.smithi133.stdout:2/160: creat da/d1d/f2f x:0 0 0 2023-12-16T07:40:39.182 INFO:tasks.workunit.client.1.smithi133.stdout:0/248: dread d2/d9/db/f15 [0,4194304] 0 2023-12-16T07:40:39.183 INFO:tasks.workunit.client.1.smithi133.stdout:6/463: dwrite d0/d4/f11 [0,4194304] 0 2023-12-16T07:40:39.184 INFO:tasks.workunit.client.1.smithi133.stdout:6/464: write d0/d4/f28 [711599,45693] 0 2023-12-16T07:40:39.184 INFO:tasks.workunit.client.1.smithi133.stdout:8/234: mknod d9/d10/d39/c4b 0 2023-12-16T07:40:39.185 INFO:tasks.workunit.client.1.smithi133.stdout:8/235: rename d9/f31 to d9/dc/f4c 0 2023-12-16T07:40:39.187 INFO:tasks.workunit.client.1.smithi133.stdout:8/236: creat d9/d11/d42/f4d x:0 0 0 2023-12-16T07:40:39.198 INFO:tasks.workunit.client.1.smithi133.stdout:0/249: dread d2/f1d [0,4194304] 0 2023-12-16T07:40:39.206 INFO:tasks.workunit.client.1.smithi133.stdout:9/266: dwrite d15/d18/d2c/f33 [0,4194304] 0 2023-12-16T07:40:39.209 INFO:tasks.workunit.client.1.smithi133.stdout:0/250: dread d2/d17/f2e [0,4194304] 0 2023-12-16T07:40:39.209 INFO:tasks.workunit.client.1.smithi133.stdout:0/251: write d2/d9/d20/f44 [1554206,117014] 0 2023-12-16T07:40:39.211 INFO:tasks.workunit.client.1.smithi133.stdout:9/267: creat d15/d42/f57 x:0 0 0 2023-12-16T07:40:39.212 INFO:tasks.workunit.client.1.smithi133.stdout:8/237: dwrite d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:39.212 INFO:tasks.workunit.client.1.smithi133.stdout:0/252: mkdir d2/d9/d12/d35/d4f 0 2023-12-16T07:40:39.212 INFO:tasks.workunit.client.1.smithi133.stdout:9/268: write d15/d18/f1d [4181341,26307] 0 2023-12-16T07:40:39.213 INFO:tasks.workunit.client.1.smithi133.stdout:6/465: dwrite d0/d4/d21/d8a/d93/d8e/f9c [0,4194304] 0 2023-12-16T07:40:39.213 INFO:tasks.workunit.client.1.smithi133.stdout:6/466: read d0/d4/f1c [761130,37341] 0 2023-12-16T07:40:39.216 INFO:tasks.workunit.client.1.smithi133.stdout:9/269: dread fc [0,4194304] 0 2023-12-16T07:40:39.216 INFO:tasks.workunit.client.1.smithi133.stdout:8/238: mknod d9/d10/d39/d48/d44/c4e 0 2023-12-16T07:40:39.216 INFO:tasks.workunit.client.1.smithi133.stdout:8/239: chown d9/d11/d33/l43 5 1 2023-12-16T07:40:39.217 INFO:tasks.workunit.client.1.smithi133.stdout:2/161: dwrite f3 [4194304,4194304] 0 2023-12-16T07:40:39.217 INFO:tasks.workunit.client.1.smithi133.stdout:0/253: mkdir d2/d9/d12/d35/d4f/d50 0 2023-12-16T07:40:39.218 INFO:tasks.workunit.client.1.smithi133.stdout:0/254: read d2/d17/f1b [3950300,23327] 0 2023-12-16T07:40:39.222 INFO:tasks.workunit.client.1.smithi133.stdout:0/255: read d2/d17/f26 [3915046,36088] 0 2023-12-16T07:40:39.223 INFO:tasks.workunit.client.1.smithi133.stdout:6/467: creat d0/d4/d21/d35/d36/f9f x:0 0 0 2023-12-16T07:40:39.224 INFO:tasks.workunit.client.1.smithi133.stdout:9/270: symlink d15/l58 0 2023-12-16T07:40:39.231 INFO:tasks.workunit.client.1.smithi133.stdout:2/162: dwrite da/d1d/f25 [0,4194304] 0 2023-12-16T07:40:39.231 INFO:tasks.workunit.client.1.smithi133.stdout:2/163: fdatasync da/f23 0 2023-12-16T07:40:39.250 INFO:tasks.workunit.client.1.smithi133.stdout:8/240: creat d9/dc/d27/f4f x:0 0 0 2023-12-16T07:40:39.269 INFO:tasks.workunit.client.1.smithi133.stdout:0/256: symlink d2/l51 0 2023-12-16T07:40:39.270 INFO:tasks.workunit.client.1.smithi133.stdout:0/257: write d2/d17/f2e [4180791,90318] 0 2023-12-16T07:40:39.270 INFO:tasks.workunit.client.1.smithi133.stdout:0/258: fdatasync d2/f8 0 2023-12-16T07:40:39.270 INFO:tasks.workunit.client.1.smithi133.stdout:0/259: stat d2/d9/db/c2a 0 2023-12-16T07:40:39.272 INFO:tasks.workunit.client.1.smithi133.stdout:6/468: unlink d0/d4/d21/f8d 0 2023-12-16T07:40:39.273 INFO:tasks.workunit.client.1.smithi133.stdout:9/271: unlink fb 0 2023-12-16T07:40:39.276 INFO:tasks.workunit.client.1.smithi133.stdout:2/164: symlink da/d15/d1b/l30 0 2023-12-16T07:40:39.276 INFO:tasks.workunit.client.1.smithi133.stdout:8/241: symlink d9/d11/d33/l50 0 2023-12-16T07:40:39.280 INFO:tasks.workunit.client.1.smithi133.stdout:2/165: dread da/d1d/f29 [0,4194304] 0 2023-12-16T07:40:39.280 INFO:tasks.workunit.client.1.smithi133.stdout:2/166: readlink da/l1c 0 2023-12-16T07:40:39.282 INFO:tasks.workunit.client.1.smithi133.stdout:0/260: link d2/d9/d20/l41 d2/d9/d12/d35/l52 0 2023-12-16T07:40:39.283 INFO:tasks.workunit.client.1.smithi133.stdout:6/469: getdents d0/d4/d21/d35/d7e 0 2023-12-16T07:40:39.283 INFO:tasks.workunit.client.1.smithi133.stdout:6/470: write d0/d4/d21/d35/d36/f45 [1245658,29139] 0 2023-12-16T07:40:39.291 INFO:tasks.workunit.client.1.smithi133.stdout:8/242: dwrite d9/d11/d42/f4d [0,4194304] 0 2023-12-16T07:40:39.297 INFO:tasks.workunit.client.1.smithi133.stdout:9/272: symlink d15/d18/d2c/d3a/l59 0 2023-12-16T07:40:39.300 INFO:tasks.workunit.client.1.smithi133.stdout:9/273: dread d15/d18/d2c/f2e [0,4194304] 0 2023-12-16T07:40:39.355 INFO:tasks.workunit.client.1.smithi133.stdout:1/248: sync 2023-12-16T07:40:39.355 INFO:tasks.workunit.client.1.smithi133.stdout:1/249: chown d0/da/db/l15 30 1 2023-12-16T07:40:39.355 INFO:tasks.workunit.client.1.smithi133.stdout:0/261: getdents d2/d9/d12/d35/d4f 0 2023-12-16T07:40:39.355 INFO:tasks.workunit.client.1.smithi133.stdout:0/262: write d2/f38 [5138491,16040] 0 2023-12-16T07:40:39.355 INFO:tasks.workunit.client.1.smithi133.stdout:0/263: fdatasync d2/d9/d12/f14 0 2023-12-16T07:40:39.356 INFO:tasks.workunit.client.1.smithi133.stdout:6/471: creat d0/d4/d21/d8a/d93/fa0 x:0 0 0 2023-12-16T07:40:39.357 INFO:tasks.workunit.client.1.smithi133.stdout:6/472: write d0/d5e/d75/f80 [3778588,13268] 0 2023-12-16T07:40:39.361 INFO:tasks.workunit.client.1.smithi133.stdout:8/243: creat d9/d10/d39/d48/f51 x:0 0 0 2023-12-16T07:40:39.368 INFO:tasks.workunit.client.1.smithi133.stdout:1/250: mknod d0/d12/c52 0 2023-12-16T07:40:39.369 INFO:tasks.workunit.client.1.smithi133.stdout:0/264: rmdir d2/d9/db/d43 0 2023-12-16T07:40:39.371 INFO:tasks.workunit.client.1.smithi133.stdout:6/473: unlink d0/ce 0 2023-12-16T07:40:39.372 INFO:tasks.workunit.client.1.smithi133.stdout:0/265: truncate d2/d9/d12/f14 40465 0 2023-12-16T07:40:39.375 INFO:tasks.workunit.client.1.smithi133.stdout:8/244: dwrite d9/dc/d27/f2b [0,4194304] 0 2023-12-16T07:40:39.375 INFO:tasks.workunit.client.1.smithi133.stdout:8/245: write d9/dc/f3c [4562762,121729] 0 2023-12-16T07:40:39.375 INFO:tasks.workunit.client.1.smithi133.stdout:6/474: mkdir d0/d4/d21/d35/d4e/d84/d69/da1 0 2023-12-16T07:40:39.375 INFO:tasks.workunit.client.1.smithi133.stdout:6/475: chown d0/d4/c26 4547366 1 2023-12-16T07:40:39.376 INFO:tasks.workunit.client.1.smithi133.stdout:9/274: getdents d15/d18/d2c/d3a 0 2023-12-16T07:40:39.378 INFO:tasks.workunit.client.1.smithi133.stdout:0/266: creat d2/d17/d2b/d31/d4d/f53 x:0 0 0 2023-12-16T07:40:39.385 INFO:tasks.workunit.client.1.smithi133.stdout:6/476: rmdir d0/d4/d21/d60/d9b 0 2023-12-16T07:40:39.389 INFO:tasks.workunit.client.1.smithi133.stdout:8/246: mkdir d9/d11/d52 0 2023-12-16T07:40:39.390 INFO:tasks.workunit.client.1.smithi133.stdout:9/275: dread f14 [0,4194304] 0 2023-12-16T07:40:39.390 INFO:tasks.workunit.client.1.smithi133.stdout:1/251: dwrite d0/f29 [0,4194304] 0 2023-12-16T07:40:39.394 INFO:tasks.workunit.client.1.smithi133.stdout:8/247: write d9/dc/f3c [2346590,59296] 0 2023-12-16T07:40:39.394 INFO:tasks.workunit.client.1.smithi133.stdout:8/248: chown d9/l13 643 1 2023-12-16T07:40:39.394 INFO:tasks.workunit.client.1.smithi133.stdout:1/252: unlink d0/da/db/d24/c30 0 2023-12-16T07:40:39.394 INFO:tasks.workunit.client.1.smithi133.stdout:6/477: dread d0/d4/d21/d35/f79 [0,4194304] 0 2023-12-16T07:40:39.396 INFO:tasks.workunit.client.1.smithi133.stdout:9/276: mkdir d15/d18/d2c/d3a/d5a 0 2023-12-16T07:40:39.396 INFO:tasks.workunit.client.1.smithi133.stdout:0/267: dwrite d2/d17/f26 [0,4194304] 0 2023-12-16T07:40:39.397 INFO:tasks.workunit.client.1.smithi133.stdout:0/268: dread - d2/d17/d2b/d31/d4d/f53 zero size 2023-12-16T07:40:39.400 INFO:tasks.workunit.client.1.smithi133.stdout:8/249: creat d9/d10/d39/d48/d44/f53 x:0 0 0 2023-12-16T07:40:39.402 INFO:tasks.workunit.client.1.smithi133.stdout:1/253: mkdir d0/da/db/d24/d32/d3e/d53 0 2023-12-16T07:40:39.402 INFO:tasks.workunit.client.1.smithi133.stdout:1/254: stat d0/da/f2e 0 2023-12-16T07:40:39.405 INFO:tasks.workunit.client.1.smithi133.stdout:1/255: dread d0/da/db/f21 [4194304,4194304] 0 2023-12-16T07:40:39.405 INFO:tasks.workunit.client.1.smithi133.stdout:9/277: mkdir d15/d18/d5b 0 2023-12-16T07:40:39.406 INFO:tasks.workunit.client.1.smithi133.stdout:9/278: truncate d15/f39 96076 0 2023-12-16T07:40:39.406 INFO:tasks.workunit.client.1.smithi133.stdout:1/256: read d0/d12/f3f [3524350,51033] 0 2023-12-16T07:40:39.410 INFO:tasks.workunit.client.1.smithi133.stdout:0/269: mkdir d2/d17/d2b/d31/d4d/d54 0 2023-12-16T07:40:39.410 INFO:tasks.workunit.client.1.smithi133.stdout:6/478: dwrite d0/d4/f1c [0,4194304] 0 2023-12-16T07:40:39.413 INFO:tasks.workunit.client.1.smithi133.stdout:8/250: symlink d9/l54 0 2023-12-16T07:40:39.420 INFO:tasks.workunit.client.1.smithi133.stdout:9/279: mkdir d15/d18/d2c/d3a/d5c 0 2023-12-16T07:40:39.420 INFO:tasks.workunit.client.1.smithi133.stdout:1/257: mknod d0/da/c54 0 2023-12-16T07:40:39.423 INFO:tasks.workunit.client.1.smithi133.stdout:0/270: dwrite d2/d9/d12/f14 [0,4194304] 0 2023-12-16T07:40:39.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/479: getdents d0/d4/d21/d35/d36 0 2023-12-16T07:40:39.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/480: chown d0/d4/d21/d8a/d93/d8e/l8f 29 1 2023-12-16T07:40:39.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/481: dread - d0/d4/d21/d35/d4e/d84/f70 zero size 2023-12-16T07:40:39.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/482: readlink d0/d4/d21/d62/l6a 0 2023-12-16T07:40:39.429 INFO:tasks.workunit.client.1.smithi133.stdout:8/251: mknod d9/dc/d27/c55 0 2023-12-16T07:40:39.431 INFO:tasks.workunit.client.1.smithi133.stdout:9/280: symlink d15/d42/l5d 0 2023-12-16T07:40:39.431 INFO:tasks.workunit.client.1.smithi133.stdout:9/281: chown d15/d18/d2c/f31 161 1 2023-12-16T07:40:39.432 INFO:tasks.workunit.client.1.smithi133.stdout:1/258: dread d0/da/f19 [0,4194304] 0 2023-12-16T07:40:39.432 INFO:tasks.workunit.client.1.smithi133.stdout:6/483: rename d0/d4/d21/d35/d36/f45 to d0/d4/d21/d62/fa2 0 2023-12-16T07:40:39.433 INFO:tasks.workunit.client.1.smithi133.stdout:8/252: creat d9/d2d/f56 x:0 0 0 2023-12-16T07:40:39.434 INFO:tasks.workunit.client.1.smithi133.stdout:9/282: truncate fe 676170 0 2023-12-16T07:40:39.439 INFO:tasks.workunit.client.1.smithi133.stdout:6/484: creat d0/d4/d21/d35/d4e/d84/d69/fa3 x:0 0 0 2023-12-16T07:40:39.439 INFO:tasks.workunit.client.1.smithi133.stdout:0/271: dwrite d2/d17/f2e [0,4194304] 0 2023-12-16T07:40:39.439 INFO:tasks.workunit.client.1.smithi133.stdout:0/272: truncate d2/d9/d20/f44 2085431 0 2023-12-16T07:40:39.440 INFO:tasks.workunit.client.1.smithi133.stdout:0/273: write d2/d9/db/fe [1846834,70607] 0 2023-12-16T07:40:39.440 INFO:tasks.workunit.client.1.smithi133.stdout:0/274: truncate d2/f6 508350 0 2023-12-16T07:40:39.440 INFO:tasks.workunit.client.1.smithi133.stdout:0/275: stat d2/d9/d12 0 2023-12-16T07:40:39.442 INFO:tasks.workunit.client.1.smithi133.stdout:0/276: creat d2/d9/db/f55 x:0 0 0 2023-12-16T07:40:39.448 INFO:tasks.workunit.client.1.smithi133.stdout:0/277: unlink d2/d9/lc 0 2023-12-16T07:40:39.448 INFO:tasks.workunit.client.1.smithi133.stdout:8/253: dread d9/dc/f4c [0,4194304] 0 2023-12-16T07:40:39.450 INFO:tasks.workunit.client.1.smithi133.stdout:0/278: rename d2/d9/db/l25 to d2/d17/l56 0 2023-12-16T07:40:39.452 INFO:tasks.workunit.client.1.smithi133.stdout:8/254: rmdir d9/d10/d39/d48/d44 39 2023-12-16T07:40:39.458 INFO:tasks.workunit.client.1.smithi133.stdout:1/259: dwrite d0/da/db/f38 [0,4194304] 0 2023-12-16T07:40:39.458 INFO:tasks.workunit.client.1.smithi133.stdout:1/260: chown d0/da/f2e 353 1 2023-12-16T07:40:39.460 INFO:tasks.workunit.client.1.smithi133.stdout:6/485: dwrite d0/d4/f5c [0,4194304] 0 2023-12-16T07:40:39.462 INFO:tasks.workunit.client.1.smithi133.stdout:1/261: creat d0/d1c/d37/f55 x:0 0 0 2023-12-16T07:40:39.467 INFO:tasks.workunit.client.1.smithi133.stdout:1/262: mkdir d0/da/db/d24/d32/d56 0 2023-12-16T07:40:39.471 INFO:tasks.workunit.client.1.smithi133.stdout:1/263: unlink d0/da/db/l33 0 2023-12-16T07:40:39.471 INFO:tasks.workunit.client.1.smithi133.stdout:1/264: chown d0/d1c/d37/f43 7 1 2023-12-16T07:40:39.476 INFO:tasks.workunit.client.1.smithi133.stdout:0/279: dwrite d2/f6 [0,4194304] 0 2023-12-16T07:40:39.477 INFO:tasks.workunit.client.1.smithi133.stdout:8/255: dwrite d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:39.480 INFO:tasks.workunit.client.1.smithi133.stdout:0/280: truncate d2/f8 1043144 0 2023-12-16T07:40:39.481 INFO:tasks.workunit.client.1.smithi133.stdout:4/367: sync 2023-12-16T07:40:39.483 INFO:tasks.workunit.client.1.smithi133.stdout:7/527: sync 2023-12-16T07:40:39.483 INFO:tasks.workunit.client.1.smithi133.stdout:3/212: sync 2023-12-16T07:40:39.483 INFO:tasks.workunit.client.1.smithi133.stdout:5/180: sync 2023-12-16T07:40:39.483 INFO:tasks.workunit.client.1.smithi133.stdout:4/368: symlink d3/d7/d6d/l79 0 2023-12-16T07:40:39.487 INFO:tasks.workunit.client.1.smithi133.stdout:5/181: creat d1/de/f3c x:0 0 0 2023-12-16T07:40:39.487 INFO:tasks.workunit.client.1.smithi133.stdout:3/213: symlink d7/d8/d1c/d2e/d43/l59 0 2023-12-16T07:40:39.489 INFO:tasks.workunit.client.1.smithi133.stdout:1/265: dwrite d0/da/f2e [0,4194304] 0 2023-12-16T07:40:39.489 INFO:tasks.workunit.client.1.smithi133.stdout:1/266: fsync d0/da/db/fd 0 2023-12-16T07:40:39.499 INFO:tasks.workunit.client.1.smithi133.stdout:7/528: dwrite db/d3e/d4a/d58/d86/d8b/f90 [0,4194304] 0 2023-12-16T07:40:39.499 INFO:tasks.workunit.client.1.smithi133.stdout:7/529: fsync db/d21/f5b 0 2023-12-16T07:40:39.499 INFO:tasks.workunit.client.1.smithi133.stdout:7/530: truncate db/d12/f5e 1196992 0 2023-12-16T07:40:39.499 INFO:tasks.workunit.client.1.smithi133.stdout:7/531: fdatasync db/d21/f37 0 2023-12-16T07:40:39.571 INFO:tasks.workunit.client.1.smithi133.stdout:4/369: rename d3/d7/d1c/l2f to d3/d7/d38/d57/d67/l7a 0 2023-12-16T07:40:39.571 INFO:tasks.workunit.client.1.smithi133.stdout:4/370: chown d3/f5d 4 1 2023-12-16T07:40:39.571 INFO:tasks.workunit.client.1.smithi133.stdout:4/371: write d3/d7/d44/f78 [280455,5855] 0 2023-12-16T07:40:39.571 INFO:tasks.workunit.client.1.smithi133.stdout:4/372: dread - d3/d7/d38/d45/f68 zero size 2023-12-16T07:40:39.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/182: creat d1/f3d x:0 0 0 2023-12-16T07:40:39.575 INFO:tasks.workunit.client.1.smithi133.stdout:3/214: symlink d7/d8/d1c/d2e/d43/l5a 0 2023-12-16T07:40:39.583 INFO:tasks.workunit.client.1.smithi133.stdout:0/281: truncate d2/d9/d12/f14 1893665 0 2023-12-16T07:40:39.584 INFO:tasks.workunit.client.1.smithi133.stdout:1/267: chown d0/lc 0 1 2023-12-16T07:40:39.587 INFO:tasks.workunit.client.1.smithi133.stdout:7/532: mknod db/caf 0 2023-12-16T07:40:39.590 INFO:tasks.workunit.client.1.smithi133.stdout:4/373: mknod d3/d7/d6d/c7b 0 2023-12-16T07:40:39.595 INFO:tasks.workunit.client.1.smithi133.stdout:5/183: creat d1/d1c/f3e x:0 0 0 2023-12-16T07:40:39.595 INFO:tasks.workunit.client.1.smithi133.stdout:5/184: readlink l0 0 2023-12-16T07:40:39.595 INFO:tasks.workunit.client.1.smithi133.stdout:5/185: write d1/d1c/f3b [1015650,47841] 0 2023-12-16T07:40:39.595 INFO:tasks.workunit.client.1.smithi133.stdout:5/186: chown d1/de/f3c 66471136 1 2023-12-16T07:40:39.598 INFO:tasks.workunit.client.1.smithi133.stdout:3/215: mkdir d7/d8/d1c/d2e/d43/d5b 0 2023-12-16T07:40:39.599 INFO:tasks.workunit.client.1.smithi133.stdout:2/167: sync 2023-12-16T07:40:39.600 INFO:tasks.workunit.client.1.smithi133.stdout:7/533: dwrite db/d21/d2c/d31/d6e/f97 [0,4194304] 0 2023-12-16T07:40:39.601 INFO:tasks.workunit.client.1.smithi133.stdout:1/268: creat d0/da/db/d24/d32/f57 x:0 0 0 2023-12-16T07:40:39.602 INFO:tasks.workunit.client.1.smithi133.stdout:7/534: write db/d21/f5b [960262,63606] 0 2023-12-16T07:40:39.603 INFO:tasks.workunit.client.1.smithi133.stdout:0/282: write d2/d9/d20/f2c [2690026,15605] 0 2023-12-16T07:40:39.605 INFO:tasks.workunit.client.1.smithi133.stdout:4/374: rename d3/f14 to d3/d7/d1c/d2a/f7c 0 2023-12-16T07:40:39.608 INFO:tasks.workunit.client.1.smithi133.stdout:5/187: unlink d1/d16/c30 0 2023-12-16T07:40:39.610 INFO:tasks.workunit.client.1.smithi133.stdout:2/168: getdents da/d15/d1b 0 2023-12-16T07:40:39.622 INFO:tasks.workunit.client.1.smithi133.stdout:1/269: creat d0/d12/f58 x:0 0 0 2023-12-16T07:40:39.625 INFO:tasks.workunit.client.1.smithi133.stdout:7/535: symlink db/d21/d2c/lb0 0 2023-12-16T07:40:39.625 INFO:tasks.workunit.client.1.smithi133.stdout:7/536: fdatasync db/f7b 0 2023-12-16T07:40:39.625 INFO:tasks.workunit.client.1.smithi133.stdout:7/537: write db/d21/f80 [880178,44623] 0 2023-12-16T07:40:39.634 INFO:tasks.workunit.client.1.smithi133.stdout:4/375: dread d3/f5d [0,4194304] 0 2023-12-16T07:40:39.635 INFO:tasks.workunit.client.1.smithi133.stdout:0/283: rename d2/d9/d4c/l4e to d2/d17/d40/l57 0 2023-12-16T07:40:39.636 INFO:tasks.workunit.client.1.smithi133.stdout:4/376: unlink d3/l4e 0 2023-12-16T07:40:39.636 INFO:tasks.workunit.client.1.smithi133.stdout:4/377: stat d3/d7/d38 0 2023-12-16T07:40:39.640 INFO:tasks.workunit.client.1.smithi133.stdout:5/188: dwrite d1/d16/f2a [0,4194304] 0 2023-12-16T07:40:39.641 INFO:tasks.workunit.client.1.smithi133.stdout:0/284: dread d2/d9/d12/f3f [0,4194304] 0 2023-12-16T07:40:39.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/285: chown d2/d9/d12/d35/d48 6 1 2023-12-16T07:40:39.643 INFO:tasks.workunit.client.1.smithi133.stdout:5/189: mknod d1/d16/c3f 0 2023-12-16T07:40:39.643 INFO:tasks.workunit.client.1.smithi133.stdout:5/190: dread - d1/d1c/f3e zero size 2023-12-16T07:40:39.643 INFO:tasks.workunit.client.1.smithi133.stdout:5/191: write d1/f3 [2559499,8482] 0 2023-12-16T07:40:39.643 INFO:tasks.workunit.client.1.smithi133.stdout:0/286: write d2/d9/d12/d35/d48/f3d [6103530,73336] 0 2023-12-16T07:40:39.647 INFO:tasks.workunit.client.1.smithi133.stdout:5/192: creat d1/d1c/f40 x:0 0 0 2023-12-16T07:40:39.648 INFO:tasks.workunit.client.1.smithi133.stdout:5/193: read d1/f17 [420237,59473] 0 2023-12-16T07:40:39.652 INFO:tasks.workunit.client.1.smithi133.stdout:5/194: creat d1/d18/f41 x:0 0 0 2023-12-16T07:40:39.654 INFO:tasks.workunit.client.1.smithi133.stdout:2/169: dwrite da/d15/d17/f2d [0,4194304] 0 2023-12-16T07:40:39.654 INFO:tasks.workunit.client.1.smithi133.stdout:2/170: readlink da/d1d/d24/l2a 0 2023-12-16T07:40:39.655 INFO:tasks.workunit.client.1.smithi133.stdout:3/216: dwrite d7/d8/d1c/d2b/f15 [0,4194304] 0 2023-12-16T07:40:39.655 INFO:tasks.workunit.client.1.smithi133.stdout:3/217: read - d7/d8/d1c/f50 zero size 2023-12-16T07:40:39.655 INFO:tasks.workunit.client.1.smithi133.stdout:3/218: stat d7/d8/d1d/d2a 0 2023-12-16T07:40:39.655 INFO:tasks.workunit.client.1.smithi133.stdout:3/219: truncate d7/d8/f54 290242 0 2023-12-16T07:40:39.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/538: dwrite db/d12/f45 [0,4194304] 0 2023-12-16T07:40:39.656 INFO:tasks.workunit.client.1.smithi133.stdout:1/270: dwrite d0/da/d3d/f50 [0,4194304] 0 2023-12-16T07:40:39.657 INFO:tasks.workunit.client.1.smithi133.stdout:7/539: write db/d3e/f69 [2242901,50616] 0 2023-12-16T07:40:39.659 INFO:tasks.workunit.client.1.smithi133.stdout:3/220: creat d7/d8/f5c x:0 0 0 2023-12-16T07:40:39.659 INFO:tasks.workunit.client.1.smithi133.stdout:3/221: chown d7/d8/d1c/f4b 3485 1 2023-12-16T07:40:39.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/195: dread d1/f34 [0,4194304] 0 2023-12-16T07:40:39.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/196: dread - d1/d1c/f38 zero size 2023-12-16T07:40:39.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/197: read - d1/f3d zero size 2023-12-16T07:40:39.666 INFO:tasks.workunit.client.1.smithi133.stdout:1/271: mkdir d0/da/db/d24/d32/d56/d59 0 2023-12-16T07:40:39.669 INFO:tasks.workunit.client.1.smithi133.stdout:1/272: write d0/da/db/ff [5546411,6625] 0 2023-12-16T07:40:39.669 INFO:tasks.workunit.client.1.smithi133.stdout:2/171: dread da/d15/d17/f2d [0,4194304] 0 2023-12-16T07:40:39.673 INFO:tasks.workunit.client.1.smithi133.stdout:0/287: dwrite d2/f8 [0,4194304] 0 2023-12-16T07:40:39.674 INFO:tasks.workunit.client.1.smithi133.stdout:7/540: rename db/d3e/d4a/d58/d86/d8b/d8d/d99 to db/d21/db1 0 2023-12-16T07:40:39.678 INFO:tasks.workunit.client.1.smithi133.stdout:4/378: dwrite d3/d7/f5c [0,4194304] 0 2023-12-16T07:40:39.684 INFO:tasks.workunit.client.1.smithi133.stdout:0/288: write d2/d9/d20/f2c [1559475,58833] 0 2023-12-16T07:40:39.686 INFO:tasks.workunit.client.1.smithi133.stdout:1/273: dwrite d0/d1c/d37/f55 [0,4194304] 0 2023-12-16T07:40:39.687 INFO:tasks.workunit.client.1.smithi133.stdout:3/222: link d7/d8/d1d/f33 d7/d8/d1c/d2e/f5d 0 2023-12-16T07:40:39.691 INFO:tasks.workunit.client.1.smithi133.stdout:2/172: unlink da/f12 0 2023-12-16T07:40:39.695 INFO:tasks.workunit.client.1.smithi133.stdout:7/541: creat db/d12/d98/fb2 x:0 0 0 2023-12-16T07:40:39.695 INFO:tasks.workunit.client.1.smithi133.stdout:7/542: fdatasync db/d3e/d4a/f9a 0 2023-12-16T07:40:39.708 INFO:tasks.workunit.client.1.smithi133.stdout:2/173: dwrite da/f10 [0,4194304] 0 2023-12-16T07:40:39.709 INFO:tasks.workunit.client.1.smithi133.stdout:4/379: truncate d3/d7/d38/d57/f66 2578373 0 2023-12-16T07:40:39.715 INFO:tasks.workunit.client.1.smithi133.stdout:0/289: rmdir d2/d17/d2b/d31 39 2023-12-16T07:40:39.715 INFO:tasks.workunit.client.1.smithi133.stdout:0/290: read - d2/d17/d2b/f4b zero size 2023-12-16T07:40:39.720 INFO:tasks.workunit.client.1.smithi133.stdout:1/274: mkdir d0/da/db/d24/d5a 0 2023-12-16T07:40:39.724 INFO:tasks.workunit.client.1.smithi133.stdout:7/543: rename db/d3e/f82 to db/d3e/d4a/d58/d86/fb3 0 2023-12-16T07:40:39.724 INFO:tasks.workunit.client.1.smithi133.stdout:4/380: dwrite d3/d7/d38/d57/f5f [0,4194304] 0 2023-12-16T07:40:39.725 INFO:tasks.workunit.client.1.smithi133.stdout:2/174: symlink da/d15/d1b/l31 0 2023-12-16T07:40:39.727 INFO:tasks.workunit.client.1.smithi133.stdout:7/544: write db/d12/f71 [3920131,113857] 0 2023-12-16T07:40:39.728 INFO:tasks.workunit.client.1.smithi133.stdout:4/381: dread d3/d7/d1a/f27 [0,4194304] 0 2023-12-16T07:40:39.728 INFO:tasks.workunit.client.1.smithi133.stdout:4/382: chown d3/d7/d44/f55 2077193 1 2023-12-16T07:40:39.728 INFO:tasks.workunit.client.1.smithi133.stdout:1/275: mknod d0/da/c5b 0 2023-12-16T07:40:39.728 INFO:tasks.workunit.client.1.smithi133.stdout:1/276: chown d0/da/d3d 204760 1 2023-12-16T07:40:39.728 INFO:tasks.workunit.client.1.smithi133.stdout:2/175: rmdir da/d15/d1b 39 2023-12-16T07:40:39.730 INFO:tasks.workunit.client.1.smithi133.stdout:0/291: link d2/d9/db/l1f d2/d9/d4c/l58 0 2023-12-16T07:40:39.731 INFO:tasks.workunit.client.1.smithi133.stdout:7/545: getdents db/d21 0 2023-12-16T07:40:39.732 INFO:tasks.workunit.client.1.smithi133.stdout:4/383: symlink d3/d7/d1c/d2a/l7d 0 2023-12-16T07:40:39.734 INFO:tasks.workunit.client.1.smithi133.stdout:1/277: rmdir d0/da/db/d24/d32/d3e/d53 0 2023-12-16T07:40:39.735 INFO:tasks.workunit.client.1.smithi133.stdout:0/292: getdents d2/d9/d12/d35/d48 0 2023-12-16T07:40:39.737 INFO:tasks.workunit.client.1.smithi133.stdout:7/546: symlink db/d21/d2c/d31/lb4 0 2023-12-16T07:40:39.738 INFO:tasks.workunit.client.1.smithi133.stdout:1/278: dread d0/da/db/f2c [0,4194304] 0 2023-12-16T07:40:39.739 INFO:tasks.workunit.client.1.smithi133.stdout:4/384: rename d3/f51 to d3/d7/d38/d57/d75/f7e 0 2023-12-16T07:40:39.740 INFO:tasks.workunit.client.1.smithi133.stdout:0/293: creat d2/d17/d2b/f59 x:0 0 0 2023-12-16T07:40:39.741 INFO:tasks.workunit.client.1.smithi133.stdout:7/547: getdents db/d12/d3a/d6c 0 2023-12-16T07:40:39.743 INFO:tasks.workunit.client.1.smithi133.stdout:1/279: unlink d0/le 0 2023-12-16T07:40:39.745 INFO:tasks.workunit.client.1.smithi133.stdout:4/385: creat d3/d7/d1c/d2a/f7f x:0 0 0 2023-12-16T07:40:39.745 INFO:tasks.workunit.client.1.smithi133.stdout:2/176: dwrite f1 [0,4194304] 0 2023-12-16T07:40:39.746 INFO:tasks.workunit.client.1.smithi133.stdout:2/177: read da/fd [414412,39894] 0 2023-12-16T07:40:39.746 INFO:tasks.workunit.client.1.smithi133.stdout:2/178: chown da/d1d/f25 23 1 2023-12-16T07:40:39.746 INFO:tasks.workunit.client.1.smithi133.stdout:7/548: mkdir db/d12/d3a/db5 0 2023-12-16T07:40:39.747 INFO:tasks.workunit.client.1.smithi133.stdout:2/179: write f3 [5654931,79340] 0 2023-12-16T07:40:39.747 INFO:tasks.workunit.client.1.smithi133.stdout:1/280: creat d0/d1c/f5c x:0 0 0 2023-12-16T07:40:39.750 INFO:tasks.workunit.client.1.smithi133.stdout:7/549: creat db/d21/d2c/d31/d6e/fb6 x:0 0 0 2023-12-16T07:40:39.753 INFO:tasks.workunit.client.1.smithi133.stdout:2/180: unlink da/f22 0 2023-12-16T07:40:39.753 INFO:tasks.workunit.client.1.smithi133.stdout:2/181: chown da/c14 118 1 2023-12-16T07:40:39.753 INFO:tasks.workunit.client.1.smithi133.stdout:0/294: dread d2/f1d [0,4194304] 0 2023-12-16T07:40:39.754 INFO:tasks.workunit.client.1.smithi133.stdout:1/281: getdents d0/da/d3d/d41 0 2023-12-16T07:40:39.756 INFO:tasks.workunit.client.1.smithi133.stdout:1/282: read d0/f2a [1720348,53024] 0 2023-12-16T07:40:39.756 INFO:tasks.workunit.client.1.smithi133.stdout:1/283: fdatasync d0/da/db/f2c 0 2023-12-16T07:40:39.757 INFO:tasks.workunit.client.1.smithi133.stdout:2/182: creat da/d1d/f32 x:0 0 0 2023-12-16T07:40:39.757 INFO:tasks.workunit.client.1.smithi133.stdout:2/183: chown da/f2c 9144 1 2023-12-16T07:40:39.757 INFO:tasks.workunit.client.1.smithi133.stdout:2/184: truncate da/fe 888420 0 2023-12-16T07:40:39.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/550: dread db/f67 [0,4194304] 0 2023-12-16T07:40:39.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/551: stat db/d21/f25 0 2023-12-16T07:40:39.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/552: truncate db/d12/d98/fb2 938012 0 2023-12-16T07:40:39.761 INFO:tasks.workunit.client.1.smithi133.stdout:2/185: dread da/f11 [0,4194304] 0 2023-12-16T07:40:39.763 INFO:tasks.workunit.client.1.smithi133.stdout:4/386: dwrite d3/d7/d1c/d2a/f7f [0,4194304] 0 2023-12-16T07:40:39.764 INFO:tasks.workunit.client.1.smithi133.stdout:4/387: dread - d3/d7/d38/d57/d67/f6a zero size 2023-12-16T07:40:39.767 INFO:tasks.workunit.client.1.smithi133.stdout:1/284: truncate d0/da/f19 2964586 0 2023-12-16T07:40:39.767 INFO:tasks.workunit.client.1.smithi133.stdout:9/283: sync 2023-12-16T07:40:39.767 INFO:tasks.workunit.client.1.smithi133.stdout:9/284: stat d15/d18/d2c/f30 0 2023-12-16T07:40:39.767 INFO:tasks.workunit.client.1.smithi133.stdout:2/186: creat da/d15/d17/f33 x:0 0 0 2023-12-16T07:40:39.767 INFO:tasks.workunit.client.1.smithi133.stdout:6/486: sync 2023-12-16T07:40:39.768 INFO:tasks.workunit.client.1.smithi133.stdout:6/487: truncate d0/d4/d21/d8a/d93/fa0 602334 0 2023-12-16T07:40:39.768 INFO:tasks.workunit.client.1.smithi133.stdout:6/488: dread - d0/d4/d21/d35/d4e/d84/f58 zero size 2023-12-16T07:40:39.768 INFO:tasks.workunit.client.1.smithi133.stdout:6/489: readlink d0/d4/d21/d8a/d93/d8e/l8f 0 2023-12-16T07:40:39.775 INFO:tasks.workunit.client.1.smithi133.stdout:6/490: dread d0/d5e/d75/d81/f86 [0,4194304] 0 2023-12-16T07:40:39.779 INFO:tasks.workunit.client.1.smithi133.stdout:7/553: dwrite db/d3e/d4a/f7c [0,4194304] 0 2023-12-16T07:40:39.780 INFO:tasks.workunit.client.1.smithi133.stdout:0/295: dwrite d2/f8 [0,4194304] 0 2023-12-16T07:40:39.780 INFO:tasks.workunit.client.1.smithi133.stdout:0/296: chown d2/f1d 2 1 2023-12-16T07:40:39.781 INFO:tasks.workunit.client.1.smithi133.stdout:4/388: symlink d3/l80 0 2023-12-16T07:40:39.781 INFO:tasks.workunit.client.1.smithi133.stdout:4/389: dread - d3/d7/d38/d45/f68 zero size 2023-12-16T07:40:39.786 INFO:tasks.workunit.client.1.smithi133.stdout:1/285: link d0/da/db/f21 d0/da/db/d24/f5d 0 2023-12-16T07:40:39.787 INFO:tasks.workunit.client.1.smithi133.stdout:9/285: creat d15/d18/f5e x:0 0 0 2023-12-16T07:40:39.788 INFO:tasks.workunit.client.1.smithi133.stdout:9/286: chown l12 3171 1 2023-12-16T07:40:39.791 INFO:tasks.workunit.client.1.smithi133.stdout:2/187: unlink f3 0 2023-12-16T07:40:39.791 INFO:tasks.workunit.client.1.smithi133.stdout:9/287: dread d15/d18/d2c/f2e [0,4194304] 0 2023-12-16T07:40:39.793 INFO:tasks.workunit.client.1.smithi133.stdout:6/491: getdents d0/d4/d21 0 2023-12-16T07:40:39.793 INFO:tasks.workunit.client.1.smithi133.stdout:6/492: chown d0/d4/d21/d35/d4e/l7f 28 1 2023-12-16T07:40:39.793 INFO:tasks.workunit.client.1.smithi133.stdout:6/493: fsync d0/d4/d21/d60/f66 0 2023-12-16T07:40:39.794 INFO:tasks.workunit.client.1.smithi133.stdout:9/288: write d15/f16 [281422,4477] 0 2023-12-16T07:40:39.794 INFO:tasks.workunit.client.1.smithi133.stdout:0/297: dwrite d2/d9/d12/f14 [0,4194304] 0 2023-12-16T07:40:39.795 INFO:tasks.workunit.client.1.smithi133.stdout:9/289: read f14 [2593698,95830] 0 2023-12-16T07:40:39.795 INFO:tasks.workunit.client.1.smithi133.stdout:9/290: dread - d15/d18/d2c/f3d zero size 2023-12-16T07:40:39.797 INFO:tasks.workunit.client.1.smithi133.stdout:0/298: write d2/d17/f2e [3901271,50680] 0 2023-12-16T07:40:39.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/554: mknod db/d21/d2c/cb7 0 2023-12-16T07:40:39.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/555: truncate db/d3e/d4a/d58/d86/fa4 158958 0 2023-12-16T07:40:39.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/556: chown db/f33 48341 1 2023-12-16T07:40:39.802 INFO:tasks.workunit.client.1.smithi133.stdout:7/557: dread db/f8c [0,4194304] 0 2023-12-16T07:40:39.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/390: rmdir d3/d7/d1a/d6e 0 2023-12-16T07:40:39.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/391: dread - d3/d7/d38/d57/d67/f6a zero size 2023-12-16T07:40:39.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/392: chown d3/d7/d38/d45/c4f 2 1 2023-12-16T07:40:39.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/393: chown d3/l28 301079 1 2023-12-16T07:40:39.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/394: chown d3/f5d 12901722 1 2023-12-16T07:40:39.803 INFO:tasks.workunit.client.1.smithi133.stdout:7/558: write db/d21/f2f [3495342,115487] 0 2023-12-16T07:40:39.805 INFO:tasks.workunit.client.1.smithi133.stdout:2/188: link da/f10 da/d15/d1b/f34 0 2023-12-16T07:40:39.806 INFO:tasks.workunit.client.1.smithi133.stdout:9/291: link c10 d15/d18/d2c/d3a/c5f 0 2023-12-16T07:40:39.806 INFO:tasks.workunit.client.1.smithi133.stdout:9/292: stat d15/d18/d2c/f31 0 2023-12-16T07:40:39.806 INFO:tasks.workunit.client.1.smithi133.stdout:9/293: truncate d15/d18/d2c/f46 4356491 0 2023-12-16T07:40:39.807 INFO:tasks.workunit.client.1.smithi133.stdout:0/299: symlink d2/d9/d12/d35/d48/l5a 0 2023-12-16T07:40:39.808 INFO:tasks.workunit.client.1.smithi133.stdout:4/395: link d3/d7/d1a/l3c d3/d7/d1a/l81 0 2023-12-16T07:40:39.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/559: unlink db/d3e/d4a/f91 0 2023-12-16T07:40:39.811 INFO:tasks.workunit.client.1.smithi133.stdout:2/189: link da/d1d/f2f da/d1d/d24/d2e/f35 0 2023-12-16T07:40:39.812 INFO:tasks.workunit.client.1.smithi133.stdout:4/396: mknod d3/d7/d44/d63/c82 0 2023-12-16T07:40:39.815 INFO:tasks.workunit.client.1.smithi133.stdout:2/190: creat da/d15/d17/f36 x:0 0 0 2023-12-16T07:40:39.818 INFO:tasks.workunit.client.1.smithi133.stdout:0/300: dread d2/d9/d20/f29 [0,4194304] 0 2023-12-16T07:40:39.818 INFO:tasks.workunit.client.1.smithi133.stdout:4/397: truncate d3/f25 1541921 0 2023-12-16T07:40:39.819 INFO:tasks.workunit.client.1.smithi133.stdout:0/301: rmdir d2/d17/d40 39 2023-12-16T07:40:39.820 INFO:tasks.workunit.client.1.smithi133.stdout:7/560: rmdir db/d12 39 2023-12-16T07:40:39.822 INFO:tasks.workunit.client.1.smithi133.stdout:0/302: getdents d2/d9/d12 0 2023-12-16T07:40:39.823 INFO:tasks.workunit.client.1.smithi133.stdout:7/561: mkdir db/d3e/d4a/d58/d86/db8 0 2023-12-16T07:40:39.824 INFO:tasks.workunit.client.1.smithi133.stdout:0/303: mknod d2/d9/db/c5b 0 2023-12-16T07:40:39.825 INFO:tasks.workunit.client.1.smithi133.stdout:7/562: mkdir db/d3e/d4a/d58/db9 0 2023-12-16T07:40:39.826 INFO:tasks.workunit.client.1.smithi133.stdout:0/304: mkdir d2/d9/d12/d35/d5c 0 2023-12-16T07:40:39.827 INFO:tasks.workunit.client.1.smithi133.stdout:0/305: truncate d2/d9/f47 555816 0 2023-12-16T07:40:39.832 INFO:tasks.workunit.client.1.smithi133.stdout:1/286: link d0/da/f19 d0/d12/f5e 0 2023-12-16T07:40:39.834 INFO:tasks.workunit.client.1.smithi133.stdout:1/287: mkdir d0/da/db/d24/d32/d56/d59/d5f 0 2023-12-16T07:40:39.834 INFO:tasks.workunit.client.1.smithi133.stdout:1/288: stat d0/da/c54 0 2023-12-16T07:40:39.834 INFO:tasks.workunit.client.1.smithi133.stdout:1/289: readlink d0/da/db/d24/l48 0 2023-12-16T07:40:39.835 INFO:tasks.workunit.client.1.smithi133.stdout:4/398: dread d3/d7/d38/d57/d75/f7e [0,4194304] 0 2023-12-16T07:40:39.837 INFO:tasks.workunit.client.1.smithi133.stdout:1/290: mkdir d0/d60 0 2023-12-16T07:40:39.837 INFO:tasks.workunit.client.1.smithi133.stdout:1/291: chown d0/da/db/f2f 78 1 2023-12-16T07:40:39.838 INFO:tasks.workunit.client.1.smithi133.stdout:4/399: unlink d3/f3b 0 2023-12-16T07:40:39.839 INFO:tasks.workunit.client.1.smithi133.stdout:1/292: mknod d0/da/db/d24/d5a/c61 0 2023-12-16T07:40:39.840 INFO:tasks.workunit.client.1.smithi133.stdout:4/400: symlink d3/d7/d38/l83 0 2023-12-16T07:40:39.840 INFO:tasks.workunit.client.1.smithi133.stdout:1/293: write d0/da/d3d/f50 [3415252,41641] 0 2023-12-16T07:40:39.841 INFO:tasks.workunit.client.1.smithi133.stdout:1/294: stat d0/d12/c52 0 2023-12-16T07:40:39.842 INFO:tasks.workunit.client.1.smithi133.stdout:4/401: symlink d3/d7/d38/d57/d75/l84 0 2023-12-16T07:40:39.845 INFO:tasks.workunit.client.1.smithi133.stdout:4/402: mknod d3/d7/d1c/d2a/c85 0 2023-12-16T07:40:39.846 INFO:tasks.workunit.client.1.smithi133.stdout:1/295: rename d0/l4e to d0/l62 0 2023-12-16T07:40:39.847 INFO:tasks.workunit.client.1.smithi133.stdout:4/403: creat d3/d7/f86 x:0 0 0 2023-12-16T07:40:39.848 INFO:tasks.workunit.client.1.smithi133.stdout:1/296: symlink d0/da/l63 0 2023-12-16T07:40:39.848 INFO:tasks.workunit.client.1.smithi133.stdout:8/256: sync 2023-12-16T07:40:39.850 INFO:tasks.workunit.client.1.smithi133.stdout:1/297: creat d0/d12/d51/f64 x:0 0 0 2023-12-16T07:40:39.850 INFO:tasks.workunit.client.1.smithi133.stdout:1/298: chown d0 0 1 2023-12-16T07:40:39.850 INFO:tasks.workunit.client.1.smithi133.stdout:1/299: stat d0/d12/f5e 0 2023-12-16T07:40:39.851 INFO:tasks.workunit.client.1.smithi133.stdout:4/404: write d3/d7/d44/f5e [3432158,70045] 0 2023-12-16T07:40:39.851 INFO:tasks.workunit.client.1.smithi133.stdout:4/405: chown d3/d7/d1a/f26 6 1 2023-12-16T07:40:39.851 INFO:tasks.workunit.client.1.smithi133.stdout:4/406: write d3/d7/d1c/d2a/f4c [256899,22818] 0 2023-12-16T07:40:39.853 INFO:tasks.workunit.client.1.smithi133.stdout:8/257: rename d9/l13 to d9/d10/l57 0 2023-12-16T07:40:39.857 INFO:tasks.workunit.client.1.smithi133.stdout:0/306: dwrite d2/d9/d12/d35/d48/f3d [4194304,4194304] 0 2023-12-16T07:40:39.858 INFO:tasks.workunit.client.1.smithi133.stdout:4/407: creat d3/d7/d38/d57/d67/f87 x:0 0 0 2023-12-16T07:40:39.858 INFO:tasks.workunit.client.1.smithi133.stdout:4/408: write d3/d7/d44/f55 [644518,31976] 0 2023-12-16T07:40:39.858 INFO:tasks.workunit.client.1.smithi133.stdout:4/409: write d3/d7/d38/d45/f65 [535198,43075] 0 2023-12-16T07:40:39.860 INFO:tasks.workunit.client.1.smithi133.stdout:0/307: link d2/d17/d40/f49 d2/d9/db/f5d 0 2023-12-16T07:40:39.861 INFO:tasks.workunit.client.1.smithi133.stdout:0/308: chown d2/d17/d2b/d31 0 1 2023-12-16T07:40:39.861 INFO:tasks.workunit.client.1.smithi133.stdout:0/309: write d2/d17/f2e [5170366,1692] 0 2023-12-16T07:40:39.861 INFO:tasks.workunit.client.1.smithi133.stdout:7/563: dwrite db/d21/f70 [0,4194304] 0 2023-12-16T07:40:39.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/564: truncate db/d12/d98/fb2 1970041 0 2023-12-16T07:40:39.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/565: write db/d21/f52 [1136139,66293] 0 2023-12-16T07:40:39.862 INFO:tasks.workunit.client.1.smithi133.stdout:4/410: creat d3/d7/d38/d57/d75/f88 x:0 0 0 2023-12-16T07:40:39.863 INFO:tasks.workunit.client.1.smithi133.stdout:0/310: mkdir d2/d9/d20/d5e 0 2023-12-16T07:40:39.864 INFO:tasks.workunit.client.1.smithi133.stdout:0/311: read d2/d9/d12/d35/d48/f3d [7753290,26124] 0 2023-12-16T07:40:39.867 INFO:tasks.workunit.client.1.smithi133.stdout:4/411: mkdir d3/d7/d6d/d89 0 2023-12-16T07:40:39.867 INFO:tasks.workunit.client.1.smithi133.stdout:4/412: chown d3/d7/d1c/d2a/c40 16526280 1 2023-12-16T07:40:39.870 INFO:tasks.workunit.client.1.smithi133.stdout:4/413: creat d3/d7/d38/d57/d75/f8a x:0 0 0 2023-12-16T07:40:39.872 INFO:tasks.workunit.client.1.smithi133.stdout:1/300: dwrite d0/d1c/d37/f43 [0,4194304] 0 2023-12-16T07:40:39.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/301: truncate d0/f29 7152116 0 2023-12-16T07:40:39.882 INFO:tasks.workunit.client.1.smithi133.stdout:8/258: dwrite d9/f22 [0,4194304] 0 2023-12-16T07:40:39.882 INFO:tasks.workunit.client.1.smithi133.stdout:4/414: write d3/d7/d1c/d2a/f4c [181479,75075] 0 2023-12-16T07:40:39.882 INFO:tasks.workunit.client.1.smithi133.stdout:4/415: dread - d3/d7/d38/d45/f68 zero size 2023-12-16T07:40:39.882 INFO:tasks.workunit.client.1.smithi133.stdout:0/312: dwrite d2/d9/d20/f2c [4194304,4194304] 0 2023-12-16T07:40:39.891 INFO:tasks.workunit.client.1.smithi133.stdout:4/416: symlink d3/d7/d38/d45/l8b 0 2023-12-16T07:40:39.894 INFO:tasks.workunit.client.1.smithi133.stdout:0/313: unlink d2/d9/db/f15 0 2023-12-16T07:40:39.895 INFO:tasks.workunit.client.1.smithi133.stdout:1/302: dwrite d0/da/f2e [0,4194304] 0 2023-12-16T07:40:39.895 INFO:tasks.workunit.client.1.smithi133.stdout:1/303: fsync d0/da/db/f38 0 2023-12-16T07:40:39.896 INFO:tasks.workunit.client.1.smithi133.stdout:1/304: chown d0/c8 1406199597 1 2023-12-16T07:40:39.896 INFO:tasks.workunit.client.1.smithi133.stdout:1/305: truncate d0/da/f4b 477021 0 2023-12-16T07:40:39.896 INFO:tasks.workunit.client.1.smithi133.stdout:1/306: write d0/d12/d51/f64 [327618,38374] 0 2023-12-16T07:40:39.899 INFO:tasks.workunit.client.1.smithi133.stdout:4/417: creat d3/f8c x:0 0 0 2023-12-16T07:40:39.899 INFO:tasks.workunit.client.1.smithi133.stdout:4/418: write d3/d7/d38/d45/f68 [858940,67277] 0 2023-12-16T07:40:39.903 INFO:tasks.workunit.client.1.smithi133.stdout:0/314: link d2/l51 d2/d9/d4c/l5f 0 2023-12-16T07:40:39.903 INFO:tasks.workunit.client.1.smithi133.stdout:0/315: fdatasync d2/d17/d2b/d31/d4d/f53 0 2023-12-16T07:40:39.905 INFO:tasks.workunit.client.1.smithi133.stdout:1/307: rename d0/da/db/c34 to d0/d12/c65 0 2023-12-16T07:40:39.906 INFO:tasks.workunit.client.1.smithi133.stdout:0/316: mkdir d2/d9/d12/d35/d48/d60 0 2023-12-16T07:40:39.906 INFO:tasks.workunit.client.1.smithi133.stdout:0/317: write d2/d9/f47 [404528,68368] 0 2023-12-16T07:40:39.908 INFO:tasks.workunit.client.1.smithi133.stdout:4/419: rename d3/f41 to d3/d7/d38/d57/d67/f8d 0 2023-12-16T07:40:39.909 INFO:tasks.workunit.client.1.smithi133.stdout:1/308: dread d0/da/db/f2c [0,4194304] 0 2023-12-16T07:40:39.909 INFO:tasks.workunit.client.1.smithi133.stdout:1/309: write d0/d1c/f5c [930256,49673] 0 2023-12-16T07:40:39.911 INFO:tasks.workunit.client.1.smithi133.stdout:8/259: dwrite d9/d10/f3a [0,4194304] 0 2023-12-16T07:40:39.912 INFO:tasks.workunit.client.1.smithi133.stdout:4/420: symlink d3/d7/d38/d45/l8e 0 2023-12-16T07:40:39.912 INFO:tasks.workunit.client.1.smithi133.stdout:4/421: chown d3/c1e 3 1 2023-12-16T07:40:39.912 INFO:tasks.workunit.client.1.smithi133.stdout:4/422: chown d3/d7/d1c/c74 362937 1 2023-12-16T07:40:39.913 INFO:tasks.workunit.client.1.smithi133.stdout:1/310: mkdir d0/da/db/d24/d32/d56/d59/d66 0 2023-12-16T07:40:39.913 INFO:tasks.workunit.client.1.smithi133.stdout:1/311: chown d0/da/d3d/d41/l4f 4560 1 2023-12-16T07:40:39.917 INFO:tasks.workunit.client.1.smithi133.stdout:0/318: mknod d2/d9/c61 0 2023-12-16T07:40:39.920 INFO:tasks.workunit.client.1.smithi133.stdout:8/260: symlink d9/d11/d52/l58 0 2023-12-16T07:40:39.925 INFO:tasks.workunit.client.1.smithi133.stdout:8/261: dread d9/d2d/f34 [0,4194304] 0 2023-12-16T07:40:39.934 INFO:tasks.workunit.client.1.smithi133.stdout:9/294: truncate d15/f16 346678 0 2023-12-16T07:40:39.934 INFO:tasks.workunit.client.1.smithi133.stdout:9/295: readlink d15/d18/l40 0 2023-12-16T07:40:39.937 INFO:tasks.workunit.client.1.smithi133.stdout:4/423: creat d3/d7/d44/f8f x:0 0 0 2023-12-16T07:40:39.938 INFO:tasks.workunit.client.1.smithi133.stdout:4/424: write d3/d7/d38/d57/f5f [4701770,111623] 0 2023-12-16T07:40:39.938 INFO:tasks.workunit.client.1.smithi133.stdout:4/425: truncate d3/f5d 1381077 0 2023-12-16T07:40:39.939 INFO:tasks.workunit.client.1.smithi133.stdout:1/312: symlink d0/d12/l67 0 2023-12-16T07:40:39.940 INFO:tasks.workunit.client.1.smithi133.stdout:1/313: read d0/da/db/f2c [2569906,102008] 0 2023-12-16T07:40:39.941 INFO:tasks.workunit.client.1.smithi133.stdout:0/319: link d2/d9/d20/l41 d2/d17/d2b/d31/l62 0 2023-12-16T07:40:39.941 INFO:tasks.workunit.client.1.smithi133.stdout:0/320: write d2/d9/f47 [675507,32101] 0 2023-12-16T07:40:39.942 INFO:tasks.workunit.client.1.smithi133.stdout:0/321: fdatasync d2/d9/db/fe 0 2023-12-16T07:40:39.945 INFO:tasks.workunit.client.1.smithi133.stdout:9/296: rmdir d15/d18/d2c/d3a/d50 0 2023-12-16T07:40:39.945 INFO:tasks.workunit.client.1.smithi133.stdout:9/297: dread - d15/d18/d2c/d3a/f49 zero size 2023-12-16T07:40:39.947 INFO:tasks.workunit.client.1.smithi133.stdout:1/314: mkdir d0/da/db/d24/d5a/d68 0 2023-12-16T07:40:39.948 INFO:tasks.workunit.client.1.smithi133.stdout:0/322: mkdir d2/d17/d2b/d31/d63 0 2023-12-16T07:40:39.950 INFO:tasks.workunit.client.1.smithi133.stdout:4/426: dread d3/d7/d38/d57/f66 [0,4194304] 0 2023-12-16T07:40:39.950 INFO:tasks.workunit.client.1.smithi133.stdout:8/262: dwrite d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:39.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/315: rename d0/l4d to d0/da/db/d24/d5a/d68/l69 0 2023-12-16T07:40:39.952 INFO:tasks.workunit.client.1.smithi133.stdout:1/316: write d0/da/db/f23 [5042827,102807] 0 2023-12-16T07:40:39.955 INFO:tasks.workunit.client.1.smithi133.stdout:0/323: mknod d2/d17/d2b/d31/d36/c64 0 2023-12-16T07:40:39.956 INFO:tasks.workunit.client.1.smithi133.stdout:4/427: symlink d3/d7/l90 0 2023-12-16T07:40:39.956 INFO:tasks.workunit.client.1.smithi133.stdout:4/428: write d3/d7/d38/d45/f68 [1473139,30119] 0 2023-12-16T07:40:39.959 INFO:tasks.workunit.client.1.smithi133.stdout:8/263: mknod d9/dc/de/c59 0 2023-12-16T07:40:39.960 INFO:tasks.workunit.client.1.smithi133.stdout:1/317: truncate d0/d12/f5e 873164 0 2023-12-16T07:40:39.962 INFO:tasks.workunit.client.1.smithi133.stdout:0/324: creat d2/d9/d12/f65 x:0 0 0 2023-12-16T07:40:39.963 INFO:tasks.workunit.client.1.smithi133.stdout:0/325: chown d2/d9/d20/l41 46 1 2023-12-16T07:40:39.970 INFO:tasks.workunit.client.1.smithi133.stdout:1/318: creat d0/da/d3d/d41/f6a x:0 0 0 2023-12-16T07:40:39.970 INFO:tasks.workunit.client.1.smithi133.stdout:4/429: dread d3/d7/d1c/d2a/f7c [0,4194304] 0 2023-12-16T07:40:39.971 INFO:tasks.workunit.client.1.smithi133.stdout:8/264: write d9/d11/f25 [2257652,25535] 0 2023-12-16T07:40:39.971 INFO:tasks.workunit.client.1.smithi133.stdout:8/265: write d9/f2e [4965202,54231] 0 2023-12-16T07:40:39.971 INFO:tasks.workunit.client.1.smithi133.stdout:9/298: dwrite d15/d18/d2c/f31 [0,4194304] 0 2023-12-16T07:40:39.971 INFO:tasks.workunit.client.1.smithi133.stdout:9/299: readlink l12 0 2023-12-16T07:40:39.975 INFO:tasks.workunit.client.1.smithi133.stdout:1/319: read d0/d12/f3f [3163293,77900] 0 2023-12-16T07:40:39.975 INFO:tasks.workunit.client.1.smithi133.stdout:1/320: write d0/da/db/f2c [4701760,17116] 0 2023-12-16T07:40:39.989 INFO:tasks.workunit.client.1.smithi133.stdout:0/326: rename d2/d9/c11 to d2/d9/d20/d5e/c66 0 2023-12-16T07:40:39.991 INFO:tasks.workunit.client.1.smithi133.stdout:0/327: write d2/d17/f2e [3918084,82949] 0 2023-12-16T07:40:39.994 INFO:tasks.workunit.client.1.smithi133.stdout:4/430: mkdir d3/d7/d1c/d2a/d91 0 2023-12-16T07:40:39.994 INFO:tasks.workunit.client.1.smithi133.stdout:4/431: chown d3/d7/d1a/f33 0 1 2023-12-16T07:40:39.994 INFO:tasks.workunit.client.1.smithi133.stdout:8/266: creat d9/d11/d52/f5a x:0 0 0 2023-12-16T07:40:39.994 INFO:tasks.workunit.client.1.smithi133.stdout:8/267: chown d9/dc 24 1 2023-12-16T07:40:39.994 INFO:tasks.workunit.client.1.smithi133.stdout:8/268: chown d9/dc/de/c59 1 1 2023-12-16T07:40:39.994 INFO:tasks.workunit.client.1.smithi133.stdout:8/269: chown d9/dc/f3c 53 1 2023-12-16T07:40:39.995 INFO:tasks.workunit.client.1.smithi133.stdout:9/300: dwrite f13 [4194304,4194304] 0 2023-12-16T07:40:40.004 INFO:tasks.workunit.client.1.smithi133.stdout:0/328: mkdir d2/d17/d2b/d67 0 2023-12-16T07:40:40.005 INFO:tasks.workunit.client.1.smithi133.stdout:0/329: chown d2/d17/d40/f49 22 1 2023-12-16T07:40:40.005 INFO:tasks.workunit.client.1.smithi133.stdout:4/432: creat d3/d7/d38/d57/d67/f92 x:0 0 0 2023-12-16T07:40:40.007 INFO:tasks.workunit.client.1.smithi133.stdout:9/301: creat d15/d18/d4d/f60 x:0 0 0 2023-12-16T07:40:40.007 INFO:tasks.workunit.client.1.smithi133.stdout:8/270: symlink d9/dc/de/l5b 0 2023-12-16T07:40:40.008 INFO:tasks.workunit.client.1.smithi133.stdout:4/433: creat d3/d7/d44/d63/f93 x:0 0 0 2023-12-16T07:40:40.009 INFO:tasks.workunit.client.1.smithi133.stdout:4/434: chown d3/d7/d44/f55 107981485 1 2023-12-16T07:40:40.010 INFO:tasks.workunit.client.1.smithi133.stdout:8/271: creat d9/d10/d39/f5c x:0 0 0 2023-12-16T07:40:40.010 INFO:tasks.workunit.client.1.smithi133.stdout:8/272: write d9/d10/f45 [361733,2250] 0 2023-12-16T07:40:40.011 INFO:tasks.workunit.client.1.smithi133.stdout:8/273: mknod d9/d11/d42/c5d 0 2023-12-16T07:40:40.012 INFO:tasks.workunit.client.1.smithi133.stdout:4/435: dread d3/d7/d44/f78 [0,4194304] 0 2023-12-16T07:40:40.013 INFO:tasks.workunit.client.1.smithi133.stdout:1/321: dwrite d0/d1c/d37/f4a [0,4194304] 0 2023-12-16T07:40:40.014 INFO:tasks.workunit.client.1.smithi133.stdout:8/274: creat d9/f5e x:0 0 0 2023-12-16T07:40:40.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/436: creat d3/d7/d44/f94 x:0 0 0 2023-12-16T07:40:40.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/437: chown d3/c6 593791 1 2023-12-16T07:40:40.019 INFO:tasks.workunit.client.1.smithi133.stdout:1/322: creat d0/da/db/d24/f6b x:0 0 0 2023-12-16T07:40:40.020 INFO:tasks.workunit.client.1.smithi133.stdout:9/302: dread d15/d18/f4e [0,4194304] 0 2023-12-16T07:40:40.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/275: write d9/f2e [2419146,57266] 0 2023-12-16T07:40:40.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/276: readlink d9/dc/l3d 0 2023-12-16T07:40:40.021 INFO:tasks.workunit.client.1.smithi133.stdout:4/438: unlink d3/d7/d6d/l79 0 2023-12-16T07:40:40.021 INFO:tasks.workunit.client.1.smithi133.stdout:4/439: chown d3/d7/d38/c54 45767125 1 2023-12-16T07:40:40.021 INFO:tasks.workunit.client.1.smithi133.stdout:9/303: write d15/d18/d2c/f3e [594398,92854] 0 2023-12-16T07:40:40.021 INFO:tasks.workunit.client.1.smithi133.stdout:9/304: readlink d15/l58 0 2023-12-16T07:40:40.021 INFO:tasks.workunit.client.1.smithi133.stdout:9/305: fdatasync d15/d18/f24 0 2023-12-16T07:40:40.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/277: unlink d9/d11/f1f 0 2023-12-16T07:40:40.026 INFO:tasks.workunit.client.1.smithi133.stdout:1/323: dread d0/d1c/f5c [0,4194304] 0 2023-12-16T07:40:40.027 INFO:tasks.workunit.client.1.smithi133.stdout:9/306: mkdir d15/d18/d61 0 2023-12-16T07:40:40.027 INFO:tasks.workunit.client.1.smithi133.stdout:9/307: dread - d15/d18/f36 zero size 2023-12-16T07:40:40.034 INFO:tasks.workunit.client.1.smithi133.stdout:8/278: truncate d9/f41 45282 0 2023-12-16T07:40:40.034 INFO:tasks.workunit.client.1.smithi133.stdout:8/279: truncate d9/d10/d39/d48/d44/f53 697995 0 2023-12-16T07:40:40.036 INFO:tasks.workunit.client.1.smithi133.stdout:8/280: mknod d9/d10/d39/d48/c5f 0 2023-12-16T07:40:40.036 INFO:tasks.workunit.client.1.smithi133.stdout:8/281: chown d9 1604123 1 2023-12-16T07:40:40.036 INFO:tasks.workunit.client.1.smithi133.stdout:8/282: truncate d9/f2e 5813031 0 2023-12-16T07:40:40.037 INFO:tasks.workunit.client.1.smithi133.stdout:8/283: read d9/dc/f4c [3887924,124160] 0 2023-12-16T07:40:40.039 INFO:tasks.workunit.client.1.smithi133.stdout:1/324: mknod d0/c6c 0 2023-12-16T07:40:40.041 INFO:tasks.workunit.client.1.smithi133.stdout:8/284: unlink d9/f22 0 2023-12-16T07:40:40.041 INFO:tasks.workunit.client.1.smithi133.stdout:8/285: stat d9/d10/d39/d48/f4a 0 2023-12-16T07:40:40.045 INFO:tasks.workunit.client.1.smithi133.stdout:1/325: dread d0/da/f3a [0,4194304] 0 2023-12-16T07:40:40.050 INFO:tasks.workunit.client.1.smithi133.stdout:9/308: dwrite d15/d18/d4d/f56 [0,4194304] 0 2023-12-16T07:40:40.050 INFO:tasks.workunit.client.1.smithi133.stdout:9/309: truncate d15/d18/f2f 4272781 0 2023-12-16T07:40:40.051 INFO:tasks.workunit.client.1.smithi133.stdout:1/326: truncate d0/da/d3d/f50 612164 0 2023-12-16T07:40:40.051 INFO:tasks.workunit.client.1.smithi133.stdout:1/327: fdatasync d0/d12/d51/f64 0 2023-12-16T07:40:40.061 INFO:tasks.workunit.client.1.smithi133.stdout:4/440: getdents d3/d7/d38/d45 0 2023-12-16T07:40:40.063 INFO:tasks.workunit.client.1.smithi133.stdout:9/310: symlink d15/d18/d2c/d3a/l62 0 2023-12-16T07:40:40.063 INFO:tasks.workunit.client.1.smithi133.stdout:9/311: read - d15/d18/d2c/d3a/f49 zero size 2023-12-16T07:40:40.067 INFO:tasks.workunit.client.1.smithi133.stdout:1/328: creat d0/da/db/d24/d5a/d68/f6d x:0 0 0 2023-12-16T07:40:40.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/329: fdatasync d0/d12/f1b 0 2023-12-16T07:40:40.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/330: fsync d0/da/db/fd 0 2023-12-16T07:40:40.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/331: fsync d0/f2a 0 2023-12-16T07:40:40.071 INFO:tasks.workunit.client.1.smithi133.stdout:9/312: dread d15/d18/d2c/f30 [0,4194304] 0 2023-12-16T07:40:40.072 INFO:tasks.workunit.client.1.smithi133.stdout:9/313: chown d15/d18/f24 3 1 2023-12-16T07:40:40.073 INFO:tasks.workunit.client.1.smithi133.stdout:4/441: link d3/l80 d3/d7/d1c/l95 0 2023-12-16T07:40:40.077 INFO:tasks.workunit.client.1.smithi133.stdout:5/198: sync 2023-12-16T07:40:40.077 INFO:tasks.workunit.client.1.smithi133.stdout:5/199: chown d1/d1c/c22 4 1 2023-12-16T07:40:40.078 INFO:tasks.workunit.client.1.smithi133.stdout:9/314: mknod d15/d18/d2c/c63 0 2023-12-16T07:40:40.078 INFO:tasks.workunit.client.1.smithi133.stdout:9/315: write d15/d18/f36 [142515,79541] 0 2023-12-16T07:40:40.079 INFO:tasks.workunit.client.1.smithi133.stdout:4/442: mkdir d3/d7/d44/d63/d96 0 2023-12-16T07:40:40.082 INFO:tasks.workunit.client.1.smithi133.stdout:1/332: rename d0/c14 to d0/da/db/c6e 0 2023-12-16T07:40:40.083 INFO:tasks.workunit.client.1.smithi133.stdout:5/200: creat d1/d18/f42 x:0 0 0 2023-12-16T07:40:40.085 INFO:tasks.workunit.client.1.smithi133.stdout:9/316: mknod d15/d18/d5b/c64 0 2023-12-16T07:40:40.087 INFO:tasks.workunit.client.1.smithi133.stdout:5/201: mknod d1/d18/d26/c43 0 2023-12-16T07:40:40.089 INFO:tasks.workunit.client.1.smithi133.stdout:9/317: link l8 d15/d18/d5b/l65 0 2023-12-16T07:40:40.089 INFO:tasks.workunit.client.1.smithi133.stdout:4/443: dread d3/d7/d1c/d2a/f7f [0,4194304] 0 2023-12-16T07:40:40.091 INFO:tasks.workunit.client.1.smithi133.stdout:4/444: dread d3/d7/d38/d45/f65 [0,4194304] 0 2023-12-16T07:40:40.093 INFO:tasks.workunit.client.1.smithi133.stdout:9/318: symlink d15/l66 0 2023-12-16T07:40:40.094 INFO:tasks.workunit.client.1.smithi133.stdout:9/319: write f14 [3622072,35713] 0 2023-12-16T07:40:40.094 INFO:tasks.workunit.client.1.smithi133.stdout:9/320: write fc [1032064,104623] 0 2023-12-16T07:40:40.094 INFO:tasks.workunit.client.1.smithi133.stdout:4/445: symlink d3/d7/d38/d57/d75/l97 0 2023-12-16T07:40:40.094 INFO:tasks.workunit.client.1.smithi133.stdout:0/330: rmdir d2/d17/d2b/d31/d36 39 2023-12-16T07:40:40.095 INFO:tasks.workunit.client.1.smithi133.stdout:0/331: write d2/d9/db/f55 [180563,16120] 0 2023-12-16T07:40:40.141 INFO:tasks.workunit.client.1.smithi133.stdout:5/202: dwrite d1/de/f13 [0,4194304] 0 2023-12-16T07:40:40.141 INFO:tasks.workunit.client.1.smithi133.stdout:5/203: rename d1 to d1/d18/d2c/d44 22 2023-12-16T07:40:40.144 INFO:tasks.workunit.client.1.smithi133.stdout:9/321: symlink d15/d18/d2c/l67 0 2023-12-16T07:40:40.145 INFO:tasks.workunit.client.1.smithi133.stdout:4/446: symlink d3/l98 0 2023-12-16T07:40:40.146 INFO:tasks.workunit.client.1.smithi133.stdout:0/332: mknod d2/d9/d12/d35/d48/c68 0 2023-12-16T07:40:40.150 INFO:tasks.workunit.client.1.smithi133.stdout:5/204: link d1/d18/d2c/f39 d1/d18/d2c/f45 0 2023-12-16T07:40:40.152 INFO:tasks.workunit.client.1.smithi133.stdout:4/447: symlink d3/d7/d38/l99 0 2023-12-16T07:40:40.153 INFO:tasks.workunit.client.1.smithi133.stdout:4/448: chown d3/d7/d1c/f69 2425 1 2023-12-16T07:40:40.153 INFO:tasks.workunit.client.1.smithi133.stdout:4/449: truncate d3/d7/d38/d57/f66 592851 0 2023-12-16T07:40:40.155 INFO:tasks.workunit.client.1.smithi133.stdout:4/450: mknod d3/c9a 0 2023-12-16T07:40:40.156 INFO:tasks.workunit.client.1.smithi133.stdout:4/451: mknod d3/d7/d6d/d89/c9b 0 2023-12-16T07:40:40.156 INFO:tasks.workunit.client.1.smithi133.stdout:4/452: write d3/d7/d44/f8f [179932,43726] 0 2023-12-16T07:40:40.156 INFO:tasks.workunit.client.1.smithi133.stdout:0/333: dread d2/f6 [0,4194304] 0 2023-12-16T07:40:40.157 INFO:tasks.workunit.client.1.smithi133.stdout:0/334: getdents d2/d9/d12/d45 0 2023-12-16T07:40:40.157 INFO:tasks.workunit.client.1.smithi133.stdout:0/335: getdents d2/d17/d2b/d31/d36 0 2023-12-16T07:40:40.160 INFO:tasks.workunit.client.1.smithi133.stdout:0/336: mknod d2/d9/d12/d35/d48/d60/c69 0 2023-12-16T07:40:40.161 INFO:tasks.workunit.client.1.smithi133.stdout:0/337: symlink d2/d17/l6a 0 2023-12-16T07:40:40.162 INFO:tasks.workunit.client.1.smithi133.stdout:0/338: chown d2/d9/d12/d35/d48/d60/c69 7646510 1 2023-12-16T07:40:40.163 INFO:tasks.workunit.client.1.smithi133.stdout:0/339: link d2/d9/db/l1a d2/d9/d12/d35/d4f/l6b 0 2023-12-16T07:40:40.163 INFO:tasks.workunit.client.1.smithi133.stdout:0/340: fsync d2/d9/d20/f29 0 2023-12-16T07:40:40.164 INFO:tasks.workunit.client.1.smithi133.stdout:9/322: rmdir d15/d18/d4d 39 2023-12-16T07:40:40.173 INFO:tasks.workunit.client.1.smithi133.stdout:8/286: truncate d9/d10/f1b 462691 0 2023-12-16T07:40:40.176 INFO:tasks.workunit.client.1.smithi133.stdout:9/323: dread d15/f17 [0,4194304] 0 2023-12-16T07:40:40.178 INFO:tasks.workunit.client.1.smithi133.stdout:4/453: dwrite d3/d7/d38/d57/d67/f87 [0,4194304] 0 2023-12-16T07:40:40.178 INFO:tasks.workunit.client.1.smithi133.stdout:4/454: chown d3/d7/d38/c54 116 1 2023-12-16T07:40:40.178 INFO:tasks.workunit.client.1.smithi133.stdout:4/455: chown d3/c15 460 1 2023-12-16T07:40:40.178 INFO:tasks.workunit.client.1.smithi133.stdout:9/324: dread fe [0,4194304] 0 2023-12-16T07:40:40.179 INFO:tasks.workunit.client.1.smithi133.stdout:9/325: read d15/f35 [603250,49331] 0 2023-12-16T07:40:40.179 INFO:tasks.workunit.client.1.smithi133.stdout:9/326: dread - d15/d18/d2c/f3d zero size 2023-12-16T07:40:40.186 INFO:tasks.workunit.client.1.smithi133.stdout:5/205: dwrite d1/f3d [0,4194304] 0 2023-12-16T07:40:40.186 INFO:tasks.workunit.client.1.smithi133.stdout:4/456: creat d3/d7/d1a/f9c x:0 0 0 2023-12-16T07:40:40.187 INFO:tasks.workunit.client.1.smithi133.stdout:9/327: mkdir d15/d18/d2c/d68 0 2023-12-16T07:40:40.196 INFO:tasks.workunit.client.1.smithi133.stdout:4/457: dread d3/d7/d38/f3d [0,4194304] 0 2023-12-16T07:40:40.197 INFO:tasks.workunit.client.1.smithi133.stdout:8/287: dwrite d9/d2d/f56 [0,4194304] 0 2023-12-16T07:40:40.197 INFO:tasks.workunit.client.1.smithi133.stdout:5/206: dread d1/d16/f2a [0,4194304] 0 2023-12-16T07:40:40.197 INFO:tasks.workunit.client.1.smithi133.stdout:5/207: dread - d1/d1c/f38 zero size 2023-12-16T07:40:40.197 INFO:tasks.workunit.client.1.smithi133.stdout:5/208: truncate d1/d18/f1e 420703 0 2023-12-16T07:40:40.198 INFO:tasks.workunit.client.1.smithi133.stdout:5/209: write d1/f7 [2714667,50440] 0 2023-12-16T07:40:40.201 INFO:tasks.workunit.client.1.smithi133.stdout:8/288: mknod d9/d10/d39/d48/c60 0 2023-12-16T07:40:40.201 INFO:tasks.workunit.client.1.smithi133.stdout:8/289: chown d9/d10/d39 123926 1 2023-12-16T07:40:40.201 INFO:tasks.workunit.client.1.smithi133.stdout:8/290: dread - d9/f3e zero size 2023-12-16T07:40:40.204 INFO:tasks.workunit.client.1.smithi133.stdout:5/210: symlink d1/d16/l46 0 2023-12-16T07:40:40.205 INFO:tasks.workunit.client.1.smithi133.stdout:8/291: rmdir d9/d10/d39/d48/d44 39 2023-12-16T07:40:40.205 INFO:tasks.workunit.client.1.smithi133.stdout:9/328: dwrite fc [0,4194304] 0 2023-12-16T07:40:40.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:39 smithi049 ceph-mon[111939]: pgmap v16: 65 pgs: 65 active+clean; 1.4 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 80 MiB/s rd, 155 MiB/s wr, 325 op/s 2023-12-16T07:40:40.209 INFO:tasks.workunit.client.1.smithi133.stdout:5/211: rename d1/d18/f1e to d1/d18/f47 0 2023-12-16T07:40:40.217 INFO:tasks.workunit.client.1.smithi133.stdout:9/329: symlink d15/d18/d2c/d3a/l69 0 2023-12-16T07:40:40.217 INFO:tasks.workunit.client.1.smithi133.stdout:9/330: fdatasync d15/d18/f41 0 2023-12-16T07:40:40.242 INFO:tasks.workunit.client.1.smithi133.stdout:4/458: dwrite d3/d7/fb [0,4194304] 0 2023-12-16T07:40:40.242 INFO:tasks.workunit.client.1.smithi133.stdout:8/292: dwrite d9/d11/d52/f5a [0,4194304] 0 2023-12-16T07:40:40.242 INFO:tasks.workunit.client.1.smithi133.stdout:9/331: dwrite d15/d18/d4d/f56 [0,4194304] 0 2023-12-16T07:40:40.242 INFO:tasks.workunit.client.1.smithi133.stdout:9/332: stat d15/d18/d2c/f30 0 2023-12-16T07:40:40.242 INFO:tasks.workunit.client.1.smithi133.stdout:9/333: fdatasync d15/f35 0 2023-12-16T07:40:40.243 INFO:tasks.workunit.client.1.smithi133.stdout:5/212: dwrite d1/d18/f42 [0,4194304] 0 2023-12-16T07:40:40.243 INFO:tasks.workunit.client.1.smithi133.stdout:5/213: chown d1/de/f23 1915766 1 2023-12-16T07:40:40.243 INFO:tasks.workunit.client.1.smithi133.stdout:4/459: write d3/d7/d38/d57/f66 [396614,29072] 0 2023-12-16T07:40:40.247 INFO:tasks.workunit.client.1.smithi133.stdout:8/293: rmdir d9/d3f 39 2023-12-16T07:40:40.250 INFO:tasks.workunit.client.1.smithi133.stdout:9/334: symlink d15/d18/d4d/l6a 0 2023-12-16T07:40:40.255 INFO:tasks.workunit.client.1.smithi133.stdout:5/214: link d1/de/l14 d1/d18/d26/l48 0 2023-12-16T07:40:40.255 INFO:tasks.workunit.client.1.smithi133.stdout:5/215: write d1/d1c/f40 [536480,33064] 0 2023-12-16T07:40:40.257 INFO:tasks.workunit.client.1.smithi133.stdout:9/335: creat d15/d18/d4d/f6b x:0 0 0 2023-12-16T07:40:40.257 INFO:tasks.workunit.client.1.smithi133.stdout:9/336: fsync fd 0 2023-12-16T07:40:40.259 INFO:tasks.workunit.client.1.smithi133.stdout:9/337: symlink d15/d18/d2c/d3a/l6c 0 2023-12-16T07:40:40.259 INFO:tasks.workunit.client.1.smithi133.stdout:9/338: chown d15/d18/d2c/l52 84 1 2023-12-16T07:40:40.261 INFO:tasks.workunit.client.1.smithi133.stdout:9/339: dread d15/d18/d2c/f47 [0,4194304] 0 2023-12-16T07:40:40.262 INFO:tasks.workunit.client.1.smithi133.stdout:9/340: rmdir d15/d18/d2c/d3a 39 2023-12-16T07:40:40.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/341: creat d15/d18/d5b/f6d x:0 0 0 2023-12-16T07:40:40.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/342: chown d15/d18/f4a 19 1 2023-12-16T07:40:40.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/343: chown d15/f26 0 1 2023-12-16T07:40:40.266 INFO:tasks.workunit.client.1.smithi133.stdout:8/294: dwrite d9/dc/d27/f2b [0,4194304] 0 2023-12-16T07:40:40.266 INFO:tasks.workunit.client.1.smithi133.stdout:4/460: dwrite d3/f8c [0,4194304] 0 2023-12-16T07:40:40.267 INFO:tasks.workunit.client.1.smithi133.stdout:9/344: mkdir d15/d18/d61/d6e 0 2023-12-16T07:40:40.270 INFO:tasks.workunit.client.1.smithi133.stdout:8/295: rename d9/dc/c17 to d9/d11/d33/c61 0 2023-12-16T07:40:40.270 INFO:tasks.workunit.client.1.smithi133.stdout:8/296: dread - d9/d11/f38 zero size 2023-12-16T07:40:40.270 INFO:tasks.workunit.client.1.smithi133.stdout:8/297: truncate d9/d10/d39/d48/f51 648661 0 2023-12-16T07:40:40.274 INFO:tasks.workunit.client.1.smithi133.stdout:8/298: link d9/d10/f37 d9/d11/d42/f62 0 2023-12-16T07:40:40.276 INFO:tasks.workunit.client.1.smithi133.stdout:9/345: dread d15/d18/d2c/f33 [0,4194304] 0 2023-12-16T07:40:40.276 INFO:tasks.workunit.client.1.smithi133.stdout:9/346: dread - d15/d18/f41 zero size 2023-12-16T07:40:40.280 INFO:tasks.workunit.client.1.smithi133.stdout:3/223: sync 2023-12-16T07:40:40.289 INFO:tasks.workunit.client.1.smithi133.stdout:8/299: dwrite d9/d10/d39/d48/f51 [0,4194304] 0 2023-12-16T07:40:40.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/347: rename d15/d18/d4d/f60 to d15/d18/d2c/d3a/f6f 0 2023-12-16T07:40:40.292 INFO:tasks.workunit.client.1.smithi133.stdout:9/348: write d15/d18/f21 [1646165,96234] 0 2023-12-16T07:40:40.296 INFO:tasks.workunit.client.1.smithi133.stdout:8/300: creat d9/d11/d42/f63 x:0 0 0 2023-12-16T07:40:40.299 INFO:tasks.workunit.client.1.smithi133.stdout:9/349: mknod d15/d18/d2c/d68/c70 0 2023-12-16T07:40:40.303 INFO:tasks.workunit.client.1.smithi133.stdout:9/350: mkdir d15/d18/d5b/d71 0 2023-12-16T07:40:40.303 INFO:tasks.workunit.client.1.smithi133.stdout:9/351: write d15/f29 [888982,21197] 0 2023-12-16T07:40:40.303 INFO:tasks.workunit.client.1.smithi133.stdout:9/352: readlink d15/d18/d2c/d3a/l59 0 2023-12-16T07:40:40.303 INFO:tasks.workunit.client.1.smithi133.stdout:3/224: dwrite d7/d8/d1c/d2b/f15 [4194304,4194304] 0 2023-12-16T07:40:40.304 INFO:tasks.workunit.client.1.smithi133.stdout:9/353: creat d15/d18/d61/d6e/f72 x:0 0 0 2023-12-16T07:40:40.307 INFO:tasks.workunit.client.1.smithi133.stdout:3/225: creat d7/d8/d1c/d2e/f5e x:0 0 0 2023-12-16T07:40:40.308 INFO:tasks.workunit.client.1.smithi133.stdout:8/301: dread d9/d10/d39/d48/f51 [0,4194304] 0 2023-12-16T07:40:40.308 INFO:tasks.workunit.client.1.smithi133.stdout:8/302: rename d9 to d9/d10/d39/d48/d64 22 2023-12-16T07:40:40.309 INFO:tasks.workunit.client.1.smithi133.stdout:8/303: write d9/d2d/f34 [829632,65862] 0 2023-12-16T07:40:40.312 INFO:tasks.workunit.client.1.smithi133.stdout:8/304: rmdir d9/d11/d52 39 2023-12-16T07:40:40.313 INFO:tasks.workunit.client.1.smithi133.stdout:2/191: sync 2023-12-16T07:40:40.313 INFO:tasks.workunit.client.1.smithi133.stdout:6/494: sync 2023-12-16T07:40:40.313 INFO:tasks.workunit.client.1.smithi133.stdout:3/226: dread d7/d8/f54 [0,4194304] 0 2023-12-16T07:40:40.313 INFO:tasks.workunit.client.1.smithi133.stdout:6/495: readlink d0/l52 0 2023-12-16T07:40:40.313 INFO:tasks.workunit.client.1.smithi133.stdout:7/566: sync 2023-12-16T07:40:40.313 INFO:tasks.workunit.client.1.smithi133.stdout:3/227: truncate d7/d8/d1c/f50 631161 0 2023-12-16T07:40:40.314 INFO:tasks.workunit.client.1.smithi133.stdout:8/305: creat d9/dc/f65 x:0 0 0 2023-12-16T07:40:40.319 INFO:tasks.workunit.client.1.smithi133.stdout:6/496: mkdir d0/d4/d21/d8a/da4 0 2023-12-16T07:40:40.319 INFO:tasks.workunit.client.1.smithi133.stdout:6/497: fdatasync d0/d4/f2b 0 2023-12-16T07:40:40.320 INFO:tasks.workunit.client.1.smithi133.stdout:7/567: creat db/d21/fba x:0 0 0 2023-12-16T07:40:40.322 INFO:tasks.workunit.client.1.smithi133.stdout:3/228: getdents d7/d8/d1c 0 2023-12-16T07:40:40.324 INFO:tasks.workunit.client.1.smithi133.stdout:2/192: creat da/d1d/d24/f37 x:0 0 0 2023-12-16T07:40:40.326 INFO:tasks.workunit.client.1.smithi133.stdout:6/498: rename d0/d4/d21/f2a to d0/d4/d21/d8a/d93/fa5 0 2023-12-16T07:40:40.328 INFO:tasks.workunit.client.1.smithi133.stdout:8/306: dwrite d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:40.328 INFO:tasks.workunit.client.1.smithi133.stdout:9/354: getdents d15/d18/d61/d6e 0 2023-12-16T07:40:40.331 INFO:tasks.workunit.client.1.smithi133.stdout:3/229: mkdir d7/d8/d1d/d2a/d5f 0 2023-12-16T07:40:40.333 INFO:tasks.workunit.client.1.smithi133.stdout:6/499: unlink d0/f18 0 2023-12-16T07:40:40.338 INFO:tasks.workunit.client.1.smithi133.stdout:9/355: dread d15/f37 [0,4194304] 0 2023-12-16T07:40:40.340 INFO:tasks.workunit.client.1.smithi133.stdout:8/307: getdents d9/d10/d39 0 2023-12-16T07:40:40.340 INFO:tasks.workunit.client.1.smithi133.stdout:8/308: chown c4 413880 1 2023-12-16T07:40:40.340 INFO:tasks.workunit.client.1.smithi133.stdout:9/356: write f13 [210933,101661] 0 2023-12-16T07:40:40.340 INFO:tasks.workunit.client.1.smithi133.stdout:3/230: mknod d7/d8/d1d/d2a/c60 0 2023-12-16T07:40:40.342 INFO:tasks.workunit.client.1.smithi133.stdout:3/231: write d7/d8/fe [495789,116931] 0 2023-12-16T07:40:40.342 INFO:tasks.workunit.client.1.smithi133.stdout:8/309: creat d9/d3f/f66 x:0 0 0 2023-12-16T07:40:40.343 INFO:tasks.workunit.client.1.smithi133.stdout:6/500: dread d0/d4/d21/d35/f48 [0,4194304] 0 2023-12-16T07:40:40.343 INFO:tasks.workunit.client.1.smithi133.stdout:6/501: dread - d0/d4/d21/d35/d4e/d84/f70 zero size 2023-12-16T07:40:40.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/232: mknod d7/d8/d1d/d2a/d5f/c61 0 2023-12-16T07:40:40.348 INFO:tasks.workunit.client.1.smithi133.stdout:8/310: creat d9/dc/f67 x:0 0 0 2023-12-16T07:40:40.350 INFO:tasks.workunit.client.1.smithi133.stdout:9/357: dread d15/d18/f21 [0,4194304] 0 2023-12-16T07:40:40.350 INFO:tasks.workunit.client.1.smithi133.stdout:9/358: read - d15/d18/d4d/f51 zero size 2023-12-16T07:40:40.350 INFO:tasks.workunit.client.1.smithi133.stdout:9/359: write d15/d18/d2c/f4c [138366,100690] 0 2023-12-16T07:40:40.352 INFO:tasks.workunit.client.1.smithi133.stdout:6/502: dread d0/d4/d21/f39 [0,4194304] 0 2023-12-16T07:40:40.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/503: fsync d0/d4/f2b 0 2023-12-16T07:40:40.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/504: dread - d0/d4/f68 zero size 2023-12-16T07:40:40.354 INFO:tasks.workunit.client.1.smithi133.stdout:6/505: mknod d0/d4/d21/d8a/ca6 0 2023-12-16T07:40:40.354 INFO:tasks.workunit.client.1.smithi133.stdout:6/506: fsync d0/d4/d21/f59 0 2023-12-16T07:40:40.354 INFO:tasks.workunit.client.1.smithi133.stdout:6/507: fsync d0/f74 0 2023-12-16T07:40:40.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/360: dread fc [0,4194304] 0 2023-12-16T07:40:40.360 INFO:tasks.workunit.client.1.smithi133.stdout:3/233: dwrite d7/d8/f35 [0,4194304] 0 2023-12-16T07:40:40.361 INFO:tasks.workunit.client.1.smithi133.stdout:3/234: truncate d7/d8/f20 1988270 0 2023-12-16T07:40:40.361 INFO:tasks.workunit.client.1.smithi133.stdout:9/361: mkdir d15/d18/d2c/d3a/d5c/d73 0 2023-12-16T07:40:40.364 INFO:tasks.workunit.client.1.smithi133.stdout:3/235: mkdir d7/d8/d1d/d2a/d62 0 2023-12-16T07:40:40.364 INFO:tasks.workunit.client.1.smithi133.stdout:3/236: chown d7/d8/l3b 514974 1 2023-12-16T07:40:40.365 INFO:tasks.workunit.client.1.smithi133.stdout:3/237: mkdir d7/d8/d1d/d2a/d63 0 2023-12-16T07:40:40.367 INFO:tasks.workunit.client.1.smithi133.stdout:3/238: mknod d7/c64 0 2023-12-16T07:40:40.367 INFO:tasks.workunit.client.1.smithi133.stdout:3/239: write d7/d8/f35 [4487396,102739] 0 2023-12-16T07:40:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:39 smithi133 ceph-mon[120445]: pgmap v16: 65 pgs: 65 active+clean; 1.4 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 80 MiB/s rd, 155 MiB/s wr, 325 op/s 2023-12-16T07:40:40.369 INFO:tasks.workunit.client.1.smithi133.stdout:3/240: link d7/d8/d1c/d2e/l44 d7/d8/d1c/d2e/l65 0 2023-12-16T07:40:40.371 INFO:tasks.workunit.client.1.smithi133.stdout:3/241: creat d7/d8/d1c/f66 x:0 0 0 2023-12-16T07:40:40.372 INFO:tasks.workunit.client.1.smithi133.stdout:3/242: creat d7/d8/d1c/f67 x:0 0 0 2023-12-16T07:40:40.372 INFO:tasks.workunit.client.1.smithi133.stdout:3/243: fsync f3 0 2023-12-16T07:40:40.372 INFO:tasks.workunit.client.1.smithi133.stdout:3/244: stat l4 0 2023-12-16T07:40:40.373 INFO:tasks.workunit.client.1.smithi133.stdout:3/245: mknod d7/d8/d1c/d2e/d43/d5b/c68 0 2023-12-16T07:40:40.374 INFO:tasks.workunit.client.1.smithi133.stdout:3/246: readlink d7/d8/d1c/d2e/l44 0 2023-12-16T07:40:40.376 INFO:tasks.workunit.client.1.smithi133.stdout:3/247: creat d7/d8/d1c/d2e/f69 x:0 0 0 2023-12-16T07:40:40.389 INFO:tasks.workunit.client.1.smithi133.stdout:3/248: fsync d7/d8/d1c/d2e/f69 0 2023-12-16T07:40:40.389 INFO:tasks.workunit.client.1.smithi133.stdout:3/249: symlink d7/d8/d1d/d2a/l6a 0 2023-12-16T07:40:40.390 INFO:tasks.workunit.client.1.smithi133.stdout:3/250: write d7/d8/f10 [1875350,114402] 0 2023-12-16T07:40:40.393 INFO:tasks.workunit.client.1.smithi133.stdout:3/251: symlink d7/d8/d1c/d2e/d43/d5b/l6b 0 2023-12-16T07:40:40.395 INFO:tasks.workunit.client.1.smithi133.stdout:3/252: getdents d7/d8/d1c 0 2023-12-16T07:40:40.398 INFO:tasks.workunit.client.1.smithi133.stdout:3/253: symlink d7/d8/d1d/d2a/d62/l6c 0 2023-12-16T07:40:40.398 INFO:tasks.workunit.client.1.smithi133.stdout:3/254: truncate d7/d8/d1c/f41 757 0 2023-12-16T07:40:40.400 INFO:tasks.workunit.client.1.smithi133.stdout:3/255: rename d7/d8/f14 to d7/d8/d1c/d2e/f6d 0 2023-12-16T07:40:40.401 INFO:tasks.workunit.client.1.smithi133.stdout:3/256: write d7/d8/d1c/f4b [890596,22609] 0 2023-12-16T07:40:40.401 INFO:tasks.workunit.client.1.smithi133.stdout:3/257: rmdir d7/d8/d1c/d2e/d43 39 2023-12-16T07:40:40.418 INFO:tasks.workunit.client.1.smithi133.stdout:3/258: dwrite d7/d8/d1c/d2e/f5e [0,4194304] 0 2023-12-16T07:40:40.418 INFO:tasks.workunit.client.1.smithi133.stdout:3/259: readlink d7/d8/l3b 0 2023-12-16T07:40:40.421 INFO:tasks.workunit.client.1.smithi133.stdout:3/260: symlink d7/d8/d1d/d2a/d5f/l6e 0 2023-12-16T07:40:40.425 INFO:tasks.workunit.client.1.smithi133.stdout:3/261: rename d7/d8/d1c/l3e to d7/d8/d1d/d2a/d62/l6f 0 2023-12-16T07:40:40.439 INFO:tasks.workunit.client.1.smithi133.stdout:3/262: symlink d7/d8/d1c/d2e/l70 0 2023-12-16T07:40:40.439 INFO:tasks.workunit.client.1.smithi133.stdout:3/263: stat d7/d8/d1c/c2c 0 2023-12-16T07:40:40.439 INFO:tasks.workunit.client.1.smithi133.stdout:3/264: chown d7/d8/d1c/d2e/d43/l59 5 1 2023-12-16T07:40:40.439 INFO:tasks.workunit.client.1.smithi133.stdout:3/265: rename d7/d8 to d7/d8/d1d/d2a/d71 22 2023-12-16T07:40:40.495 INFO:tasks.workunit.client.1.smithi133.stdout:1/333: sync 2023-12-16T07:40:40.497 INFO:tasks.workunit.client.1.smithi133.stdout:1/334: rename d0/da/db/d24/c31 to d0/da/db/d24/d5a/d68/c6f 0 2023-12-16T07:40:40.498 INFO:tasks.workunit.client.1.smithi133.stdout:1/335: read d0/d12/f3f [5731757,78453] 0 2023-12-16T07:40:40.507 INFO:tasks.workunit.client.1.smithi133.stdout:1/336: dread d0/f29 [0,4194304] 0 2023-12-16T07:40:40.508 INFO:tasks.workunit.client.1.smithi133.stdout:1/337: read d0/da/db/f35 [1819432,44746] 0 2023-12-16T07:40:40.510 INFO:tasks.workunit.client.1.smithi133.stdout:1/338: truncate d0/d12/f5e 821688 0 2023-12-16T07:40:40.511 INFO:tasks.workunit.client.1.smithi133.stdout:1/339: write d0/da/f3a [397541,28208] 0 2023-12-16T07:40:40.513 INFO:tasks.workunit.client.1.smithi133.stdout:1/340: mkdir d0/da/db/d24/d32/d3e/d70 0 2023-12-16T07:40:40.513 INFO:tasks.workunit.client.1.smithi133.stdout:1/341: chown d0/da/f4b 1932630 1 2023-12-16T07:40:40.518 INFO:tasks.workunit.client.1.smithi133.stdout:1/342: mkdir d0/d1c/d71 0 2023-12-16T07:40:40.521 INFO:tasks.workunit.client.1.smithi133.stdout:1/343: creat d0/d60/f72 x:0 0 0 2023-12-16T07:40:40.521 INFO:tasks.workunit.client.1.smithi133.stdout:1/344: stat d0/da/db/f23 0 2023-12-16T07:40:40.522 INFO:tasks.workunit.client.1.smithi133.stdout:1/345: read d0/d1c/d37/f55 [2172732,78953] 0 2023-12-16T07:40:40.522 INFO:tasks.workunit.client.1.smithi133.stdout:1/346: dread - d0/d12/f58 zero size 2023-12-16T07:40:40.524 INFO:tasks.workunit.client.1.smithi133.stdout:1/347: mknod d0/d1c/d37/c73 0 2023-12-16T07:40:40.539 INFO:tasks.workunit.client.1.smithi133.stdout:1/348: dwrite d0/da/db/ff [4194304,4194304] 0 2023-12-16T07:40:40.541 INFO:tasks.workunit.client.1.smithi133.stdout:1/349: creat d0/da/db/d24/d32/d56/d59/d66/f74 x:0 0 0 2023-12-16T07:40:40.584 INFO:tasks.workunit.client.1.smithi133.stdout:1/350: truncate d0/d12/f1b 4360548 0 2023-12-16T07:40:40.585 INFO:tasks.workunit.client.1.smithi133.stdout:1/351: creat d0/da/db/d24/d32/d56/f75 x:0 0 0 2023-12-16T07:40:40.586 INFO:tasks.workunit.client.1.smithi133.stdout:1/352: write d0/da/f3a [573749,123695] 0 2023-12-16T07:40:40.586 INFO:tasks.workunit.client.1.smithi133.stdout:1/353: truncate d0/f17 3091327 0 2023-12-16T07:40:40.654 INFO:tasks.workunit.client.1.smithi133.stdout:1/354: creat d0/da/db/d24/d5a/d68/f76 x:0 0 0 2023-12-16T07:40:40.658 INFO:tasks.workunit.client.1.smithi133.stdout:1/355: unlink d0/da/db/d24/d32/c4c 0 2023-12-16T07:40:40.660 INFO:tasks.workunit.client.1.smithi133.stdout:1/356: creat d0/da/db/f77 x:0 0 0 2023-12-16T07:40:40.661 INFO:tasks.workunit.client.1.smithi133.stdout:1/357: write d0/d1c/d37/f4a [3544052,107094] 0 2023-12-16T07:40:40.661 INFO:tasks.workunit.client.1.smithi133.stdout:1/358: write d0/d12/f5e [1665701,82288] 0 2023-12-16T07:40:40.662 INFO:tasks.workunit.client.1.smithi133.stdout:1/359: chown d0/da/d3d/f50 436820 1 2023-12-16T07:40:40.662 INFO:tasks.workunit.client.1.smithi133.stdout:1/360: dread - d0/d12/f58 zero size 2023-12-16T07:40:40.664 INFO:tasks.workunit.client.1.smithi133.stdout:1/361: symlink d0/da/d3d/d41/l78 0 2023-12-16T07:40:40.664 INFO:tasks.workunit.client.1.smithi133.stdout:1/362: write d0/da/f19 [773576,126034] 0 2023-12-16T07:40:40.666 INFO:tasks.workunit.client.1.smithi133.stdout:1/363: link d0/da/db/f2c d0/da/d3d/d41/f79 0 2023-12-16T07:40:40.680 INFO:tasks.workunit.client.1.smithi133.stdout:1/364: dwrite d0/da/db/d24/d32/d56/d59/d66/f74 [0,4194304] 0 2023-12-16T07:40:40.680 INFO:tasks.workunit.client.1.smithi133.stdout:1/365: write d0/da/d3d/f50 [1500203,112658] 0 2023-12-16T07:40:40.686 INFO:tasks.workunit.client.1.smithi133.stdout:1/366: dread d0/da/db/d24/d32/d56/d59/d66/f74 [0,4194304] 0 2023-12-16T07:40:40.689 INFO:tasks.workunit.client.1.smithi133.stdout:1/367: mknod d0/da/c7a 0 2023-12-16T07:40:40.695 INFO:tasks.workunit.client.1.smithi133.stdout:1/368: truncate d0/d12/f5e 875825 0 2023-12-16T07:40:40.697 INFO:tasks.workunit.client.1.smithi133.stdout:1/369: mknod d0/d1c/d37/c7b 0 2023-12-16T07:40:40.698 INFO:tasks.workunit.client.1.smithi133.stdout:1/370: dread d0/d12/d51/f64 [0,4194304] 0 2023-12-16T07:40:40.702 INFO:tasks.workunit.client.1.smithi133.stdout:1/371: write d0/d12/f5e [1189636,84766] 0 2023-12-16T07:40:40.707 INFO:tasks.workunit.client.1.smithi133.stdout:1/372: creat d0/da/db/d24/d32/d3e/d70/f7c x:0 0 0 2023-12-16T07:40:40.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/373: dread - d0/da/d3d/d41/f6a zero size 2023-12-16T07:40:40.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/374: write d0/d1c/f5c [179050,97194] 0 2023-12-16T07:40:40.711 INFO:tasks.workunit.client.1.smithi133.stdout:1/375: truncate d0/da/db/ff 7869515 0 2023-12-16T07:40:40.731 INFO:tasks.workunit.client.1.smithi133.stdout:5/216: sync 2023-12-16T07:40:40.731 INFO:tasks.workunit.client.1.smithi133.stdout:0/341: sync 2023-12-16T07:40:40.732 INFO:tasks.workunit.client.1.smithi133.stdout:1/376: dwrite d0/d1c/d37/f4a [0,4194304] 0 2023-12-16T07:40:40.734 INFO:tasks.workunit.client.1.smithi133.stdout:1/377: symlink d0/da/db/d24/d32/d3e/d70/l7d 0 2023-12-16T07:40:40.734 INFO:tasks.workunit.client.1.smithi133.stdout:1/378: chown d0/da/db/d24/d5a/c61 3 1 2023-12-16T07:40:40.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/217: write d1/f3 [258345,106136] 0 2023-12-16T07:40:40.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/218: chown d1/de/d35 1 1 2023-12-16T07:40:40.736 INFO:tasks.workunit.client.1.smithi133.stdout:5/219: symlink d1/l49 0 2023-12-16T07:40:40.736 INFO:tasks.workunit.client.1.smithi133.stdout:5/220: truncate d1/de/f32 1561981 0 2023-12-16T07:40:40.737 INFO:tasks.workunit.client.1.smithi133.stdout:5/221: mknod d1/c4a 0 2023-12-16T07:40:40.737 INFO:tasks.workunit.client.1.smithi133.stdout:5/222: chown d1/d18/d26/c43 1443827029 1 2023-12-16T07:40:40.737 INFO:tasks.workunit.client.1.smithi133.stdout:5/223: fsync d1/de/d35/f37 0 2023-12-16T07:40:40.738 INFO:tasks.workunit.client.1.smithi133.stdout:5/224: mkdir d1/d4b 0 2023-12-16T07:40:40.739 INFO:tasks.workunit.client.1.smithi133.stdout:1/379: write d0/d12/f40 [152210,128523] 0 2023-12-16T07:40:40.739 INFO:tasks.workunit.client.1.smithi133.stdout:5/225: creat d1/d4b/f4c x:0 0 0 2023-12-16T07:40:40.740 INFO:tasks.workunit.client.1.smithi133.stdout:1/380: mknod d0/da/db/d24/d32/d3e/d70/c7e 0 2023-12-16T07:40:40.741 INFO:tasks.workunit.client.1.smithi133.stdout:5/226: mknod d1/de/c4d 0 2023-12-16T07:40:40.744 INFO:tasks.workunit.client.1.smithi133.stdout:5/227: link d1/d1c/f3b d1/d18/f4e 0 2023-12-16T07:40:40.746 INFO:tasks.workunit.client.1.smithi133.stdout:1/381: fdatasync d0/d12/f40 0 2023-12-16T07:40:40.750 INFO:tasks.workunit.client.1.smithi133.stdout:5/228: rename d1/de/c4d to d1/de/c4f 0 2023-12-16T07:40:40.753 INFO:tasks.workunit.client.1.smithi133.stdout:0/342: dwrite d2/d9/d20/f44 [0,4194304] 0 2023-12-16T07:40:40.755 INFO:tasks.workunit.client.1.smithi133.stdout:1/382: truncate d0/d1c/d37/f43 3768087 0 2023-12-16T07:40:40.756 INFO:tasks.workunit.client.1.smithi133.stdout:5/229: rename d1/f3 to d1/de/f50 0 2023-12-16T07:40:40.759 INFO:tasks.workunit.client.1.smithi133.stdout:1/383: mknod d0/d12/d51/c7f 0 2023-12-16T07:40:40.761 INFO:tasks.workunit.client.1.smithi133.stdout:1/384: mknod d0/da/db/d24/d32/d56/d59/d66/c80 0 2023-12-16T07:40:40.763 INFO:tasks.workunit.client.1.smithi133.stdout:1/385: creat d0/d1c/f81 x:0 0 0 2023-12-16T07:40:40.767 INFO:tasks.workunit.client.1.smithi133.stdout:1/386: getdents d0/da/db/d24/d5a/d68 0 2023-12-16T07:40:40.767 INFO:tasks.workunit.client.1.smithi133.stdout:1/387: dread - d0/d60/f72 zero size 2023-12-16T07:40:40.767 INFO:tasks.workunit.client.1.smithi133.stdout:1/388: fsync d0/da/f19 0 2023-12-16T07:40:40.773 INFO:tasks.workunit.client.1.smithi133.stdout:1/389: rename d0/d1c/f81 to d0/da/d3d/d41/f82 0 2023-12-16T07:40:40.776 INFO:tasks.workunit.client.1.smithi133.stdout:0/343: dwrite d2/d9/d12/d35/d48/f3d [8388608,4194304] 0 2023-12-16T07:40:40.776 INFO:tasks.workunit.client.1.smithi133.stdout:0/344: write d2/d17/d2b/f59 [791391,39894] 0 2023-12-16T07:40:40.777 INFO:tasks.workunit.client.1.smithi133.stdout:1/390: creat d0/da/d3d/d41/f83 x:0 0 0 2023-12-16T07:40:40.783 INFO:tasks.workunit.client.1.smithi133.stdout:1/391: truncate d0/d12/f1b 2222822 0 2023-12-16T07:40:40.792 INFO:tasks.workunit.client.1.smithi133.stdout:5/230: dwrite d1/de/ff [0,4194304] 0 2023-12-16T07:40:40.797 INFO:tasks.workunit.client.1.smithi133.stdout:0/345: dwrite d2/d17/d2b/f4b [0,4194304] 0 2023-12-16T07:40:40.803 INFO:tasks.workunit.client.1.smithi133.stdout:0/346: rename d2/f1d to d2/d9/db/f6c 0 2023-12-16T07:40:40.804 INFO:tasks.workunit.client.1.smithi133.stdout:0/347: write d2/d9/d20/f29 [52733,119170] 0 2023-12-16T07:40:40.808 INFO:tasks.workunit.client.1.smithi133.stdout:0/348: rmdir d2/d17 39 2023-12-16T07:40:40.809 INFO:tasks.workunit.client.1.smithi133.stdout:1/392: dwrite d0/d1c/d37/f55 [4194304,4194304] 0 2023-12-16T07:40:40.810 INFO:tasks.workunit.client.1.smithi133.stdout:0/349: creat d2/d9/d12/f6d x:0 0 0 2023-12-16T07:40:40.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/393: creat d0/d1c/d37/f84 x:0 0 0 2023-12-16T07:40:40.815 INFO:tasks.workunit.client.1.smithi133.stdout:1/394: chown d0/da/c5b 2 1 2023-12-16T07:40:40.816 INFO:tasks.workunit.client.1.smithi133.stdout:0/350: link d2/f6 d2/d17/d2b/d31/d36/f6e 0 2023-12-16T07:40:40.818 INFO:tasks.workunit.client.1.smithi133.stdout:1/395: truncate d0/d12/f5e 198543 0 2023-12-16T07:40:40.822 INFO:tasks.workunit.client.1.smithi133.stdout:0/351: mknod d2/d9/d12/d45/c6f 0 2023-12-16T07:40:40.822 INFO:tasks.workunit.client.1.smithi133.stdout:4/461: sync 2023-12-16T07:40:40.822 INFO:tasks.workunit.client.1.smithi133.stdout:7/568: sync 2023-12-16T07:40:40.822 INFO:tasks.workunit.client.1.smithi133.stdout:7/569: chown f9 27713 1 2023-12-16T07:40:40.823 INFO:tasks.workunit.client.1.smithi133.stdout:2/193: sync 2023-12-16T07:40:40.823 INFO:tasks.workunit.client.1.smithi133.stdout:2/194: fdatasync da/f23 0 2023-12-16T07:40:40.823 INFO:tasks.workunit.client.1.smithi133.stdout:2/195: stat da/d1d/d24/d2e 0 2023-12-16T07:40:40.823 INFO:tasks.workunit.client.1.smithi133.stdout:4/462: write d3/d7/d1a/f9c [523275,76808] 0 2023-12-16T07:40:40.825 INFO:tasks.workunit.client.1.smithi133.stdout:4/463: dread d3/d7/d44/f55 [0,4194304] 0 2023-12-16T07:40:40.826 INFO:tasks.workunit.client.1.smithi133.stdout:0/352: creat d2/d17/d40/f70 x:0 0 0 2023-12-16T07:40:40.830 INFO:tasks.workunit.client.1.smithi133.stdout:2/196: creat da/d1d/d24/d2e/f38 x:0 0 0 2023-12-16T07:40:40.831 INFO:tasks.workunit.client.1.smithi133.stdout:4/464: creat d3/d7/d38/d57/d75/f9d x:0 0 0 2023-12-16T07:40:40.833 INFO:tasks.workunit.client.1.smithi133.stdout:0/353: symlink d2/d9/d12/d35/l71 0 2023-12-16T07:40:40.834 INFO:tasks.workunit.client.1.smithi133.stdout:0/354: fdatasync d2/d9/db/fe 0 2023-12-16T07:40:40.835 INFO:tasks.workunit.client.1.smithi133.stdout:1/396: dwrite d0/d12/d51/f64 [0,4194304] 0 2023-12-16T07:40:40.835 INFO:tasks.workunit.client.1.smithi133.stdout:1/397: fdatasync d0/d1c/d37/f84 0 2023-12-16T07:40:40.835 INFO:tasks.workunit.client.1.smithi133.stdout:1/398: chown d0/da/db/d24/d5a/d68 20589 1 2023-12-16T07:40:40.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/197: link da/l16 da/d15/d17/l39 0 2023-12-16T07:40:40.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/198: fsync da/d15/d17/f33 0 2023-12-16T07:40:40.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/199: chown da/d1d/d24/d2e/f35 2841 1 2023-12-16T07:40:40.839 INFO:tasks.workunit.client.1.smithi133.stdout:7/570: dread db/d21/f23 [0,4194304] 0 2023-12-16T07:40:40.839 INFO:tasks.workunit.client.1.smithi133.stdout:7/571: chown db/d3e/d4a/c57 4344765 1 2023-12-16T07:40:40.841 INFO:tasks.workunit.client.1.smithi133.stdout:0/355: symlink d2/d9/d12/d35/d4f/l72 0 2023-12-16T07:40:40.841 INFO:tasks.workunit.client.1.smithi133.stdout:1/399: getdents d0/da/d3d 0 2023-12-16T07:40:40.841 INFO:tasks.workunit.client.1.smithi133.stdout:1/400: write d0/da/f3a [1464193,8339] 0 2023-12-16T07:40:40.842 INFO:tasks.workunit.client.1.smithi133.stdout:2/200: mkdir da/d1d/d24/d3a 0 2023-12-16T07:40:40.847 INFO:tasks.workunit.client.1.smithi133.stdout:2/201: dread da/fe [0,4194304] 0 2023-12-16T07:40:40.859 INFO:tasks.workunit.client.1.smithi133.stdout:2/202: write da/d15/d17/f18 [1702663,95807] 0 2023-12-16T07:40:40.859 INFO:tasks.workunit.client.1.smithi133.stdout:0/356: dread d2/d17/d2b/f4b [0,4194304] 0 2023-12-16T07:40:40.859 INFO:tasks.workunit.client.1.smithi133.stdout:2/203: write da/d15/d17/f33 [614679,70990] 0 2023-12-16T07:40:40.859 INFO:tasks.workunit.client.1.smithi133.stdout:2/204: chown da/d1d/d24/d3a 94315 1 2023-12-16T07:40:40.860 INFO:tasks.workunit.client.1.smithi133.stdout:4/465: dwrite d3/d7/d38/f3d [0,4194304] 0 2023-12-16T07:40:40.860 INFO:tasks.workunit.client.1.smithi133.stdout:7/572: dwrite db/d3e/f40 [0,4194304] 0 2023-12-16T07:40:40.861 INFO:tasks.workunit.client.1.smithi133.stdout:0/357: creat d2/d17/d2b/d67/f73 x:0 0 0 2023-12-16T07:40:40.861 INFO:tasks.workunit.client.1.smithi133.stdout:0/358: stat d2/d9/db 0 2023-12-16T07:40:40.862 INFO:tasks.workunit.client.1.smithi133.stdout:2/205: mknod da/d1d/d24/d3a/c3b 0 2023-12-16T07:40:40.865 INFO:tasks.workunit.client.1.smithi133.stdout:4/466: mknod d3/d7/d1c/d2a/d91/c9e 0 2023-12-16T07:40:40.865 INFO:tasks.workunit.client.1.smithi133.stdout:4/467: chown d3/d7/d1c/l70 61990 1 2023-12-16T07:40:40.865 INFO:tasks.workunit.client.1.smithi133.stdout:4/468: chown d3/d7/d38/d57/d67/f6a 45 1 2023-12-16T07:40:40.869 INFO:tasks.workunit.client.1.smithi133.stdout:7/573: mknod db/d12/d3a/db5/cbb 0 2023-12-16T07:40:40.872 INFO:tasks.workunit.client.1.smithi133.stdout:0/359: rmdir d2/d17/d2b/d31 39 2023-12-16T07:40:40.872 INFO:tasks.workunit.client.1.smithi133.stdout:0/360: fsync d2/d17/d2b/f4b 0 2023-12-16T07:40:40.872 INFO:tasks.workunit.client.1.smithi133.stdout:0/361: fsync d2/d17/f1b 0 2023-12-16T07:40:40.877 INFO:tasks.workunit.client.1.smithi133.stdout:7/574: mkdir db/d21/d2c/dbc 0 2023-12-16T07:40:40.877 INFO:tasks.workunit.client.1.smithi133.stdout:7/575: stat db/d3e/f40 0 2023-12-16T07:40:40.880 INFO:tasks.workunit.client.1.smithi133.stdout:0/362: unlink d2/d17/l21 0 2023-12-16T07:40:40.882 INFO:tasks.workunit.client.1.smithi133.stdout:4/469: dwrite d3/d7/d38/d57/d67/f8d [0,4194304] 0 2023-12-16T07:40:40.883 INFO:tasks.workunit.client.1.smithi133.stdout:4/470: creat d3/d7/d44/f9f x:0 0 0 2023-12-16T07:40:40.893 INFO:tasks.workunit.client.1.smithi133.stdout:7/576: dwrite db/f67 [0,4194304] 0 2023-12-16T07:40:40.896 INFO:tasks.workunit.client.1.smithi133.stdout:7/577: rename f9 to db/d12/d3a/db5/fbd 0 2023-12-16T07:40:40.896 INFO:tasks.workunit.client.1.smithi133.stdout:7/578: stat db/d3e/f40 0 2023-12-16T07:40:40.901 INFO:tasks.workunit.client.1.smithi133.stdout:4/471: dwrite d3/d7/f86 [0,4194304] 0 2023-12-16T07:40:40.906 INFO:tasks.workunit.client.1.smithi133.stdout:4/472: mknod d3/d7/d1c/d2a/ca0 0 2023-12-16T07:40:40.909 INFO:tasks.workunit.client.1.smithi133.stdout:7/579: dread db/d21/d2c/d31/d6e/f97 [0,4194304] 0 2023-12-16T07:40:40.909 INFO:tasks.workunit.client.1.smithi133.stdout:7/580: write db/d3e/faa [526822,85861] 0 2023-12-16T07:40:40.909 INFO:tasks.workunit.client.1.smithi133.stdout:7/581: readlink db/d12/d3a/l3d 0 2023-12-16T07:40:40.912 INFO:tasks.workunit.client.1.smithi133.stdout:7/582: rename db/d3e/d4a/f76 to db/d12/fbe 0 2023-12-16T07:40:40.913 INFO:tasks.workunit.client.1.smithi133.stdout:7/583: write db/d12/d3a/d6c/f83 [35771,40759] 0 2023-12-16T07:40:40.920 INFO:tasks.workunit.client.1.smithi133.stdout:7/584: dread db/d21/f37 [0,4194304] 0 2023-12-16T07:40:40.922 INFO:tasks.workunit.client.1.smithi133.stdout:7/585: creat db/d12/fbf x:0 0 0 2023-12-16T07:40:40.924 INFO:tasks.workunit.client.1.smithi133.stdout:7/586: symlink db/d21/d2c/dbc/lc0 0 2023-12-16T07:40:40.925 INFO:tasks.workunit.client.1.smithi133.stdout:4/473: dwrite d3/d7/d44/f5e [0,4194304] 0 2023-12-16T07:40:40.928 INFO:tasks.workunit.client.1.smithi133.stdout:7/587: rename db/d3e/d4a/d58/c5c to db/d3e/d4a/d58/d86/d8b/d8d/cc1 0 2023-12-16T07:40:40.928 INFO:tasks.workunit.client.1.smithi133.stdout:7/588: fdatasync db/d21/d2c/f50 0 2023-12-16T07:40:40.930 INFO:tasks.workunit.client.1.smithi133.stdout:4/474: mknod d3/d7/d44/ca1 0 2023-12-16T07:40:40.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/475: read d3/d7/d1c/d2a/f4c [177505,79049] 0 2023-12-16T07:40:40.932 INFO:tasks.workunit.client.1.smithi133.stdout:7/589: creat db/d3e/d4a/d58/db9/fc2 x:0 0 0 2023-12-16T07:40:40.932 INFO:tasks.workunit.client.1.smithi133.stdout:7/590: chown db/d21/d2c/c2e 1256 1 2023-12-16T07:40:40.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/476: mknod d3/d7/d6d/d89/ca2 0 2023-12-16T07:40:40.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/477: write d3/fa [392731,94860] 0 2023-12-16T07:40:40.935 INFO:tasks.workunit.client.1.smithi133.stdout:7/591: getdents db/d12/d3a 0 2023-12-16T07:40:40.937 INFO:tasks.workunit.client.1.smithi133.stdout:4/478: rename d3/d7/d1c/l52 to d3/d7/d1c/la3 0 2023-12-16T07:40:40.937 INFO:tasks.workunit.client.1.smithi133.stdout:4/479: stat d3/d7/d38/d45 0 2023-12-16T07:40:40.937 INFO:tasks.workunit.client.1.smithi133.stdout:4/480: fdatasync d3/d7/d38/d57/d67/f8d 0 2023-12-16T07:40:40.938 INFO:tasks.workunit.client.1.smithi133.stdout:4/481: symlink d3/d7/d1c/d2a/d91/la4 0 2023-12-16T07:40:40.943 INFO:tasks.workunit.client.1.smithi133.stdout:7/592: dread db/f67 [0,4194304] 0 2023-12-16T07:40:40.943 INFO:tasks.workunit.client.1.smithi133.stdout:7/593: chown db/d3e/d4a/d58/d86/d8b/cae 2374 1 2023-12-16T07:40:40.943 INFO:tasks.workunit.client.1.smithi133.stdout:7/594: fsync db/f18 0 2023-12-16T07:40:40.958 INFO:tasks.workunit.client.1.smithi133.stdout:4/482: dwrite d3/d7/d1a/f26 [0,4194304] 0 2023-12-16T07:40:40.958 INFO:tasks.workunit.client.1.smithi133.stdout:4/483: chown d3/d7/d44/c4d 854240185 1 2023-12-16T07:40:40.959 INFO:tasks.workunit.client.1.smithi133.stdout:4/484: read d3/d7/d38/d57/d67/f87 [781782,74533] 0 2023-12-16T07:40:40.960 INFO:tasks.workunit.client.1.smithi133.stdout:4/485: mknod d3/d7/d1c/d2a/ca5 0 2023-12-16T07:40:40.962 INFO:tasks.workunit.client.1.smithi133.stdout:7/595: dwrite db/d21/f2f [0,4194304] 0 2023-12-16T07:40:40.963 INFO:tasks.workunit.client.1.smithi133.stdout:7/596: creat db/d3e/d4a/d58/fc3 x:0 0 0 2023-12-16T07:40:40.971 INFO:tasks.workunit.client.1.smithi133.stdout:7/597: dread db/d3e/d4a/f60 [0,4194304] 0 2023-12-16T07:40:40.978 INFO:tasks.workunit.client.1.smithi133.stdout:4/486: dwrite d3/d7/f2e [0,4194304] 0 2023-12-16T07:40:40.980 INFO:tasks.workunit.client.1.smithi133.stdout:4/487: mkdir d3/d7/d1c/d2a/da6 0 2023-12-16T07:40:40.982 INFO:tasks.workunit.client.1.smithi133.stdout:7/598: dread db/d3e/f69 [0,4194304] 0 2023-12-16T07:40:40.982 INFO:tasks.workunit.client.1.smithi133.stdout:4/488: mkdir d3/d7/d44/da7 0 2023-12-16T07:40:40.982 INFO:tasks.workunit.client.1.smithi133.stdout:7/599: write db/d3e/d4a/d58/d86/fa1 [208192,62081] 0 2023-12-16T07:40:41.017 INFO:tasks.workunit.client.1.smithi133.stdout:7/600: dwrite db/d12/d98/fb2 [0,4194304] 0 2023-12-16T07:40:41.017 INFO:tasks.workunit.client.1.smithi133.stdout:4/489: dwrite d3/d7/d44/f5e [0,4194304] 0 2023-12-16T07:40:41.017 INFO:tasks.workunit.client.1.smithi133.stdout:4/490: write d3/d7/d38/f5a [478705,115815] 0 2023-12-16T07:40:41.021 INFO:tasks.workunit.client.1.smithi133.stdout:7/601: write db/d21/d2c/f56 [3840733,122643] 0 2023-12-16T07:40:41.021 INFO:tasks.workunit.client.1.smithi133.stdout:7/602: fdatasync db/d12/f5e 0 2023-12-16T07:40:41.023 INFO:tasks.workunit.client.1.smithi133.stdout:4/491: dread d3/fa [0,4194304] 0 2023-12-16T07:40:41.025 INFO:tasks.workunit.client.1.smithi133.stdout:7/603: mknod db/d21/d2c/d31/d59/cc4 0 2023-12-16T07:40:41.027 INFO:tasks.workunit.client.1.smithi133.stdout:4/492: getdents d3 0 2023-12-16T07:40:41.030 INFO:tasks.workunit.client.1.smithi133.stdout:4/493: rename d3/d7/d1c/d2a/d91/la4 to d3/d7/d44/la8 0 2023-12-16T07:40:41.031 INFO:tasks.workunit.client.1.smithi133.stdout:4/494: write d3/d7/d1a/f26 [722206,82993] 0 2023-12-16T07:40:41.040 INFO:tasks.workunit.client.1.smithi133.stdout:4/495: dread d3/f59 [0,4194304] 0 2023-12-16T07:40:41.040 INFO:tasks.workunit.client.1.smithi133.stdout:4/496: truncate d3/d7/d38/d57/f5f 5391288 0 2023-12-16T07:40:41.040 INFO:tasks.workunit.client.1.smithi133.stdout:4/497: write d3/d7/d1c/d2a/f7c [9363215,14789] 0 2023-12-16T07:40:41.041 INFO:tasks.workunit.client.1.smithi133.stdout:4/498: symlink d3/d7/d44/da7/la9 0 2023-12-16T07:40:41.042 INFO:tasks.workunit.client.1.smithi133.stdout:4/499: rmdir d3/d7/d38 39 2023-12-16T07:40:41.042 INFO:tasks.workunit.client.1.smithi133.stdout:6/508: sync 2023-12-16T07:40:41.042 INFO:tasks.workunit.client.1.smithi133.stdout:8/311: sync 2023-12-16T07:40:41.045 INFO:tasks.workunit.client.1.smithi133.stdout:6/509: rmdir d0/d4/d21/d8a/d93/d8e 39 2023-12-16T07:40:41.045 INFO:tasks.workunit.client.1.smithi133.stdout:6/510: write d0/d4/d21/f39 [4565750,50886] 0 2023-12-16T07:40:41.047 INFO:tasks.workunit.client.1.smithi133.stdout:6/511: unlink d0/d4/f68 0 2023-12-16T07:40:41.048 INFO:tasks.workunit.client.1.smithi133.stdout:6/512: chown d0/d4/d21/d8a/d93/d8e/c9e 326396 1 2023-12-16T07:40:41.048 INFO:tasks.workunit.client.1.smithi133.stdout:6/513: chown d0/d5e/d75 72326 1 2023-12-16T07:40:41.049 INFO:tasks.workunit.client.1.smithi133.stdout:6/514: creat d0/d4/fa7 x:0 0 0 2023-12-16T07:40:41.050 INFO:tasks.workunit.client.1.smithi133.stdout:7/604: dwrite db/f1c [4194304,4194304] 0 2023-12-16T07:40:41.063 INFO:tasks.workunit.client.1.smithi133.stdout:4/500: dwrite d3/f5d [0,4194304] 0 2023-12-16T07:40:41.063 INFO:tasks.workunit.client.1.smithi133.stdout:4/501: chown d3/d7/d44/da7 239531287 1 2023-12-16T07:40:41.064 INFO:tasks.workunit.client.1.smithi133.stdout:4/502: readlink d3/d7/d1a/l58 0 2023-12-16T07:40:41.069 INFO:tasks.workunit.client.1.smithi133.stdout:8/312: dwrite d9/d10/d39/d48/f51 [4194304,4194304] 0 2023-12-16T07:40:41.120 INFO:tasks.workunit.client.1.smithi133.stdout:7/605: creat db/d21/d2c/dbc/fc5 x:0 0 0 2023-12-16T07:40:41.121 INFO:tasks.workunit.client.1.smithi133.stdout:7/606: truncate db/d12/fbf 458076 0 2023-12-16T07:40:41.121 INFO:tasks.workunit.client.1.smithi133.stdout:7/607: stat db/d21/c42 0 2023-12-16T07:40:41.124 INFO:tasks.workunit.client.1.smithi133.stdout:4/503: mkdir d3/d7/d44/da7/daa 0 2023-12-16T07:40:41.126 INFO:tasks.workunit.client.1.smithi133.stdout:8/313: creat d9/d10/d39/d48/f68 x:0 0 0 2023-12-16T07:40:41.129 INFO:tasks.workunit.client.1.smithi133.stdout:6/515: mknod d0/d4/d21/d35/d36/ca8 0 2023-12-16T07:40:41.130 INFO:tasks.workunit.client.1.smithi133.stdout:7/608: rename db/d21/d2c/d31/d79/l7a to db/d3e/d4a/d58/d86/da8/lc6 0 2023-12-16T07:40:41.132 INFO:tasks.workunit.client.1.smithi133.stdout:8/314: mkdir d9/d10/d39/d48/d44/d69 0 2023-12-16T07:40:41.133 INFO:tasks.workunit.client.1.smithi133.stdout:8/315: stat d9/d2d 0 2023-12-16T07:40:41.134 INFO:tasks.workunit.client.1.smithi133.stdout:7/609: link db/d53/f6b db/d21/d2c/d31/d59/fc7 0 2023-12-16T07:40:41.138 INFO:tasks.workunit.client.1.smithi133.stdout:4/504: rename d3/d7/d1c/l70 to d3/d7/d6d/d89/lab 0 2023-12-16T07:40:41.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/610: mkdir db/d12/d3a/d6c/dc8 0 2023-12-16T07:40:41.148 INFO:tasks.workunit.client.1.smithi133.stdout:7/611: link db/fe db/d12/d3a/d6c/fc9 0 2023-12-16T07:40:41.162 INFO:tasks.workunit.client.1.smithi133.stdout:6/516: dwrite d0/d4/d21/f59 [0,4194304] 0 2023-12-16T07:40:41.162 INFO:tasks.workunit.client.1.smithi133.stdout:8/316: dwrite d9/f5e [0,4194304] 0 2023-12-16T07:40:41.162 INFO:tasks.workunit.client.1.smithi133.stdout:4/505: dwrite d3/d7/d44/f77 [0,4194304] 0 2023-12-16T07:40:41.168 INFO:tasks.workunit.client.1.smithi133.stdout:8/317: creat d9/f6a x:0 0 0 2023-12-16T07:40:41.169 INFO:tasks.workunit.client.1.smithi133.stdout:6/517: creat d0/d4/d21/d8a/d93/fa9 x:0 0 0 2023-12-16T07:40:41.170 INFO:tasks.workunit.client.1.smithi133.stdout:6/518: write d0/d4/f1c [23529,103585] 0 2023-12-16T07:40:41.176 INFO:tasks.workunit.client.1.smithi133.stdout:4/506: mkdir d3/d7/d44/dac 0 2023-12-16T07:40:41.178 INFO:tasks.workunit.client.1.smithi133.stdout:8/318: creat d9/d10/d39/d48/d44/f6b x:0 0 0 2023-12-16T07:40:41.179 INFO:tasks.workunit.client.1.smithi133.stdout:8/319: write d9/d10/f37 [3016290,88018] 0 2023-12-16T07:40:41.187 INFO:tasks.workunit.client.1.smithi133.stdout:6/519: symlink d0/d4/d21/d35/d7e/laa 0 2023-12-16T07:40:41.187 INFO:tasks.workunit.client.1.smithi133.stdout:6/520: chown d0/d4/f34 50125 1 2023-12-16T07:40:41.188 INFO:tasks.workunit.client.1.smithi133.stdout:4/507: mknod d3/d7/d38/cad 0 2023-12-16T07:40:41.188 INFO:tasks.workunit.client.1.smithi133.stdout:4/508: truncate d3/d7/d1c/f69 757753 0 2023-12-16T07:40:41.188 INFO:tasks.workunit.client.1.smithi133.stdout:4/509: stat d3/d7/d44/da7/la9 0 2023-12-16T07:40:41.191 INFO:tasks.workunit.client.1.smithi133.stdout:8/320: creat d9/f6c x:0 0 0 2023-12-16T07:40:41.191 INFO:tasks.workunit.client.1.smithi133.stdout:8/321: fdatasync d9/d10/f45 0 2023-12-16T07:40:41.194 INFO:tasks.workunit.client.1.smithi133.stdout:4/510: getdents d3/d7/d1c/d2a/d91 0 2023-12-16T07:40:41.195 INFO:tasks.workunit.client.1.smithi133.stdout:4/511: write d3/d7/d1a/f33 [123592,12282] 0 2023-12-16T07:40:41.197 INFO:tasks.workunit.client.1.smithi133.stdout:8/322: truncate d9/f1c 1700565 0 2023-12-16T07:40:41.198 INFO:tasks.workunit.client.1.smithi133.stdout:6/521: dread d0/d4/d21/d35/d36/f46 [0,4194304] 0 2023-12-16T07:40:41.198 INFO:tasks.workunit.client.1.smithi133.stdout:6/522: write d0/d4/d21/d35/d4e/d84/d69/fa3 [453781,2165] 0 2023-12-16T07:40:41.200 INFO:tasks.workunit.client.1.smithi133.stdout:6/523: chown d0/d4/d21/d35/d36/l3f 0 1 2023-12-16T07:40:41.206 INFO:tasks.workunit.client.1.smithi133.stdout:6/524: mknod d0/cab 0 2023-12-16T07:40:41.206 INFO:tasks.workunit.client.1.smithi133.stdout:6/525: mkdir d0/d4/d21/d35/d7e/dac 0 2023-12-16T07:40:41.206 INFO:tasks.workunit.client.1.smithi133.stdout:6/526: mkdir d0/d5e/d75/dad 0 2023-12-16T07:40:41.206 INFO:tasks.workunit.client.1.smithi133.stdout:6/527: creat d0/d4/fae x:0 0 0 2023-12-16T07:40:41.208 INFO:tasks.workunit.client.1.smithi133.stdout:6/528: symlink d0/d5e/d75/d81/laf 0 2023-12-16T07:40:41.208 INFO:tasks.workunit.client.1.smithi133.stdout:6/529: chown d0/f4d 188099 1 2023-12-16T07:40:41.208 INFO:tasks.workunit.client.1.smithi133.stdout:6/530: fsync d0/d4/d21/d60/f89 0 2023-12-16T07:40:41.208 INFO:tasks.workunit.client.1.smithi133.stdout:6/531: symlink d0/d4/d21/d8a/d93/d8e/lb0 0 2023-12-16T07:40:41.208 INFO:tasks.workunit.client.1.smithi133.stdout:6/532: chown d0/d4/d21/c90 685142 1 2023-12-16T07:40:41.210 INFO:tasks.workunit.client.1.smithi133.stdout:6/533: write d0/d5e/d75/f80 [1586131,104928] 0 2023-12-16T07:40:41.213 INFO:tasks.workunit.client.1.smithi133.stdout:6/534: write d0/d4/f37 [3814109,46525] 0 2023-12-16T07:40:41.215 INFO:tasks.workunit.client.1.smithi133.stdout:6/535: creat d0/d4/d21/d8a/da4/fb1 x:0 0 0 2023-12-16T07:40:41.218 INFO:tasks.workunit.client.1.smithi133.stdout:6/536: mknod d0/d5e/d75/d81/d99/cb2 0 2023-12-16T07:40:41.219 INFO:tasks.workunit.client.1.smithi133.stdout:8/323: dwrite d9/f41 [0,4194304] 0 2023-12-16T07:40:41.219 INFO:tasks.workunit.client.1.smithi133.stdout:4/512: dwrite d3/d7/d1a/f26 [0,4194304] 0 2023-12-16T07:40:41.225 INFO:tasks.workunit.client.1.smithi133.stdout:4/513: symlink d3/d7/d38/d57/d75/lae 0 2023-12-16T07:40:41.226 INFO:tasks.workunit.client.1.smithi133.stdout:4/514: creat d3/d7/d1a/faf x:0 0 0 2023-12-16T07:40:41.227 INFO:tasks.workunit.client.1.smithi133.stdout:4/515: mkdir d3/d7/d1c/db0 0 2023-12-16T07:40:41.228 INFO:tasks.workunit.client.1.smithi133.stdout:4/516: mkdir d3/d7/db1 0 2023-12-16T07:40:41.228 INFO:tasks.workunit.client.1.smithi133.stdout:4/517: write d3/d7/fb [4802998,29779] 0 2023-12-16T07:40:41.228 INFO:tasks.workunit.client.1.smithi133.stdout:6/537: dread d0/d4/d21/d35/f79 [0,4194304] 0 2023-12-16T07:40:41.228 INFO:tasks.workunit.client.1.smithi133.stdout:6/538: read - d0/d4/d21/d60/f66 zero size 2023-12-16T07:40:41.234 INFO:tasks.workunit.client.1.smithi133.stdout:8/324: dwrite d9/dc/d27/f2b [0,4194304] 0 2023-12-16T07:40:41.253 INFO:tasks.workunit.client.1.smithi133.stdout:6/539: dwrite d0/d4/d21/d35/d4e/d84/f58 [0,4194304] 0 2023-12-16T07:40:41.253 INFO:tasks.workunit.client.1.smithi133.stdout:6/540: chown d0/l7d 30516 1 2023-12-16T07:40:41.267 INFO:tasks.workunit.client.1.smithi133.stdout:9/362: sync 2023-12-16T07:40:41.267 INFO:tasks.workunit.client.1.smithi133.stdout:3/266: sync 2023-12-16T07:40:41.267 INFO:tasks.workunit.client.1.smithi133.stdout:5/231: sync 2023-12-16T07:40:41.295 INFO:tasks.workunit.client.1.smithi133.stdout:4/518: getdents d3/d7/d1c/d2a 0 2023-12-16T07:40:41.308 INFO:tasks.workunit.client.1.smithi133.stdout:6/541: creat d0/d4/d21/d35/d4e/d84/fb3 x:0 0 0 2023-12-16T07:40:41.308 INFO:tasks.workunit.client.1.smithi133.stdout:6/542: chown d0/d4/d21/d35/d7e/laa 95766756 1 2023-12-16T07:40:41.319 INFO:tasks.workunit.client.1.smithi133.stdout:4/519: dwrite d3/d7/d44/f94 [0,4194304] 0 2023-12-16T07:40:41.320 INFO:tasks.workunit.client.1.smithi133.stdout:4/520: dread d3/d7/d44/f78 [0,4194304] 0 2023-12-16T07:40:41.321 INFO:tasks.workunit.client.1.smithi133.stdout:4/521: write d3/d7/d1a/f9c [90020,36208] 0 2023-12-16T07:40:41.321 INFO:tasks.workunit.client.1.smithi133.stdout:4/522: truncate d3/d7/d44/d63/f93 745118 0 2023-12-16T07:40:41.322 INFO:tasks.workunit.client.1.smithi133.stdout:4/523: write d3/d7/d1c/d2a/f7c [2371352,47816] 0 2023-12-16T07:40:41.337 INFO:tasks.workunit.client.1.smithi133.stdout:4/524: dwrite d3/f5d [0,4194304] 0 2023-12-16T07:40:41.338 INFO:tasks.workunit.client.1.smithi133.stdout:4/525: write d3/d7/d1a/f26 [3310434,36552] 0 2023-12-16T07:40:41.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/363: rename d15/d18/d2c/f47 to d15/d18/d2c/d3a/f74 0 2023-12-16T07:40:41.361 INFO:tasks.workunit.client.1.smithi133.stdout:9/364: dread d15/d18/f36 [0,4194304] 0 2023-12-16T07:40:41.363 INFO:tasks.workunit.client.1.smithi133.stdout:6/543: link d0/d4/d21/d8a/d93/fa5 d0/d4/d21/d8a/d93/d8e/fb4 0 2023-12-16T07:40:41.398 INFO:tasks.workunit.client.1.smithi133.stdout:4/526: creat d3/d7/d38/d57/d67/fb2 x:0 0 0 2023-12-16T07:40:41.410 INFO:tasks.workunit.client.1.smithi133.stdout:3/267: mkdir d7/d8/d72 0 2023-12-16T07:40:41.411 INFO:tasks.workunit.client.1.smithi133.stdout:9/365: creat d15/d18/d61/d6e/f75 x:0 0 0 2023-12-16T07:40:41.414 INFO:tasks.workunit.client.1.smithi133.stdout:6/544: creat d0/d4/d21/d8a/da4/fb5 x:0 0 0 2023-12-16T07:40:41.417 INFO:tasks.workunit.client.1.smithi133.stdout:6/545: write d0/f1b [2953039,72829] 0 2023-12-16T07:40:41.417 INFO:tasks.workunit.client.1.smithi133.stdout:4/527: creat d3/d7/d1c/d2a/fb3 x:0 0 0 2023-12-16T07:40:41.417 INFO:tasks.workunit.client.1.smithi133.stdout:4/528: truncate d3/d7/d1c/f69 1045008 0 2023-12-16T07:40:41.418 INFO:tasks.workunit.client.1.smithi133.stdout:3/268: mknod d7/d8/d1d/d2a/d5f/c73 0 2023-12-16T07:40:41.418 INFO:tasks.workunit.client.1.smithi133.stdout:3/269: fdatasync d7/d8/d1d/f52 0 2023-12-16T07:40:41.422 INFO:tasks.workunit.client.1.smithi133.stdout:4/529: symlink d3/d7/d38/lb4 0 2023-12-16T07:40:41.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/270: creat d7/d8/d1c/f74 x:0 0 0 2023-12-16T07:40:41.424 INFO:tasks.workunit.client.1.smithi133.stdout:4/530: rename d3/d7/d38/d45/c5b to d3/d7/d1c/d2a/cb5 0 2023-12-16T07:40:41.424 INFO:tasks.workunit.client.1.smithi133.stdout:4/531: readlink d3/d7/l90 0 2023-12-16T07:40:41.426 INFO:tasks.workunit.client.1.smithi133.stdout:3/271: creat d7/d8/f75 x:0 0 0 2023-12-16T07:40:41.426 INFO:tasks.workunit.client.1.smithi133.stdout:1/401: sync 2023-12-16T07:40:41.427 INFO:tasks.workunit.client.1.smithi133.stdout:3/272: write d7/f47 [42970,72399] 0 2023-12-16T07:40:41.430 INFO:tasks.workunit.client.1.smithi133.stdout:1/402: dread d0/d12/f1b [0,4194304] 0 2023-12-16T07:40:41.430 INFO:tasks.workunit.client.1.smithi133.stdout:1/403: truncate d0/da/f19 357473 0 2023-12-16T07:40:41.432 INFO:tasks.workunit.client.1.smithi133.stdout:3/273: mkdir d7/d8/d1c/d76 0 2023-12-16T07:40:41.432 INFO:tasks.workunit.client.1.smithi133.stdout:3/274: stat d7/d8/d1d/f52 0 2023-12-16T07:40:41.432 INFO:tasks.workunit.client.1.smithi133.stdout:3/275: chown d7/d8/c49 9 1 2023-12-16T07:40:41.432 INFO:tasks.workunit.client.1.smithi133.stdout:3/276: write d7/d8/d1c/d2e/f5d [333044,125367] 0 2023-12-16T07:40:41.433 INFO:tasks.workunit.client.1.smithi133.stdout:2/206: sync 2023-12-16T07:40:41.434 INFO:tasks.workunit.client.1.smithi133.stdout:1/404: creat d0/da/db/d24/d32/d56/d59/d66/f85 x:0 0 0 2023-12-16T07:40:41.437 INFO:tasks.workunit.client.1.smithi133.stdout:9/366: dwrite d15/d18/d61/d6e/f72 [0,4194304] 0 2023-12-16T07:40:41.438 INFO:tasks.workunit.client.1.smithi133.stdout:9/367: write d15/f37 [1839268,35779] 0 2023-12-16T07:40:41.439 INFO:tasks.workunit.client.1.smithi133.stdout:2/207: write da/d1d/f25 [826843,60154] 0 2023-12-16T07:40:41.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/368: mknod d15/d18/d2c/d3a/d5a/c76 0 2023-12-16T07:40:41.444 INFO:tasks.workunit.client.1.smithi133.stdout:6/546: dwrite d0/d4/f5c [0,4194304] 0 2023-12-16T07:40:41.448 INFO:tasks.workunit.client.1.smithi133.stdout:2/208: fdatasync da/d1d/f25 0 2023-12-16T07:40:41.452 INFO:tasks.workunit.client.1.smithi133.stdout:4/532: dwrite d3/f25 [0,4194304] 0 2023-12-16T07:40:41.467 INFO:tasks.workunit.client.1.smithi133.stdout:4/533: dread d3/d7/f5c [0,4194304] 0 2023-12-16T07:40:41.481 INFO:tasks.workunit.client.1.smithi133.stdout:9/369: dwrite d15/d18/f36 [0,4194304] 0 2023-12-16T07:40:41.482 INFO:tasks.workunit.client.1.smithi133.stdout:1/405: dwrite d0/da/db/d24/d32/d3e/d70/f7c [0,4194304] 0 2023-12-16T07:40:41.482 INFO:tasks.workunit.client.1.smithi133.stdout:3/277: dwrite d7/d8/d1c/d2e/f34 [4194304,4194304] 0 2023-12-16T07:40:41.482 INFO:tasks.workunit.client.1.smithi133.stdout:6/547: dwrite d0/d5e/d8c/f97 [0,4194304] 0 2023-12-16T07:40:41.483 INFO:tasks.workunit.client.1.smithi133.stdout:2/209: dwrite f1 [0,4194304] 0 2023-12-16T07:40:41.483 INFO:tasks.workunit.client.1.smithi133.stdout:2/210: write da/fe [935141,95688] 0 2023-12-16T07:40:41.511 INFO:tasks.workunit.client.1.smithi133.stdout:9/370: creat d15/d18/f77 x:0 0 0 2023-12-16T07:40:41.516 INFO:tasks.workunit.client.1.smithi133.stdout:1/406: creat d0/da/db/d24/d32/f86 x:0 0 0 2023-12-16T07:40:41.516 INFO:tasks.workunit.client.1.smithi133.stdout:1/407: chown d0/da/db/f35 3617 1 2023-12-16T07:40:41.520 INFO:tasks.workunit.client.1.smithi133.stdout:3/278: mkdir d7/d8/d72/d77 0 2023-12-16T07:40:41.520 INFO:tasks.workunit.client.1.smithi133.stdout:3/279: truncate d7/f1b 3404272 0 2023-12-16T07:40:41.520 INFO:tasks.workunit.client.1.smithi133.stdout:3/280: chown d7/d8/d1c/d2e/f69 1584 1 2023-12-16T07:40:41.520 INFO:tasks.workunit.client.1.smithi133.stdout:3/281: write f6 [2087950,124308] 0 2023-12-16T07:40:41.527 INFO:tasks.workunit.client.1.smithi133.stdout:9/371: dwrite d15/f26 [4194304,4194304] 0 2023-12-16T07:40:41.527 INFO:tasks.workunit.client.1.smithi133.stdout:9/372: write d15/f16 [1170611,88107] 0 2023-12-16T07:40:41.527 INFO:tasks.workunit.client.1.smithi133.stdout:9/373: readlink d15/d18/d2c/d3a/l59 0 2023-12-16T07:40:41.528 INFO:tasks.workunit.client.1.smithi133.stdout:2/211: dread - da/d1d/f2f zero size 2023-12-16T07:40:41.530 INFO:tasks.workunit.client.1.smithi133.stdout:1/408: symlink d0/d1c/d71/l87 0 2023-12-16T07:40:41.533 INFO:tasks.workunit.client.1.smithi133.stdout:9/374: rename d15/d18/d61 to d15/d18/d5b/d71/d78 0 2023-12-16T07:40:41.551 INFO:tasks.workunit.client.1.smithi133.stdout:2/212: dwrite f1 [0,4194304] 0 2023-12-16T07:40:41.551 INFO:tasks.workunit.client.1.smithi133.stdout:9/375: dread f9 [0,4194304] 0 2023-12-16T07:40:41.551 INFO:tasks.workunit.client.1.smithi133.stdout:3/282: dwrite d7/d8/d1c/d2e/f69 [0,4194304] 0 2023-12-16T07:40:41.551 INFO:tasks.workunit.client.1.smithi133.stdout:9/376: chown f13 5 1 2023-12-16T07:40:41.551 INFO:tasks.workunit.client.1.smithi133.stdout:9/377: chown f9 3989 1 2023-12-16T07:40:41.551 INFO:tasks.workunit.client.1.smithi133.stdout:9/378: truncate d15/d18/d2c/d3a/f49 13538 0 2023-12-16T07:40:41.552 INFO:tasks.workunit.client.1.smithi133.stdout:9/379: write d15/f26 [6784587,48572] 0 2023-12-16T07:40:41.574 INFO:tasks.workunit.client.1.smithi133.stdout:9/380: dwrite d15/d18/d2c/d3a/f6f [0,4194304] 0 2023-12-16T07:40:41.575 INFO:tasks.workunit.client.1.smithi133.stdout:2/213: dwrite da/d1d/d24/f37 [0,4194304] 0 2023-12-16T07:40:41.592 INFO:tasks.workunit.client.1.smithi133.stdout:1/409: rename d0/d60/f72 to d0/da/db/d24/d5a/d68/f88 0 2023-12-16T07:40:41.596 INFO:tasks.workunit.client.1.smithi133.stdout:9/381: link d15/d18/c38 d15/d42/c79 0 2023-12-16T07:40:41.603 INFO:tasks.workunit.client.1.smithi133.stdout:2/214: chown da/d1d/f21 8679290 1 2023-12-16T07:40:41.604 INFO:tasks.workunit.client.1.smithi133.stdout:1/410: truncate d0/f2a 2464433 0 2023-12-16T07:40:41.604 INFO:tasks.workunit.client.1.smithi133.stdout:1/411: chown d0/da/f3a 99251 1 2023-12-16T07:40:41.606 INFO:tasks.workunit.client.1.smithi133.stdout:9/382: creat d15/d18/d5b/d71/f7a x:0 0 0 2023-12-16T07:40:41.607 INFO:tasks.workunit.client.1.smithi133.stdout:2/215: symlink da/d1d/d24/d2e/l3c 0 2023-12-16T07:40:41.609 INFO:tasks.workunit.client.1.smithi133.stdout:1/412: symlink d0/d1c/d71/l89 0 2023-12-16T07:40:41.620 INFO:tasks.workunit.client.1.smithi133.stdout:9/383: dread f0 [4194304,4194304] 0 2023-12-16T07:40:41.620 INFO:tasks.workunit.client.1.smithi133.stdout:9/384: creat d15/d18/d2c/d3a/d5c/d73/f7b x:0 0 0 2023-12-16T07:40:41.667 INFO:tasks.workunit.client.1.smithi133.stdout:4/534: mkdir d3/db6 0 2023-12-16T07:40:41.668 INFO:tasks.workunit.client.1.smithi133.stdout:4/535: truncate d3/d7/d38/d45/f65 566031 0 2023-12-16T07:40:41.669 INFO:tasks.workunit.client.1.smithi133.stdout:1/413: symlink d0/l8a 0 2023-12-16T07:40:41.670 INFO:tasks.workunit.client.1.smithi133.stdout:1/414: symlink d0/da/db/d24/d32/l8b 0 2023-12-16T07:40:41.670 INFO:tasks.workunit.client.1.smithi133.stdout:1/415: stat d0/d1c/d37 0 2023-12-16T07:40:41.671 INFO:tasks.workunit.client.1.smithi133.stdout:1/416: symlink d0/d60/l8c 0 2023-12-16T07:40:41.672 INFO:tasks.workunit.client.1.smithi133.stdout:1/417: symlink d0/da/db/d24/d32/d3e/l8d 0 2023-12-16T07:40:41.673 INFO:tasks.workunit.client.1.smithi133.stdout:1/418: dread d0/d12/f5e [0,4194304] 0 2023-12-16T07:40:41.673 INFO:tasks.workunit.client.1.smithi133.stdout:1/419: stat d0/l8a 0 2023-12-16T07:40:41.673 INFO:tasks.workunit.client.1.smithi133.stdout:1/420: creat d0/d60/f8e x:0 0 0 2023-12-16T07:40:41.674 INFO:tasks.workunit.client.1.smithi133.stdout:1/421: read d0/da/d3d/f50 [1026017,121759] 0 2023-12-16T07:40:41.675 INFO:tasks.workunit.client.1.smithi133.stdout:1/422: mkdir d0/da/db/d24/d32/d3e/d70/d8f 0 2023-12-16T07:40:41.676 INFO:tasks.workunit.client.1.smithi133.stdout:2/216: creat da/f3d x:0 0 0 2023-12-16T07:40:41.677 INFO:tasks.workunit.client.1.smithi133.stdout:2/217: mkdir da/d1d/d24/d3e 0 2023-12-16T07:40:41.677 INFO:tasks.workunit.client.1.smithi133.stdout:4/536: dread d3/f5d [0,4194304] 0 2023-12-16T07:40:41.678 INFO:tasks.workunit.client.1.smithi133.stdout:4/537: write d3/d7/f2e [2305417,41384] 0 2023-12-16T07:40:41.678 INFO:tasks.workunit.client.1.smithi133.stdout:2/218: mknod da/d1d/d24/d3e/c3f 0 2023-12-16T07:40:41.682 INFO:tasks.workunit.client.1.smithi133.stdout:3/283: rename d7/d8/d1c/d2e to d7/d8/d78 0 2023-12-16T07:40:41.682 INFO:tasks.workunit.client.1.smithi133.stdout:3/284: readlink d7/d8/d78/d43/l5a 0 2023-12-16T07:40:41.682 INFO:tasks.workunit.client.1.smithi133.stdout:9/385: rename d15/d18 to d15/d18/d2c/d3a/d5c/d73/d7c 22 2023-12-16T07:40:41.684 INFO:tasks.workunit.client.1.smithi133.stdout:9/386: symlink d15/d18/l7d 0 2023-12-16T07:40:41.684 INFO:tasks.workunit.client.1.smithi133.stdout:9/387: stat d15/d42/f57 0 2023-12-16T07:40:41.686 INFO:tasks.workunit.client.1.smithi133.stdout:9/388: unlink l12 0 2023-12-16T07:40:41.692 INFO:tasks.workunit.client.1.smithi133.stdout:9/389: mkdir d15/d18/d4d/d7e 0 2023-12-16T07:40:41.692 INFO:tasks.workunit.client.1.smithi133.stdout:9/390: chown d15/d18/l40 1873 1 2023-12-16T07:40:41.694 INFO:tasks.workunit.client.1.smithi133.stdout:9/391: dread d15/d18/d2c/f4c [0,4194304] 0 2023-12-16T07:40:41.694 INFO:tasks.workunit.client.1.smithi133.stdout:9/392: truncate d15/d18/d2c/d3a/d5c/d73/f7b 869919 0 2023-12-16T07:40:41.702 INFO:tasks.workunit.client.1.smithi133.stdout:9/393: creat d15/d18/d2c/d68/f7f x:0 0 0 2023-12-16T07:40:41.703 INFO:tasks.workunit.client.1.smithi133.stdout:2/219: dwrite da/d1d/f25 [4194304,4194304] 0 2023-12-16T07:40:41.704 INFO:tasks.workunit.client.1.smithi133.stdout:2/220: readlink da/d15/d17/l39 0 2023-12-16T07:40:41.706 INFO:tasks.workunit.client.1.smithi133.stdout:9/394: rename d15/d18/d2c/d3a/d5c to d15/d18/d80 0 2023-12-16T07:40:41.706 INFO:tasks.workunit.client.1.smithi133.stdout:7/612: sync 2023-12-16T07:40:41.706 INFO:tasks.workunit.client.1.smithi133.stdout:5/232: sync 2023-12-16T07:40:41.706 INFO:tasks.workunit.client.1.smithi133.stdout:8/325: sync 2023-12-16T07:40:41.706 INFO:tasks.workunit.client.1.smithi133.stdout:5/233: chown d1/d1c/c22 235 1 2023-12-16T07:40:41.706 INFO:tasks.workunit.client.1.smithi133.stdout:0/363: sync 2023-12-16T07:40:41.707 INFO:tasks.workunit.client.1.smithi133.stdout:3/285: dwrite d7/d8/d1d/f52 [0,4194304] 0 2023-12-16T07:40:41.708 INFO:tasks.workunit.client.1.smithi133.stdout:4/538: dwrite d3/d7/d38/f3d [4194304,4194304] 0 2023-12-16T07:40:41.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/423: dwrite d0/d1c/d37/f4a [0,4194304] 0 2023-12-16T07:40:41.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/424: read - d0/da/db/d24/d5a/d68/f88 zero size 2023-12-16T07:40:41.711 INFO:tasks.workunit.client.1.smithi133.stdout:9/395: link d15/d18/c22 d15/d18/d5b/d71/c81 0 2023-12-16T07:40:41.712 INFO:tasks.workunit.client.1.smithi133.stdout:7/613: unlink db/f16 0 2023-12-16T07:40:41.713 INFO:tasks.workunit.client.1.smithi133.stdout:7/614: read db/fe [2224803,24602] 0 2023-12-16T07:40:41.713 INFO:tasks.workunit.client.1.smithi133.stdout:8/326: mknod d9/d2d/c6d 0 2023-12-16T07:40:41.718 INFO:tasks.workunit.client.1.smithi133.stdout:5/234: creat d1/d1c/f51 x:0 0 0 2023-12-16T07:40:41.718 INFO:tasks.workunit.client.1.smithi133.stdout:0/364: getdents d2/d9/d12/d35/d4f 0 2023-12-16T07:40:41.718 INFO:tasks.workunit.client.1.smithi133.stdout:0/365: write d2/d9/d12/f6d [413222,90953] 0 2023-12-16T07:40:41.719 INFO:tasks.workunit.client.1.smithi133.stdout:2/221: rename da/d1d/d24/d3e to da/d15/d17/d40 0 2023-12-16T07:40:41.722 INFO:tasks.workunit.client.1.smithi133.stdout:4/539: mknod d3/d7/d38/d57/d67/cb7 0 2023-12-16T07:40:41.722 INFO:tasks.workunit.client.1.smithi133.stdout:8/327: dread d9/d2d/f56 [0,4194304] 0 2023-12-16T07:40:41.729 INFO:tasks.workunit.client.1.smithi133.stdout:1/425: link d0/d12/c52 d0/d1c/d71/c90 0 2023-12-16T07:40:41.729 INFO:tasks.workunit.client.1.smithi133.stdout:1/426: chown d0/d1c/d37 28412 1 2023-12-16T07:40:41.730 INFO:tasks.workunit.client.1.smithi133.stdout:1/427: chown d0/da/db/d24/d32/d3e/d70/d8f 4627247 1 2023-12-16T07:40:41.730 INFO:tasks.workunit.client.1.smithi133.stdout:1/428: write d0/d12/f5e [1004888,87694] 0 2023-12-16T07:40:41.730 INFO:tasks.workunit.client.1.smithi133.stdout:1/429: readlink d0/l62 0 2023-12-16T07:40:41.731 INFO:tasks.workunit.client.1.smithi133.stdout:9/396: mknod d15/d18/d2c/d68/c82 0 2023-12-16T07:40:41.733 INFO:tasks.workunit.client.1.smithi133.stdout:7/615: rename db/d21/d2c/d31/f36 to db/d3e/d4a/d58/d86/da9/fca 0 2023-12-16T07:40:41.733 INFO:tasks.workunit.client.1.smithi133.stdout:7/616: truncate db/d21/d2c/d31/d6e/f93 688188 0 2023-12-16T07:40:41.734 INFO:tasks.workunit.client.1.smithi133.stdout:2/222: mkdir da/d15/d17/d40/d41 0 2023-12-16T07:40:41.734 INFO:tasks.workunit.client.1.smithi133.stdout:2/223: getdents da/d15 0 2023-12-16T07:40:41.738 INFO:tasks.workunit.client.1.smithi133.stdout:1/430: mknod d0/da/db/d24/d32/d3e/c91 0 2023-12-16T07:40:41.739 INFO:tasks.workunit.client.1.smithi133.stdout:0/366: dwrite d2/d9/d20/f2c [0,4194304] 0 2023-12-16T07:40:41.740 INFO:tasks.workunit.client.1.smithi133.stdout:4/540: rename d3/l49 to d3/d7/d38/d45/lb8 0 2023-12-16T07:40:41.742 INFO:tasks.workunit.client.1.smithi133.stdout:2/224: symlink da/d15/d17/l42 0 2023-12-16T07:40:41.743 INFO:tasks.workunit.client.1.smithi133.stdout:2/225: dread - da/d1d/d24/d2e/f38 zero size 2023-12-16T07:40:41.748 INFO:tasks.workunit.client.1.smithi133.stdout:0/367: unlink d2/d9/d12/d35/d48/c46 0 2023-12-16T07:40:41.748 INFO:tasks.workunit.client.1.smithi133.stdout:1/431: dread d0/da/f2e [0,4194304] 0 2023-12-16T07:40:41.749 INFO:tasks.workunit.client.1.smithi133.stdout:4/541: unlink d3/d7/d38/c61 0 2023-12-16T07:40:41.750 INFO:tasks.workunit.client.1.smithi133.stdout:0/368: dread d2/d9/f47 [0,4194304] 0 2023-12-16T07:40:41.752 INFO:tasks.workunit.client.1.smithi133.stdout:1/432: creat d0/da/db/d24/d32/d56/d59/d66/f92 x:0 0 0 2023-12-16T07:40:41.753 INFO:tasks.workunit.client.1.smithi133.stdout:4/542: creat d3/d7/d38/d45/fb9 x:0 0 0 2023-12-16T07:40:41.753 INFO:tasks.workunit.client.1.smithi133.stdout:4/543: chown d3/d7/d1a/f33 942511 1 2023-12-16T07:40:41.753 INFO:tasks.workunit.client.1.smithi133.stdout:2/226: dread da/f2c [0,4194304] 0 2023-12-16T07:40:41.755 INFO:tasks.workunit.client.1.smithi133.stdout:0/369: mknod d2/c74 0 2023-12-16T07:40:41.756 INFO:tasks.workunit.client.1.smithi133.stdout:1/433: mknod d0/da/db/d24/d32/c93 0 2023-12-16T07:40:41.757 INFO:tasks.workunit.client.1.smithi133.stdout:1/434: chown d0/d60/f8e 153300424 1 2023-12-16T07:40:41.757 INFO:tasks.workunit.client.1.smithi133.stdout:4/544: read d3/d7/d38/d57/d67/f8d [6702471,120535] 0 2023-12-16T07:40:41.760 INFO:tasks.workunit.client.1.smithi133.stdout:5/235: dwrite d1/d18/f41 [0,4194304] 0 2023-12-16T07:40:41.760 INFO:tasks.workunit.client.1.smithi133.stdout:5/236: fsync d1/f1a 0 2023-12-16T07:40:41.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/227: mkdir da/d15/d1b/d43 0 2023-12-16T07:40:41.762 INFO:tasks.workunit.client.1.smithi133.stdout:7/617: dwrite db/d21/d2c/d31/d59/f5a [0,4194304] 0 2023-12-16T07:40:41.762 INFO:tasks.workunit.client.1.smithi133.stdout:8/328: dwrite d9/d10/d39/d48/d44/f53 [0,4194304] 0 2023-12-16T07:40:41.764 INFO:tasks.workunit.client.1.smithi133.stdout:1/435: getdents d0/da/db/d24/d5a/d68 0 2023-12-16T07:40:41.767 INFO:tasks.workunit.client.1.smithi133.stdout:4/545: mknod d3/d7/d38/d57/d75/cba 0 2023-12-16T07:40:41.769 INFO:tasks.workunit.client.1.smithi133.stdout:5/237: dread d1/f1a [0,4194304] 0 2023-12-16T07:40:41.770 INFO:tasks.workunit.client.1.smithi133.stdout:5/238: read d1/d18/f4e [39704,113873] 0 2023-12-16T07:40:41.772 INFO:tasks.workunit.client.1.smithi133.stdout:2/228: rmdir da/d15/d1b 39 2023-12-16T07:40:41.772 INFO:tasks.workunit.client.1.smithi133.stdout:0/370: dwrite d2/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:41.777 INFO:tasks.workunit.client.1.smithi133.stdout:7/618: unlink db/d3e/d4a/d58/d86/da8/lc6 0 2023-12-16T07:40:41.778 INFO:tasks.workunit.client.1.smithi133.stdout:6/548: sync 2023-12-16T07:40:41.778 INFO:tasks.workunit.client.1.smithi133.stdout:6/549: dread - d0/d4/d21/d60/f66 zero size 2023-12-16T07:40:41.779 INFO:tasks.workunit.client.1.smithi133.stdout:6/550: chown d0 22687432 1 2023-12-16T07:40:41.780 INFO:tasks.workunit.client.1.smithi133.stdout:8/329: unlink d9/d11/f25 0 2023-12-16T07:40:41.780 INFO:tasks.workunit.client.1.smithi133.stdout:8/330: write d9/d11/f38 [562128,80004] 0 2023-12-16T07:40:41.780 INFO:tasks.workunit.client.1.smithi133.stdout:8/331: dread - d9/d10/d39/d48/d44/f46 zero size 2023-12-16T07:40:41.783 INFO:tasks.workunit.client.1.smithi133.stdout:1/436: rmdir d0/d12/d51 39 2023-12-16T07:40:41.785 INFO:tasks.workunit.client.1.smithi133.stdout:4/546: mkdir d3/d7/d44/da7/dbb 0 2023-12-16T07:40:41.785 INFO:tasks.workunit.client.1.smithi133.stdout:4/547: truncate d3/d7/d44/f78 1037931 0 2023-12-16T07:40:41.786 INFO:tasks.workunit.client.1.smithi133.stdout:7/619: dread db/d12/f34 [4194304,4194304] 0 2023-12-16T07:40:41.786 INFO:tasks.workunit.client.1.smithi133.stdout:7/620: write db/d3e/d4a/d58/d86/d8b/d8d/f95 [5872872,99591] 0 2023-12-16T07:40:41.789 INFO:tasks.workunit.client.1.smithi133.stdout:5/239: getdents d1/d18 0 2023-12-16T07:40:41.792 INFO:tasks.workunit.client.1.smithi133.stdout:2/229: creat da/d15/d1b/f44 x:0 0 0 2023-12-16T07:40:41.795 INFO:tasks.workunit.client.1.smithi133.stdout:0/371: link d2/d17/d2b/d31/l62 d2/d9/d12/d45/l75 0 2023-12-16T07:40:41.797 INFO:tasks.workunit.client.1.smithi133.stdout:6/551: truncate d0/d5e/f76 1101418 0 2023-12-16T07:40:41.797 INFO:tasks.workunit.client.1.smithi133.stdout:6/552: rename d0/d4/d21 to d0/d4/d21/d35/d4e/d84/d69/db6 22 2023-12-16T07:40:41.800 INFO:tasks.workunit.client.1.smithi133.stdout:8/332: mkdir d9/d10/d39/d48/d44/d6e 0 2023-12-16T07:40:41.801 INFO:tasks.workunit.client.1.smithi133.stdout:7/621: link db/d3e/faa db/d12/fcb 0 2023-12-16T07:40:41.801 INFO:tasks.workunit.client.1.smithi133.stdout:7/622: readlink db/la7 0 2023-12-16T07:40:41.801 INFO:tasks.workunit.client.1.smithi133.stdout:5/240: dread d1/fb [0,4194304] 0 2023-12-16T07:40:41.802 INFO:tasks.workunit.client.1.smithi133.stdout:5/241: fsync d1/d16/f2b 0 2023-12-16T07:40:41.803 INFO:tasks.workunit.client.1.smithi133.stdout:7/623: write db/d21/f2a [3754799,19566] 0 2023-12-16T07:40:41.803 INFO:tasks.workunit.client.1.smithi133.stdout:2/230: creat da/d15/d1b/d43/f45 x:0 0 0 2023-12-16T07:40:41.803 INFO:tasks.workunit.client.1.smithi133.stdout:8/333: dread d9/d10/d39/d48/f51 [0,4194304] 0 2023-12-16T07:40:41.804 INFO:tasks.workunit.client.1.smithi133.stdout:4/548: dwrite d3/d7/d38/d57/d75/f88 [0,4194304] 0 2023-12-16T07:40:41.804 INFO:tasks.workunit.client.1.smithi133.stdout:6/553: readlink d0/d4/d21/d35/d36/l63 0 2023-12-16T07:40:41.804 INFO:tasks.workunit.client.1.smithi133.stdout:6/554: fsync d0/d4/d21/d8a/d93/f82 0 2023-12-16T07:40:41.804 INFO:tasks.workunit.client.1.smithi133.stdout:6/555: stat d0/d4/d21/d8a/d93/d8e 0 2023-12-16T07:40:41.804 INFO:tasks.workunit.client.1.smithi133.stdout:6/556: dread - d0/d4/d21/d8a/d93/fa9 zero size 2023-12-16T07:40:41.805 INFO:tasks.workunit.client.1.smithi133.stdout:1/437: dwrite d0/d1c/d37/f84 [0,4194304] 0 2023-12-16T07:40:41.805 INFO:tasks.workunit.client.1.smithi133.stdout:0/372: dread d2/d9/d20/f29 [0,4194304] 0 2023-12-16T07:40:41.805 INFO:tasks.workunit.client.1.smithi133.stdout:5/242: mkdir d1/de/d52 0 2023-12-16T07:40:41.808 INFO:tasks.workunit.client.1.smithi133.stdout:7/624: link db/c19 db/d3e/d4a/d58/d86/ccc 0 2023-12-16T07:40:41.809 INFO:tasks.workunit.client.1.smithi133.stdout:2/231: creat da/d1d/f46 x:0 0 0 2023-12-16T07:40:41.810 INFO:tasks.workunit.client.1.smithi133.stdout:2/232: stat da/d1d/d24/f37 0 2023-12-16T07:40:41.811 INFO:tasks.workunit.client.1.smithi133.stdout:8/334: symlink d9/dc/de/l6f 0 2023-12-16T07:40:41.817 INFO:tasks.workunit.client.1.smithi133.stdout:4/549: rename d3/d7/d1c/d2a/da6 to d3/d7/d44/dac/dbc 0 2023-12-16T07:40:41.821 INFO:tasks.workunit.client.1.smithi133.stdout:0/373: mkdir d2/d9/d12/d76 0 2023-12-16T07:40:41.821 INFO:tasks.workunit.client.1.smithi133.stdout:0/374: getdents d2/d9/d12/d76 0 2023-12-16T07:40:41.822 INFO:tasks.workunit.client.1.smithi133.stdout:5/243: rmdir d1/d18 39 2023-12-16T07:40:41.823 INFO:tasks.workunit.client.1.smithi133.stdout:7/625: symlink db/d12/d3a/d6c/lcd 0 2023-12-16T07:40:41.825 INFO:tasks.workunit.client.1.smithi133.stdout:1/438: rename d0/l8a to d0/d12/l94 0 2023-12-16T07:40:41.826 INFO:tasks.workunit.client.1.smithi133.stdout:4/550: stat d3/d7/d38/d45/lb8 0 2023-12-16T07:40:41.826 INFO:tasks.workunit.client.1.smithi133.stdout:4/551: fdatasync d3/d7/d44/f78 0 2023-12-16T07:40:41.826 INFO:tasks.workunit.client.1.smithi133.stdout:4/552: fdatasync d3/f59 0 2023-12-16T07:40:41.826 INFO:tasks.workunit.client.1.smithi133.stdout:0/375: write d2/f8 [185518,21851] 0 2023-12-16T07:40:41.826 INFO:tasks.workunit.client.1.smithi133.stdout:0/376: fsync d2/d17/f1b 0 2023-12-16T07:40:41.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/557: dwrite d0/d4/d21/d35/d4e/d84/fb3 [0,4194304] 0 2023-12-16T07:40:41.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/558: dread - d0/d4/d21/d60/f9d zero size 2023-12-16T07:40:41.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/559: fsync d0/d4/f5c 0 2023-12-16T07:40:41.827 INFO:tasks.workunit.client.1.smithi133.stdout:8/335: dwrite d9/d10/d39/d48/d44/f53 [0,4194304] 0 2023-12-16T07:40:41.827 INFO:tasks.workunit.client.1.smithi133.stdout:5/244: creat d1/d18/d2c/f53 x:0 0 0 2023-12-16T07:40:41.827 INFO:tasks.workunit.client.1.smithi133.stdout:5/245: write d1/de/f23 [789361,47550] 0 2023-12-16T07:40:41.828 INFO:tasks.workunit.client.1.smithi133.stdout:5/246: readlink d1/d18/l33 0 2023-12-16T07:40:41.828 INFO:tasks.workunit.client.1.smithi133.stdout:5/247: fdatasync d1/f3d 0 2023-12-16T07:40:41.830 INFO:tasks.workunit.client.1.smithi133.stdout:7/626: link db/d21/f2f db/d21/d2c/d31/fce 0 2023-12-16T07:40:41.830 INFO:tasks.workunit.client.1.smithi133.stdout:7/627: chown db/d21/d2c 134867 1 2023-12-16T07:40:41.832 INFO:tasks.workunit.client.1.smithi133.stdout:2/233: rename da/d15/d17/d40/d41 to da/d1d/d24/d2e/d47 0 2023-12-16T07:40:41.834 INFO:tasks.workunit.client.1.smithi133.stdout:1/439: truncate d0/da/db/d24/f5d 1112712 0 2023-12-16T07:40:41.837 INFO:tasks.workunit.client.1.smithi133.stdout:0/377: creat d2/d17/d2b/f77 x:0 0 0 2023-12-16T07:40:41.842 INFO:tasks.workunit.client.1.smithi133.stdout:6/560: symlink d0/d5e/d75/d81/d99/lb7 0 2023-12-16T07:40:41.844 INFO:tasks.workunit.client.1.smithi133.stdout:8/336: creat d9/f70 x:0 0 0 2023-12-16T07:40:41.847 INFO:tasks.workunit.client.1.smithi133.stdout:5/248: mkdir d1/d54 0 2023-12-16T07:40:41.847 INFO:tasks.workunit.client.1.smithi133.stdout:4/553: dwrite d3/d7/f23 [0,4194304] 0 2023-12-16T07:40:41.849 INFO:tasks.workunit.client.1.smithi133.stdout:1/440: mknod d0/da/db/d24/d32/d56/d59/c95 0 2023-12-16T07:40:41.851 INFO:tasks.workunit.client.1.smithi133.stdout:6/561: mknod d0/d4/d21/d35/d4e/d84/cb8 0 2023-12-16T07:40:41.853 INFO:tasks.workunit.client.1.smithi133.stdout:5/249: symlink d1/d18/l55 0 2023-12-16T07:40:41.855 INFO:tasks.workunit.client.1.smithi133.stdout:4/554: link d3/d7/d38/d45/fb9 d3/d7/d6d/fbd 0 2023-12-16T07:40:41.856 INFO:tasks.workunit.client.1.smithi133.stdout:1/441: link d0/da/db/f23 d0/da/db/d24/d32/d3e/d70/d8f/f96 0 2023-12-16T07:40:41.856 INFO:tasks.workunit.client.1.smithi133.stdout:1/442: read - d0/d12/f58 zero size 2023-12-16T07:40:41.858 INFO:tasks.workunit.client.1.smithi133.stdout:6/562: rename d0/d4/d21/d62/l6a to d0/d4/d21/d35/d4e/d84/lb9 0 2023-12-16T07:40:41.859 INFO:tasks.workunit.client.1.smithi133.stdout:8/337: symlink d9/d11/l71 0 2023-12-16T07:40:41.859 INFO:tasks.workunit.client.1.smithi133.stdout:8/338: chown d9/d10/d39/d48/f4a 21 1 2023-12-16T07:40:41.859 INFO:tasks.workunit.client.1.smithi133.stdout:8/339: truncate d9/d10/d39/d48/f68 994808 0 2023-12-16T07:40:41.861 INFO:tasks.workunit.client.1.smithi133.stdout:4/555: mkdir d3/d7/d1c/d2a/d91/dbe 0 2023-12-16T07:40:41.861 INFO:tasks.workunit.client.1.smithi133.stdout:4/556: fdatasync d3/d7/d38/d57/d67/f92 0 2023-12-16T07:40:41.862 INFO:tasks.workunit.client.1.smithi133.stdout:4/557: write d3/d7/d38/d57/d75/f7e [4529255,101696] 0 2023-12-16T07:40:41.862 INFO:tasks.workunit.client.1.smithi133.stdout:4/558: write d3/d7/d1c/d2a/fb3 [773427,106995] 0 2023-12-16T07:40:41.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/628: dwrite db/f7b [0,4194304] 0 2023-12-16T07:40:41.863 INFO:tasks.workunit.client.1.smithi133.stdout:7/629: readlink db/d21/d2c/d31/d59/l7d 0 2023-12-16T07:40:41.863 INFO:tasks.workunit.client.1.smithi133.stdout:0/378: dwrite d2/d9/d12/f6d [0,4194304] 0 2023-12-16T07:40:41.863 INFO:tasks.workunit.client.1.smithi133.stdout:1/443: creat d0/d12/d51/f97 x:0 0 0 2023-12-16T07:40:41.863 INFO:tasks.workunit.client.1.smithi133.stdout:2/234: dwrite da/d15/d1b/d43/f45 [0,4194304] 0 2023-12-16T07:40:41.863 INFO:tasks.workunit.client.1.smithi133.stdout:6/563: stat d0/l5b 0 2023-12-16T07:40:41.867 INFO:tasks.workunit.client.1.smithi133.stdout:7/630: dread db/d21/f37 [0,4194304] 0 2023-12-16T07:40:41.872 INFO:tasks.workunit.client.1.smithi133.stdout:7/631: write db/d21/f80 [524958,121295] 0 2023-12-16T07:40:41.874 INFO:tasks.workunit.client.1.smithi133.stdout:7/632: dread db/d21/d2c/f48 [0,4194304] 0 2023-12-16T07:40:41.874 INFO:tasks.workunit.client.1.smithi133.stdout:0/379: mknod d2/d17/d2b/d31/d36/c78 0 2023-12-16T07:40:41.876 INFO:tasks.workunit.client.1.smithi133.stdout:8/340: dread d9/d11/f38 [0,4194304] 0 2023-12-16T07:40:41.880 INFO:tasks.workunit.client.1.smithi133.stdout:6/564: link d0/d4/d21/c51 d0/d4/d21/d35/d4e/d84/cba 0 2023-12-16T07:40:41.880 INFO:tasks.workunit.client.1.smithi133.stdout:6/565: readlink d0/l5b 0 2023-12-16T07:40:41.881 INFO:tasks.workunit.client.1.smithi133.stdout:7/633: mkdir db/d21/d2c/d31/d79/dcf 0 2023-12-16T07:40:41.883 INFO:tasks.workunit.client.1.smithi133.stdout:0/380: symlink d2/d17/l79 0 2023-12-16T07:40:41.883 INFO:tasks.workunit.client.1.smithi133.stdout:0/381: dread - d2/d17/d2b/d31/d4d/f53 zero size 2023-12-16T07:40:41.883 INFO:tasks.workunit.client.1.smithi133.stdout:0/382: stat d2/d17/d2b/d31/d36/c78 0 2023-12-16T07:40:41.885 INFO:tasks.workunit.client.1.smithi133.stdout:8/341: link d9/d11/d33/c61 d9/dc/d27/c72 0 2023-12-16T07:40:41.886 INFO:tasks.workunit.client.1.smithi133.stdout:8/342: read d9/d11/f38 [474509,5802] 0 2023-12-16T07:40:41.886 INFO:tasks.workunit.client.1.smithi133.stdout:8/343: read - d9/d10/d39/d48/f4a zero size 2023-12-16T07:40:41.887 INFO:tasks.workunit.client.1.smithi133.stdout:6/566: creat d0/d4/d21/d60/fbb x:0 0 0 2023-12-16T07:40:41.889 INFO:tasks.workunit.client.1.smithi133.stdout:6/567: read d0/d4/d21/d8a/d93/d8e/fb4 [63941,80642] 0 2023-12-16T07:40:41.889 INFO:tasks.workunit.client.1.smithi133.stdout:6/568: getdents d0/d4/d21/d35/d7e/dac 0 2023-12-16T07:40:41.890 INFO:tasks.workunit.client.1.smithi133.stdout:0/383: write d2/d17/d40/f49 [1073582,64600] 0 2023-12-16T07:40:41.891 INFO:tasks.workunit.client.1.smithi133.stdout:6/569: mknod d0/d4/d21/d35/d7e/cbc 0 2023-12-16T07:40:41.891 INFO:tasks.workunit.client.1.smithi133.stdout:6/570: write d0/d4/d21/d60/f9d [368079,109667] 0 2023-12-16T07:40:41.891 INFO:tasks.workunit.client.1.smithi133.stdout:6/571: readlink d0/d4/d21/d35/d7e/laa 0 2023-12-16T07:40:41.891 INFO:tasks.workunit.client.1.smithi133.stdout:6/572: fdatasync d0/d4/d21/f40 0 2023-12-16T07:40:41.896 INFO:tasks.workunit.client.1.smithi133.stdout:4/559: dwrite d3/d7/d38/d45/f65 [0,4194304] 0 2023-12-16T07:40:41.897 INFO:tasks.workunit.client.1.smithi133.stdout:1/444: dwrite d0/f17 [0,4194304] 0 2023-12-16T07:40:41.897 INFO:tasks.workunit.client.1.smithi133.stdout:1/445: fdatasync d0/d12/f1b 0 2023-12-16T07:40:41.897 INFO:tasks.workunit.client.1.smithi133.stdout:1/446: chown d0/da/f4b 230 1 2023-12-16T07:40:41.898 INFO:tasks.workunit.client.1.smithi133.stdout:5/250: dwrite d1/d4b/f4c [0,4194304] 0 2023-12-16T07:40:41.900 INFO:tasks.workunit.client.1.smithi133.stdout:7/634: dwrite db/f33 [0,4194304] 0 2023-12-16T07:40:41.901 INFO:tasks.workunit.client.1.smithi133.stdout:8/344: dread d9/d10/f37 [0,4194304] 0 2023-12-16T07:40:41.901 INFO:tasks.workunit.client.1.smithi133.stdout:8/345: chown d9/dc/d27/f28 509 1 2023-12-16T07:40:41.901 INFO:tasks.workunit.client.1.smithi133.stdout:0/384: dread d2/d9/d20/f29 [0,4194304] 0 2023-12-16T07:40:41.902 INFO:tasks.workunit.client.1.smithi133.stdout:4/560: write d3/d7/d44/f55 [281650,88828] 0 2023-12-16T07:40:41.902 INFO:tasks.workunit.client.1.smithi133.stdout:4/561: stat d3/c32 0 2023-12-16T07:40:41.906 INFO:tasks.workunit.client.1.smithi133.stdout:1/447: dread d0/da/db/f38 [0,4194304] 0 2023-12-16T07:40:41.906 INFO:tasks.workunit.client.1.smithi133.stdout:1/448: chown d0/d12/d51/f97 28239 1 2023-12-16T07:40:41.917 INFO:tasks.workunit.client.1.smithi133.stdout:6/573: dwrite d0/d4/d21/d8a/d93/fa0 [0,4194304] 0 2023-12-16T07:40:41.920 INFO:tasks.workunit.client.1.smithi133.stdout:5/251: unlink d1/d1c/c22 0 2023-12-16T07:40:41.940 INFO:tasks.workunit.client.1.smithi133.stdout:7/635: link db/d12/l1d db/d12/ld0 0 2023-12-16T07:40:41.940 INFO:tasks.workunit.client.1.smithi133.stdout:7/636: dread - db/d21/d2c/d31/d6e/fb6 zero size 2023-12-16T07:40:41.941 INFO:tasks.workunit.client.1.smithi133.stdout:8/346: symlink d9/dc/de/l73 0 2023-12-16T07:40:41.941 INFO:tasks.workunit.client.1.smithi133.stdout:8/347: readlink l7 0 2023-12-16T07:40:41.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/385: link d2/d9/d12/d35/d48/l5a d2/d9/d12/d35/d48/l7a 0 2023-12-16T07:40:41.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/386: write d2/d9/f47 [1583931,36288] 0 2023-12-16T07:40:41.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/387: fsync d2/d9/d12/f3f 0 2023-12-16T07:40:41.944 INFO:tasks.workunit.client.1.smithi133.stdout:1/449: symlink d0/da/l98 0 2023-12-16T07:40:41.947 INFO:tasks.workunit.client.1.smithi133.stdout:4/562: dwrite d3/d7/d38/d45/fb9 [0,4194304] 0 2023-12-16T07:40:41.952 INFO:tasks.workunit.client.1.smithi133.stdout:5/252: dwrite d1/d16/f2a [0,4194304] 0 2023-12-16T07:40:41.952 INFO:tasks.workunit.client.1.smithi133.stdout:5/253: truncate d1/de/f23 1360581 0 2023-12-16T07:40:41.956 INFO:tasks.workunit.client.1.smithi133.stdout:7/637: link db/d21/ca6 db/d12/d3a/d6c/dc8/cd1 0 2023-12-16T07:40:41.956 INFO:tasks.workunit.client.1.smithi133.stdout:7/638: dread - db/d53/f6b zero size 2023-12-16T07:40:41.962 INFO:tasks.workunit.client.1.smithi133.stdout:0/388: symlink d2/d9/d12/l7b 0 2023-12-16T07:40:41.964 INFO:tasks.workunit.client.1.smithi133.stdout:1/450: truncate d0/da/db/d24/d32/d3e/d70/d8f/f96 249149 0 2023-12-16T07:40:41.965 INFO:tasks.workunit.client.1.smithi133.stdout:5/254: dread d1/de/f13 [0,4194304] 0 2023-12-16T07:40:41.965 INFO:tasks.workunit.client.1.smithi133.stdout:8/348: dwrite d9/f41 [4194304,4194304] 0 2023-12-16T07:40:41.965 INFO:tasks.workunit.client.1.smithi133.stdout:8/349: readlink d9/d11/d33/l50 0 2023-12-16T07:40:41.970 INFO:tasks.workunit.client.1.smithi133.stdout:2/235: getdents da/d1d/d24/d2e 0 2023-12-16T07:40:41.974 INFO:tasks.workunit.client.1.smithi133.stdout:0/389: creat d2/d9/f7c x:0 0 0 2023-12-16T07:40:41.978 INFO:tasks.workunit.client.1.smithi133.stdout:1/451: creat d0/da/db/d24/d5a/d68/f99 x:0 0 0 2023-12-16T07:40:41.981 INFO:tasks.workunit.client.1.smithi133.stdout:5/255: mknod d1/d4b/c56 0 2023-12-16T07:40:41.981 INFO:tasks.workunit.client.1.smithi133.stdout:8/350: stat d9/d10/c19 0 2023-12-16T07:40:41.983 INFO:tasks.workunit.client.1.smithi133.stdout:2/236: readlink da/d1d/l27 0 2023-12-16T07:40:41.983 INFO:tasks.workunit.client.1.smithi133.stdout:2/237: truncate da/d1d/f46 438559 0 2023-12-16T07:40:41.983 INFO:tasks.workunit.client.1.smithi133.stdout:5/256: write d1/d1c/f40 [362409,123713] 0 2023-12-16T07:40:41.986 INFO:tasks.workunit.client.1.smithi133.stdout:8/351: rename d9/d10/d39/d48/f4a to d9/d10/f74 0 2023-12-16T07:40:41.990 INFO:tasks.workunit.client.1.smithi133.stdout:2/238: mknod da/d1d/d24/c48 0 2023-12-16T07:40:41.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/352: write d9/f41 [2102643,125807] 0 2023-12-16T07:40:41.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/353: fdatasync d9/d10/d39/d48/d44/f46 0 2023-12-16T07:40:41.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/354: chown d9/d10/f1b 368721 1 2023-12-16T07:40:41.991 INFO:tasks.workunit.client.1.smithi133.stdout:1/452: dread d0/f17 [0,4194304] 0 2023-12-16T07:40:41.992 INFO:tasks.workunit.client.1.smithi133.stdout:5/257: mkdir d1/de/d57 0 2023-12-16T07:40:41.994 INFO:tasks.workunit.client.1.smithi133.stdout:2/239: rename da/d15/d17/f18 to da/d15/d17/d40/f49 0 2023-12-16T07:40:41.994 INFO:tasks.workunit.client.1.smithi133.stdout:2/240: chown da/d1d/d24/l2a 588 1 2023-12-16T07:40:41.996 INFO:tasks.workunit.client.1.smithi133.stdout:1/453: truncate d0/da/f2e 2071438 0 2023-12-16T07:40:41.998 INFO:tasks.workunit.client.1.smithi133.stdout:2/241: link da/d15/d17/l42 da/l4a 0 2023-12-16T07:40:42.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/454: symlink d0/da/db/d24/d5a/d68/l9a 0 2023-12-16T07:40:42.001 INFO:tasks.workunit.client.1.smithi133.stdout:1/455: read - d0/da/db/d24/f6b zero size 2023-12-16T07:40:42.001 INFO:tasks.workunit.client.1.smithi133.stdout:1/456: write d0/da/db/d24/d32/d56/d59/d66/f85 [474600,96522] 0 2023-12-16T07:40:42.001 INFO:tasks.workunit.client.1.smithi133.stdout:1/457: write d0/da/db/d24/f6b [707725,79799] 0 2023-12-16T07:40:42.001 INFO:tasks.workunit.client.1.smithi133.stdout:1/458: chown d0/da/db/d24/d32/d3e/d70/c7e 4 1 2023-12-16T07:40:42.001 INFO:tasks.workunit.client.1.smithi133.stdout:1/459: chown d0/da/f19 4175591 1 2023-12-16T07:40:42.001 INFO:tasks.workunit.client.1.smithi133.stdout:5/258: dread d1/d18/d2c/f45 [0,4194304] 0 2023-12-16T07:40:42.002 INFO:tasks.workunit.client.1.smithi133.stdout:2/242: symlink da/d15/d1b/d43/l4b 0 2023-12-16T07:40:42.002 INFO:tasks.workunit.client.1.smithi133.stdout:2/243: fsync da/d1d/d24/d2e/f35 0 2023-12-16T07:40:42.002 INFO:tasks.workunit.client.1.smithi133.stdout:2/244: readlink da/d15/d17/l39 0 2023-12-16T07:40:42.005 INFO:tasks.workunit.client.1.smithi133.stdout:5/259: link d1/de/c27 d1/d18/c58 0 2023-12-16T07:40:42.012 INFO:tasks.workunit.client.1.smithi133.stdout:5/260: symlink d1/d18/l59 0 2023-12-16T07:40:42.016 INFO:tasks.workunit.client.1.smithi133.stdout:5/261: mknod d1/d4b/c5a 0 2023-12-16T07:40:42.016 INFO:tasks.workunit.client.1.smithi133.stdout:5/262: fdatasync d1/d18/f4e 0 2023-12-16T07:40:42.016 INFO:tasks.workunit.client.1.smithi133.stdout:5/263: mknod d1/c5b 0 2023-12-16T07:40:42.018 INFO:tasks.workunit.client.1.smithi133.stdout:5/264: write d1/de/f50 [1361194,29240] 0 2023-12-16T07:40:42.019 INFO:tasks.workunit.client.1.smithi133.stdout:5/265: mknod d1/d16/c5c 0 2023-12-16T07:40:42.019 INFO:tasks.workunit.client.1.smithi133.stdout:5/266: read d1/de/f13 [3226664,85162] 0 2023-12-16T07:40:42.020 INFO:tasks.workunit.client.1.smithi133.stdout:5/267: creat d1/de/d52/f5d x:0 0 0 2023-12-16T07:40:42.025 INFO:tasks.workunit.client.1.smithi133.stdout:5/268: creat d1/d18/d26/f5e x:0 0 0 2023-12-16T07:40:42.025 INFO:tasks.workunit.client.1.smithi133.stdout:5/269: readlink d1/d1c/l28 0 2023-12-16T07:40:42.026 INFO:tasks.workunit.client.1.smithi133.stdout:1/460: dwrite d0/d12/f58 [0,4194304] 0 2023-12-16T07:40:42.026 INFO:tasks.workunit.client.1.smithi133.stdout:5/270: creat d1/d4b/f5f x:0 0 0 2023-12-16T07:40:42.026 INFO:tasks.workunit.client.1.smithi133.stdout:0/390: getdents d2/d17 0 2023-12-16T07:40:42.026 INFO:tasks.workunit.client.1.smithi133.stdout:0/391: write d2/d17/d2b/d31/d36/f6e [5119503,3348] 0 2023-12-16T07:40:42.029 INFO:tasks.workunit.client.1.smithi133.stdout:2/245: dwrite da/d1d/d24/f37 [0,4194304] 0 2023-12-16T07:40:42.033 INFO:tasks.workunit.client.1.smithi133.stdout:0/392: mkdir d2/d9/d12/d7d 0 2023-12-16T07:40:42.033 INFO:tasks.workunit.client.1.smithi133.stdout:6/574: fsync d0/d4/d21/d60/fbb 0 2023-12-16T07:40:42.035 INFO:tasks.workunit.client.1.smithi133.stdout:2/246: mknod da/d15/d1b/c4c 0 2023-12-16T07:40:42.036 INFO:tasks.workunit.client.1.smithi133.stdout:1/461: mkdir d0/d1c/d9b 0 2023-12-16T07:40:42.037 INFO:tasks.workunit.client.1.smithi133.stdout:0/393: write d2/d9/d12/f6d [720359,42477] 0 2023-12-16T07:40:42.038 INFO:tasks.workunit.client.1.smithi133.stdout:6/575: truncate d0/d4/d21/d35/f79 4155532 0 2023-12-16T07:40:42.041 INFO:tasks.workunit.client.1.smithi133.stdout:1/462: dread d0/d12/f1b [0,4194304] 0 2023-12-16T07:40:42.042 INFO:tasks.workunit.client.1.smithi133.stdout:6/576: mkdir d0/d4/d21/d35/d4e/d84/d69/dbd 0 2023-12-16T07:40:42.043 INFO:tasks.workunit.client.1.smithi133.stdout:1/463: dread d0/d12/f1b [0,4194304] 0 2023-12-16T07:40:42.044 INFO:tasks.workunit.client.1.smithi133.stdout:1/464: write d0/da/d3d/d41/f83 [665786,124055] 0 2023-12-16T07:40:42.044 INFO:tasks.workunit.client.1.smithi133.stdout:2/247: dread da/d1d/f29 [0,4194304] 0 2023-12-16T07:40:42.045 INFO:tasks.workunit.client.1.smithi133.stdout:6/577: unlink d0/d4/d21/d62/fa2 0 2023-12-16T07:40:42.048 INFO:tasks.workunit.client.1.smithi133.stdout:2/248: mknod da/d15/d17/c4d 0 2023-12-16T07:40:42.052 INFO:tasks.workunit.client.1.smithi133.stdout:6/578: creat d0/d4/d21/d8a/d93/d8e/fbe x:0 0 0 2023-12-16T07:40:42.055 INFO:tasks.workunit.client.1.smithi133.stdout:5/271: dwrite d1/d1c/f38 [0,4194304] 0 2023-12-16T07:40:42.055 INFO:tasks.workunit.client.1.smithi133.stdout:5/272: truncate d1/f1f 323386 0 2023-12-16T07:40:42.061 INFO:tasks.workunit.client.1.smithi133.stdout:5/273: mkdir d1/d16/d60 0 2023-12-16T07:40:42.063 INFO:tasks.workunit.client.1.smithi133.stdout:6/579: dread d0/d4/f2b [0,4194304] 0 2023-12-16T07:40:42.066 INFO:tasks.workunit.client.1.smithi133.stdout:5/274: unlink d1/de/d52/f5d 0 2023-12-16T07:40:42.066 INFO:tasks.workunit.client.1.smithi133.stdout:5/275: truncate d1/de/f23 2200107 0 2023-12-16T07:40:42.068 INFO:tasks.workunit.client.1.smithi133.stdout:6/580: creat d0/d5e/d75/dad/fbf x:0 0 0 2023-12-16T07:40:42.068 INFO:tasks.workunit.client.1.smithi133.stdout:5/276: write d1/f7 [3989102,45413] 0 2023-12-16T07:40:42.070 INFO:tasks.workunit.client.1.smithi133.stdout:1/465: dwrite d0/d12/d51/f64 [0,4194304] 0 2023-12-16T07:40:42.071 INFO:tasks.workunit.client.1.smithi133.stdout:6/581: mknod d0/d4/d21/d8a/da4/cc0 0 2023-12-16T07:40:42.072 INFO:tasks.workunit.client.1.smithi133.stdout:5/277: link d1/d1c/f38 d1/d54/f61 0 2023-12-16T07:40:42.072 INFO:tasks.workunit.client.1.smithi133.stdout:2/249: dwrite da/d1d/f25 [4194304,4194304] 0 2023-12-16T07:40:42.077 INFO:tasks.workunit.client.1.smithi133.stdout:1/466: rename d0/d1c/d37/c3b to d0/da/db/c9c 0 2023-12-16T07:40:42.077 INFO:tasks.workunit.client.1.smithi133.stdout:1/467: stat d0/d60/l8c 0 2023-12-16T07:40:42.079 INFO:tasks.workunit.client.1.smithi133.stdout:2/250: mknod da/d15/d1b/c4e 0 2023-12-16T07:40:42.079 INFO:tasks.workunit.client.1.smithi133.stdout:2/251: truncate da/d15/d17/f36 945187 0 2023-12-16T07:40:42.082 INFO:tasks.workunit.client.1.smithi133.stdout:1/468: write d0/d1c/d37/f43 [1189910,46502] 0 2023-12-16T07:40:42.083 INFO:tasks.workunit.client.1.smithi133.stdout:1/469: dread - d0/da/d3d/d41/f6a zero size 2023-12-16T07:40:42.087 INFO:tasks.workunit.client.1.smithi133.stdout:6/582: dread d0/f1b [4194304,4194304] 0 2023-12-16T07:40:42.089 INFO:tasks.workunit.client.1.smithi133.stdout:1/470: creat d0/d12/d51/f9d x:0 0 0 2023-12-16T07:40:42.092 INFO:tasks.workunit.client.1.smithi133.stdout:6/583: dread d0/d4/f28 [0,4194304] 0 2023-12-16T07:40:42.095 INFO:tasks.workunit.client.1.smithi133.stdout:6/584: unlink d0/d4/d21/d8a/d93/d8e/fb4 0 2023-12-16T07:40:42.097 INFO:tasks.workunit.client.1.smithi133.stdout:6/585: rename d0/f74 to d0/d5e/d75/dad/fc1 0 2023-12-16T07:40:42.098 INFO:tasks.workunit.client.1.smithi133.stdout:6/586: write d0/d4/d21/d35/d36/f64 [1460458,68909] 0 2023-12-16T07:40:42.098 INFO:tasks.workunit.client.1.smithi133.stdout:6/587: readlink d0/l7d 0 2023-12-16T07:40:42.099 INFO:tasks.workunit.client.1.smithi133.stdout:6/588: symlink d0/d4/d21/d8a/d93/d8e/lc2 0 2023-12-16T07:40:42.104 INFO:tasks.workunit.client.1.smithi133.stdout:7/639: getdents db/d12/d3a/d6c/dc8 0 2023-12-16T07:40:42.106 INFO:tasks.workunit.client.1.smithi133.stdout:7/640: getdents db/d12/d98 0 2023-12-16T07:40:42.106 INFO:tasks.workunit.client.1.smithi133.stdout:7/641: fsync db/f22 0 2023-12-16T07:40:42.106 INFO:tasks.workunit.client.1.smithi133.stdout:7/642: fsync db/d3e/d4a/d58/db9/fc2 0 2023-12-16T07:40:42.107 INFO:tasks.workunit.client.1.smithi133.stdout:7/643: mkdir db/d21/d2c/d31/dd2 0 2023-12-16T07:40:42.107 INFO:tasks.workunit.client.1.smithi133.stdout:7/644: fsync db/d3e/d4a/d58/f62 0 2023-12-16T07:40:42.114 INFO:tasks.workunit.client.1.smithi133.stdout:2/252: dwrite f4 [0,4194304] 0 2023-12-16T07:40:42.114 INFO:tasks.workunit.client.1.smithi133.stdout:6/589: dread d0/d4/d21/d35/d4e/d84/fb3 [0,4194304] 0 2023-12-16T07:40:42.115 INFO:tasks.workunit.client.1.smithi133.stdout:2/253: dread - da/d1d/d24/d2e/f35 zero size 2023-12-16T07:40:42.115 INFO:tasks.workunit.client.1.smithi133.stdout:1/471: dwrite d0/da/db/d24/d32/f57 [0,4194304] 0 2023-12-16T07:40:42.115 INFO:tasks.workunit.client.1.smithi133.stdout:5/278: dwrite d1/d18/f47 [0,4194304] 0 2023-12-16T07:40:42.117 INFO:tasks.workunit.client.1.smithi133.stdout:6/590: mknod d0/d4/d21/d35/d4e/d84/d69/da1/cc3 0 2023-12-16T07:40:42.118 INFO:tasks.workunit.client.1.smithi133.stdout:2/254: symlink da/d15/d1b/l4f 0 2023-12-16T07:40:42.121 INFO:tasks.workunit.client.1.smithi133.stdout:1/472: rename d0/d12/f5e to d0/d1c/d37/f9e 0 2023-12-16T07:40:42.122 INFO:tasks.workunit.client.1.smithi133.stdout:1/473: write d0/da/db/d24/d32/d3e/d70/f7c [4331481,11122] 0 2023-12-16T07:40:42.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/286: sync 2023-12-16T07:40:42.123 INFO:tasks.workunit.client.1.smithi133.stdout:3/287: chown d7/d8/f54 200251016 1 2023-12-16T07:40:42.123 INFO:tasks.workunit.client.1.smithi133.stdout:7/645: dwrite db/d3e/d4a/d58/d86/fa4 [0,4194304] 0 2023-12-16T07:40:42.123 INFO:tasks.workunit.client.1.smithi133.stdout:9/397: sync 2023-12-16T07:40:42.125 INFO:tasks.workunit.client.1.smithi133.stdout:6/591: mknod d0/d4/d21/d35/cc4 0 2023-12-16T07:40:42.125 INFO:tasks.workunit.client.1.smithi133.stdout:6/592: chown d0/d4/c94 4 1 2023-12-16T07:40:42.126 INFO:tasks.workunit.client.1.smithi133.stdout:2/255: mkdir da/d50 0 2023-12-16T07:40:42.129 INFO:tasks.workunit.client.1.smithi133.stdout:1/474: mkdir d0/da/d3d/d41/d9f 0 2023-12-16T07:40:42.130 INFO:tasks.workunit.client.1.smithi133.stdout:3/288: creat d7/d8/d78/d43/f79 x:0 0 0 2023-12-16T07:40:42.134 INFO:tasks.workunit.client.1.smithi133.stdout:7/646: symlink db/d21/d2c/d31/dd2/ld3 0 2023-12-16T07:40:42.135 INFO:tasks.workunit.client.1.smithi133.stdout:9/398: creat d15/d18/d2c/d68/f83 x:0 0 0 2023-12-16T07:40:42.136 INFO:tasks.workunit.client.1.smithi133.stdout:6/593: mkdir d0/d5e/d8c/dc5 0 2023-12-16T07:40:42.138 INFO:tasks.workunit.client.1.smithi133.stdout:2/256: link da/lf da/d1d/d24/l51 0 2023-12-16T07:40:42.139 INFO:tasks.workunit.client.1.smithi133.stdout:3/289: creat d7/d8/d1c/d2b/f7a x:0 0 0 2023-12-16T07:40:42.140 INFO:tasks.workunit.client.1.smithi133.stdout:7/647: truncate db/d3e/d4a/d58/d86/d8b/d8d/f95 2353083 0 2023-12-16T07:40:42.141 INFO:tasks.workunit.client.1.smithi133.stdout:9/399: creat d15/d18/d4d/f84 x:0 0 0 2023-12-16T07:40:42.145 INFO:tasks.workunit.client.1.smithi133.stdout:5/279: getdents d1/d18 0 2023-12-16T07:40:42.146 INFO:tasks.workunit.client.1.smithi133.stdout:6/594: creat d0/d4/d21/d35/fc6 x:0 0 0 2023-12-16T07:40:42.148 INFO:tasks.workunit.client.1.smithi133.stdout:3/290: creat d7/d8/d1c/d76/f7b x:0 0 0 2023-12-16T07:40:42.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/595: dread d0/d4/f28 [0,4194304] 0 2023-12-16T07:40:42.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/280: symlink d1/d16/l62 0 2023-12-16T07:40:42.151 INFO:tasks.workunit.client.1.smithi133.stdout:9/400: dread d15/d18/d2c/f46 [0,4194304] 0 2023-12-16T07:40:42.151 INFO:tasks.workunit.client.1.smithi133.stdout:3/291: symlink d7/d8/d1c/d76/l7c 0 2023-12-16T07:40:42.151 INFO:tasks.workunit.client.1.smithi133.stdout:3/292: read - d7/d8/d1c/f74 zero size 2023-12-16T07:40:42.152 INFO:tasks.workunit.client.1.smithi133.stdout:5/281: write d1/f24 [1933909,115762] 0 2023-12-16T07:40:42.153 INFO:tasks.workunit.client.1.smithi133.stdout:1/475: dwrite d0/da/db/d24/d32/d56/d59/d66/f85 [0,4194304] 0 2023-12-16T07:40:42.153 INFO:tasks.workunit.client.1.smithi133.stdout:9/401: mknod d15/d18/d2c/d3a/c85 0 2023-12-16T07:40:42.154 INFO:tasks.workunit.client.1.smithi133.stdout:3/293: rmdir d7/d8/d78/d43/d5b 39 2023-12-16T07:40:42.154 INFO:tasks.workunit.client.1.smithi133.stdout:3/294: fdatasync d7/d8/f75 0 2023-12-16T07:40:42.154 INFO:tasks.workunit.client.1.smithi133.stdout:9/402: write d15/d18/d2c/d3a/f3c [1850773,83721] 0 2023-12-16T07:40:42.155 INFO:tasks.workunit.client.1.smithi133.stdout:5/282: rename d1/d54/f61 to d1/d18/f63 0 2023-12-16T07:40:42.157 INFO:tasks.workunit.client.1.smithi133.stdout:7/648: dwrite db/d3e/d4a/f7c [0,4194304] 0 2023-12-16T07:40:42.158 INFO:tasks.workunit.client.1.smithi133.stdout:7/649: fsync db/d21/f37 0 2023-12-16T07:40:42.159 INFO:tasks.workunit.client.1.smithi133.stdout:1/476: link d0/d12/l94 d0/da/db/d24/d32/d56/d59/d5f/la0 0 2023-12-16T07:40:42.159 INFO:tasks.workunit.client.1.smithi133.stdout:1/477: stat d0/l2b 0 2023-12-16T07:40:42.159 INFO:tasks.workunit.client.1.smithi133.stdout:1/478: chown d0/da/db/l11 3046736 1 2023-12-16T07:40:42.159 INFO:tasks.workunit.client.1.smithi133.stdout:1/479: read d0/da/d3d/d41/f83 [744537,18204] 0 2023-12-16T07:40:42.159 INFO:tasks.workunit.client.1.smithi133.stdout:3/295: mknod d7/d8/d1d/d2a/c7d 0 2023-12-16T07:40:42.160 INFO:tasks.workunit.client.1.smithi133.stdout:3/296: read d7/d8/d1c/f4b [393685,80092] 0 2023-12-16T07:40:42.162 INFO:tasks.workunit.client.1.smithi133.stdout:9/403: mknod d15/d18/d2c/d3a/c86 0 2023-12-16T07:40:42.164 INFO:tasks.workunit.client.1.smithi133.stdout:5/283: mkdir d1/d16/d60/d64 0 2023-12-16T07:40:42.165 INFO:tasks.workunit.client.1.smithi133.stdout:7/650: mkdir db/dd4 0 2023-12-16T07:40:42.167 INFO:tasks.workunit.client.1.smithi133.stdout:1/480: rmdir d0/da/db/d24/d32/d3e/d70 39 2023-12-16T07:40:42.167 INFO:tasks.workunit.client.1.smithi133.stdout:9/404: getdents d15/d18/d5b/d71/d78 0 2023-12-16T07:40:42.169 INFO:tasks.workunit.client.1.smithi133.stdout:9/405: dread fe [0,4194304] 0 2023-12-16T07:40:42.169 INFO:tasks.workunit.client.1.smithi133.stdout:9/406: fdatasync d15/d18/d2c/f3e 0 2023-12-16T07:40:42.172 INFO:tasks.workunit.client.1.smithi133.stdout:5/284: getdents d1/d1c 0 2023-12-16T07:40:42.173 INFO:tasks.workunit.client.1.smithi133.stdout:7/651: unlink db/d21/d2c/dbc/lc0 0 2023-12-16T07:40:42.174 INFO:tasks.workunit.client.1.smithi133.stdout:1/481: symlink d0/da/db/d24/d32/d3e/d70/d8f/la1 0 2023-12-16T07:40:42.176 INFO:tasks.workunit.client.1.smithi133.stdout:9/407: unlink d15/d18/d2c/l3f 0 2023-12-16T07:40:42.177 INFO:tasks.workunit.client.1.smithi133.stdout:5/285: creat d1/d16/d60/d64/f65 x:0 0 0 2023-12-16T07:40:42.177 INFO:tasks.workunit.client.1.smithi133.stdout:5/286: fdatasync d1/d18/d2c/f45 0 2023-12-16T07:40:42.180 INFO:tasks.workunit.client.1.smithi133.stdout:9/408: link d15/d18/d5b/l65 d15/d18/d4d/l87 0 2023-12-16T07:40:42.180 INFO:tasks.workunit.client.1.smithi133.stdout:9/409: fsync d15/f16 0 2023-12-16T07:40:42.180 INFO:tasks.workunit.client.1.smithi133.stdout:9/410: dread - d15/d18/f5e zero size 2023-12-16T07:40:42.182 INFO:tasks.workunit.client.1.smithi133.stdout:6/596: getdents d0 0 2023-12-16T07:40:42.183 INFO:tasks.workunit.client.1.smithi133.stdout:7/652: dread db/d12/fbf [0,4194304] 0 2023-12-16T07:40:42.184 INFO:tasks.workunit.client.1.smithi133.stdout:9/411: unlink fe 0 2023-12-16T07:40:42.185 INFO:tasks.workunit.client.1.smithi133.stdout:6/597: creat d0/d5e/d8c/dc5/fc7 x:0 0 0 2023-12-16T07:40:42.187 INFO:tasks.workunit.client.1.smithi133.stdout:7/653: rename db/d21/fba to db/d3e/d4a/d58/d86/fd5 0 2023-12-16T07:40:42.188 INFO:tasks.workunit.client.1.smithi133.stdout:7/654: write db/d12/f71 [3032525,96148] 0 2023-12-16T07:40:42.189 INFO:tasks.workunit.client.1.smithi133.stdout:9/412: unlink d15/d18/d4d/f51 0 2023-12-16T07:40:42.191 INFO:tasks.workunit.client.1.smithi133.stdout:6/598: creat d0/d4/d21/d35/d4e/d84/d69/fc8 x:0 0 0 2023-12-16T07:40:42.191 INFO:tasks.workunit.client.1.smithi133.stdout:6/599: stat d0/d4/d21/f4c 0 2023-12-16T07:40:42.191 INFO:tasks.workunit.client.1.smithi133.stdout:6/600: write d0/d4/d21/d8a/d93/d8e/fbe [598940,103758] 0 2023-12-16T07:40:42.194 INFO:tasks.workunit.client.1.smithi133.stdout:1/482: fsync d0/d1c/d37/f9e 0 2023-12-16T07:40:42.195 INFO:tasks.workunit.client.1.smithi133.stdout:7/655: creat db/dd4/fd6 x:0 0 0 2023-12-16T07:40:42.197 INFO:tasks.workunit.client.1.smithi133.stdout:6/601: symlink d0/d5e/d75/dad/lc9 0 2023-12-16T07:40:42.198 INFO:tasks.workunit.client.1.smithi133.stdout:1/483: creat d0/da/db/d24/d32/d56/d59/d66/fa2 x:0 0 0 2023-12-16T07:40:42.207 INFO:tasks.workunit.client.1.smithi133.stdout:2/257: getdents da 0 2023-12-16T07:40:42.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:41 smithi049 ceph-mon[111939]: pgmap v17: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 82 MiB/s rd, 172 MiB/s wr, 354 op/s 2023-12-16T07:40:42.211 INFO:tasks.workunit.client.1.smithi133.stdout:1/484: truncate d0/d1c/d37/f4a 3841788 0 2023-12-16T07:40:42.213 INFO:tasks.workunit.client.1.smithi133.stdout:2/258: mkdir da/d1d/d24/d2e/d47/d52 0 2023-12-16T07:40:42.213 INFO:tasks.workunit.client.1.smithi133.stdout:2/259: write da/d15/d1b/f44 [333228,104763] 0 2023-12-16T07:40:42.214 INFO:tasks.workunit.client.1.smithi133.stdout:1/485: rename d0/da/db/d24/c42 to d0/da/db/d24/d32/d56/d59/ca3 0 2023-12-16T07:40:42.215 INFO:tasks.workunit.client.1.smithi133.stdout:2/260: write da/d15/d1b/f34 [2334716,35792] 0 2023-12-16T07:40:42.216 INFO:tasks.workunit.client.1.smithi133.stdout:1/486: creat d0/da/d3d/d41/fa4 x:0 0 0 2023-12-16T07:40:42.216 INFO:tasks.workunit.client.1.smithi133.stdout:1/487: stat d0/c6c 0 2023-12-16T07:40:42.217 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:41 smithi133 ceph-mon[120445]: pgmap v17: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 82 MiB/s rd, 172 MiB/s wr, 354 op/s 2023-12-16T07:40:42.218 INFO:tasks.workunit.client.1.smithi133.stdout:6/602: dwrite d0/d4/d21/d8a/da4/fb1 [0,4194304] 0 2023-12-16T07:40:42.218 INFO:tasks.workunit.client.1.smithi133.stdout:6/603: chown d0/d4/f1c 11503609 1 2023-12-16T07:40:42.218 INFO:tasks.workunit.client.1.smithi133.stdout:6/604: write d0/d4/d21/d60/f89 [1011425,58412] 0 2023-12-16T07:40:42.218 INFO:tasks.workunit.client.1.smithi133.stdout:6/605: chown d0/d4/d21/d60/f9d 0 1 2023-12-16T07:40:42.218 INFO:tasks.workunit.client.1.smithi133.stdout:6/606: chown d0/d4/d21/d35/d4e/l57 237943910 1 2023-12-16T07:40:42.218 INFO:tasks.workunit.client.1.smithi133.stdout:9/413: dwrite f0 [0,4194304] 0 2023-12-16T07:40:42.218 INFO:tasks.workunit.client.1.smithi133.stdout:5/287: getdents d1/d16 0 2023-12-16T07:40:42.219 INFO:tasks.workunit.client.1.smithi133.stdout:2/261: symlink da/d1d/d24/l53 0 2023-12-16T07:40:42.221 INFO:tasks.workunit.client.1.smithi133.stdout:7/656: dread db/d3e/d4a/d58/d86/d8b/d8d/f95 [0,4194304] 0 2023-12-16T07:40:42.230 INFO:tasks.workunit.client.1.smithi133.stdout:6/607: creat d0/d4/d21/d35/d4e/d84/d69/fca x:0 0 0 2023-12-16T07:40:42.230 INFO:tasks.workunit.client.1.smithi133.stdout:9/414: unlink d15/d18/d4d/f56 0 2023-12-16T07:40:42.230 INFO:tasks.workunit.client.1.smithi133.stdout:1/488: dwrite d0/d1c/d37/f55 [8388608,4194304] 0 2023-12-16T07:40:42.231 INFO:tasks.workunit.client.1.smithi133.stdout:5/288: truncate d1/de/f32 888400 0 2023-12-16T07:40:42.237 INFO:tasks.workunit.client.1.smithi133.stdout:2/262: rename da/d1d/d24/c48 to da/d1d/d24/d3a/c54 0 2023-12-16T07:40:42.238 INFO:tasks.workunit.client.1.smithi133.stdout:7/657: link db/d21/l9d db/d3e/d4a/ld7 0 2023-12-16T07:40:42.239 INFO:tasks.workunit.client.1.smithi133.stdout:6/608: mkdir d0/d4/d21/d35/d4e/d84/d69/dbd/dcb 0 2023-12-16T07:40:42.239 INFO:tasks.workunit.client.1.smithi133.stdout:7/658: dread db/d3e/d4a/d58/d86/da9/fca [0,4194304] 0 2023-12-16T07:40:42.259 INFO:tasks.workunit.client.1.smithi133.stdout:9/415: dwrite d15/d18/d2c/d3a/f3c [0,4194304] 0 2023-12-16T07:40:42.327 INFO:tasks.workunit.client.1.smithi133.stdout:1/489: rename d0/da/db/f77 to d0/da/db/d24/d5a/d68/fa5 0 2023-12-16T07:40:42.327 INFO:tasks.workunit.client.1.smithi133.stdout:1/490: stat d0/d1c/d9b 0 2023-12-16T07:40:42.327 INFO:tasks.workunit.client.1.smithi133.stdout:1/491: chown d0/d12/f3f 1186274 1 2023-12-16T07:40:42.328 INFO:tasks.workunit.client.1.smithi133.stdout:2/263: unlink da/d15/d17/d40/c3f 0 2023-12-16T07:40:42.330 INFO:tasks.workunit.client.1.smithi133.stdout:6/609: creat d0/d5e/d8c/fcc x:0 0 0 2023-12-16T07:40:42.331 INFO:tasks.workunit.client.1.smithi133.stdout:6/610: write d0/d4/d21/d8a/da4/fb1 [367726,4732] 0 2023-12-16T07:40:42.332 INFO:tasks.workunit.client.1.smithi133.stdout:7/659: symlink db/d12/d3a/db5/ld8 0 2023-12-16T07:40:42.332 INFO:tasks.workunit.client.1.smithi133.stdout:7/660: chown db/d21/d2c/d31/d79/dcf 10416 1 2023-12-16T07:40:42.334 INFO:tasks.workunit.client.1.smithi133.stdout:9/416: symlink d15/d18/d5b/l88 0 2023-12-16T07:40:42.337 INFO:tasks.workunit.client.1.smithi133.stdout:1/492: unlink d0/da/db/d24/d32/d56/f75 0 2023-12-16T07:40:42.337 INFO:tasks.workunit.client.1.smithi133.stdout:1/493: write d0/f17 [2290340,123248] 0 2023-12-16T07:40:42.338 INFO:tasks.workunit.client.1.smithi133.stdout:2/264: mknod da/d1d/d24/d2e/d47/d52/c55 0 2023-12-16T07:40:42.343 INFO:tasks.workunit.client.1.smithi133.stdout:6/611: creat d0/fcd x:0 0 0 2023-12-16T07:40:42.343 INFO:tasks.workunit.client.1.smithi133.stdout:6/612: chown d0/d4/d21/c51 392477816 1 2023-12-16T07:40:42.343 INFO:tasks.workunit.client.1.smithi133.stdout:6/613: truncate d0/d4/d21/d35/d4e/d84/d69/fc8 950594 0 2023-12-16T07:40:42.343 INFO:tasks.workunit.client.1.smithi133.stdout:6/614: truncate d0/d5e/f76 1582111 0 2023-12-16T07:40:42.344 INFO:tasks.workunit.client.1.smithi133.stdout:7/661: mkdir db/d12/d3a/d6c/dc8/dd9 0 2023-12-16T07:40:42.344 INFO:tasks.workunit.client.1.smithi133.stdout:7/662: write db/d3e/d4a/d58/d86/d8b/d8d/f95 [206330,117150] 0 2023-12-16T07:40:42.345 INFO:tasks.workunit.client.1.smithi133.stdout:9/417: creat d15/d18/d5b/d71/f89 x:0 0 0 2023-12-16T07:40:42.345 INFO:tasks.workunit.client.1.smithi133.stdout:1/494: dread d0/d1c/d37/f84 [0,4194304] 0 2023-12-16T07:40:42.345 INFO:tasks.workunit.client.1.smithi133.stdout:9/418: chown c6 0 1 2023-12-16T07:40:42.345 INFO:tasks.workunit.client.1.smithi133.stdout:1/495: chown d0/d1c/d37/f55 18728 1 2023-12-16T07:40:42.350 INFO:tasks.workunit.client.1.smithi133.stdout:2/265: rename da/d1d/l27 to da/d1d/d24/l56 0 2023-12-16T07:40:42.351 INFO:tasks.workunit.client.1.smithi133.stdout:6/615: symlink d0/d5e/d75/lce 0 2023-12-16T07:40:42.355 INFO:tasks.workunit.client.1.smithi133.stdout:7/663: link db/d12/d98/l9e db/d3e/d4a/d58/lda 0 2023-12-16T07:40:42.358 INFO:tasks.workunit.client.1.smithi133.stdout:1/496: mkdir d0/d1c/d37/da6 0 2023-12-16T07:40:42.359 INFO:tasks.workunit.client.1.smithi133.stdout:2/266: creat da/d1d/d24/d2e/f57 x:0 0 0 2023-12-16T07:40:42.365 INFO:tasks.workunit.client.1.smithi133.stdout:9/419: mkdir d15/d18/d2c/d3a/d8a 0 2023-12-16T07:40:42.367 INFO:tasks.workunit.client.1.smithi133.stdout:2/267: mknod da/c58 0 2023-12-16T07:40:42.367 INFO:tasks.workunit.client.1.smithi133.stdout:2/268: chown da/d1d/d24/d3a 31011 1 2023-12-16T07:40:42.367 INFO:tasks.workunit.client.1.smithi133.stdout:7/664: dread db/d21/d2c/d31/f3f [0,4194304] 0 2023-12-16T07:40:42.367 INFO:tasks.workunit.client.1.smithi133.stdout:7/665: write db/d53/f9c [384510,86282] 0 2023-12-16T07:40:42.367 INFO:tasks.workunit.client.1.smithi133.stdout:7/666: write db/f67 [4879408,16761] 0 2023-12-16T07:40:42.367 INFO:tasks.workunit.client.1.smithi133.stdout:7/667: chown db/d3e/d4a/d58/f8f 10162 1 2023-12-16T07:40:42.369 INFO:tasks.workunit.client.1.smithi133.stdout:9/420: rename d15/l55 to d15/l8b 0 2023-12-16T07:40:42.371 INFO:tasks.workunit.client.1.smithi133.stdout:2/269: dread da/f2c [0,4194304] 0 2023-12-16T07:40:42.372 INFO:tasks.workunit.client.1.smithi133.stdout:7/668: symlink db/d21/d2c/d31/ldb 0 2023-12-16T07:40:42.373 INFO:tasks.workunit.client.1.smithi133.stdout:1/497: dwrite d0/da/f2e [0,4194304] 0 2023-12-16T07:40:42.375 INFO:tasks.workunit.client.1.smithi133.stdout:9/421: write d15/d18/d2c/f33 [1396405,97724] 0 2023-12-16T07:40:42.378 INFO:tasks.workunit.client.1.smithi133.stdout:2/270: unlink da/d1d/d24/d3a/c54 0 2023-12-16T07:40:42.378 INFO:tasks.workunit.client.1.smithi133.stdout:5/289: write d1/de/f32 [322318,22864] 0 2023-12-16T07:40:42.378 INFO:tasks.workunit.client.1.smithi133.stdout:5/290: write d1/d1c/f3b [1848451,41236] 0 2023-12-16T07:40:42.382 INFO:tasks.workunit.client.1.smithi133.stdout:7/669: dread db/f22 [0,4194304] 0 2023-12-16T07:40:42.385 INFO:tasks.workunit.client.1.smithi133.stdout:1/498: symlink d0/da/db/d24/d32/d56/d59/d66/la7 0 2023-12-16T07:40:42.389 INFO:tasks.workunit.client.1.smithi133.stdout:4/563: sync 2023-12-16T07:40:42.389 INFO:tasks.workunit.client.1.smithi133.stdout:4/564: write d3/d7/d1c/f46 [5108885,48417] 0 2023-12-16T07:40:42.389 INFO:tasks.workunit.client.1.smithi133.stdout:9/422: mknod d15/c8c 0 2023-12-16T07:40:42.390 INFO:tasks.workunit.client.1.smithi133.stdout:4/565: write d3/d7/d38/d57/d75/f7e [2595377,65575] 0 2023-12-16T07:40:42.390 INFO:tasks.workunit.client.1.smithi133.stdout:4/566: fsync d3/d7/d38/d45/f65 0 2023-12-16T07:40:42.395 INFO:tasks.workunit.client.1.smithi133.stdout:7/670: dread db/d21/d2c/f56 [0,4194304] 0 2023-12-16T07:40:42.399 INFO:tasks.workunit.client.1.smithi133.stdout:2/271: rmdir da 39 2023-12-16T07:40:42.399 INFO:tasks.workunit.client.1.smithi133.stdout:2/272: dread - da/d1d/d24/d2e/f38 zero size 2023-12-16T07:40:42.399 INFO:tasks.workunit.client.1.smithi133.stdout:9/423: dread d15/d18/f54 [4194304,4194304] 0 2023-12-16T07:40:42.402 INFO:tasks.workunit.client.1.smithi133.stdout:5/291: link d1/c5b d1/d16/c66 0 2023-12-16T07:40:42.411 INFO:tasks.workunit.client.1.smithi133.stdout:4/567: mkdir d3/d7/d6d/d89/dbf 0 2023-12-16T07:40:42.414 INFO:tasks.workunit.client.1.smithi133.stdout:9/424: dwrite d15/d18/f24 [0,4194304] 0 2023-12-16T07:40:42.415 INFO:tasks.workunit.client.1.smithi133.stdout:2/273: mkdir da/d1d/d24/d2e/d59 0 2023-12-16T07:40:42.417 INFO:tasks.workunit.client.1.smithi133.stdout:4/568: truncate d3/d7/d38/d45/f65 2020315 0 2023-12-16T07:40:42.417 INFO:tasks.workunit.client.1.smithi133.stdout:4/569: chown d3/d7/d44/f77 1 1 2023-12-16T07:40:42.419 INFO:tasks.workunit.client.1.smithi133.stdout:9/425: mkdir d15/d42/d8d 0 2023-12-16T07:40:42.420 INFO:tasks.workunit.client.1.smithi133.stdout:2/274: mkdir da/d1d/d24/d3a/d5a 0 2023-12-16T07:40:42.422 INFO:tasks.workunit.client.1.smithi133.stdout:4/570: creat d3/d7/d38/d57/fc0 x:0 0 0 2023-12-16T07:40:42.422 INFO:tasks.workunit.client.1.smithi133.stdout:4/571: getdents d3/d7/d1c/db0 0 2023-12-16T07:40:42.423 INFO:tasks.workunit.client.1.smithi133.stdout:4/572: dread d3/d7/d44/f78 [0,4194304] 0 2023-12-16T07:40:42.426 INFO:tasks.workunit.client.1.smithi133.stdout:4/573: creat d3/d7/d38/d57/d67/fc1 x:0 0 0 2023-12-16T07:40:42.426 INFO:tasks.workunit.client.1.smithi133.stdout:4/574: chown d3/d7/d38/d57/d75/l84 91388 1 2023-12-16T07:40:42.428 INFO:tasks.workunit.client.1.smithi133.stdout:9/426: creat d15/d18/d2c/d68/f8e x:0 0 0 2023-12-16T07:40:42.428 INFO:tasks.workunit.client.1.smithi133.stdout:9/427: chown d15/f29 532217 1 2023-12-16T07:40:42.430 INFO:tasks.workunit.client.1.smithi133.stdout:4/575: mknod d3/d7/d6d/d89/cc2 0 2023-12-16T07:40:42.440 INFO:tasks.workunit.client.1.smithi133.stdout:5/292: rename d1/d16 to d1/de/d67 0 2023-12-16T07:40:42.442 INFO:tasks.workunit.client.1.smithi133.stdout:5/293: symlink d1/de/d35/l68 0 2023-12-16T07:40:42.442 INFO:tasks.workunit.client.1.smithi133.stdout:5/294: write d1/de/f3c [953000,58870] 0 2023-12-16T07:40:42.442 INFO:tasks.workunit.client.1.smithi133.stdout:5/295: fsync d1/de/d67/d60/d64/f65 0 2023-12-16T07:40:42.443 INFO:tasks.workunit.client.1.smithi133.stdout:5/296: write d1/de/f50 [155700,98055] 0 2023-12-16T07:40:42.445 INFO:tasks.workunit.client.1.smithi133.stdout:5/297: symlink d1/d18/l69 0 2023-12-16T07:40:42.445 INFO:tasks.workunit.client.1.smithi133.stdout:9/428: dwrite d15/d18/d5b/d71/f89 [0,4194304] 0 2023-12-16T07:40:42.448 INFO:tasks.workunit.client.1.smithi133.stdout:9/429: mknod d15/d18/d5b/d71/c8f 0 2023-12-16T07:40:42.449 INFO:tasks.workunit.client.1.smithi133.stdout:9/430: creat d15/d42/d8d/f90 x:0 0 0 2023-12-16T07:40:42.451 INFO:tasks.workunit.client.1.smithi133.stdout:9/431: mknod d15/d18/d4d/d7e/c91 0 2023-12-16T07:40:42.465 INFO:tasks.workunit.client.1.smithi133.stdout:9/432: dwrite f9 [0,4194304] 0 2023-12-16T07:40:42.468 INFO:tasks.workunit.client.1.smithi133.stdout:9/433: symlink d15/d18/d2c/d3a/l92 0 2023-12-16T07:40:42.468 INFO:tasks.workunit.client.1.smithi133.stdout:9/434: fsync fd 0 2023-12-16T07:40:42.469 INFO:tasks.workunit.client.1.smithi133.stdout:9/435: creat d15/d18/d2c/f93 x:0 0 0 2023-12-16T07:40:42.470 INFO:tasks.workunit.client.1.smithi133.stdout:9/436: mkdir d15/d18/d4d/d94 0 2023-12-16T07:40:42.470 INFO:tasks.workunit.client.1.smithi133.stdout:9/437: write d15/d18/f2f [1661716,77412] 0 2023-12-16T07:40:42.472 INFO:tasks.workunit.client.1.smithi133.stdout:9/438: creat d15/d18/d4d/d7e/f95 x:0 0 0 2023-12-16T07:40:42.473 INFO:tasks.workunit.client.1.smithi133.stdout:9/439: stat d15/d18/d2c/l67 0 2023-12-16T07:40:42.475 INFO:tasks.workunit.client.1.smithi133.stdout:9/440: truncate d15/d18/d80/d73/f7b 424037 0 2023-12-16T07:40:42.488 INFO:tasks.workunit.client.1.smithi133.stdout:8/355: sync 2023-12-16T07:40:42.490 INFO:tasks.workunit.client.1.smithi133.stdout:8/356: unlink d9/dc/de/c59 0 2023-12-16T07:40:42.490 INFO:tasks.workunit.client.1.smithi133.stdout:8/357: truncate d9/f6c 770165 0 2023-12-16T07:40:42.492 INFO:tasks.workunit.client.1.smithi133.stdout:8/358: symlink d9/d10/d39/d48/l75 0 2023-12-16T07:40:42.497 INFO:tasks.workunit.client.1.smithi133.stdout:7/671: dread db/d21/d2c/d31/d6e/f97 [0,4194304] 0 2023-12-16T07:40:42.498 INFO:tasks.workunit.client.1.smithi133.stdout:1/499: dwrite d0/da/d3d/d41/f82 [0,4194304] 0 2023-12-16T07:40:42.501 INFO:tasks.workunit.client.1.smithi133.stdout:5/298: dwrite d1/f34 [0,4194304] 0 2023-12-16T07:40:42.503 INFO:tasks.workunit.client.1.smithi133.stdout:4/576: fsync d3/d7/d1c/f46 0 2023-12-16T07:40:42.506 INFO:tasks.workunit.client.1.smithi133.stdout:4/577: link d3/d7/d1c/d2a/c72 d3/d7/d38/d45/cc3 0 2023-12-16T07:40:42.512 INFO:tasks.workunit.client.1.smithi133.stdout:1/500: dread d0/d12/d51/f64 [0,4194304] 0 2023-12-16T07:40:42.512 INFO:tasks.workunit.client.1.smithi133.stdout:1/501: fdatasync d0/d12/d51/f97 0 2023-12-16T07:40:42.514 INFO:tasks.workunit.client.1.smithi133.stdout:1/502: symlink d0/da/db/d24/d32/d56/d59/d5f/la8 0 2023-12-16T07:40:42.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/578: write d3/d7/d38/d57/d75/f7e [4355489,60664] 0 2023-12-16T07:40:42.521 INFO:tasks.workunit.client.1.smithi133.stdout:9/441: dwrite f14 [0,4194304] 0 2023-12-16T07:40:42.522 INFO:tasks.workunit.client.1.smithi133.stdout:2/275: dwrite da/d15/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:42.522 INFO:tasks.workunit.client.1.smithi133.stdout:2/276: chown da/d1d/d24/d2e 130050457 1 2023-12-16T07:40:42.522 INFO:tasks.workunit.client.1.smithi133.stdout:8/359: dwrite d9/f6c [0,4194304] 0 2023-12-16T07:40:42.522 INFO:tasks.workunit.client.1.smithi133.stdout:8/360: chown d9/f3e 51535 1 2023-12-16T07:40:42.522 INFO:tasks.workunit.client.1.smithi133.stdout:8/361: truncate d9/f5e 4232565 0 2023-12-16T07:40:42.524 INFO:tasks.workunit.client.1.smithi133.stdout:4/579: dread d3/d7/d38/d45/f68 [0,4194304] 0 2023-12-16T07:40:42.525 INFO:tasks.workunit.client.1.smithi133.stdout:4/580: read d3/d7/d1c/d2a/fb3 [297308,11626] 0 2023-12-16T07:40:42.525 INFO:tasks.workunit.client.1.smithi133.stdout:7/672: dwrite db/ff [0,4194304] 0 2023-12-16T07:40:42.525 INFO:tasks.workunit.client.1.smithi133.stdout:7/673: readlink db/d21/d2c/l87 0 2023-12-16T07:40:42.526 INFO:tasks.workunit.client.1.smithi133.stdout:9/442: write d15/d18/d2c/f46 [3255750,80999] 0 2023-12-16T07:40:42.526 INFO:tasks.workunit.client.1.smithi133.stdout:9/443: readlink l5 0 2023-12-16T07:40:42.526 INFO:tasks.workunit.client.1.smithi133.stdout:9/444: write d15/d18/d5b/d71/d78/d6e/f75 [903204,126553] 0 2023-12-16T07:40:42.526 INFO:tasks.workunit.client.1.smithi133.stdout:9/445: chown f0 15269315 1 2023-12-16T07:40:42.526 INFO:tasks.workunit.client.1.smithi133.stdout:2/277: mknod da/d1d/d24/d2e/c5b 0 2023-12-16T07:40:42.528 INFO:tasks.workunit.client.1.smithi133.stdout:2/278: dread da/d15/d17/f33 [0,4194304] 0 2023-12-16T07:40:42.528 INFO:tasks.workunit.client.1.smithi133.stdout:2/279: fdatasync da/d1d/d24/f37 0 2023-12-16T07:40:42.531 INFO:tasks.workunit.client.1.smithi133.stdout:8/362: creat d9/dc/d27/f76 x:0 0 0 2023-12-16T07:40:42.533 INFO:tasks.workunit.client.1.smithi133.stdout:7/674: mknod db/cdc 0 2023-12-16T07:40:42.533 INFO:tasks.workunit.client.1.smithi133.stdout:7/675: fdatasync db/d3e/faa 0 2023-12-16T07:40:42.533 INFO:tasks.workunit.client.1.smithi133.stdout:7/676: fdatasync db/d21/d2c/d31/f35 0 2023-12-16T07:40:42.533 INFO:tasks.workunit.client.1.smithi133.stdout:7/677: readlink db/d3e/d4a/ld7 0 2023-12-16T07:40:42.534 INFO:tasks.workunit.client.1.smithi133.stdout:5/299: dwrite d1/f34 [0,4194304] 0 2023-12-16T07:40:42.534 INFO:tasks.workunit.client.1.smithi133.stdout:5/300: write d1/d4b/f5f [660600,124226] 0 2023-12-16T07:40:42.534 INFO:tasks.workunit.client.1.smithi133.stdout:5/301: dread - d1/de/d67/d60/d64/f65 zero size 2023-12-16T07:40:42.536 INFO:tasks.workunit.client.1.smithi133.stdout:1/503: dwrite d0/d1c/d37/f9e [0,4194304] 0 2023-12-16T07:40:42.536 INFO:tasks.workunit.client.1.smithi133.stdout:4/581: dread d3/d7/d38/d57/d67/f87 [0,4194304] 0 2023-12-16T07:40:42.536 INFO:tasks.workunit.client.1.smithi133.stdout:4/582: chown d3/d7/d38/l71 64786 1 2023-12-16T07:40:42.536 INFO:tasks.workunit.client.1.smithi133.stdout:4/583: stat d3/d7/d38/d57/d67/f87 0 2023-12-16T07:40:42.536 INFO:tasks.workunit.client.1.smithi133.stdout:4/584: chown d3/c6 500358 1 2023-12-16T07:40:42.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/585: readlink d3/d7/d38/d45/lb8 0 2023-12-16T07:40:42.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/586: write d3/d7/d38/d57/d67/f87 [4437383,52547] 0 2023-12-16T07:40:42.539 INFO:tasks.workunit.client.1.smithi133.stdout:9/446: dread d15/d18/d2c/f4c [0,4194304] 0 2023-12-16T07:40:42.539 INFO:tasks.workunit.client.1.smithi133.stdout:9/447: chown d15/d18/d2c/d3a/l6c 6 1 2023-12-16T07:40:42.539 INFO:tasks.workunit.client.1.smithi133.stdout:9/448: write d15/d18/d2c/d68/f8e [897450,122874] 0 2023-12-16T07:40:42.542 INFO:tasks.workunit.client.1.smithi133.stdout:5/302: symlink d1/d1c/l6a 0 2023-12-16T07:40:42.542 INFO:tasks.workunit.client.1.smithi133.stdout:5/303: chown d1/d18/f4e 30 1 2023-12-16T07:40:42.546 INFO:tasks.workunit.client.1.smithi133.stdout:1/504: rmdir d0/da/db/d24/d32/d56 39 2023-12-16T07:40:42.550 INFO:tasks.workunit.client.1.smithi133.stdout:2/280: rename da/d1d/f20 to da/f5c 0 2023-12-16T07:40:42.550 INFO:tasks.workunit.client.1.smithi133.stdout:8/363: rename d9 to d9/d77 22 2023-12-16T07:40:42.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/364: fsync d9/dc/d27/f4f 0 2023-12-16T07:40:42.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/365: stat d9/d2d/c49 0 2023-12-16T07:40:42.554 INFO:tasks.workunit.client.1.smithi133.stdout:9/449: unlink c10 0 2023-12-16T07:40:42.556 INFO:tasks.workunit.client.1.smithi133.stdout:5/304: creat d1/f6b x:0 0 0 2023-12-16T07:40:42.556 INFO:tasks.workunit.client.1.smithi133.stdout:5/305: readlink d1/d18/l59 0 2023-12-16T07:40:42.556 INFO:tasks.workunit.client.1.smithi133.stdout:5/306: write d1/de/d67/f2b [866708,67012] 0 2023-12-16T07:40:42.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/678: dwrite db/d3e/d4a/d58/d86/fb3 [0,4194304] 0 2023-12-16T07:40:42.558 INFO:tasks.workunit.client.1.smithi133.stdout:4/587: dwrite d3/d7/d38/d57/d75/f8a [0,4194304] 0 2023-12-16T07:40:42.559 INFO:tasks.workunit.client.1.smithi133.stdout:1/505: creat d0/da/db/d24/d32/d56/d59/d66/fa9 x:0 0 0 2023-12-16T07:40:42.560 INFO:tasks.workunit.client.1.smithi133.stdout:2/281: mknod da/d50/c5d 0 2023-12-16T07:40:42.563 INFO:tasks.workunit.client.1.smithi133.stdout:8/366: mkdir d9/d10/d39/d48/d44/d6e/d78 0 2023-12-16T07:40:42.564 INFO:tasks.workunit.client.1.smithi133.stdout:9/450: creat d15/d18/d80/f96 x:0 0 0 2023-12-16T07:40:42.569 INFO:tasks.workunit.client.1.smithi133.stdout:7/679: symlink db/d53/ldd 0 2023-12-16T07:40:42.572 INFO:tasks.workunit.client.1.smithi133.stdout:4/588: getdents d3/d7/d38/d57/d67 0 2023-12-16T07:40:42.576 INFO:tasks.workunit.client.1.smithi133.stdout:2/282: creat da/d1d/d24/d2e/d47/f5e x:0 0 0 2023-12-16T07:40:42.580 INFO:tasks.workunit.client.1.smithi133.stdout:5/307: dwrite d1/de/f32 [0,4194304] 0 2023-12-16T07:40:42.580 INFO:tasks.workunit.client.1.smithi133.stdout:5/308: fdatasync d1/de/d67/f2a 0 2023-12-16T07:40:42.580 INFO:tasks.workunit.client.1.smithi133.stdout:7/680: dread db/f7b [0,4194304] 0 2023-12-16T07:40:42.582 INFO:tasks.workunit.client.1.smithi133.stdout:8/367: symlink d9/d10/d39/d48/d44/l79 0 2023-12-16T07:40:42.583 INFO:tasks.workunit.client.1.smithi133.stdout:4/589: getdents d3/d7/d1c 0 2023-12-16T07:40:42.583 INFO:tasks.workunit.client.1.smithi133.stdout:4/590: truncate d3/d7/d38/d57/d67/f6a 1015929 0 2023-12-16T07:40:42.586 INFO:tasks.workunit.client.1.smithi133.stdout:2/283: unlink da/d1d/d24/d2e/d47/d52/c55 0 2023-12-16T07:40:42.587 INFO:tasks.workunit.client.1.smithi133.stdout:9/451: dwrite d15/d18/d2c/d68/f7f [0,4194304] 0 2023-12-16T07:40:42.587 INFO:tasks.workunit.client.1.smithi133.stdout:9/452: write d15/d18/f24 [4799523,32279] 0 2023-12-16T07:40:42.587 INFO:tasks.workunit.client.1.smithi133.stdout:9/453: write d15/d18/f41 [1023949,26125] 0 2023-12-16T07:40:42.591 INFO:tasks.workunit.client.1.smithi133.stdout:5/309: link d1/d18/f41 d1/d18/d2c/f6c 0 2023-12-16T07:40:42.592 INFO:tasks.workunit.client.1.smithi133.stdout:1/506: dwrite d0/da/db/d24/d32/d56/d59/d66/f85 [0,4194304] 0 2023-12-16T07:40:42.594 INFO:tasks.workunit.client.1.smithi133.stdout:8/368: link d9/d10/d39/d48/d44/f6b d9/d11/d42/f7a 0 2023-12-16T07:40:42.594 INFO:tasks.workunit.client.1.smithi133.stdout:8/369: chown d9/d10/d39/d48/d44/d6e 5892060 1 2023-12-16T07:40:42.594 INFO:tasks.workunit.client.1.smithi133.stdout:8/370: write d9/d3f/f66 [1037276,41665] 0 2023-12-16T07:40:42.595 INFO:tasks.workunit.client.1.smithi133.stdout:4/591: mknod d3/d7/d38/cc4 0 2023-12-16T07:40:42.597 INFO:tasks.workunit.client.1.smithi133.stdout:2/284: link f4 da/d1d/d24/d3a/d5a/f5f 0 2023-12-16T07:40:42.601 INFO:tasks.workunit.client.1.smithi133.stdout:7/681: dwrite db/d3e/d4a/d58/d86/fb3 [4194304,4194304] 0 2023-12-16T07:40:42.602 INFO:tasks.workunit.client.1.smithi133.stdout:7/682: write db/d3e/d4a/d58/d86/fa1 [801993,43249] 0 2023-12-16T07:40:42.609 INFO:tasks.workunit.client.1.smithi133.stdout:5/310: symlink d1/d18/l6d 0 2023-12-16T07:40:42.617 INFO:tasks.workunit.client.1.smithi133.stdout:9/454: dread d15/d18/d2c/d3a/f6f [0,4194304] 0 2023-12-16T07:40:42.619 INFO:tasks.workunit.client.1.smithi133.stdout:2/285: dwrite da/d1d/d24/d3a/d5a/f5f [0,4194304] 0 2023-12-16T07:40:42.619 INFO:tasks.workunit.client.1.smithi133.stdout:2/286: write da/d1d/d24/d2e/f57 [490761,63759] 0 2023-12-16T07:40:42.619 INFO:tasks.workunit.client.1.smithi133.stdout:2/287: fsync da/d1d/f25 0 2023-12-16T07:40:42.630 INFO:tasks.workunit.client.1.smithi133.stdout:2/288: dread da/d1d/d24/f37 [0,4194304] 0 2023-12-16T07:40:42.631 INFO:tasks.workunit.client.1.smithi133.stdout:1/507: rmdir d0/d1c 39 2023-12-16T07:40:42.631 INFO:tasks.workunit.client.1.smithi133.stdout:1/508: read - d0/d60/f8e zero size 2023-12-16T07:40:42.631 INFO:tasks.workunit.client.1.smithi133.stdout:1/509: readlink d0/d12/l67 0 2023-12-16T07:40:42.631 INFO:tasks.workunit.client.1.smithi133.stdout:1/510: fsync d0/d12/f1b 0 2023-12-16T07:40:42.632 INFO:tasks.workunit.client.1.smithi133.stdout:8/371: creat d9/dc/de/f7b x:0 0 0 2023-12-16T07:40:42.637 INFO:tasks.workunit.client.1.smithi133.stdout:4/592: creat d3/d7/d6d/d89/fc5 x:0 0 0 2023-12-16T07:40:42.642 INFO:tasks.workunit.client.1.smithi133.stdout:7/683: rename db/d21/d2c/d31/d59/l7d to db/d3e/lde 0 2023-12-16T07:40:42.643 INFO:tasks.workunit.client.1.smithi133.stdout:5/311: symlink d1/d54/l6e 0 2023-12-16T07:40:42.649 INFO:tasks.workunit.client.1.smithi133.stdout:2/289: dwrite da/d1d/f2f [0,4194304] 0 2023-12-16T07:40:42.655 INFO:tasks.workunit.client.1.smithi133.stdout:4/593: mkdir d3/d7/d44/da7/daa/dc6 0 2023-12-16T07:40:42.657 INFO:tasks.workunit.client.1.smithi133.stdout:7/684: mknod db/d3e/d4a/d58/db9/cdf 0 2023-12-16T07:40:42.657 INFO:tasks.workunit.client.1.smithi133.stdout:7/685: readlink db/d12/d3a/l3d 0 2023-12-16T07:40:42.657 INFO:tasks.workunit.client.1.smithi133.stdout:0/394: sync 2023-12-16T07:40:42.658 INFO:tasks.workunit.client.1.smithi133.stdout:0/395: truncate d2/d17/d2b/d67/f73 87614 0 2023-12-16T07:40:42.660 INFO:tasks.workunit.client.1.smithi133.stdout:7/686: write db/d21/f2f [355052,2414] 0 2023-12-16T07:40:42.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/312: mkdir d1/d18/d6f 0 2023-12-16T07:40:42.663 INFO:tasks.workunit.client.1.smithi133.stdout:8/372: dwrite d9/f2e [0,4194304] 0 2023-12-16T07:40:42.663 INFO:tasks.workunit.client.1.smithi133.stdout:8/373: write d9/d2d/f34 [876561,110025] 0 2023-12-16T07:40:42.663 INFO:tasks.workunit.client.1.smithi133.stdout:1/511: dwrite d0/da/db/fd [0,4194304] 0 2023-12-16T07:40:42.669 INFO:tasks.workunit.client.1.smithi133.stdout:4/594: truncate d3/d7/d1a/f26 1335663 0 2023-12-16T07:40:42.669 INFO:tasks.workunit.client.1.smithi133.stdout:4/595: stat d3/d7/d38/d57/d75/f8a 0 2023-12-16T07:40:42.669 INFO:tasks.workunit.client.1.smithi133.stdout:4/596: getdents d3/d7/d44/dac/dbc 0 2023-12-16T07:40:42.670 INFO:tasks.workunit.client.1.smithi133.stdout:0/396: dread d2/d9/d20/f44 [0,4194304] 0 2023-12-16T07:40:42.670 INFO:tasks.workunit.client.1.smithi133.stdout:8/374: write d9/d10/f1b [4003807,68901] 0 2023-12-16T07:40:42.670 INFO:tasks.workunit.client.1.smithi133.stdout:2/290: dwrite da/d1d/f2f [0,4194304] 0 2023-12-16T07:40:42.671 INFO:tasks.workunit.client.1.smithi133.stdout:7/687: symlink db/d21/d2c/d31/le0 0 2023-12-16T07:40:42.675 INFO:tasks.workunit.client.1.smithi133.stdout:5/313: rename d1/d18/d2c/f6c to d1/d18/d26/f70 0 2023-12-16T07:40:42.683 INFO:tasks.workunit.client.1.smithi133.stdout:1/512: mknod d0/d12/caa 0 2023-12-16T07:40:42.687 INFO:tasks.workunit.client.1.smithi133.stdout:4/597: creat d3/db6/fc7 x:0 0 0 2023-12-16T07:40:42.689 INFO:tasks.workunit.client.1.smithi133.stdout:5/314: dwrite d1/f24 [0,4194304] 0 2023-12-16T07:40:42.692 INFO:tasks.workunit.client.1.smithi133.stdout:0/397: mknod d2/d9/d12/d35/d48/d60/c7e 0 2023-12-16T07:40:42.692 INFO:tasks.workunit.client.1.smithi133.stdout:0/398: chown d2/d17/c4a 10 1 2023-12-16T07:40:42.699 INFO:tasks.workunit.client.1.smithi133.stdout:7/688: creat db/d3e/d4a/d58/d86/db8/fe1 x:0 0 0 2023-12-16T07:40:42.715 INFO:tasks.workunit.client.1.smithi133.stdout:8/375: rename d9/dc/f67 to d9/d10/d39/d48/d44/d6e/f7c 0 2023-12-16T07:40:42.715 INFO:tasks.workunit.client.1.smithi133.stdout:8/376: chown d9/dc/d27/c55 109 1 2023-12-16T07:40:42.715 INFO:tasks.workunit.client.1.smithi133.stdout:1/513: truncate d0/f17 3285072 0 2023-12-16T07:40:42.722 INFO:tasks.workunit.client.1.smithi133.stdout:2/291: mkdir da/d1d/d60 0 2023-12-16T07:40:42.722 INFO:tasks.workunit.client.1.smithi133.stdout:2/292: chown da/f5c 119228 1 2023-12-16T07:40:42.727 INFO:tasks.workunit.client.1.smithi133.stdout:4/598: dwrite d3/d7/d44/f5e [8388608,4194304] 0 2023-12-16T07:40:42.727 INFO:tasks.workunit.client.1.smithi133.stdout:7/689: dwrite db/d3e/d4a/f60 [0,4194304] 0 2023-12-16T07:40:42.728 INFO:tasks.workunit.client.1.smithi133.stdout:0/399: dwrite d2/d9/f7c [0,4194304] 0 2023-12-16T07:40:42.729 INFO:tasks.workunit.client.1.smithi133.stdout:5/315: dwrite d1/d1c/f51 [0,4194304] 0 2023-12-16T07:40:42.729 INFO:tasks.workunit.client.1.smithi133.stdout:5/316: truncate d1/f34 4423514 0 2023-12-16T07:40:42.741 INFO:tasks.workunit.client.1.smithi133.stdout:1/514: creat d0/da/db/d24/d32/d3e/d70/d8f/fab x:0 0 0 2023-12-16T07:40:42.743 INFO:tasks.workunit.client.1.smithi133.stdout:2/293: write da/d1d/f32 [547607,77723] 0 2023-12-16T07:40:42.743 INFO:tasks.workunit.client.1.smithi133.stdout:2/294: fsync da/d1d/f46 0 2023-12-16T07:40:42.743 INFO:tasks.workunit.client.1.smithi133.stdout:2/295: write da/d1d/d24/f37 [779985,10241] 0 2023-12-16T07:40:42.745 INFO:tasks.workunit.client.1.smithi133.stdout:4/599: rename d3/d7/d38/d45 to d3/d7/d1c/db0/dc8 0 2023-12-16T07:40:42.749 INFO:tasks.workunit.client.1.smithi133.stdout:7/690: dwrite db/d3e/d4a/d58/db9/fc2 [0,4194304] 0 2023-12-16T07:40:42.751 INFO:tasks.workunit.client.1.smithi133.stdout:0/400: dwrite d2/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:42.751 INFO:tasks.workunit.client.1.smithi133.stdout:7/691: write db/d12/d3a/f7e [3676738,15747] 0 2023-12-16T07:40:42.755 INFO:tasks.workunit.client.1.smithi133.stdout:7/692: read db/f67 [1876825,19470] 0 2023-12-16T07:40:42.755 INFO:tasks.workunit.client.1.smithi133.stdout:7/693: truncate db/d12/f71 4554885 0 2023-12-16T07:40:42.763 INFO:tasks.workunit.client.1.smithi133.stdout:5/317: unlink d1/d1c/f3e 0 2023-12-16T07:40:42.766 INFO:tasks.workunit.client.1.smithi133.stdout:8/377: truncate d9/d10/f1b 8239799 0 2023-12-16T07:40:42.767 INFO:tasks.workunit.client.1.smithi133.stdout:2/296: mkdir da/d1d/d24/d3a/d61 0 2023-12-16T07:40:42.774 INFO:tasks.workunit.client.1.smithi133.stdout:7/694: dwrite db/d3e/d4a/d58/d86/d8b/d8d/f95 [0,4194304] 0 2023-12-16T07:40:42.774 INFO:tasks.workunit.client.1.smithi133.stdout:7/695: write db/d53/f6b [372838,65436] 0 2023-12-16T07:40:42.774 INFO:tasks.workunit.client.1.smithi133.stdout:1/515: rename d0/da/db to d0/d12/d51/dac 0 2023-12-16T07:40:42.778 INFO:tasks.workunit.client.1.smithi133.stdout:4/600: mknod d3/d7/d38/d57/d75/cc9 0 2023-12-16T07:40:42.779 INFO:tasks.workunit.client.1.smithi133.stdout:8/378: dread d9/dc/d27/f2b [0,4194304] 0 2023-12-16T07:40:42.785 INFO:tasks.workunit.client.1.smithi133.stdout:2/297: dwrite da/f11 [0,4194304] 0 2023-12-16T07:40:42.786 INFO:tasks.workunit.client.1.smithi133.stdout:2/298: write da/d15/d17/f33 [715058,86687] 0 2023-12-16T07:40:42.786 INFO:tasks.workunit.client.1.smithi133.stdout:2/299: chown da/d15/d1b/f44 19548 1 2023-12-16T07:40:42.786 INFO:tasks.workunit.client.1.smithi133.stdout:2/300: chown da/d1d/d24/l56 191209665 1 2023-12-16T07:40:42.786 INFO:tasks.workunit.client.1.smithi133.stdout:7/696: dread db/d3e/d4a/d58/f62 [0,4194304] 0 2023-12-16T07:40:42.786 INFO:tasks.workunit.client.1.smithi133.stdout:0/401: rmdir d2/d9/d12/d7d 0 2023-12-16T07:40:42.795 INFO:tasks.workunit.client.1.smithi133.stdout:5/318: mkdir d1/d18/d6f/d71 0 2023-12-16T07:40:42.798 INFO:tasks.workunit.client.1.smithi133.stdout:4/601: link d3/d7/d38/d57/d75/f9d d3/d7/d44/da7/daa/fca 0 2023-12-16T07:40:42.800 INFO:tasks.workunit.client.1.smithi133.stdout:8/379: creat d9/d11/f7d x:0 0 0 2023-12-16T07:40:42.806 INFO:tasks.workunit.client.1.smithi133.stdout:2/301: truncate da/d15/d1b/d43/f45 244858 0 2023-12-16T07:40:42.806 INFO:tasks.workunit.client.1.smithi133.stdout:7/697: rmdir db/d3e/d4a/d58/d86/d8b/d8d 39 2023-12-16T07:40:42.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/402: mkdir d2/d17/d2b/d31/d7f 0 2023-12-16T07:40:42.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/403: readlink d2/l51 0 2023-12-16T07:40:42.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/404: write d2/d17/d40/f70 [467231,100572] 0 2023-12-16T07:40:42.818 INFO:tasks.workunit.client.1.smithi133.stdout:5/319: rmdir d1/d18/d6f 39 2023-12-16T07:40:42.821 INFO:tasks.workunit.client.1.smithi133.stdout:4/602: mknod d3/d7/d1c/d2a/ccb 0 2023-12-16T07:40:42.823 INFO:tasks.workunit.client.1.smithi133.stdout:0/405: dread d2/d9/d12/d35/d48/f3d [8388608,4194304] 0 2023-12-16T07:40:42.823 INFO:tasks.workunit.client.1.smithi133.stdout:8/380: link d9/dc/d27/f2b d9/d11/d33/f7e 0 2023-12-16T07:40:42.825 INFO:tasks.workunit.client.1.smithi133.stdout:2/302: rename c5 to da/d1d/d24/d2e/d47/c62 0 2023-12-16T07:40:42.825 INFO:tasks.workunit.client.1.smithi133.stdout:3/297: sync 2023-12-16T07:40:42.825 INFO:tasks.workunit.client.1.smithi133.stdout:9/455: sync 2023-12-16T07:40:42.826 INFO:tasks.workunit.client.1.smithi133.stdout:9/456: write d15/d42/f57 [183086,10093] 0 2023-12-16T07:40:42.826 INFO:tasks.workunit.client.1.smithi133.stdout:2/303: dread da/fd [0,4194304] 0 2023-12-16T07:40:42.827 INFO:tasks.workunit.client.1.smithi133.stdout:7/698: creat db/d12/d98/fe2 x:0 0 0 2023-12-16T07:40:42.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/616: sync 2023-12-16T07:40:42.827 INFO:tasks.workunit.client.1.smithi133.stdout:2/304: read da/d15/d17/d40/f49 [1286353,21988] 0 2023-12-16T07:40:42.828 INFO:tasks.workunit.client.1.smithi133.stdout:5/320: mknod d1/d18/d26/c72 0 2023-12-16T07:40:42.828 INFO:tasks.workunit.client.1.smithi133.stdout:5/321: write d1/d18/f4e [2853447,14785] 0 2023-12-16T07:40:42.836 INFO:tasks.workunit.client.1.smithi133.stdout:0/406: rmdir d2/d9/d12/d35/d5c 0 2023-12-16T07:40:42.836 INFO:tasks.workunit.client.1.smithi133.stdout:7/699: dread db/d12/f34 [4194304,4194304] 0 2023-12-16T07:40:42.836 INFO:tasks.workunit.client.1.smithi133.stdout:7/700: write db/d3e/d4a/d58/d86/da9/fca [1695010,85352] 0 2023-12-16T07:40:42.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/381: creat d9/d10/d39/d48/f7f x:0 0 0 2023-12-16T07:40:42.839 INFO:tasks.workunit.client.1.smithi133.stdout:3/298: read d7/d8/d1d/d2a/f3c [154826,92862] 0 2023-12-16T07:40:42.840 INFO:tasks.workunit.client.1.smithi133.stdout:7/701: write db/d21/d2c/d31/f35 [1649914,60161] 0 2023-12-16T07:40:42.846 INFO:tasks.workunit.client.1.smithi133.stdout:6/617: unlink d0/d4/d21/c51 0 2023-12-16T07:40:42.848 INFO:tasks.workunit.client.1.smithi133.stdout:2/305: dwrite da/d1d/d24/d2e/f57 [0,4194304] 0 2023-12-16T07:40:42.848 INFO:tasks.workunit.client.1.smithi133.stdout:4/603: dwrite d3/d7/d38/f3d [0,4194304] 0 2023-12-16T07:40:42.848 INFO:tasks.workunit.client.1.smithi133.stdout:4/604: readlink d3/d7/d38/lb4 0 2023-12-16T07:40:42.848 INFO:tasks.workunit.client.1.smithi133.stdout:4/605: write d3/d7/d1a/faf [620338,90594] 0 2023-12-16T07:40:42.848 INFO:tasks.workunit.client.1.smithi133.stdout:4/606: truncate d3/d7/d38/d57/d75/f9d 146723 0 2023-12-16T07:40:42.849 INFO:tasks.workunit.client.1.smithi133.stdout:5/322: symlink d1/de/l73 0 2023-12-16T07:40:42.850 INFO:tasks.workunit.client.1.smithi133.stdout:0/407: getdents d2/d17/d2b/d31/d36 0 2023-12-16T07:40:42.852 INFO:tasks.workunit.client.1.smithi133.stdout:5/323: dread d1/d4b/f5f [0,4194304] 0 2023-12-16T07:40:42.852 INFO:tasks.workunit.client.1.smithi133.stdout:8/382: link d9/d10/f1b d9/d11/d42/f80 0 2023-12-16T07:40:42.858 INFO:tasks.workunit.client.1.smithi133.stdout:9/457: rename d15/d18/d2c/d3a/d5a to d15/d18/d80/d97 0 2023-12-16T07:40:42.861 INFO:tasks.workunit.client.1.smithi133.stdout:0/408: truncate d2/d9/f7c 1885003 0 2023-12-16T07:40:42.862 INFO:tasks.workunit.client.1.smithi133.stdout:5/324: mkdir d1/de/d57/d74 0 2023-12-16T07:40:42.863 INFO:tasks.workunit.client.1.smithi133.stdout:0/409: read d2/f8 [1418196,43470] 0 2023-12-16T07:40:42.864 INFO:tasks.workunit.client.1.smithi133.stdout:8/383: creat d9/d10/f81 x:0 0 0 2023-12-16T07:40:42.867 INFO:tasks.workunit.client.1.smithi133.stdout:0/410: creat d2/d17/d2b/d31/d4d/d54/f80 x:0 0 0 2023-12-16T07:40:42.868 INFO:tasks.workunit.client.1.smithi133.stdout:5/325: dread d1/d1c/f40 [0,4194304] 0 2023-12-16T07:40:42.868 INFO:tasks.workunit.client.1.smithi133.stdout:5/326: chown d1/ca 226 1 2023-12-16T07:40:42.868 INFO:tasks.workunit.client.1.smithi133.stdout:5/327: chown d1/f34 0 1 2023-12-16T07:40:42.868 INFO:tasks.workunit.client.1.smithi133.stdout:5/328: fdatasync d1/de/f13 0 2023-12-16T07:40:42.870 INFO:tasks.workunit.client.1.smithi133.stdout:3/299: dwrite d7/d8/d78/f6d [0,4194304] 0 2023-12-16T07:40:42.872 INFO:tasks.workunit.client.1.smithi133.stdout:8/384: rmdir d9/d11/d33 39 2023-12-16T07:40:42.878 INFO:tasks.workunit.client.1.smithi133.stdout:5/329: rename d1/f7 to d1/f75 0 2023-12-16T07:40:42.880 INFO:tasks.workunit.client.1.smithi133.stdout:3/300: mkdir d7/d8/d1c/d7e 0 2023-12-16T07:40:42.883 INFO:tasks.workunit.client.1.smithi133.stdout:5/330: write d1/d18/d26/f70 [2880174,117834] 0 2023-12-16T07:40:42.884 INFO:tasks.workunit.client.1.smithi133.stdout:8/385: dread d9/d11/d42/f62 [0,4194304] 0 2023-12-16T07:40:42.885 INFO:tasks.workunit.client.1.smithi133.stdout:8/386: truncate d9/d10/d39/d48/f68 1582157 0 2023-12-16T07:40:42.885 INFO:tasks.workunit.client.1.smithi133.stdout:8/387: truncate d9/dc/d27/f29 564955 0 2023-12-16T07:40:42.885 INFO:tasks.workunit.client.1.smithi133.stdout:8/388: stat d9/dc/f65 0 2023-12-16T07:40:42.887 INFO:tasks.workunit.client.1.smithi133.stdout:5/331: creat d1/de/f76 x:0 0 0 2023-12-16T07:40:42.888 INFO:tasks.workunit.client.1.smithi133.stdout:4/607: dwrite d3/db6/fc7 [0,4194304] 0 2023-12-16T07:40:42.891 INFO:tasks.workunit.client.1.smithi133.stdout:8/389: mknod d9/dc/d27/c82 0 2023-12-16T07:40:42.891 INFO:tasks.workunit.client.1.smithi133.stdout:9/458: dwrite d15/d18/d2c/f2e [0,4194304] 0 2023-12-16T07:40:42.892 INFO:tasks.workunit.client.1.smithi133.stdout:7/702: dwrite db/d21/f23 [0,4194304] 0 2023-12-16T07:40:42.892 INFO:tasks.workunit.client.1.smithi133.stdout:7/703: write db/d21/d2c/d31/fab [1032860,3702] 0 2023-12-16T07:40:42.897 INFO:tasks.workunit.client.1.smithi133.stdout:2/306: dwrite da/d15/d17/f33 [0,4194304] 0 2023-12-16T07:40:42.897 INFO:tasks.workunit.client.1.smithi133.stdout:6/618: dwrite d0/d4/d21/d35/f42 [0,4194304] 0 2023-12-16T07:40:42.898 INFO:tasks.workunit.client.1.smithi133.stdout:8/390: mknod d9/dc/d27/c83 0 2023-12-16T07:40:42.900 INFO:tasks.workunit.client.1.smithi133.stdout:9/459: getdents d15/d18/d5b 0 2023-12-16T07:40:42.906 INFO:tasks.workunit.client.1.smithi133.stdout:7/704: rename db/d12/d3a/d6c/lcd to db/d21/d2c/d31/d79/le3 0 2023-12-16T07:40:42.911 INFO:tasks.workunit.client.1.smithi133.stdout:0/411: dwrite d2/d9/d12/d35/d48/f3d [4194304,4194304] 0 2023-12-16T07:40:42.911 INFO:tasks.workunit.client.1.smithi133.stdout:0/412: truncate d2/d17/d2b/d31/d4d/d54/f80 18298 0 2023-12-16T07:40:42.911 INFO:tasks.workunit.client.1.smithi133.stdout:3/301: dwrite d7/d8/d1d/f40 [0,4194304] 0 2023-12-16T07:40:42.911 INFO:tasks.workunit.client.1.smithi133.stdout:3/302: fdatasync d7/d8/f5c 0 2023-12-16T07:40:42.912 INFO:tasks.workunit.client.1.smithi133.stdout:6/619: mkdir d0/d5e/d75/dcf 0 2023-12-16T07:40:42.912 INFO:tasks.workunit.client.1.smithi133.stdout:6/620: write d0/d5e/f78 [599602,10977] 0 2023-12-16T07:40:42.914 INFO:tasks.workunit.client.1.smithi133.stdout:2/307: creat da/d1d/d24/d2e/d47/d52/f63 x:0 0 0 2023-12-16T07:40:42.915 INFO:tasks.workunit.client.1.smithi133.stdout:4/608: dwrite d3/d7/d1c/db0/dc8/f65 [0,4194304] 0 2023-12-16T07:40:42.915 INFO:tasks.workunit.client.1.smithi133.stdout:2/308: write da/f10 [3038337,63576] 0 2023-12-16T07:40:42.915 INFO:tasks.workunit.client.1.smithi133.stdout:2/309: chown da/d50 317003052 1 2023-12-16T07:40:42.917 INFO:tasks.workunit.client.1.smithi133.stdout:8/391: creat d9/d10/d39/d48/d44/d6e/d78/f84 x:0 0 0 2023-12-16T07:40:42.918 INFO:tasks.workunit.client.1.smithi133.stdout:8/392: stat d9/d10/d39/d48 0 2023-12-16T07:40:42.918 INFO:tasks.workunit.client.1.smithi133.stdout:8/393: write d9/d10/d39/d48/f7f [919601,129171] 0 2023-12-16T07:40:42.920 INFO:tasks.workunit.client.1.smithi133.stdout:7/705: truncate db/d21/f70 3664884 0 2023-12-16T07:40:42.920 INFO:tasks.workunit.client.1.smithi133.stdout:7/706: write db/d12/f49 [1103256,105005] 0 2023-12-16T07:40:42.921 INFO:tasks.workunit.client.1.smithi133.stdout:7/707: getdents db/d21/d2c/d31/d6e/dad 0 2023-12-16T07:40:42.921 INFO:tasks.workunit.client.1.smithi133.stdout:9/460: dwrite d15/d18/d2c/d68/f83 [0,4194304] 0 2023-12-16T07:40:42.922 INFO:tasks.workunit.client.1.smithi133.stdout:5/332: dwrite d1/d18/f1b [0,4194304] 0 2023-12-16T07:40:42.925 INFO:tasks.workunit.client.1.smithi133.stdout:0/413: creat d2/d9/d12/d35/d48/f81 x:0 0 0 2023-12-16T07:40:42.925 INFO:tasks.workunit.client.1.smithi133.stdout:5/333: read d1/d18/f47 [923618,92275] 0 2023-12-16T07:40:42.925 INFO:tasks.workunit.client.1.smithi133.stdout:6/621: dread d0/d4/d21/d8a/da4/fb1 [0,4194304] 0 2023-12-16T07:40:42.928 INFO:tasks.workunit.client.1.smithi133.stdout:3/303: mkdir d7/d8/d78/d43/d7f 0 2023-12-16T07:40:42.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/609: symlink d3/d7/d38/d57/d67/lcc 0 2023-12-16T07:40:42.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/610: chown d3/d7/d38/l3a 0 1 2023-12-16T07:40:42.933 INFO:tasks.workunit.client.1.smithi133.stdout:2/310: rename da/f2c to da/f64 0 2023-12-16T07:40:42.933 INFO:tasks.workunit.client.1.smithi133.stdout:2/311: truncate da/d1d/d24/d2e/f38 68489 0 2023-12-16T07:40:42.937 INFO:tasks.workunit.client.1.smithi133.stdout:8/394: mkdir d9/d85 0 2023-12-16T07:40:42.940 INFO:tasks.workunit.client.1.smithi133.stdout:7/708: mknod db/d21/d2c/d31/d79/dcf/ce4 0 2023-12-16T07:40:42.942 INFO:tasks.workunit.client.1.smithi133.stdout:9/461: creat d15/d18/d80/f98 x:0 0 0 2023-12-16T07:40:42.942 INFO:tasks.workunit.client.1.smithi133.stdout:9/462: fdatasync d15/d18/f54 0 2023-12-16T07:40:42.950 INFO:tasks.workunit.client.1.smithi133.stdout:0/414: mknod d2/d9/d20/d5e/c82 0 2023-12-16T07:40:42.950 INFO:tasks.workunit.client.1.smithi133.stdout:0/415: write d2/d17/d2b/f77 [585358,73412] 0 2023-12-16T07:40:42.952 INFO:tasks.workunit.client.1.smithi133.stdout:6/622: symlink d0/d4/d21/d35/ld0 0 2023-12-16T07:40:42.955 INFO:tasks.workunit.client.1.smithi133.stdout:3/304: rename d7/d8/d1d/d2a/d62/l6c to d7/d8/d78/d43/l80 0 2023-12-16T07:40:42.955 INFO:tasks.workunit.client.1.smithi133.stdout:7/709: dread db/d21/d2c/d31/f35 [0,4194304] 0 2023-12-16T07:40:42.960 INFO:tasks.workunit.client.1.smithi133.stdout:4/611: mknod d3/d7/d1c/d2a/ccd 0 2023-12-16T07:40:42.963 INFO:tasks.workunit.client.1.smithi133.stdout:5/334: dwrite d1/d18/f4e [0,4194304] 0 2023-12-16T07:40:42.965 INFO:tasks.workunit.client.1.smithi133.stdout:3/305: dread d7/f1b [0,4194304] 0 2023-12-16T07:40:42.965 INFO:tasks.workunit.client.1.smithi133.stdout:3/306: truncate d7/d8/d1c/f50 1027143 0 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:6/623: dwrite d0/d4/d21/d8a/d93/f82 [0,4194304] 0 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:6/624: fdatasync d0/d4/d21/d35/d36/f46 0 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:6/625: dread - d0/d4/d21/d35/f95 zero size 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:8/395: dwrite d9/dc/d27/f29 [0,4194304] 0 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:6/626: write d0/d5e/d75/dad/fc1 [586463,30436] 0 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:8/396: fdatasync d9/f5e 0 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:6/627: dread - d0/d4/d21/d60/fbb zero size 2023-12-16T07:40:42.970 INFO:tasks.workunit.client.1.smithi133.stdout:8/397: fdatasync d9/d10/f37 0 2023-12-16T07:40:42.972 INFO:tasks.workunit.client.1.smithi133.stdout:0/416: symlink d2/l83 0 2023-12-16T07:40:42.979 INFO:tasks.workunit.client.1.smithi133.stdout:7/710: creat db/d3e/d4a/d58/d86/da9/fe5 x:0 0 0 2023-12-16T07:40:42.980 INFO:tasks.workunit.client.1.smithi133.stdout:4/612: creat d3/d7/d1c/d2a/d91/dbe/fce x:0 0 0 2023-12-16T07:40:42.988 INFO:tasks.workunit.client.1.smithi133.stdout:0/417: dwrite d2/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:42.988 INFO:tasks.workunit.client.1.smithi133.stdout:0/418: fdatasync d2/d9/d12/f3f 0 2023-12-16T07:40:42.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/335: rename d1/de/d67/f2b to d1/d1c/f77 0 2023-12-16T07:40:43.000 INFO:tasks.workunit.client.1.smithi133.stdout:3/307: creat d7/d8/d72/d77/f81 x:0 0 0 2023-12-16T07:40:43.004 INFO:tasks.workunit.client.1.smithi133.stdout:8/398: creat d9/d10/d39/d48/f86 x:0 0 0 2023-12-16T07:40:43.010 INFO:tasks.workunit.client.1.smithi133.stdout:4/613: mkdir d3/d7/d44/dac/dcf 0 2023-12-16T07:40:43.014 INFO:tasks.workunit.client.1.smithi133.stdout:0/419: mknod d2/d17/d2b/d31/d63/c84 0 2023-12-16T07:40:43.019 INFO:tasks.workunit.client.1.smithi133.stdout:6/628: rename d0/d4/f37 to d0/d5e/d75/fd1 0 2023-12-16T07:40:43.020 INFO:tasks.workunit.client.1.smithi133.stdout:5/336: creat d1/de/d52/f78 x:0 0 0 2023-12-16T07:40:43.022 INFO:tasks.workunit.client.1.smithi133.stdout:3/308: creat d7/d8/d1c/d2b/d2d/f82 x:0 0 0 2023-12-16T07:40:43.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/399: symlink d9/d10/d39/d48/d44/d6e/l87 0 2023-12-16T07:40:43.026 INFO:tasks.workunit.client.1.smithi133.stdout:4/614: mkdir d3/d7/d1c/d2a/d91/dbe/dd0 0 2023-12-16T07:40:43.026 INFO:tasks.workunit.client.1.smithi133.stdout:4/615: fdatasync d3/d7/d44/f5e 0 2023-12-16T07:40:43.026 INFO:tasks.workunit.client.1.smithi133.stdout:4/616: getdents d3/d7/d44/dac/dcf 0 2023-12-16T07:40:43.026 INFO:tasks.workunit.client.1.smithi133.stdout:4/617: getdents d3/d7/d44/dac/dcf 0 2023-12-16T07:40:43.029 INFO:tasks.workunit.client.1.smithi133.stdout:0/420: link d2/d9/d12/l7b d2/d17/l85 0 2023-12-16T07:40:43.030 INFO:tasks.workunit.client.1.smithi133.stdout:8/400: dread d9/dc/f30 [0,4194304] 0 2023-12-16T07:40:43.031 INFO:tasks.workunit.client.1.smithi133.stdout:7/711: rename db/d21/d2c/c3c to db/d3e/d4a/d58/d86/ce6 0 2023-12-16T07:40:43.032 INFO:tasks.workunit.client.1.smithi133.stdout:7/712: read db/ff [3520551,34858] 0 2023-12-16T07:40:43.035 INFO:tasks.workunit.client.1.smithi133.stdout:6/629: mknod d0/d5e/d75/d81/cd2 0 2023-12-16T07:40:43.038 INFO:tasks.workunit.client.1.smithi133.stdout:5/337: mknod d1/d54/c79 0 2023-12-16T07:40:43.039 INFO:tasks.workunit.client.1.smithi133.stdout:3/309: creat d7/d8/d1d/d2a/d63/f83 x:0 0 0 2023-12-16T07:40:43.041 INFO:tasks.workunit.client.1.smithi133.stdout:4/618: mkdir d3/d7/d1c/d2a/d91/dd1 0 2023-12-16T07:40:43.042 INFO:tasks.workunit.client.1.smithi133.stdout:3/310: dread d7/f25 [0,4194304] 0 2023-12-16T07:40:43.043 INFO:tasks.workunit.client.1.smithi133.stdout:0/421: dwrite d2/d9/db/fe [0,4194304] 0 2023-12-16T07:40:43.045 INFO:tasks.workunit.client.1.smithi133.stdout:7/713: truncate db/d12/f34 6566331 0 2023-12-16T07:40:43.045 INFO:tasks.workunit.client.1.smithi133.stdout:0/422: dread d2/d9/db/f55 [0,4194304] 0 2023-12-16T07:40:43.045 INFO:tasks.workunit.client.1.smithi133.stdout:7/714: write db/d3e/d4a/d58/d86/fb3 [8346941,96310] 0 2023-12-16T07:40:43.049 INFO:tasks.workunit.client.1.smithi133.stdout:6/630: getdents d0/d4/d21/d35/d4e/d84/d69 0 2023-12-16T07:40:43.051 INFO:tasks.workunit.client.1.smithi133.stdout:5/338: getdents d1/d18/d2c 0 2023-12-16T07:40:43.051 INFO:tasks.workunit.client.1.smithi133.stdout:3/311: dread d7/d8/d1c/d2b/f15 [0,4194304] 0 2023-12-16T07:40:43.051 INFO:tasks.workunit.client.1.smithi133.stdout:3/312: write d7/d8/d1c/f38 [614828,48626] 0 2023-12-16T07:40:43.054 INFO:tasks.workunit.client.1.smithi133.stdout:4/619: truncate d3/d7/f86 3281335 0 2023-12-16T07:40:43.055 INFO:tasks.workunit.client.1.smithi133.stdout:8/401: mkdir d9/d11/d88 0 2023-12-16T07:40:43.058 INFO:tasks.workunit.client.1.smithi133.stdout:1/516: sync 2023-12-16T07:40:43.060 INFO:tasks.workunit.client.1.smithi133.stdout:0/423: creat d2/d9/d12/d45/f86 x:0 0 0 2023-12-16T07:40:43.063 INFO:tasks.workunit.client.1.smithi133.stdout:7/715: truncate db/d3e/d4a/d58/db9/fc2 1271751 0 2023-12-16T07:40:43.064 INFO:tasks.workunit.client.1.smithi133.stdout:6/631: mknod d0/d4/d21/d35/d4e/d84/d69/da1/cd3 0 2023-12-16T07:40:43.064 INFO:tasks.workunit.client.1.smithi133.stdout:6/632: chown d0/d4/d21/d35/d7e 192 1 2023-12-16T07:40:43.064 INFO:tasks.workunit.client.1.smithi133.stdout:6/633: chown d0/l25 128358115 1 2023-12-16T07:40:43.066 INFO:tasks.workunit.client.1.smithi133.stdout:5/339: creat d1/de/d67/d60/d64/f7a x:0 0 0 2023-12-16T07:40:43.068 INFO:tasks.workunit.client.1.smithi133.stdout:4/620: rmdir d3/d7/d38/d57 39 2023-12-16T07:40:43.072 INFO:tasks.workunit.client.1.smithi133.stdout:8/402: creat d9/d10/d39/d48/d44/f89 x:0 0 0 2023-12-16T07:40:43.075 INFO:tasks.workunit.client.1.smithi133.stdout:1/517: getdents d0/d12/d51/dac/d24/d32/d56/d59 0 2023-12-16T07:40:43.077 INFO:tasks.workunit.client.1.smithi133.stdout:4/621: dread d3/d7/d38/d57/d67/f87 [0,4194304] 0 2023-12-16T07:40:43.077 INFO:tasks.workunit.client.1.smithi133.stdout:0/424: rename d2/d17/d2b/d31/d36/c64 to d2/d9/d12/d35/d48/c87 0 2023-12-16T07:40:43.078 INFO:tasks.workunit.client.1.smithi133.stdout:3/313: dwrite d7/d8/f54 [0,4194304] 0 2023-12-16T07:40:43.079 INFO:tasks.workunit.client.1.smithi133.stdout:0/425: dread d2/d9/db/f55 [0,4194304] 0 2023-12-16T07:40:43.079 INFO:tasks.workunit.client.1.smithi133.stdout:0/426: fdatasync d2/d9/d20/f44 0 2023-12-16T07:40:43.079 INFO:tasks.workunit.client.1.smithi133.stdout:0/427: truncate d2/d9/db/f55 960903 0 2023-12-16T07:40:43.079 INFO:tasks.workunit.client.1.smithi133.stdout:0/428: truncate d2/d17/d2b/d31/d4d/d54/f80 31761 0 2023-12-16T07:40:43.080 INFO:tasks.workunit.client.1.smithi133.stdout:6/634: rename d0/d4/d21/d8a/d93/f88 to d0/d4/d21/d8a/d93/fd4 0 2023-12-16T07:40:43.084 INFO:tasks.workunit.client.1.smithi133.stdout:7/716: dwrite db/d21/f52 [0,4194304] 0 2023-12-16T07:40:43.085 INFO:tasks.workunit.client.1.smithi133.stdout:5/340: rename d1/de/l14 to d1/de/d67/d60/d64/l7b 0 2023-12-16T07:40:43.087 INFO:tasks.workunit.client.1.smithi133.stdout:3/314: creat d7/d8/f84 x:0 0 0 2023-12-16T07:40:43.089 INFO:tasks.workunit.client.1.smithi133.stdout:0/429: creat d2/d17/d2b/f88 x:0 0 0 2023-12-16T07:40:43.090 INFO:tasks.workunit.client.1.smithi133.stdout:0/430: dread - d2/d17/d2b/f88 zero size 2023-12-16T07:40:43.090 INFO:tasks.workunit.client.1.smithi133.stdout:4/622: dread d3/d7/d1c/f46 [0,4194304] 0 2023-12-16T07:40:43.093 INFO:tasks.workunit.client.1.smithi133.stdout:6/635: symlink d0/d4/d21/d8a/d93/d8e/ld5 0 2023-12-16T07:40:43.093 INFO:tasks.workunit.client.1.smithi133.stdout:6/636: chown d0/d4/d21/d8a/c91 2 1 2023-12-16T07:40:43.093 INFO:tasks.workunit.client.1.smithi133.stdout:6/637: write d0/d4/d21/d8a/da4/fb5 [256795,29860] 0 2023-12-16T07:40:43.095 INFO:tasks.workunit.client.1.smithi133.stdout:8/403: rename d9/d10/f1b to d9/d2d/f8a 0 2023-12-16T07:40:43.095 INFO:tasks.workunit.client.1.smithi133.stdout:8/404: fdatasync d9/d10/d39/d48/d44/f46 0 2023-12-16T07:40:43.097 INFO:tasks.workunit.client.1.smithi133.stdout:7/717: dread db/d12/d3a/f7e [0,4194304] 0 2023-12-16T07:40:43.098 INFO:tasks.workunit.client.1.smithi133.stdout:7/718: fdatasync db/d21/f26 0 2023-12-16T07:40:43.098 INFO:tasks.workunit.client.1.smithi133.stdout:7/719: truncate db/d21/f80 1724240 0 2023-12-16T07:40:43.098 INFO:tasks.workunit.client.1.smithi133.stdout:6/638: dread d0/d5e/f76 [0,4194304] 0 2023-12-16T07:40:43.098 INFO:tasks.workunit.client.1.smithi133.stdout:6/639: stat d0/cab 0 2023-12-16T07:40:43.098 INFO:tasks.workunit.client.1.smithi133.stdout:6/640: dread - d0/d5e/d8c/fcc zero size 2023-12-16T07:40:43.099 INFO:tasks.workunit.client.1.smithi133.stdout:5/341: mkdir d1/de/d67/d7c 0 2023-12-16T07:40:43.100 INFO:tasks.workunit.client.1.smithi133.stdout:3/315: mkdir d7/d8/d78/d43/d7f/d85 0 2023-12-16T07:40:43.105 INFO:tasks.workunit.client.1.smithi133.stdout:1/518: rename d0/d12/d51/dac/d24/d32/c93 to d0/d1c/d37/cad 0 2023-12-16T07:40:43.105 INFO:tasks.workunit.client.1.smithi133.stdout:6/641: link d0/d5e/d75/f80 d0/d5e/d75/d81/d99/fd6 0 2023-12-16T07:40:43.108 INFO:tasks.workunit.client.1.smithi133.stdout:0/431: rename d2/d9/d12/d35/d48/d60 to d2/d9/d20/d5e/d89 0 2023-12-16T07:40:43.109 INFO:tasks.workunit.client.1.smithi133.stdout:0/432: write d2/d17/d2b/f77 [1679601,5581] 0 2023-12-16T07:40:43.112 INFO:tasks.workunit.client.1.smithi133.stdout:3/316: rename d7/d8/d1c/d76 to d7/d8/d72/d86 0 2023-12-16T07:40:43.115 INFO:tasks.workunit.client.1.smithi133.stdout:3/317: mkdir d7/d8/d1c/d87 0 2023-12-16T07:40:43.115 INFO:tasks.workunit.client.1.smithi133.stdout:3/318: truncate d7/d8/d78/f6d 4910938 0 2023-12-16T07:40:43.119 INFO:tasks.workunit.client.1.smithi133.stdout:4/623: dwrite d3/d7/d44/f9f [0,4194304] 0 2023-12-16T07:40:43.123 INFO:tasks.workunit.client.1.smithi133.stdout:4/624: creat d3/d7/d1c/d2a/d91/dbe/fd2 x:0 0 0 2023-12-16T07:40:43.125 INFO:tasks.workunit.client.1.smithi133.stdout:0/433: read d2/d17/f26 [394576,68727] 0 2023-12-16T07:40:43.125 INFO:tasks.workunit.client.1.smithi133.stdout:4/625: read d3/d7/d1a/faf [340580,124564] 0 2023-12-16T07:40:43.127 INFO:tasks.workunit.client.1.smithi133.stdout:4/626: symlink d3/d7/d38/d57/d67/ld3 0 2023-12-16T07:40:43.127 INFO:tasks.workunit.client.1.smithi133.stdout:6/642: dread d0/d4/f31 [4194304,4194304] 0 2023-12-16T07:40:43.128 INFO:tasks.workunit.client.1.smithi133.stdout:6/643: mknod d0/d5e/cd7 0 2023-12-16T07:40:43.128 INFO:tasks.workunit.client.1.smithi133.stdout:6/644: chown d0/d4/d21/d35/d36/l3f 32255 1 2023-12-16T07:40:43.128 INFO:tasks.workunit.client.1.smithi133.stdout:6/645: chown d0/d4/fae 378 1 2023-12-16T07:40:43.130 INFO:tasks.workunit.client.1.smithi133.stdout:6/646: symlink d0/d5e/d75/d81/d99/ld8 0 2023-12-16T07:40:43.131 INFO:tasks.workunit.client.1.smithi133.stdout:6/647: fsync d0/d4/d21/d60/fbb 0 2023-12-16T07:40:43.140 INFO:tasks.workunit.client.1.smithi133.stdout:6/648: write d0/d4/d21/d35/d4e/d84/d69/fa3 [320297,40134] 0 2023-12-16T07:40:43.140 INFO:tasks.workunit.client.1.smithi133.stdout:1/519: dwrite d0/d60/f8e [0,4194304] 0 2023-12-16T07:40:43.145 INFO:tasks.workunit.client.1.smithi133.stdout:6/649: dread d0/d4/d21/d8a/d93/d8e/fbe [0,4194304] 0 2023-12-16T07:40:43.145 INFO:tasks.workunit.client.1.smithi133.stdout:6/650: truncate d0/d5e/d75/fd1 4208305 0 2023-12-16T07:40:43.146 INFO:tasks.workunit.client.1.smithi133.stdout:1/520: creat d0/d12/d51/dac/d24/fae x:0 0 0 2023-12-16T07:40:43.146 INFO:tasks.workunit.client.1.smithi133.stdout:1/521: fsync d0/d1c/d37/f84 0 2023-12-16T07:40:43.146 INFO:tasks.workunit.client.1.smithi133.stdout:8/405: dwrite d9/d10/f3a [0,4194304] 0 2023-12-16T07:40:43.146 INFO:tasks.workunit.client.1.smithi133.stdout:8/406: read - d9/f3e zero size 2023-12-16T07:40:43.147 INFO:tasks.workunit.client.1.smithi133.stdout:1/522: rmdir d0/d12/d51/dac/d24/d32/d56/d59 39 2023-12-16T07:40:43.152 INFO:tasks.workunit.client.1.smithi133.stdout:1/523: unlink d0/d12/d51/dac/d24/d5a/d68/f6d 0 2023-12-16T07:40:43.156 INFO:tasks.workunit.client.1.smithi133.stdout:7/720: dwrite db/d21/d2c/d31/d6e/f93 [0,4194304] 0 2023-12-16T07:40:43.198 INFO:tasks.workunit.client.1.smithi133.stdout:7/721: chown db/d3e/d4a/f9a 511591771 1 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:3/319: dwrite d7/d8/d78/d43/f79 [0,4194304] 0 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:7/722: truncate db/d12/d3a/d6c/f83 2041776 0 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:5/342: dwrite d1/f1a [0,4194304] 0 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:5/343: chown d1/d18/d2c 263248054 1 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:7/723: mkdir db/d21/d2c/d31/d59/de7 0 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:5/344: mknod d1/d1c/c7d 0 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:7/724: mkdir db/d12/d3a/d6c/dc8/de8 0 2023-12-16T07:40:43.200 INFO:tasks.workunit.client.1.smithi133.stdout:7/725: creat db/fe9 x:0 0 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:0/434: dwrite d2/d17/f1b [4194304,4194304] 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:7/726: mknod db/d21/d2c/d31/cea 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:4/627: dwrite d3/d7/d1a/f9c [0,4194304] 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/345: dread d1/d18/d2c/f45 [0,4194304] 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:3/320: dread d7/d8/d78/f6d [0,4194304] 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:8/407: dwrite d9/dc/d27/f28 [0,4194304] 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:0/435: write d2/f8 [2441498,39388] 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/346: rename d1/de/d67/c20 to d1/d18/c7e 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/347: stat d1/de/c36 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/348: readlink d1/d18/l55 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/349: readlink d1/l49 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:6/651: dwrite d0/d4/d21/d8a/da4/fb5 [0,4194304] 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:3/321: creat d7/d8/d1d/d2a/d5f/f88 x:0 0 0 2023-12-16T07:40:43.201 INFO:tasks.workunit.client.1.smithi133.stdout:4/628: dwrite d3/d7/f2e [0,4194304] 0 2023-12-16T07:40:43.202 INFO:tasks.workunit.client.1.smithi133.stdout:8/408: symlink d9/dc/l8b 0 2023-12-16T07:40:43.202 INFO:tasks.workunit.client.1.smithi133.stdout:5/350: symlink d1/d18/d2c/l7f 0 2023-12-16T07:40:43.202 INFO:tasks.workunit.client.1.smithi133.stdout:5/351: fdatasync d1/d18/f63 0 2023-12-16T07:40:43.202 INFO:tasks.workunit.client.1.smithi133.stdout:4/629: dread d3/f59 [0,4194304] 0 2023-12-16T07:40:43.202 INFO:tasks.workunit.client.1.smithi133.stdout:6/652: creat d0/fd9 x:0 0 0 2023-12-16T07:40:43.205 INFO:tasks.workunit.client.1.smithi133.stdout:3/322: creat d7/d8/d78/d43/d5b/f89 x:0 0 0 2023-12-16T07:40:43.205 INFO:tasks.workunit.client.1.smithi133.stdout:0/436: dwrite d2/f8 [0,4194304] 0 2023-12-16T07:40:43.207 INFO:tasks.workunit.client.1.smithi133.stdout:0/437: write d2/d9/d12/f3f [702307,57546] 0 2023-12-16T07:40:43.213 INFO:tasks.workunit.client.1.smithi133.stdout:0/438: write d2/d17/d2b/f4b [3118888,39456] 0 2023-12-16T07:40:43.219 INFO:tasks.workunit.client.1.smithi133.stdout:8/409: getdents d9/dc/de 0 2023-12-16T07:40:43.222 INFO:tasks.workunit.client.1.smithi133.stdout:3/323: symlink d7/d8/d1c/d2b/d2d/l8a 0 2023-12-16T07:40:43.226 INFO:tasks.workunit.client.1.smithi133.stdout:8/410: mknod d9/d85/c8c 0 2023-12-16T07:40:43.226 INFO:tasks.workunit.client.1.smithi133.stdout:8/411: truncate d9/d10/d39/d48/d44/f53 4659473 0 2023-12-16T07:40:43.226 INFO:tasks.workunit.client.1.smithi133.stdout:8/412: dread - d9/d11/d42/f7a zero size 2023-12-16T07:40:43.228 INFO:tasks.workunit.client.1.smithi133.stdout:3/324: rename d7/d8/d1d/f28 to d7/d8/d78/f8b 0 2023-12-16T07:40:43.230 INFO:tasks.workunit.client.1.smithi133.stdout:5/352: dwrite d1/d1c/f3b [4194304,4194304] 0 2023-12-16T07:40:43.230 INFO:tasks.workunit.client.1.smithi133.stdout:6/653: dwrite d0/d5e/d75/f80 [0,4194304] 0 2023-12-16T07:40:43.230 INFO:tasks.workunit.client.1.smithi133.stdout:4/630: dwrite d3/d7/d1c/d2a/f4c [0,4194304] 0 2023-12-16T07:40:43.230 INFO:tasks.workunit.client.1.smithi133.stdout:4/631: truncate d3/d7/d44/f55 1386042 0 2023-12-16T07:40:43.231 INFO:tasks.workunit.client.1.smithi133.stdout:4/632: chown d3/d7/d1c/d2a/cb5 11 1 2023-12-16T07:40:43.231 INFO:tasks.workunit.client.1.smithi133.stdout:8/413: symlink d9/d3f/l8d 0 2023-12-16T07:40:43.231 INFO:tasks.workunit.client.1.smithi133.stdout:6/654: write d0/d4/f31 [5404995,42789] 0 2023-12-16T07:40:43.231 INFO:tasks.workunit.client.1.smithi133.stdout:6/655: readlink d0/d5e/d75/d81/d99/ld8 0 2023-12-16T07:40:43.233 INFO:tasks.workunit.client.1.smithi133.stdout:3/325: unlink d7/d8/d78/d43/l80 0 2023-12-16T07:40:43.236 INFO:tasks.workunit.client.1.smithi133.stdout:0/439: dwrite d2/d9/d12/d35/d48/f3d [0,4194304] 0 2023-12-16T07:40:43.243 INFO:tasks.workunit.client.1.smithi133.stdout:5/353: rename d1/de/d67/d60 to d1/d1c/d80 0 2023-12-16T07:40:43.247 INFO:tasks.workunit.client.1.smithi133.stdout:6/656: creat d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/fda x:0 0 0 2023-12-16T07:40:43.249 INFO:tasks.workunit.client.1.smithi133.stdout:3/326: link d7/d8/d1c/f38 d7/d8/d78/d43/d5b/f8c 0 2023-12-16T07:40:43.249 INFO:tasks.workunit.client.1.smithi133.stdout:3/327: chown d7/c64 2 1 2023-12-16T07:40:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:5/354: creat d1/d1c/d80/f81 x:0 0 0 2023-12-16T07:40:43.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/414: dwrite d9/d11/d52/f5a [0,4194304] 0 2023-12-16T07:40:43.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/415: fsync d9/d10/f81 0 2023-12-16T07:40:43.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/416: chown d9/d11/d88 68 1 2023-12-16T07:40:43.257 INFO:tasks.workunit.client.1.smithi133.stdout:4/633: dwrite d3/d7/d44/f55 [0,4194304] 0 2023-12-16T07:40:43.257 INFO:tasks.workunit.client.1.smithi133.stdout:0/440: dwrite d2/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:43.258 INFO:tasks.workunit.client.1.smithi133.stdout:6/657: link d0/d4/c2f d0/d4/d21/d8a/da4/cdb 0 2023-12-16T07:40:43.259 INFO:tasks.workunit.client.1.smithi133.stdout:6/658: fdatasync d0/d4/d21/d35/fc6 0 2023-12-16T07:40:43.259 INFO:tasks.workunit.client.1.smithi133.stdout:6/659: readlink d0/l30 0 2023-12-16T07:40:43.259 INFO:tasks.workunit.client.1.smithi133.stdout:6/660: read d0/d4/d21/d8a/d93/d8e/f9c [1758796,1747] 0 2023-12-16T07:40:43.259 INFO:tasks.workunit.client.1.smithi133.stdout:3/328: mknod d7/d8/d1d/d2a/d63/c8d 0 2023-12-16T07:40:43.263 INFO:tasks.workunit.client.1.smithi133.stdout:5/355: symlink d1/de/d52/l82 0 2023-12-16T07:40:43.263 INFO:tasks.workunit.client.1.smithi133.stdout:3/329: dread d7/d8/d78/d43/d5b/f8c [0,4194304] 0 2023-12-16T07:40:43.266 INFO:tasks.workunit.client.1.smithi133.stdout:8/417: rmdir d9/d3f 39 2023-12-16T07:40:43.266 INFO:tasks.workunit.client.1.smithi133.stdout:8/418: fsync d9/d10/f37 0 2023-12-16T07:40:43.266 INFO:tasks.workunit.client.1.smithi133.stdout:8/419: write d9/dc/d27/f4f [109882,63743] 0 2023-12-16T07:40:43.269 INFO:tasks.workunit.client.1.smithi133.stdout:4/634: rename d3/d7/f6b to d3/d7/d1c/d2a/d91/dbe/fd4 0 2023-12-16T07:40:43.271 INFO:tasks.workunit.client.1.smithi133.stdout:0/441: symlink d2/d9/d12/d35/d4f/l8a 0 2023-12-16T07:40:43.272 INFO:tasks.workunit.client.1.smithi133.stdout:6/661: truncate d0/d4/d21/d35/d36/f64 430435 0 2023-12-16T07:40:43.272 INFO:tasks.workunit.client.1.smithi133.stdout:6/662: chown d0/d4/d21/d35/d4e/d84/cb8 21 1 2023-12-16T07:40:43.272 INFO:tasks.workunit.client.1.smithi133.stdout:6/663: truncate d0/d4/fa7 232063 0 2023-12-16T07:40:43.275 INFO:tasks.workunit.client.1.smithi133.stdout:8/420: dread d9/d11/d42/f4d [0,4194304] 0 2023-12-16T07:40:43.276 INFO:tasks.workunit.client.1.smithi133.stdout:8/421: read d9/d10/f37 [3530021,83730] 0 2023-12-16T07:40:43.279 INFO:tasks.workunit.client.1.smithi133.stdout:0/442: dread d2/d9/d20/f2c [0,4194304] 0 2023-12-16T07:40:43.282 INFO:tasks.workunit.client.1.smithi133.stdout:5/356: symlink d1/d18/d6f/d71/l83 0 2023-12-16T07:40:43.286 INFO:tasks.workunit.client.1.smithi133.stdout:3/330: link d7/d8/d1d/f40 d7/f8e 0 2023-12-16T07:40:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:4/635: rename d3/d7/d44 to d3/d7/d38/dd5 0 2023-12-16T07:40:43.297 INFO:tasks.workunit.client.1.smithi133.stdout:6/664: mkdir d0/d4/d21/d8a/ddc 0 2023-12-16T07:40:43.300 INFO:tasks.workunit.client.1.smithi133.stdout:3/331: dwrite d7/d8/d72/d77/f81 [0,4194304] 0 2023-12-16T07:40:43.300 INFO:tasks.workunit.client.1.smithi133.stdout:0/443: creat d2/d9/d12/d35/f8b x:0 0 0 2023-12-16T07:40:43.305 INFO:tasks.workunit.client.1.smithi133.stdout:5/357: creat d1/d1c/d80/d64/f84 x:0 0 0 2023-12-16T07:40:43.308 INFO:tasks.workunit.client.1.smithi133.stdout:8/422: rename d9/d2d/f56 to d9/d10/f8e 0 2023-12-16T07:40:43.309 INFO:tasks.workunit.client.1.smithi133.stdout:4/636: creat d3/db6/fd6 x:0 0 0 2023-12-16T07:40:43.313 INFO:tasks.workunit.client.1.smithi133.stdout:6/665: rmdir d0/d4/d21/d35/d4e 39 2023-12-16T07:40:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:4/637: dread d3/d7/d1a/f33 [0,4194304] 0 2023-12-16T07:40:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/444: dwrite d2/d9/db/fe [0,4194304] 0 2023-12-16T07:40:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:9/463: sync 2023-12-16T07:40:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:2/312: sync 2023-12-16T07:40:43.322 INFO:tasks.workunit.client.1.smithi133.stdout:3/332: mkdir d7/d8/d78/d43/d7f/d85/d8f 0 2023-12-16T07:40:43.327 INFO:tasks.workunit.client.1.smithi133.stdout:5/358: creat d1/de/d35/f85 x:0 0 0 2023-12-16T07:40:43.327 INFO:tasks.workunit.client.1.smithi133.stdout:5/359: write d1/de/f23 [2687572,48078] 0 2023-12-16T07:40:43.329 INFO:tasks.workunit.client.1.smithi133.stdout:8/423: truncate d9/d3f/f66 764663 0 2023-12-16T07:40:43.331 INFO:tasks.workunit.client.1.smithi133.stdout:6/666: unlink d0/d4/f2b 0 2023-12-16T07:40:43.333 INFO:tasks.workunit.client.1.smithi133.stdout:4/638: rmdir d3/d7/d38/d57/d67 39 2023-12-16T07:40:43.335 INFO:tasks.workunit.client.1.smithi133.stdout:0/445: rename d2/l83 to d2/d17/d2b/d31/d36/l8c 0 2023-12-16T07:40:43.339 INFO:tasks.workunit.client.1.smithi133.stdout:9/464: mknod d15/c99 0 2023-12-16T07:40:43.340 INFO:tasks.workunit.client.1.smithi133.stdout:3/333: dwrite d7/d8/d1c/f50 [0,4194304] 0 2023-12-16T07:40:43.340 INFO:tasks.workunit.client.1.smithi133.stdout:2/313: symlink da/d1d/d60/l65 0 2023-12-16T07:40:43.346 INFO:tasks.workunit.client.1.smithi133.stdout:8/424: symlink d9/l8f 0 2023-12-16T07:40:43.346 INFO:tasks.workunit.client.1.smithi133.stdout:8/425: write d9/d10/f45 [1266509,73734] 0 2023-12-16T07:40:43.348 INFO:tasks.workunit.client.1.smithi133.stdout:6/667: link d0/c3d d0/d4/d21/d35/d4e/d84/d69/da1/cdd 0 2023-12-16T07:40:43.350 INFO:tasks.workunit.client.1.smithi133.stdout:4/639: mknod d3/d7/d1c/db0/dc8/cd7 0 2023-12-16T07:40:43.350 INFO:tasks.workunit.client.1.smithi133.stdout:4/640: readlink d3/d7/d1c/l2c 0 2023-12-16T07:40:43.357 INFO:tasks.workunit.client.1.smithi133.stdout:5/360: rename l0 to d1/d54/l86 0 2023-12-16T07:40:43.358 INFO:tasks.workunit.client.1.smithi133.stdout:0/446: mknod d2/d17/d40/c8d 0 2023-12-16T07:40:43.361 INFO:tasks.workunit.client.1.smithi133.stdout:9/465: creat d15/d18/d80/d97/f9a x:0 0 0 2023-12-16T07:40:43.361 INFO:tasks.workunit.client.1.smithi133.stdout:9/466: chown d15/d18/d4d/f6b 0 1 2023-12-16T07:40:43.361 INFO:tasks.workunit.client.1.smithi133.stdout:9/467: write d15/d18/f5e [47984,103526] 0 2023-12-16T07:40:43.365 INFO:tasks.workunit.client.1.smithi133.stdout:6/668: dwrite d0/d5e/d8c/f97 [0,4194304] 0 2023-12-16T07:40:43.365 INFO:tasks.workunit.client.1.smithi133.stdout:6/669: fsync d0/d4/d21/d8a/d93/fa5 0 2023-12-16T07:40:43.365 INFO:tasks.workunit.client.1.smithi133.stdout:6/670: stat d0/l17 0 2023-12-16T07:40:43.371 INFO:tasks.workunit.client.1.smithi133.stdout:3/334: link d7/d8/d1c/f74 d7/d8/d1d/f90 0 2023-12-16T07:40:43.372 INFO:tasks.workunit.client.1.smithi133.stdout:2/314: link da/d15/d17/l39 da/d1d/d24/d2e/d59/l66 0 2023-12-16T07:40:43.375 INFO:tasks.workunit.client.1.smithi133.stdout:4/641: unlink d3/d7/d1c/f46 0 2023-12-16T07:40:43.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/426: rename l6 to d9/dc/d27/l90 0 2023-12-16T07:40:43.379 INFO:tasks.workunit.client.1.smithi133.stdout:5/361: mknod d1/d18/d6f/d71/c87 0 2023-12-16T07:40:43.379 INFO:tasks.workunit.client.1.smithi133.stdout:0/447: stat d2/d9/l34 0 2023-12-16T07:40:43.379 INFO:tasks.workunit.client.1.smithi133.stdout:0/448: readlink d2/d9/d12/l7b 0 2023-12-16T07:40:43.382 INFO:tasks.workunit.client.1.smithi133.stdout:1/524: sync 2023-12-16T07:40:43.382 INFO:tasks.workunit.client.1.smithi133.stdout:9/468: mkdir d15/d18/d5b/d71/d78/d6e/d9b 0 2023-12-16T07:40:43.385 INFO:tasks.workunit.client.1.smithi133.stdout:6/671: getdents d0/d4/d21/d35/d4e/d84/d69/dbd 0 2023-12-16T07:40:43.386 INFO:tasks.workunit.client.1.smithi133.stdout:3/335: rmdir d7/d8/d72/d86 39 2023-12-16T07:40:43.388 INFO:tasks.workunit.client.1.smithi133.stdout:6/672: dread d0/d5e/f76 [0,4194304] 0 2023-12-16T07:40:43.389 INFO:tasks.workunit.client.1.smithi133.stdout:4/642: mkdir d3/d7/d38/dd5/da7/dbb/dd8 0 2023-12-16T07:40:43.390 INFO:tasks.workunit.client.1.smithi133.stdout:4/643: read d3/d7/fb [2571540,128775] 0 2023-12-16T07:40:43.391 INFO:tasks.workunit.client.1.smithi133.stdout:5/362: link d1/d18/c58 d1/de/d52/c88 0 2023-12-16T07:40:43.394 INFO:tasks.workunit.client.1.smithi133.stdout:0/449: rmdir d2/d9/d12/d35/d4f/d50 0 2023-12-16T07:40:43.396 INFO:tasks.workunit.client.1.smithi133.stdout:9/469: creat d15/d18/d5b/d71/d78/d6e/d9b/f9c x:0 0 0 2023-12-16T07:40:43.400 INFO:tasks.workunit.client.1.smithi133.stdout:3/336: rename d7/lb to d7/d8/d1c/d2b/d2d/l91 0 2023-12-16T07:40:43.401 INFO:tasks.workunit.client.1.smithi133.stdout:8/427: dwrite d9/d10/d39/d48/f68 [0,4194304] 0 2023-12-16T07:40:43.402 INFO:tasks.workunit.client.1.smithi133.stdout:2/315: symlink da/d1d/l67 0 2023-12-16T07:40:43.405 INFO:tasks.workunit.client.1.smithi133.stdout:1/525: dwrite d0/f2a [0,4194304] 0 2023-12-16T07:40:43.405 INFO:tasks.workunit.client.1.smithi133.stdout:6/673: link d0/c77 d0/d5e/d75/d81/cde 0 2023-12-16T07:40:43.405 INFO:tasks.workunit.client.1.smithi133.stdout:6/674: chown d0/d4/d21/d35/d4e/d84/l4a 58445624 1 2023-12-16T07:40:43.406 INFO:tasks.workunit.client.1.smithi133.stdout:1/526: read d0/d12/d51/dac/d24/d32/d56/d59/d66/f85 [314899,115284] 0 2023-12-16T07:40:43.409 INFO:tasks.workunit.client.1.smithi133.stdout:4/644: truncate d3/f25 3461459 0 2023-12-16T07:40:43.410 INFO:tasks.workunit.client.1.smithi133.stdout:5/363: mkdir d1/de/d57/d74/d89 0 2023-12-16T07:40:43.442 INFO:tasks.workunit.client.1.smithi133.stdout:0/450: symlink d2/d17/d2b/d31/d36/l8e 0 2023-12-16T07:40:43.444 INFO:tasks.workunit.client.1.smithi133.stdout:0/451: dread d2/d17/d2b/f59 [0,4194304] 0 2023-12-16T07:40:43.444 INFO:tasks.workunit.client.1.smithi133.stdout:0/452: readlink d2/d9/d20/l28 0 2023-12-16T07:40:43.445 INFO:tasks.workunit.client.1.smithi133.stdout:9/470: creat d15/d18/d4d/d7e/f9d x:0 0 0 2023-12-16T07:40:43.447 INFO:tasks.workunit.client.1.smithi133.stdout:3/337: mknod d7/d8/d78/d43/d5b/c92 0 2023-12-16T07:40:43.453 INFO:tasks.workunit.client.1.smithi133.stdout:8/428: rmdir d9/d10/d39/d48/d44/d6e/d78 39 2023-12-16T07:40:43.458 INFO:tasks.workunit.client.1.smithi133.stdout:2/316: truncate da/d15/d17/f36 122291 0 2023-12-16T07:40:43.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/645: creat d3/fd9 x:0 0 0 2023-12-16T07:40:43.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/646: write d3/d7/d1a/f24 [3983022,42566] 0 2023-12-16T07:40:43.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/647: truncate d3/d7/d1c/f73 1013724 0 2023-12-16T07:40:43.459 INFO:tasks.workunit.client.1.smithi133.stdout:5/364: mknod d1/de/d67/d7c/c8a 0 2023-12-16T07:40:43.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/648: write d3/d7/f5c [9008961,15537] 0 2023-12-16T07:40:43.459 INFO:tasks.workunit.client.1.smithi133.stdout:9/471: rmdir d15/d18/d2c/d3a 39 2023-12-16T07:40:43.460 INFO:tasks.workunit.client.1.smithi133.stdout:3/338: mknod d7/d8/d1c/d7e/c93 0 2023-12-16T07:40:43.460 INFO:tasks.workunit.client.1.smithi133.stdout:3/339: dread - d7/d8/d1c/f26 zero size 2023-12-16T07:40:43.460 INFO:tasks.workunit.client.1.smithi133.stdout:3/340: chown d7/d8/d1c/c4c 26107939 1 2023-12-16T07:40:43.460 INFO:tasks.workunit.client.1.smithi133.stdout:7/727: sync 2023-12-16T07:40:43.462 INFO:tasks.workunit.client.1.smithi133.stdout:8/429: creat d9/d10/f91 x:0 0 0 2023-12-16T07:40:43.462 INFO:tasks.workunit.client.1.smithi133.stdout:8/430: write d9/dc/d27/f76 [1013135,100356] 0 2023-12-16T07:40:43.463 INFO:tasks.workunit.client.1.smithi133.stdout:2/317: rmdir da/d1d/d24/d2e/d47 39 2023-12-16T07:40:43.466 INFO:tasks.workunit.client.1.smithi133.stdout:5/365: creat d1/de/d57/d74/d89/f8b x:0 0 0 2023-12-16T07:40:43.466 INFO:tasks.workunit.client.1.smithi133.stdout:5/366: write d1/d1c/d80/d64/f65 [299944,87411] 0 2023-12-16T07:40:43.469 INFO:tasks.workunit.client.1.smithi133.stdout:3/341: dread d7/f23 [0,4194304] 0 2023-12-16T07:40:43.469 INFO:tasks.workunit.client.1.smithi133.stdout:4/649: creat d3/d7/d6d/fda x:0 0 0 2023-12-16T07:40:43.471 INFO:tasks.workunit.client.1.smithi133.stdout:0/453: rename d2/d17/d2b/d31/d36 to d2/d9/d8f 0 2023-12-16T07:40:43.474 INFO:tasks.workunit.client.1.smithi133.stdout:9/472: creat d15/d42/d8d/f9e x:0 0 0 2023-12-16T07:40:43.475 INFO:tasks.workunit.client.1.smithi133.stdout:9/473: dread d15/d18/d2c/f4c [0,4194304] 0 2023-12-16T07:40:43.478 INFO:tasks.workunit.client.1.smithi133.stdout:4/650: dread d3/f25 [0,4194304] 0 2023-12-16T07:40:43.478 INFO:tasks.workunit.client.1.smithi133.stdout:4/651: write d3/d7/d38/dd5/d63/f93 [22813,91963] 0 2023-12-16T07:40:43.479 INFO:tasks.workunit.client.1.smithi133.stdout:7/728: creat db/d21/d2c/d31/dd2/feb x:0 0 0 2023-12-16T07:40:43.480 INFO:tasks.workunit.client.1.smithi133.stdout:8/431: mkdir d9/d10/d39/d48/d92 0 2023-12-16T07:40:43.482 INFO:tasks.workunit.client.1.smithi133.stdout:2/318: creat da/d1d/d24/d3a/d61/f68 x:0 0 0 2023-12-16T07:40:43.483 INFO:tasks.workunit.client.1.smithi133.stdout:5/367: rmdir d1/d18/d6f/d71 39 2023-12-16T07:40:43.485 INFO:tasks.workunit.client.1.smithi133.stdout:3/342: creat d7/d8/d1d/d2a/f94 x:0 0 0 2023-12-16T07:40:43.485 INFO:tasks.workunit.client.1.smithi133.stdout:3/343: chown d7/d8/d72/d77/f81 7 1 2023-12-16T07:40:43.489 INFO:tasks.workunit.client.1.smithi133.stdout:0/454: symlink d2/d9/d8f/l90 0 2023-12-16T07:40:43.489 INFO:tasks.workunit.client.1.smithi133.stdout:3/344: write d7/d8/d78/f5e [1848092,36079] 0 2023-12-16T07:40:43.489 INFO:tasks.workunit.client.1.smithi133.stdout:9/474: getdents d15/d18/d2c 0 2023-12-16T07:40:43.489 INFO:tasks.workunit.client.1.smithi133.stdout:9/475: truncate d15/d18/d80/f96 47260 0 2023-12-16T07:40:43.491 INFO:tasks.workunit.client.1.smithi133.stdout:8/432: dread d9/f6c [0,4194304] 0 2023-12-16T07:40:43.493 INFO:tasks.workunit.client.1.smithi133.stdout:8/433: write d9/d11/d33/f7e [2005938,114017] 0 2023-12-16T07:40:43.493 INFO:tasks.workunit.client.1.smithi133.stdout:8/434: chown d9/d10/d39/d48/d44/d6e/f7c 4120 1 2023-12-16T07:40:43.493 INFO:tasks.workunit.client.1.smithi133.stdout:8/435: write d9/d11/f16 [1756357,44441] 0 2023-12-16T07:40:43.495 INFO:tasks.workunit.client.1.smithi133.stdout:4/652: symlink d3/d7/d38/d57/d75/ldb 0 2023-12-16T07:40:43.495 INFO:tasks.workunit.client.1.smithi133.stdout:4/653: readlink d3/d7/d38/d57/d67/l7a 0 2023-12-16T07:40:43.497 INFO:tasks.workunit.client.1.smithi133.stdout:7/729: dwrite db/d3e/d4a/d58/d86/d8b/d8d/f95 [0,4194304] 0 2023-12-16T07:40:43.497 INFO:tasks.workunit.client.1.smithi133.stdout:7/730: fsync db/d21/f26 0 2023-12-16T07:40:43.501 INFO:tasks.workunit.client.1.smithi133.stdout:2/319: rmdir da/d1d/d60 39 2023-12-16T07:40:43.501 INFO:tasks.workunit.client.1.smithi133.stdout:2/320: chown da/d15/d17/f33 31 1 2023-12-16T07:40:43.504 INFO:tasks.workunit.client.1.smithi133.stdout:5/368: rename d1/de/d35/f85 to d1/de/d57/f8c 0 2023-12-16T07:40:43.507 INFO:tasks.workunit.client.1.smithi133.stdout:3/345: mkdir d7/d8/d1c/d7e/d95 0 2023-12-16T07:40:43.507 INFO:tasks.workunit.client.1.smithi133.stdout:3/346: dread - d7/d8/d1c/d2b/f7a zero size 2023-12-16T07:40:43.509 INFO:tasks.workunit.client.1.smithi133.stdout:8/436: dwrite d9/d10/f74 [0,4194304] 0 2023-12-16T07:40:43.510 INFO:tasks.workunit.client.1.smithi133.stdout:9/476: symlink d15/d18/d2c/d68/l9f 0 2023-12-16T07:40:43.510 INFO:tasks.workunit.client.1.smithi133.stdout:9/477: write d15/d18/d5b/d71/d78/d6e/f75 [1681409,130623] 0 2023-12-16T07:40:43.510 INFO:tasks.workunit.client.1.smithi133.stdout:9/478: write d15/d18/d2c/f33 [4245016,110964] 0 2023-12-16T07:40:43.512 INFO:tasks.workunit.client.1.smithi133.stdout:0/455: dwrite d2/d17/d2b/f77 [0,4194304] 0 2023-12-16T07:40:43.512 INFO:tasks.workunit.client.1.smithi133.stdout:0/456: readlink d2/d17/d2b/d31/l62 0 2023-12-16T07:40:43.512 INFO:tasks.workunit.client.1.smithi133.stdout:0/457: fsync d2/d9/db/fe 0 2023-12-16T07:40:43.515 INFO:tasks.workunit.client.1.smithi133.stdout:9/479: write d15/d18/d2c/d68/f7f [73996,26572] 0 2023-12-16T07:40:43.516 INFO:tasks.workunit.client.1.smithi133.stdout:7/731: creat db/d3e/d4a/fec x:0 0 0 2023-12-16T07:40:43.520 INFO:tasks.workunit.client.1.smithi133.stdout:2/321: symlink da/d1d/d24/l69 0 2023-12-16T07:40:43.521 INFO:tasks.workunit.client.1.smithi133.stdout:2/322: write da/d1d/d24/d2e/d47/d52/f63 [626440,42497] 0 2023-12-16T07:40:43.521 INFO:tasks.workunit.client.1.smithi133.stdout:2/323: fdatasync da/d1d/f46 0 2023-12-16T07:40:43.521 INFO:tasks.workunit.client.1.smithi133.stdout:2/324: readlink da/d1d/d60/l65 0 2023-12-16T07:40:43.524 INFO:tasks.workunit.client.1.smithi133.stdout:7/732: dread db/f7b [0,4194304] 0 2023-12-16T07:40:43.524 INFO:tasks.workunit.client.1.smithi133.stdout:7/733: stat db/d21/d2c/d31/d59/l77 0 2023-12-16T07:40:43.524 INFO:tasks.workunit.client.1.smithi133.stdout:4/654: rename d3/f8c to d3/d7/d1c/d2a/d91/dbe/fdc 0 2023-12-16T07:40:43.528 INFO:tasks.workunit.client.1.smithi133.stdout:5/369: mkdir d1/d1c/d80/d8d 0 2023-12-16T07:40:43.530 INFO:tasks.workunit.client.1.smithi133.stdout:8/437: dwrite d9/d10/d39/d48/d44/f6b [0,4194304] 0 2023-12-16T07:40:43.541 INFO:tasks.workunit.client.1.smithi133.stdout:9/480: dwrite d15/d18/d2c/d68/f83 [0,4194304] 0 2023-12-16T07:40:43.542 INFO:tasks.workunit.client.1.smithi133.stdout:2/325: creat da/d1d/f6a x:0 0 0 2023-12-16T07:40:43.542 INFO:tasks.workunit.client.1.smithi133.stdout:2/326: chown da/d1d/d24/d2e/l3c 4 1 2023-12-16T07:40:43.547 INFO:tasks.workunit.client.1.smithi133.stdout:3/347: mkdir d7/d8/d96 0 2023-12-16T07:40:43.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/438: mknod d9/c93 0 2023-12-16T07:40:43.552 INFO:tasks.workunit.client.1.smithi133.stdout:8/439: chown d9/dc/f3c 149963545 1 2023-12-16T07:40:43.552 INFO:tasks.workunit.client.1.smithi133.stdout:8/440: stat d9/dc/de/l5b 0 2023-12-16T07:40:43.552 INFO:tasks.workunit.client.1.smithi133.stdout:5/370: dwrite d1/d1c/d80/f81 [0,4194304] 0 2023-12-16T07:40:43.552 INFO:tasks.workunit.client.1.smithi133.stdout:5/371: fdatasync d1/de/d57/d74/d89/f8b 0 2023-12-16T07:40:43.552 INFO:tasks.workunit.client.1.smithi133.stdout:5/372: write d1/de/d57/d74/d89/f8b [688132,119183] 0 2023-12-16T07:40:43.553 INFO:tasks.workunit.client.1.smithi133.stdout:8/441: write d9/f1c [1441171,10238] 0 2023-12-16T07:40:43.558 INFO:tasks.workunit.client.1.smithi133.stdout:2/327: dwrite da/d1d/f21 [0,4194304] 0 2023-12-16T07:40:43.564 INFO:tasks.workunit.client.1.smithi133.stdout:3/348: link d7/d8/d1d/f33 d7/d8/d72/d77/f97 0 2023-12-16T07:40:43.564 INFO:tasks.workunit.client.1.smithi133.stdout:3/349: stat d7/d8/d1c/f48 0 2023-12-16T07:40:43.565 INFO:tasks.workunit.client.1.smithi133.stdout:4/655: getdents d3/d7/d1c/d2a/d91/dbe 0 2023-12-16T07:40:43.572 INFO:tasks.workunit.client.1.smithi133.stdout:8/442: creat d9/d10/d39/d48/d44/d6e/f94 x:0 0 0 2023-12-16T07:40:43.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/373: dwrite d1/de/d35/f37 [0,4194304] 0 2023-12-16T07:40:43.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/374: chown d1/fb 3946 1 2023-12-16T07:40:43.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/375: dread - d1/de/d52/f78 zero size 2023-12-16T07:40:43.578 INFO:tasks.workunit.client.1.smithi133.stdout:2/328: mknod da/d1d/d24/d3a/d61/c6b 0 2023-12-16T07:40:43.580 INFO:tasks.workunit.client.1.smithi133.stdout:9/481: creat d15/d18/d2c/d3a/d8a/fa0 x:0 0 0 2023-12-16T07:40:43.582 INFO:tasks.workunit.client.1.smithi133.stdout:8/443: creat d9/d10/d39/d48/d92/f95 x:0 0 0 2023-12-16T07:40:43.582 INFO:tasks.workunit.client.1.smithi133.stdout:8/444: dread - d9/f6a zero size 2023-12-16T07:40:43.583 INFO:tasks.workunit.client.1.smithi133.stdout:3/350: dwrite d7/d8/f10 [0,4194304] 0 2023-12-16T07:40:43.587 INFO:tasks.workunit.client.1.smithi133.stdout:5/376: rmdir d1/de/d57/d74/d89 39 2023-12-16T07:40:43.588 INFO:tasks.workunit.client.1.smithi133.stdout:4/656: dwrite d3/d7/f86 [0,4194304] 0 2023-12-16T07:40:43.589 INFO:tasks.workunit.client.1.smithi133.stdout:4/657: chown d3/d7/d38/d57/f66 220310 1 2023-12-16T07:40:43.589 INFO:tasks.workunit.client.1.smithi133.stdout:4/658: fsync d3/d7/d38/f3d 0 2023-12-16T07:40:43.590 INFO:tasks.workunit.client.1.smithi133.stdout:2/329: symlink da/d1d/d24/l6c 0 2023-12-16T07:40:43.594 INFO:tasks.workunit.client.1.smithi133.stdout:9/482: mknod d15/d18/d5b/ca1 0 2023-12-16T07:40:43.594 INFO:tasks.workunit.client.1.smithi133.stdout:8/445: dread d9/d10/d39/d48/f68 [0,4194304] 0 2023-12-16T07:40:43.595 INFO:tasks.workunit.client.1.smithi133.stdout:9/483: write d15/f29 [71617,123391] 0 2023-12-16T07:40:43.596 INFO:tasks.workunit.client.1.smithi133.stdout:4/659: dread d3/d7/d1a/faf [0,4194304] 0 2023-12-16T07:40:43.596 INFO:tasks.workunit.client.1.smithi133.stdout:4/660: readlink d3/d7/d1c/db0/dc8/l8b 0 2023-12-16T07:40:43.596 INFO:tasks.workunit.client.1.smithi133.stdout:3/351: getdents d7/d8/d1c/d2b 0 2023-12-16T07:40:43.597 INFO:tasks.workunit.client.1.smithi133.stdout:3/352: truncate d7/d8/d1c/f38 1618524 0 2023-12-16T07:40:43.597 INFO:tasks.workunit.client.1.smithi133.stdout:5/377: dread d1/d18/f47 [0,4194304] 0 2023-12-16T07:40:43.598 INFO:tasks.workunit.client.1.smithi133.stdout:2/330: mknod da/d15/d1b/d43/c6d 0 2023-12-16T07:40:43.598 INFO:tasks.workunit.client.1.smithi133.stdout:2/331: write da/fd [1705435,3745] 0 2023-12-16T07:40:43.599 INFO:tasks.workunit.client.1.smithi133.stdout:2/332: chown da/d15/d17/l39 47553960 1 2023-12-16T07:40:43.600 INFO:tasks.workunit.client.1.smithi133.stdout:3/353: dread d7/d8/d72/d77/f97 [0,4194304] 0 2023-12-16T07:40:43.600 INFO:tasks.workunit.client.1.smithi133.stdout:3/354: dread - d7/d8/d1d/f57 zero size 2023-12-16T07:40:43.602 INFO:tasks.workunit.client.1.smithi133.stdout:8/446: symlink d9/dc/l96 0 2023-12-16T07:40:43.602 INFO:tasks.workunit.client.1.smithi133.stdout:8/447: dread - d9/d10/d39/d48/d44/f89 zero size 2023-12-16T07:40:43.603 INFO:tasks.workunit.client.1.smithi133.stdout:9/484: symlink d15/d18/d80/d97/la2 0 2023-12-16T07:40:43.606 INFO:tasks.workunit.client.1.smithi133.stdout:4/661: symlink d3/d7/d1c/db0/dc8/ldd 0 2023-12-16T07:40:43.608 INFO:tasks.workunit.client.1.smithi133.stdout:3/355: link d7/f23 d7/d8/d78/d43/d7f/d85/f98 0 2023-12-16T07:40:43.609 INFO:tasks.workunit.client.1.smithi133.stdout:2/333: dread f1 [0,4194304] 0 2023-12-16T07:40:43.609 INFO:tasks.workunit.client.1.smithi133.stdout:2/334: write da/fe [1467798,41302] 0 2023-12-16T07:40:43.611 INFO:tasks.workunit.client.1.smithi133.stdout:8/448: creat d9/d10/f97 x:0 0 0 2023-12-16T07:40:43.611 INFO:tasks.workunit.client.1.smithi133.stdout:3/356: dread d7/d8/d78/f5d [0,4194304] 0 2023-12-16T07:40:43.612 INFO:tasks.workunit.client.1.smithi133.stdout:9/485: rmdir d15/d18/d80/d73 39 2023-12-16T07:40:43.612 INFO:tasks.workunit.client.1.smithi133.stdout:4/662: dread d3/d7/d1a/f24 [8388608,4194304] 0 2023-12-16T07:40:43.612 INFO:tasks.workunit.client.1.smithi133.stdout:4/663: write d3/d7/d38/d57/d67/fb2 [182903,123276] 0 2023-12-16T07:40:43.613 INFO:tasks.workunit.client.1.smithi133.stdout:8/449: write d9/d10/f8e [1272464,125108] 0 2023-12-16T07:40:43.613 INFO:tasks.workunit.client.1.smithi133.stdout:4/664: write d3/d7/f2e [2182623,430] 0 2023-12-16T07:40:43.613 INFO:tasks.workunit.client.1.smithi133.stdout:4/665: write d3/d7/d38/d57/d67/fb2 [1234019,100831] 0 2023-12-16T07:40:43.614 INFO:tasks.workunit.client.1.smithi133.stdout:4/666: stat d3/c6 0 2023-12-16T07:40:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: pgmap v18: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 39 MiB/s rd, 79 MiB/s wr, 200 op/s 2023-12-16T07:40:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: Adjusting osd_memory_target on smithi133 to 2592M 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:40:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:43 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:40:43.621 INFO:tasks.workunit.client.1.smithi133.stdout:2/335: mkdir da/d1d/d24/d2e/d47/d52/d6e 0 2023-12-16T07:40:43.623 INFO:tasks.workunit.client.1.smithi133.stdout:5/378: dwrite d1/d1c/f51 [0,4194304] 0 2023-12-16T07:40:43.624 INFO:tasks.workunit.client.1.smithi133.stdout:8/450: rmdir d9/d11/d88 0 2023-12-16T07:40:43.625 INFO:tasks.workunit.client.1.smithi133.stdout:2/336: write da/d15/d1b/f44 [70063,7243] 0 2023-12-16T07:40:43.625 INFO:tasks.workunit.client.1.smithi133.stdout:8/451: write d9/dc/d27/f2b [2225928,55548] 0 2023-12-16T07:40:43.625 INFO:tasks.workunit.client.1.smithi133.stdout:5/379: creat d1/de/d67/d7c/f8e x:0 0 0 2023-12-16T07:40:43.626 INFO:tasks.workunit.client.1.smithi133.stdout:5/380: stat d1/de/d67/d7c 0 2023-12-16T07:40:43.629 INFO:tasks.workunit.client.1.smithi133.stdout:8/452: link d9/dc/de/l73 d9/d10/l98 0 2023-12-16T07:40:43.629 INFO:tasks.workunit.client.1.smithi133.stdout:2/337: dread da/d15/d17/f2d [0,4194304] 0 2023-12-16T07:40:43.630 INFO:tasks.workunit.client.1.smithi133.stdout:5/381: creat d1/de/d67/d7c/f8f x:0 0 0 2023-12-16T07:40:43.634 INFO:tasks.workunit.client.1.smithi133.stdout:2/338: getdents da/d15/d17 0 2023-12-16T07:40:43.639 INFO:tasks.workunit.client.1.smithi133.stdout:4/667: dwrite d3/d7/d1a/f33 [0,4194304] 0 2023-12-16T07:40:43.645 INFO:tasks.workunit.client.1.smithi133.stdout:4/668: mknod d3/d7/d38/dd5/d63/cde 0 2023-12-16T07:40:43.646 INFO:tasks.workunit.client.1.smithi133.stdout:4/669: mknod d3/d7/d38/dd5/da7/daa/dc6/cdf 0 2023-12-16T07:40:43.646 INFO:tasks.workunit.client.1.smithi133.stdout:4/670: chown d3/d7/d38/l99 195416 1 2023-12-16T07:40:43.649 INFO:tasks.workunit.client.1.smithi133.stdout:9/486: dwrite d15/d18/d80/f98 [0,4194304] 0 2023-12-16T07:40:43.649 INFO:tasks.workunit.client.1.smithi133.stdout:4/671: write d3/d7/f1f [199025,67190] 0 2023-12-16T07:40:43.651 INFO:tasks.workunit.client.1.smithi133.stdout:3/357: getdents d7/d8/d78/d43/d7f/d85 0 2023-12-16T07:40:43.651 INFO:tasks.workunit.client.1.smithi133.stdout:2/339: dwrite da/d1d/d24/d3a/d5a/f5f [4194304,4194304] 0 2023-12-16T07:40:43.652 INFO:tasks.workunit.client.1.smithi133.stdout:8/453: dwrite d9/d11/d42/f4d [0,4194304] 0 2023-12-16T07:40:43.662 INFO:tasks.workunit.client.1.smithi133.stdout:4/672: creat d3/d7/d38/dd5/da7/dbb/fe0 x:0 0 0 2023-12-16T07:40:43.665 INFO:tasks.workunit.client.1.smithi133.stdout:3/358: mknod d7/d8/d1d/d2a/d62/c99 0 2023-12-16T07:40:43.666 INFO:tasks.workunit.client.1.smithi133.stdout:9/487: dwrite f14 [0,4194304] 0 2023-12-16T07:40:43.667 INFO:tasks.workunit.client.1.smithi133.stdout:2/340: unlink da/f23 0 2023-12-16T07:40:43.667 INFO:tasks.workunit.client.1.smithi133.stdout:2/341: chown da/d15/d1b/l4f 3257287 1 2023-12-16T07:40:43.668 INFO:tasks.workunit.client.1.smithi133.stdout:9/488: write d15/d18/d5b/d71/f89 [3837477,20142] 0 2023-12-16T07:40:43.669 INFO:tasks.workunit.client.1.smithi133.stdout:9/489: stat d15/d18/d80/f96 0 2023-12-16T07:40:43.669 INFO:tasks.workunit.client.1.smithi133.stdout:9/490: chown d15/d18/d2c/f31 252862 1 2023-12-16T07:40:43.674 INFO:tasks.workunit.client.1.smithi133.stdout:8/454: symlink d9/d10/d39/d48/d44/d6e/l99 0 2023-12-16T07:40:43.679 INFO:tasks.workunit.client.1.smithi133.stdout:9/491: truncate d15/d18/d2c/f33 98950 0 2023-12-16T07:40:43.680 INFO:tasks.workunit.client.1.smithi133.stdout:3/359: symlink d7/d8/l9a 0 2023-12-16T07:40:43.680 INFO:tasks.workunit.client.1.smithi133.stdout:3/360: readlink d7/d8/d78/l42 0 2023-12-16T07:40:43.685 INFO:tasks.workunit.client.1.smithi133.stdout:9/492: mkdir d15/d18/d2c/d68/da3 0 2023-12-16T07:40:43.690 INFO:tasks.workunit.client.1.smithi133.stdout:2/342: dwrite da/d15/d17/f36 [0,4194304] 0 2023-12-16T07:40:43.690 INFO:tasks.workunit.client.1.smithi133.stdout:2/343: chown da/d1d/d24/d2e/d47/d52 7 1 2023-12-16T07:40:43.692 INFO:tasks.workunit.client.1.smithi133.stdout:9/493: write d15/d18/d2c/d68/f83 [3385369,75170] 0 2023-12-16T07:40:43.692 INFO:tasks.workunit.client.1.smithi133.stdout:2/344: write da/f10 [3808812,36135] 0 2023-12-16T07:40:43.694 INFO:tasks.workunit.client.1.smithi133.stdout:9/494: mkdir d15/d18/d2c/d3a/da4 0 2023-12-16T07:40:43.694 INFO:tasks.workunit.client.1.smithi133.stdout:9/495: creat d15/d18/fa5 x:0 0 0 2023-12-16T07:40:43.695 INFO:tasks.workunit.client.1.smithi133.stdout:9/496: chown d15/f39 0 1 2023-12-16T07:40:43.697 INFO:tasks.workunit.client.1.smithi133.stdout:8/455: dwrite d9/d10/f8e [0,4194304] 0 2023-12-16T07:40:43.697 INFO:tasks.workunit.client.1.smithi133.stdout:8/456: stat d9/f41 0 2023-12-16T07:40:43.697 INFO:tasks.workunit.client.1.smithi133.stdout:4/673: dwrite d3/d7/d1c/d2a/f7c [8388608,4194304] 0 2023-12-16T07:40:43.699 INFO:tasks.workunit.client.1.smithi133.stdout:9/497: write d15/d18/f24 [2025519,97734] 0 2023-12-16T07:40:43.700 INFO:tasks.workunit.client.1.smithi133.stdout:4/674: symlink d3/le1 0 2023-12-16T07:40:43.704 INFO:tasks.workunit.client.1.smithi133.stdout:9/498: mkdir d15/d18/d2c/d68/da6 0 2023-12-16T07:40:43.704 INFO:tasks.workunit.client.1.smithi133.stdout:3/361: dwrite d7/d8/d1d/d2a/f3c [0,4194304] 0 2023-12-16T07:40:43.707 INFO:tasks.workunit.client.1.smithi133.stdout:4/675: creat d3/d7/d38/dd5/d63/fe2 x:0 0 0 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: pgmap v18: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 39 MiB/s rd, 79 MiB/s wr, 200 op/s 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-16T07:40:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: Adjusting osd_memory_target on smithi133 to 2592M 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:40:43.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:43 smithi049 ceph-mon[111939]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:40:43.710 INFO:tasks.workunit.client.1.smithi133.stdout:9/499: mknod d15/d18/d2c/d68/ca7 0 2023-12-16T07:40:43.712 INFO:tasks.workunit.client.1.smithi133.stdout:3/362: dread d7/f25 [0,4194304] 0 2023-12-16T07:40:43.716 INFO:tasks.workunit.client.1.smithi133.stdout:9/500: dread d15/f16 [0,4194304] 0 2023-12-16T07:40:43.717 INFO:tasks.workunit.client.1.smithi133.stdout:2/345: dread da/d15/d1b/f34 [0,4194304] 0 2023-12-16T07:40:43.722 INFO:tasks.workunit.client.1.smithi133.stdout:4/676: creat d3/d7/d38/dd5/da7/daa/dc6/fe3 x:0 0 0 2023-12-16T07:40:43.724 INFO:tasks.workunit.client.1.smithi133.stdout:8/457: dwrite d9/dc/d27/f76 [0,4194304] 0 2023-12-16T07:40:43.736 INFO:tasks.workunit.client.1.smithi133.stdout:9/501: link d15/f39 d15/d18/d4d/d7e/fa8 0 2023-12-16T07:40:43.738 INFO:tasks.workunit.client.1.smithi133.stdout:2/346: link da/d1d/d24/l6c da/d1d/d24/l6f 0 2023-12-16T07:40:43.738 INFO:tasks.workunit.client.1.smithi133.stdout:2/347: dread - da/f3d zero size 2023-12-16T07:40:43.744 INFO:tasks.workunit.client.1.smithi133.stdout:9/502: chown d15/d18/d2c/d3a/l69 6 1 2023-12-16T07:40:43.746 INFO:tasks.workunit.client.1.smithi133.stdout:8/458: link c4 d9/d11/c9a 0 2023-12-16T07:40:43.746 INFO:tasks.workunit.client.1.smithi133.stdout:8/459: dread - d9/d10/d39/d48/d44/d6e/f7c zero size 2023-12-16T07:40:43.747 INFO:tasks.workunit.client.1.smithi133.stdout:2/348: dread da/d1d/d24/d2e/f35 [0,4194304] 0 2023-12-16T07:40:43.747 INFO:tasks.workunit.client.1.smithi133.stdout:2/349: read - da/d1d/f6a zero size 2023-12-16T07:40:43.747 INFO:tasks.workunit.client.1.smithi133.stdout:9/503: mkdir d15/d42/d8d/da9 0 2023-12-16T07:40:43.748 INFO:tasks.workunit.client.1.smithi133.stdout:9/504: write f14 [2782102,100324] 0 2023-12-16T07:40:43.749 INFO:tasks.workunit.client.1.smithi133.stdout:8/460: rename d9/d10/d39/d48/d44/d6e/d78/f84 to d9/d11/d52/f9b 0 2023-12-16T07:40:43.749 INFO:tasks.workunit.client.1.smithi133.stdout:2/350: creat da/d15/d1b/f70 x:0 0 0 2023-12-16T07:40:43.750 INFO:tasks.workunit.client.1.smithi133.stdout:9/505: mknod d15/d18/d2c/caa 0 2023-12-16T07:40:43.750 INFO:tasks.workunit.client.1.smithi133.stdout:9/506: dread - d15/d18/d4d/f84 zero size 2023-12-16T07:40:43.751 INFO:tasks.workunit.client.1.smithi133.stdout:9/507: truncate d15/d42/f57 755897 0 2023-12-16T07:40:43.751 INFO:tasks.workunit.client.1.smithi133.stdout:9/508: chown d15/d18/f41 16 1 2023-12-16T07:40:43.751 INFO:tasks.workunit.client.1.smithi133.stdout:9/509: fdatasync d15/f17 0 2023-12-16T07:40:43.751 INFO:tasks.workunit.client.1.smithi133.stdout:9/510: write d15/d18/f2f [1551993,55573] 0 2023-12-16T07:40:43.751 INFO:tasks.workunit.client.1.smithi133.stdout:8/461: truncate d9/d2d/f34 10171 0 2023-12-16T07:40:43.753 INFO:tasks.workunit.client.1.smithi133.stdout:9/511: mkdir d15/d18/d4d/d94/dab 0 2023-12-16T07:40:43.754 INFO:tasks.workunit.client.1.smithi133.stdout:8/462: mkdir d9/d11/d33/d9c 0 2023-12-16T07:40:43.755 INFO:tasks.workunit.client.1.smithi133.stdout:8/463: fdatasync d9/d11/d42/f62 0 2023-12-16T07:40:43.755 INFO:tasks.workunit.client.1.smithi133.stdout:8/464: fdatasync d9/d10/d39/d48/d44/f89 0 2023-12-16T07:40:43.755 INFO:tasks.workunit.client.1.smithi133.stdout:8/465: readlink d9/d3f/l8d 0 2023-12-16T07:40:43.755 INFO:tasks.workunit.client.1.smithi133.stdout:8/466: dread - d9/d11/f7d zero size 2023-12-16T07:40:43.763 INFO:tasks.workunit.client.1.smithi133.stdout:8/467: rename d9/d11/d33/l43 to d9/d11/d33/d9c/l9d 0 2023-12-16T07:40:43.763 INFO:tasks.workunit.client.1.smithi133.stdout:8/468: fdatasync d9/d10/d39/d48/d44/d6e/f94 0 2023-12-16T07:40:43.765 INFO:tasks.workunit.client.1.smithi133.stdout:8/469: link d9/d11/l71 d9/dc/d27/l9e 0 2023-12-16T07:40:43.766 INFO:tasks.workunit.client.1.smithi133.stdout:8/470: mknod d9/d11/d42/c9f 0 2023-12-16T07:40:43.767 INFO:tasks.workunit.client.1.smithi133.stdout:8/471: write d9/f70 [127744,90258] 0 2023-12-16T07:40:43.767 INFO:tasks.workunit.client.1.smithi133.stdout:8/472: dread - d9/d10/f91 zero size 2023-12-16T07:40:43.767 INFO:tasks.workunit.client.1.smithi133.stdout:9/512: dwrite d15/d18/d2c/f4c [0,4194304] 0 2023-12-16T07:40:43.768 INFO:tasks.workunit.client.1.smithi133.stdout:8/473: mknod d9/d85/ca0 0 2023-12-16T07:40:43.768 INFO:tasks.workunit.client.1.smithi133.stdout:8/474: fdatasync d9/d11/d42/f4d 0 2023-12-16T07:40:43.768 INFO:tasks.workunit.client.1.smithi133.stdout:8/475: chown d9/d11/f38 782896 1 2023-12-16T07:40:43.768 INFO:tasks.workunit.client.1.smithi133.stdout:8/476: fdatasync d9/f2e 0 2023-12-16T07:40:43.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/513: readlink d15/d18/d2c/d3a/l53 0 2023-12-16T07:40:43.772 INFO:tasks.workunit.client.1.smithi133.stdout:9/514: creat d15/fac x:0 0 0 2023-12-16T07:40:43.775 INFO:tasks.workunit.client.1.smithi133.stdout:9/515: rmdir d15/d18/d80/d97 39 2023-12-16T07:40:43.779 INFO:tasks.workunit.client.1.smithi133.stdout:9/516: unlink d15/d18/d5b/f6d 0 2023-12-16T07:40:43.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/517: truncate d15/f39 15722 0 2023-12-16T07:40:43.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/518: fsync d15/d18/d2c/f31 0 2023-12-16T07:40:43.785 INFO:tasks.workunit.client.1.smithi133.stdout:9/519: creat d15/d18/d2c/fad x:0 0 0 2023-12-16T07:40:43.790 INFO:tasks.workunit.client.1.smithi133.stdout:9/520: dread d15/d18/d2c/d3a/f74 [0,4194304] 0 2023-12-16T07:40:43.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/521: symlink d15/lae 0 2023-12-16T07:40:43.808 INFO:tasks.workunit.client.1.smithi133.stdout:9/522: dwrite d15/d18/d4d/d7e/f9d [0,4194304] 0 2023-12-16T07:40:43.817 INFO:tasks.workunit.client.1.smithi133.stdout:6/675: sync 2023-12-16T07:40:43.817 INFO:tasks.workunit.client.1.smithi133.stdout:1/527: sync 2023-12-16T07:40:43.817 INFO:tasks.workunit.client.1.smithi133.stdout:1/528: chown d0/d12/d51/dac/d24/d32/d56/d59/d66/f85 32210 1 2023-12-16T07:40:43.818 INFO:tasks.workunit.client.1.smithi133.stdout:9/523: truncate d15/d42/f57 191123 0 2023-12-16T07:40:43.818 INFO:tasks.workunit.client.1.smithi133.stdout:9/524: write d15/d18/fa5 [244121,61590] 0 2023-12-16T07:40:43.851 INFO:tasks.workunit.client.1.smithi133.stdout:6/676: dwrite d0/d4/d21/d60/fbb [0,4194304] 0 2023-12-16T07:40:43.856 INFO:tasks.workunit.client.1.smithi133.stdout:9/525: dwrite d15/d18/f41 [0,4194304] 0 2023-12-16T07:40:43.856 INFO:tasks.workunit.client.1.smithi133.stdout:6/677: creat d0/d4/d21/d8a/d93/fdf x:0 0 0 2023-12-16T07:40:43.857 INFO:tasks.workunit.client.1.smithi133.stdout:6/678: read d0/d5e/f76 [1519301,28844] 0 2023-12-16T07:40:43.862 INFO:tasks.workunit.client.1.smithi133.stdout:9/526: rename d15/d18/d5b/d71/d78/d6e/d9b/f9c to d15/d18/d2c/d68/da3/faf 0 2023-12-16T07:40:43.863 INFO:tasks.workunit.client.1.smithi133.stdout:9/527: chown d15/c3b 1 1 2023-12-16T07:40:43.869 INFO:tasks.workunit.client.1.smithi133.stdout:9/528: link d15/d18/f41 d15/d18/d5b/fb0 0 2023-12-16T07:40:43.871 INFO:tasks.workunit.client.1.smithi133.stdout:9/529: creat d15/fb1 x:0 0 0 2023-12-16T07:40:43.875 INFO:tasks.workunit.client.1.smithi133.stdout:9/530: mkdir d15/d18/d2c/d68/db2 0 2023-12-16T07:40:43.879 INFO:tasks.workunit.client.1.smithi133.stdout:6/679: dwrite d0/d4/d21/d60/fbb [0,4194304] 0 2023-12-16T07:40:43.879 INFO:tasks.workunit.client.1.smithi133.stdout:6/680: truncate d0/d5e/d75/dad/fc1 747348 0 2023-12-16T07:40:43.879 INFO:tasks.workunit.client.1.smithi133.stdout:6/681: write d0/d4/fae [721441,39197] 0 2023-12-16T07:40:43.887 INFO:tasks.workunit.client.1.smithi133.stdout:6/682: mknod d0/d4/d21/d8a/d93/ce0 0 2023-12-16T07:40:43.887 INFO:tasks.workunit.client.1.smithi133.stdout:9/531: rmdir d15/d18/d4d/d94 39 2023-12-16T07:40:43.889 INFO:tasks.workunit.client.1.smithi133.stdout:6/683: creat d0/d4/d21/d8a/ddc/fe1 x:0 0 0 2023-12-16T07:40:43.918 INFO:tasks.workunit.client.1.smithi133.stdout:6/684: dwrite d0/d4/d21/f39 [0,4194304] 0 2023-12-16T07:40:43.920 INFO:tasks.workunit.client.1.smithi133.stdout:6/685: write d0/d4/fae [688683,111774] 0 2023-12-16T07:40:43.924 INFO:tasks.workunit.client.1.smithi133.stdout:6/686: mknod d0/d4/ce2 0 2023-12-16T07:40:43.932 INFO:tasks.workunit.client.1.smithi133.stdout:6/687: truncate d0/d4/f1c 746190 0 2023-12-16T07:40:43.933 INFO:tasks.workunit.client.1.smithi133.stdout:6/688: fdatasync d0/d4/d21/d35/d4e/d84/d69/fc8 0 2023-12-16T07:40:43.933 INFO:tasks.workunit.client.1.smithi133.stdout:6/689: chown d0/d4/d21/d35/ld0 24450888 1 2023-12-16T07:40:43.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/690: creat d0/d4/d21/d35/d7e/fe3 x:0 0 0 2023-12-16T07:40:43.942 INFO:tasks.workunit.client.1.smithi133.stdout:6/691: link d0/d4/d21/d8a/d93/fa9 d0/d4/d21/d8a/d93/fe4 0 2023-12-16T07:40:43.947 INFO:tasks.workunit.client.1.smithi133.stdout:6/692: symlink d0/d4/d21/d62/le5 0 2023-12-16T07:40:43.947 INFO:tasks.workunit.client.1.smithi133.stdout:6/693: truncate d0/d4/d21/d8a/d93/d8e/fbe 1239733 0 2023-12-16T07:40:43.948 INFO:tasks.workunit.client.1.smithi133.stdout:6/694: write d0/fcd [591512,60241] 0 2023-12-16T07:40:43.948 INFO:tasks.workunit.client.1.smithi133.stdout:6/695: fdatasync d0/d4/d21/d8a/d93/fd4 0 2023-12-16T07:40:43.959 INFO:tasks.workunit.client.1.smithi133.stdout:6/696: dread d0/d4/d21/f87 [0,4194304] 0 2023-12-16T07:40:43.960 INFO:tasks.workunit.client.1.smithi133.stdout:6/697: stat d0/d4/d21/d35/d4e/d84/c4b 0 2023-12-16T07:40:43.962 INFO:tasks.workunit.client.1.smithi133.stdout:6/698: mknod d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/ce6 0 2023-12-16T07:40:43.966 INFO:tasks.workunit.client.1.smithi133.stdout:6/699: mkdir d0/d4/d21/d62/de7 0 2023-12-16T07:40:43.967 INFO:tasks.workunit.client.1.smithi133.stdout:6/700: write d0/d4/f1c [375182,18775] 0 2023-12-16T07:40:43.968 INFO:tasks.workunit.client.1.smithi133.stdout:6/701: read d0/d4/d21/d35/f48 [253251,23784] 0 2023-12-16T07:40:43.968 INFO:tasks.workunit.client.1.smithi133.stdout:6/702: chown d0/d5e/d8c/dc5/fc7 1782 1 2023-12-16T07:40:43.968 INFO:tasks.workunit.client.1.smithi133.stdout:6/703: fsync d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/fda 0 2023-12-16T07:40:43.968 INFO:tasks.workunit.client.1.smithi133.stdout:6/704: write d0/d4/d21/d35/fc6 [551773,26165] 0 2023-12-16T07:40:43.985 INFO:tasks.workunit.client.1.smithi133.stdout:6/705: dwrite d0/d4/f47 [0,4194304] 0 2023-12-16T07:40:43.987 INFO:tasks.workunit.client.1.smithi133.stdout:6/706: rename d0/d4/c38 to d0/d4/d21/d35/d4e/ce8 0 2023-12-16T07:40:43.990 INFO:tasks.workunit.client.1.smithi133.stdout:6/707: unlink d0/d4/d21/d35/f48 0 2023-12-16T07:40:43.990 INFO:tasks.workunit.client.1.smithi133.stdout:6/708: chown d0/d5e/d75/d81/f86 2 1 2023-12-16T07:40:43.990 INFO:tasks.workunit.client.1.smithi133.stdout:6/709: fsync d0/d4/d21/f59 0 2023-12-16T07:40:44.011 INFO:tasks.workunit.client.1.smithi133.stdout:6/710: dwrite d0/d4/d21/d8a/d93/fe4 [0,4194304] 0 2023-12-16T07:40:44.015 INFO:tasks.workunit.client.1.smithi133.stdout:6/711: rename d0/d4/d21/d8a/d93/fd4 to d0/d5e/d75/dcf/fe9 0 2023-12-16T07:40:44.016 INFO:tasks.workunit.client.1.smithi133.stdout:6/712: symlink d0/d5e/d75/d81/d99/lea 0 2023-12-16T07:40:44.017 INFO:tasks.workunit.client.1.smithi133.stdout:6/713: read d0/d4/d21/d35/d4e/d84/fb3 [2311120,121471] 0 2023-12-16T07:40:44.020 INFO:tasks.workunit.client.1.smithi133.stdout:6/714: rename d0/d5e/d75/d81/d99/ld8 to d0/d4/d21/d60/leb 0 2023-12-16T07:40:44.020 INFO:tasks.workunit.client.1.smithi133.stdout:6/715: chown d0/d4/d21/d35/d4e/l7f 97549252 1 2023-12-16T07:40:44.041 INFO:tasks.workunit.client.1.smithi133.stdout:6/716: dwrite d0/d5e/d75/d81/f86 [0,4194304] 0 2023-12-16T07:40:44.056 INFO:tasks.workunit.client.1.smithi133.stdout:6/717: dwrite d0/d4/d21/d60/f89 [0,4194304] 0 2023-12-16T07:40:44.063 INFO:tasks.workunit.client.1.smithi133.stdout:6/718: unlink d0/d4/d21/d8a/d93/f82 0 2023-12-16T07:40:44.064 INFO:tasks.workunit.client.1.smithi133.stdout:6/719: mkdir d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/dec 0 2023-12-16T07:40:44.065 INFO:tasks.workunit.client.1.smithi133.stdout:6/720: chown d0/d4/d21/d35/d7e/cbc 24318642 1 2023-12-16T07:40:44.127 INFO:tasks.workunit.client.1.smithi133.stdout:0/458: sync 2023-12-16T07:40:44.127 INFO:tasks.workunit.client.1.smithi133.stdout:7/734: sync 2023-12-16T07:40:44.127 INFO:tasks.workunit.client.1.smithi133.stdout:5/382: sync 2023-12-16T07:40:44.127 INFO:tasks.workunit.client.1.smithi133.stdout:0/459: stat d2/d9/d20/f29 0 2023-12-16T07:40:44.127 INFO:tasks.workunit.client.1.smithi133.stdout:7/735: chown db/d21/d2c/d31/d59 1933630436 1 2023-12-16T07:40:44.128 INFO:tasks.workunit.client.1.smithi133.stdout:5/383: write d1/d1c/d80/f81 [2387238,111274] 0 2023-12-16T07:40:44.128 INFO:tasks.workunit.client.1.smithi133.stdout:0/460: link d2/d9/d20/f44 d2/d9/db/f91 0 2023-12-16T07:40:44.128 INFO:tasks.workunit.client.1.smithi133.stdout:0/461: write d2/d9/d12/f65 [216144,39430] 0 2023-12-16T07:40:44.128 INFO:tasks.workunit.client.1.smithi133.stdout:0/462: truncate d2/d17/d2b/d67/f73 1082650 0 2023-12-16T07:40:44.129 INFO:tasks.workunit.client.1.smithi133.stdout:7/736: mknod db/d3e/d4a/d58/d86/d8b/d8d/ced 0 2023-12-16T07:40:44.129 INFO:tasks.workunit.client.1.smithi133.stdout:7/737: chown db/f33 16483648 1 2023-12-16T07:40:44.130 INFO:tasks.workunit.client.1.smithi133.stdout:7/738: creat db/d21/d2c/d31/dd2/fee x:0 0 0 2023-12-16T07:40:44.136 INFO:tasks.workunit.client.1.smithi133.stdout:5/384: dread d1/d18/f63 [0,4194304] 0 2023-12-16T07:40:44.151 INFO:tasks.workunit.client.1.smithi133.stdout:0/463: dwrite d2/d17/d2b/f77 [0,4194304] 0 2023-12-16T07:40:44.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/739: dwrite db/d21/f23 [0,4194304] 0 2023-12-16T07:40:44.153 INFO:tasks.workunit.client.1.smithi133.stdout:0/464: unlink d2/d17/f2e 0 2023-12-16T07:40:44.154 INFO:tasks.workunit.client.1.smithi133.stdout:7/740: mkdir db/d3e/d4a/d58/d86/d8b/def 0 2023-12-16T07:40:44.157 INFO:tasks.workunit.client.1.smithi133.stdout:0/465: rename d2/d9/d12/d35/d48 to d2/d9/d20/d5e/d92 0 2023-12-16T07:40:44.159 INFO:tasks.workunit.client.1.smithi133.stdout:7/741: symlink db/d21/d2c/lf0 0 2023-12-16T07:40:44.159 INFO:tasks.workunit.client.1.smithi133.stdout:7/742: stat db/l54 0 2023-12-16T07:40:44.159 INFO:tasks.workunit.client.1.smithi133.stdout:7/743: fdatasync db/d21/d2c/f56 0 2023-12-16T07:40:44.159 INFO:tasks.workunit.client.1.smithi133.stdout:7/744: chown db/d21/d2c/d31/c46 32167206 1 2023-12-16T07:40:44.160 INFO:tasks.workunit.client.1.smithi133.stdout:0/466: mkdir d2/d9/d12/d35/d4f/d93 0 2023-12-16T07:40:44.185 INFO:tasks.workunit.client.1.smithi133.stdout:7/745: dwrite db/fe9 [0,4194304] 0 2023-12-16T07:40:44.185 INFO:tasks.workunit.client.1.smithi133.stdout:7/746: truncate db/d3e/d4a/d58/fc3 911265 0 2023-12-16T07:40:44.186 INFO:tasks.workunit.client.1.smithi133.stdout:7/747: stat db/d12/ld0 0 2023-12-16T07:40:44.186 INFO:tasks.workunit.client.1.smithi133.stdout:7/748: chown db/d21/d2c 0 1 2023-12-16T07:40:44.186 INFO:tasks.workunit.client.1.smithi133.stdout:0/467: dwrite d2/f8 [0,4194304] 0 2023-12-16T07:40:44.187 INFO:tasks.workunit.client.1.smithi133.stdout:0/468: write d2/d9/d12/d35/f8b [630264,79504] 0 2023-12-16T07:40:44.191 INFO:tasks.workunit.client.1.smithi133.stdout:0/469: unlink d2/d9/d8f/l90 0 2023-12-16T07:40:44.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/470: truncate d2/d9/d20/d5e/d92/f3d 11319586 0 2023-12-16T07:40:44.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/471: getdents d2/d17/d2b/d31/d4d 0 2023-12-16T07:40:44.195 INFO:tasks.workunit.client.1.smithi133.stdout:0/472: write d2/d17/f1b [149543,47931] 0 2023-12-16T07:40:44.197 INFO:tasks.workunit.client.1.smithi133.stdout:0/473: mknod d2/d9/d20/d5e/d92/c94 0 2023-12-16T07:40:44.197 INFO:tasks.workunit.client.1.smithi133.stdout:0/474: dread - d2/d9/d12/d45/f86 zero size 2023-12-16T07:40:44.197 INFO:tasks.workunit.client.1.smithi133.stdout:0/475: fdatasync d2/f8 0 2023-12-16T07:40:44.198 INFO:tasks.workunit.client.1.smithi133.stdout:0/476: creat d2/d9/d12/d35/f95 x:0 0 0 2023-12-16T07:40:44.200 INFO:tasks.workunit.client.1.smithi133.stdout:7/749: dwrite db/d3e/f7f [0,4194304] 0 2023-12-16T07:40:44.200 INFO:tasks.workunit.client.1.smithi133.stdout:0/477: mknod d2/d17/d2b/d31/d7f/c96 0 2023-12-16T07:40:44.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/750: rename db/d12/c1a to db/d3e/d4a/cf1 0 2023-12-16T07:40:44.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/751: fdatasync db/d21/d2c/dbc/fc5 0 2023-12-16T07:40:44.206 INFO:tasks.workunit.client.1.smithi133.stdout:7/752: write db/d3e/f4f [625775,121780] 0 2023-12-16T07:40:44.210 INFO:tasks.workunit.client.1.smithi133.stdout:7/753: unlink db/d21/d2c/d31/f3f 0 2023-12-16T07:40:44.210 INFO:tasks.workunit.client.1.smithi133.stdout:7/754: chown db/d21/f2a 1 1 2023-12-16T07:40:44.211 INFO:tasks.workunit.client.1.smithi133.stdout:7/755: write db/f1c [1800363,87206] 0 2023-12-16T07:40:44.211 INFO:tasks.workunit.client.1.smithi133.stdout:0/478: rename d2/d9/c16 to d2/d9/d20/d5e/d92/c97 0 2023-12-16T07:40:44.234 INFO:tasks.workunit.client.1.smithi133.stdout:7/756: dwrite db/d21/d2c/d31/d6e/fb6 [0,4194304] 0 2023-12-16T07:40:44.234 INFO:tasks.workunit.client.1.smithi133.stdout:7/757: chown db/d12/f5e 520 1 2023-12-16T07:40:44.234 INFO:tasks.workunit.client.1.smithi133.stdout:7/758: write db/d12/d98/fa2 [232799,116632] 0 2023-12-16T07:40:44.236 INFO:tasks.workunit.client.1.smithi133.stdout:0/479: dwrite d2/d9/db/f6c [4194304,4194304] 0 2023-12-16T07:40:44.237 INFO:tasks.workunit.client.1.smithi133.stdout:7/759: creat db/d3e/d4a/d58/ff2 x:0 0 0 2023-12-16T07:40:44.244 INFO:tasks.workunit.client.1.smithi133.stdout:0/480: dread d2/d17/d2b/f4b [0,4194304] 0 2023-12-16T07:40:44.247 INFO:tasks.workunit.client.1.smithi133.stdout:0/481: mkdir d2/d17/d2b/d31/d63/d98 0 2023-12-16T07:40:44.249 INFO:tasks.workunit.client.1.smithi133.stdout:0/482: symlink d2/d9/d12/d76/l99 0 2023-12-16T07:40:44.252 INFO:tasks.workunit.client.1.smithi133.stdout:0/483: creat d2/d17/d2b/d31/d4d/f9a x:0 0 0 2023-12-16T07:40:44.252 INFO:tasks.workunit.client.1.smithi133.stdout:0/484: chown d2/d9 29488511 1 2023-12-16T07:40:44.257 INFO:tasks.workunit.client.1.smithi133.stdout:7/760: dwrite db/d3e/d4a/f7c [4194304,4194304] 0 2023-12-16T07:40:44.259 INFO:tasks.workunit.client.1.smithi133.stdout:7/761: truncate db/f67 390536 0 2023-12-16T07:40:44.259 INFO:tasks.workunit.client.1.smithi133.stdout:7/762: chown db/f1c 48899 1 2023-12-16T07:40:44.260 INFO:tasks.workunit.client.1.smithi133.stdout:7/763: creat db/d3e/d4a/d58/d86/d8b/d8d/ff3 x:0 0 0 2023-12-16T07:40:44.263 INFO:tasks.workunit.client.1.smithi133.stdout:7/764: rename db/d21/d2c/lf0 to db/d12/d3a/d6c/dc8/dd9/lf4 0 2023-12-16T07:40:44.266 INFO:tasks.workunit.client.1.smithi133.stdout:7/765: rename db/d21/d2c/d31/d59/l77 to db/d12/lf5 0 2023-12-16T07:40:44.266 INFO:tasks.workunit.client.1.smithi133.stdout:7/766: chown db 578520391 1 2023-12-16T07:40:44.269 INFO:tasks.workunit.client.1.smithi133.stdout:0/485: dwrite d2/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:44.273 INFO:tasks.workunit.client.1.smithi133.stdout:0/486: rename d2/d9/d12/d45/f86 to d2/f9b 0 2023-12-16T07:40:44.274 INFO:tasks.workunit.client.1.smithi133.stdout:0/487: fdatasync d2/d9/d12/f3f 0 2023-12-16T07:40:44.277 INFO:tasks.workunit.client.1.smithi133.stdout:0/488: mknod d2/d17/d2b/d67/c9c 0 2023-12-16T07:40:44.277 INFO:tasks.workunit.client.1.smithi133.stdout:0/489: getdents d2/d17/d2b/d31/d4d/d54 0 2023-12-16T07:40:44.280 INFO:tasks.workunit.client.1.smithi133.stdout:0/490: symlink d2/d9/l9d 0 2023-12-16T07:40:44.281 INFO:tasks.workunit.client.1.smithi133.stdout:7/767: dwrite db/d12/fcb [0,4194304] 0 2023-12-16T07:40:44.281 INFO:tasks.workunit.client.1.smithi133.stdout:0/491: truncate d2/d9/d20/d5e/d92/f3d 4599094 0 2023-12-16T07:40:44.283 INFO:tasks.workunit.client.1.smithi133.stdout:0/492: write d2/d9/db/f6c [4281057,111737] 0 2023-12-16T07:40:44.284 INFO:tasks.workunit.client.1.smithi133.stdout:7/768: rename db/d3e/d4a/d58/l96 to db/d21/d2c/d31/d59/de7/lf6 0 2023-12-16T07:40:44.287 INFO:tasks.workunit.client.1.smithi133.stdout:0/493: unlink d2/d9/d20/f2c 0 2023-12-16T07:40:44.290 INFO:tasks.workunit.client.1.smithi133.stdout:7/769: rename db/dd4 to db/d12/d3a/df7 0 2023-12-16T07:40:44.290 INFO:tasks.workunit.client.1.smithi133.stdout:4/677: sync 2023-12-16T07:40:44.290 INFO:tasks.workunit.client.1.smithi133.stdout:3/363: sync 2023-12-16T07:40:44.292 INFO:tasks.workunit.client.1.smithi133.stdout:0/494: unlink d2/d9/db/f55 0 2023-12-16T07:40:44.292 INFO:tasks.workunit.client.1.smithi133.stdout:0/495: dread - d2/d17/d2b/d31/d4d/f9a zero size 2023-12-16T07:40:44.292 INFO:tasks.workunit.client.1.smithi133.stdout:0/496: read d2/d17/d2b/f4b [154821,14574] 0 2023-12-16T07:40:44.293 INFO:tasks.workunit.client.1.smithi133.stdout:3/364: symlink d7/d8/d78/d43/d7f/l9b 0 2023-12-16T07:40:44.293 INFO:tasks.workunit.client.1.smithi133.stdout:3/365: readlink d7/d8/d1d/l45 0 2023-12-16T07:40:44.295 INFO:tasks.workunit.client.1.smithi133.stdout:0/497: mkdir d2/d9/d12/d45/d9e 0 2023-12-16T07:40:44.296 INFO:tasks.workunit.client.1.smithi133.stdout:3/366: creat d7/d8/d1c/d2b/f9c x:0 0 0 2023-12-16T07:40:44.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/498: creat d2/d17/d40/f9f x:0 0 0 2023-12-16T07:40:44.298 INFO:tasks.workunit.client.1.smithi133.stdout:0/499: chown d2/d17/d2b/d31/c3e 22 1 2023-12-16T07:40:44.298 INFO:tasks.workunit.client.1.smithi133.stdout:0/500: truncate d2/f9b 849665 0 2023-12-16T07:40:44.298 INFO:tasks.workunit.client.1.smithi133.stdout:0/501: stat d2 0 2023-12-16T07:40:44.299 INFO:tasks.workunit.client.1.smithi133.stdout:3/367: rename d7/d8/d1c/d2b/l3d to d7/d8/d72/d77/l9d 0 2023-12-16T07:40:44.300 INFO:tasks.workunit.client.1.smithi133.stdout:4/678: dread d3/f5d [0,4194304] 0 2023-12-16T07:40:44.302 INFO:tasks.workunit.client.1.smithi133.stdout:3/368: truncate d7/f1b 2117899 0 2023-12-16T07:40:44.304 INFO:tasks.workunit.client.1.smithi133.stdout:4/679: mkdir d3/d7/d38/d57/d75/de4 0 2023-12-16T07:40:44.304 INFO:tasks.workunit.client.1.smithi133.stdout:7/770: dread db/d21/f23 [0,4194304] 0 2023-12-16T07:40:44.309 INFO:tasks.workunit.client.1.smithi133.stdout:3/369: dread d7/d8/d78/f34 [0,4194304] 0 2023-12-16T07:40:44.309 INFO:tasks.workunit.client.1.smithi133.stdout:4/680: rename d3/c9a to d3/d7/ce5 0 2023-12-16T07:40:44.309 INFO:tasks.workunit.client.1.smithi133.stdout:4/681: read d3/d7/d38/dd5/f78 [345424,65019] 0 2023-12-16T07:40:44.310 INFO:tasks.workunit.client.1.smithi133.stdout:7/771: mknod db/d3e/d4a/d58/d86/da8/cf8 0 2023-12-16T07:40:44.310 INFO:tasks.workunit.client.1.smithi133.stdout:7/772: fdatasync db/d21/f5b 0 2023-12-16T07:40:44.311 INFO:tasks.workunit.client.1.smithi133.stdout:4/682: write d3/d7/d1c/db0/dc8/f65 [1196799,20883] 0 2023-12-16T07:40:44.314 INFO:tasks.workunit.client.1.smithi133.stdout:3/370: mknod d7/d8/d1c/d2b/d2d/c9e 0 2023-12-16T07:40:44.319 INFO:tasks.workunit.client.1.smithi133.stdout:7/773: mkdir db/d12/d3a/db5/df9 0 2023-12-16T07:40:44.320 INFO:tasks.workunit.client.1.smithi133.stdout:0/502: fsync d2/d17/d40/f9f 0 2023-12-16T07:40:44.323 INFO:tasks.workunit.client.1.smithi133.stdout:4/683: creat d3/d7/d38/dd5/da7/dbb/fe6 x:0 0 0 2023-12-16T07:40:44.331 INFO:tasks.workunit.client.1.smithi133.stdout:4/684: dread d3/d7/d38/dd5/f77 [0,4194304] 0 2023-12-16T07:40:44.331 INFO:tasks.workunit.client.1.smithi133.stdout:4/685: write d3/d7/d1a/f26 [744982,94633] 0 2023-12-16T07:40:44.332 INFO:tasks.workunit.client.1.smithi133.stdout:3/371: dwrite d7/d8/f20 [0,4194304] 0 2023-12-16T07:40:44.340 INFO:tasks.workunit.client.1.smithi133.stdout:7/774: truncate db/f7b 1530262 0 2023-12-16T07:40:44.341 INFO:tasks.workunit.client.1.smithi133.stdout:0/503: mkdir d2/d9/d12/d45/d9e/da0 0 2023-12-16T07:40:44.343 INFO:tasks.workunit.client.1.smithi133.stdout:4/686: getdents d3/d7/d1c 0 2023-12-16T07:40:44.346 INFO:tasks.workunit.client.1.smithi133.stdout:3/372: link d7/d8/d78/f5e d7/d8/d1c/d7e/d95/f9f 0 2023-12-16T07:40:44.347 INFO:tasks.workunit.client.1.smithi133.stdout:7/775: rename db/d21/d2c/d31/d79/le3 to db/d12/d3a/d6c/lfa 0 2023-12-16T07:40:44.350 INFO:tasks.workunit.client.1.smithi133.stdout:4/687: getdents d3/d7/d38/dd5/da7/dbb 0 2023-12-16T07:40:44.350 INFO:tasks.workunit.client.1.smithi133.stdout:4/688: fsync d3/d7/d1c/db0/dc8/f65 0 2023-12-16T07:40:44.350 INFO:tasks.workunit.client.1.smithi133.stdout:4/689: write d3/d7/d38/dd5/f55 [4616083,127997] 0 2023-12-16T07:40:44.351 INFO:tasks.workunit.client.1.smithi133.stdout:7/776: truncate db/d3e/d4a/f60 1546518 0 2023-12-16T07:40:44.351 INFO:tasks.workunit.client.1.smithi133.stdout:7/777: chown db/d3e/d4a/d58/d86/da9/fe5 107146140 1 2023-12-16T07:40:44.352 INFO:tasks.workunit.client.1.smithi133.stdout:4/690: getdents d3/d7/d38/dd5/da7/daa 0 2023-12-16T07:40:44.354 INFO:tasks.workunit.client.1.smithi133.stdout:7/778: mkdir db/d3e/d4a/dfb 0 2023-12-16T07:40:44.356 INFO:tasks.workunit.client.1.smithi133.stdout:4/691: symlink d3/d7/d38/dd5/da7/dbb/dd8/le7 0 2023-12-16T07:40:44.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/373: dread d7/d8/d1c/d7e/d95/f9f [0,4194304] 0 2023-12-16T07:40:44.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/374: truncate d7/d8/d1d/f90 882169 0 2023-12-16T07:40:44.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/375: write d7/d8/f75 [271870,48602] 0 2023-12-16T07:40:44.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/376: chown d7/d8/d78/f69 7900937 1 2023-12-16T07:40:44.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/377: fsync d7/d8/d1c/f31 0 2023-12-16T07:40:44.357 INFO:tasks.workunit.client.1.smithi133.stdout:7/779: truncate db/d3e/f69 3443237 0 2023-12-16T07:40:44.360 INFO:tasks.workunit.client.1.smithi133.stdout:0/504: dwrite d2/d17/d2b/d31/d4d/f53 [0,4194304] 0 2023-12-16T07:40:44.365 INFO:tasks.workunit.client.1.smithi133.stdout:0/505: getdents d2/d9/d12/d35 0 2023-12-16T07:40:44.370 INFO:tasks.workunit.client.1.smithi133.stdout:7/780: dread db/d3e/d4a/d58/d86/fb3 [0,4194304] 0 2023-12-16T07:40:44.371 INFO:tasks.workunit.client.1.smithi133.stdout:7/781: mknod db/d3e/d4a/dfb/cfc 0 2023-12-16T07:40:44.374 INFO:tasks.workunit.client.1.smithi133.stdout:7/782: mkdir db/d3e/d4a/d58/d86/d8b/dfd 0 2023-12-16T07:40:44.374 INFO:tasks.workunit.client.1.smithi133.stdout:4/692: dread d3/d7/d1a/f26 [0,4194304] 0 2023-12-16T07:40:44.374 INFO:tasks.workunit.client.1.smithi133.stdout:7/783: truncate db/f85 4372990 0 2023-12-16T07:40:44.377 INFO:tasks.workunit.client.1.smithi133.stdout:7/784: unlink db/d3e/d4a/d58/d86/da8/cf8 0 2023-12-16T07:40:44.378 INFO:tasks.workunit.client.1.smithi133.stdout:3/378: dwrite d7/f8e [4194304,4194304] 0 2023-12-16T07:40:44.378 INFO:tasks.workunit.client.1.smithi133.stdout:0/506: dread d2/d17/d2b/d31/d4d/f53 [0,4194304] 0 2023-12-16T07:40:44.378 INFO:tasks.workunit.client.1.smithi133.stdout:4/693: mkdir d3/d7/d1c/d2a/d91/dbe/dd0/de8 0 2023-12-16T07:40:44.382 INFO:tasks.workunit.client.1.smithi133.stdout:7/785: creat db/d21/d2c/d31/d79/ffe x:0 0 0 2023-12-16T07:40:44.384 INFO:tasks.workunit.client.1.smithi133.stdout:3/379: creat d7/d8/d1c/fa0 x:0 0 0 2023-12-16T07:40:44.384 INFO:tasks.workunit.client.1.smithi133.stdout:3/380: fsync d7/d8/f84 0 2023-12-16T07:40:44.386 INFO:tasks.workunit.client.1.smithi133.stdout:4/694: rename d3/d7/d38/dd5/f9f to d3/d7/d6d/d89/dbf/fe9 0 2023-12-16T07:40:44.388 INFO:tasks.workunit.client.1.smithi133.stdout:3/381: dread d7/d8/d78/f34 [0,4194304] 0 2023-12-16T07:40:44.394 INFO:tasks.workunit.client.1.smithi133.stdout:7/786: creat db/d3e/d4a/d58/d86/d8b/def/fff x:0 0 0 2023-12-16T07:40:44.395 INFO:tasks.workunit.client.1.smithi133.stdout:3/382: creat d7/d8/d78/d43/d7f/d85/d8f/fa1 x:0 0 0 2023-12-16T07:40:44.395 INFO:tasks.workunit.client.1.smithi133.stdout:3/383: dread - d7/d8/d1c/fa0 zero size 2023-12-16T07:40:44.396 INFO:tasks.workunit.client.1.smithi133.stdout:7/787: symlink db/d3e/d4a/dfb/l100 0 2023-12-16T07:40:44.396 INFO:tasks.workunit.client.1.smithi133.stdout:7/788: fsync db/d12/d3a/df7/fd6 0 2023-12-16T07:40:44.397 INFO:tasks.workunit.client.1.smithi133.stdout:3/384: mkdir d7/d8/d1d/d2a/da2 0 2023-12-16T07:40:44.397 INFO:tasks.workunit.client.1.smithi133.stdout:7/789: write db/d12/d3a/d6c/fc9 [2251516,117632] 0 2023-12-16T07:40:44.399 INFO:tasks.workunit.client.1.smithi133.stdout:7/790: write db/d3e/d4a/d58/d86/fa4 [46755,115662] 0 2023-12-16T07:40:44.401 INFO:tasks.workunit.client.1.smithi133.stdout:4/695: dwrite d3/d7/d1c/d2a/f7f [0,4194304] 0 2023-12-16T07:40:44.402 INFO:tasks.workunit.client.1.smithi133.stdout:7/791: link db/fe db/d21/d2c/d31/d79/f101 0 2023-12-16T07:40:44.404 INFO:tasks.workunit.client.1.smithi133.stdout:7/792: mknod db/d21/d2c/d31/dd2/c102 0 2023-12-16T07:40:44.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/793: creat db/d12/d3a/d6c/f103 x:0 0 0 2023-12-16T07:40:44.407 INFO:tasks.workunit.client.1.smithi133.stdout:7/794: read db/d21/f26 [8201971,120802] 0 2023-12-16T07:40:44.407 INFO:tasks.workunit.client.1.smithi133.stdout:7/795: readlink db/d3e/lde 0 2023-12-16T07:40:44.408 INFO:tasks.workunit.client.1.smithi133.stdout:7/796: creat db/f104 x:0 0 0 2023-12-16T07:40:44.409 INFO:tasks.workunit.client.1.smithi133.stdout:7/797: read db/d21/d2c/d31/fce [165348,27586] 0 2023-12-16T07:40:44.410 INFO:tasks.workunit.client.1.smithi133.stdout:7/798: symlink db/d3e/d4a/l105 0 2023-12-16T07:40:44.413 INFO:tasks.workunit.client.1.smithi133.stdout:7/799: dread db/f7b [0,4194304] 0 2023-12-16T07:40:44.413 INFO:tasks.workunit.client.1.smithi133.stdout:7/800: readlink db/d3e/l4d 0 2023-12-16T07:40:44.413 INFO:tasks.workunit.client.1.smithi133.stdout:7/801: chown db/d21/d2c/d31/d79/dcf 812137 1 2023-12-16T07:40:44.416 INFO:tasks.workunit.client.1.smithi133.stdout:4/696: dwrite d3/d7/d1a/f27 [0,4194304] 0 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:4/697: rename d3/c6 to d3/cea 0 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:7/802: write db/d3e/d4a/d58/db9/fc2 [743060,9631] 0 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:7/803: truncate db/d12/fbf 1237099 0 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:4/698: write d3/d7/d38/d57/d67/fc1 [713606,96338] 0 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:4/699: fdatasync d3/d7/d1a/f33 0 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:4/700: chown d3/d7/d38/d57/c60 30052929 1 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:4/701: chown d3/d7/d6d/d89 8444 1 2023-12-16T07:40:44.418 INFO:tasks.workunit.client.1.smithi133.stdout:4/702: dread - d3/d7/d1c/d2a/d91/dbe/fd4 zero size 2023-12-16T07:40:44.419 INFO:tasks.workunit.client.1.smithi133.stdout:3/385: dwrite d7/d8/f20 [0,4194304] 0 2023-12-16T07:40:44.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/386: creat d7/d8/d1c/d7e/fa3 x:0 0 0 2023-12-16T07:40:44.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/387: chown d7/d8/d1c/d7e 5 1 2023-12-16T07:40:44.430 INFO:tasks.workunit.client.1.smithi133.stdout:3/388: getdents d7/d8/d1c/d2b/d2d 0 2023-12-16T07:40:44.433 INFO:tasks.workunit.client.1.smithi133.stdout:3/389: dread d7/d8/fe [0,4194304] 0 2023-12-16T07:40:44.435 INFO:tasks.workunit.client.1.smithi133.stdout:3/390: mknod d7/d8/d1d/d2a/da2/ca4 0 2023-12-16T07:40:44.435 INFO:tasks.workunit.client.1.smithi133.stdout:3/391: chown d7/d8/d78/f5d 415 1 2023-12-16T07:40:44.451 INFO:tasks.workunit.client.1.smithi133.stdout:7/804: dwrite db/f85 [0,4194304] 0 2023-12-16T07:40:44.465 INFO:tasks.workunit.client.1.smithi133.stdout:7/805: dwrite db/d21/d2c/d31/fab [0,4194304] 0 2023-12-16T07:40:44.521 INFO:tasks.workunit.client.1.smithi133.stdout:8/477: sync 2023-12-16T07:40:44.521 INFO:tasks.workunit.client.1.smithi133.stdout:2/351: sync 2023-12-16T07:40:44.521 INFO:tasks.workunit.client.1.smithi133.stdout:8/478: stat d9/d10/f3a 0 2023-12-16T07:40:44.522 INFO:tasks.workunit.client.1.smithi133.stdout:8/479: dread d9/dc/d27/f4f [0,4194304] 0 2023-12-16T07:40:44.523 INFO:tasks.workunit.client.1.smithi133.stdout:8/480: write d9/d11/f38 [406649,15809] 0 2023-12-16T07:40:44.523 INFO:tasks.workunit.client.1.smithi133.stdout:8/481: fdatasync d9/d11/d33/f7e 0 2023-12-16T07:40:44.541 INFO:tasks.workunit.client.1.smithi133.stdout:7/806: creat db/d3e/d4a/d58/d86/f106 x:0 0 0 2023-12-16T07:40:44.542 INFO:tasks.workunit.client.1.smithi133.stdout:2/352: truncate da/f64 2146902 0 2023-12-16T07:40:44.546 INFO:tasks.workunit.client.1.smithi133.stdout:8/482: rmdir d9/d10/d39 39 2023-12-16T07:40:44.546 INFO:tasks.workunit.client.1.smithi133.stdout:8/483: truncate d9/dc/d27/f4f 493233 0 2023-12-16T07:40:44.547 INFO:tasks.workunit.client.1.smithi133.stdout:8/484: creat d9/d10/d39/fa1 x:0 0 0 2023-12-16T07:40:44.549 INFO:tasks.workunit.client.1.smithi133.stdout:2/353: dread da/d1d/d24/d2e/f57 [0,4194304] 0 2023-12-16T07:40:44.550 INFO:tasks.workunit.client.1.smithi133.stdout:8/485: truncate d9/d2d/f8a 6413634 0 2023-12-16T07:40:44.552 INFO:tasks.workunit.client.1.smithi133.stdout:2/354: unlink da/d15/d17/l19 0 2023-12-16T07:40:44.557 INFO:tasks.workunit.client.1.smithi133.stdout:2/355: rename da/d1d/d24 to da/d1d/d60/d71 0 2023-12-16T07:40:44.558 INFO:tasks.workunit.client.1.smithi133.stdout:7/807: dwrite db/d3e/f69 [0,4194304] 0 2023-12-16T07:40:44.558 INFO:tasks.workunit.client.1.smithi133.stdout:7/808: chown db/d3e/d4a/ld7 2309285 1 2023-12-16T07:40:44.558 INFO:tasks.workunit.client.1.smithi133.stdout:2/356: getdents da/d15/d1b/d43 0 2023-12-16T07:40:44.561 INFO:tasks.workunit.client.1.smithi133.stdout:7/809: creat db/d3e/d4a/d58/d86/db8/f107 x:0 0 0 2023-12-16T07:40:44.561 INFO:tasks.workunit.client.1.smithi133.stdout:7/810: dread - db/d3e/d4a/d58/ff2 zero size 2023-12-16T07:40:44.562 INFO:tasks.workunit.client.1.smithi133.stdout:2/357: truncate da/d1d/f21 2111073 0 2023-12-16T07:40:44.565 INFO:tasks.workunit.client.1.smithi133.stdout:2/358: creat da/d1d/f72 x:0 0 0 2023-12-16T07:40:44.565 INFO:tasks.workunit.client.1.smithi133.stdout:8/486: dwrite d9/f3e [0,4194304] 0 2023-12-16T07:40:44.565 INFO:tasks.workunit.client.1.smithi133.stdout:2/359: chown da/d15 1 1 2023-12-16T07:40:44.565 INFO:tasks.workunit.client.1.smithi133.stdout:8/487: dread - d9/d11/d52/f9b zero size 2023-12-16T07:40:44.571 INFO:tasks.workunit.client.1.smithi133.stdout:2/360: mkdir da/d1d/d60/d71/d3a/d61/d73 0 2023-12-16T07:40:44.572 INFO:tasks.workunit.client.1.smithi133.stdout:2/361: read da/f10 [1376069,107155] 0 2023-12-16T07:40:44.572 INFO:tasks.workunit.client.1.smithi133.stdout:8/488: creat d9/d85/fa2 x:0 0 0 2023-12-16T07:40:44.572 INFO:tasks.workunit.client.1.smithi133.stdout:8/489: chown d9/d11/d42/f80 133 1 2023-12-16T07:40:44.573 INFO:tasks.workunit.client.1.smithi133.stdout:2/362: write da/d1d/d60/d71/d3a/d5a/f5f [6148875,81680] 0 2023-12-16T07:40:44.577 INFO:tasks.workunit.client.1.smithi133.stdout:8/490: rename d9/d10/d39/d48/c5f to d9/d85/ca3 0 2023-12-16T07:40:44.577 INFO:tasks.workunit.client.1.smithi133.stdout:8/491: chown d9/f2e 4284 1 2023-12-16T07:40:44.579 INFO:tasks.workunit.client.1.smithi133.stdout:2/363: dread da/d1d/f29 [0,4194304] 0 2023-12-16T07:40:44.579 INFO:tasks.workunit.client.1.smithi133.stdout:2/364: chown da/d1d/d60/d71/d2e/d47/c62 0 1 2023-12-16T07:40:44.579 INFO:tasks.workunit.client.1.smithi133.stdout:2/365: write da/d1d/f46 [1292156,39950] 0 2023-12-16T07:40:44.580 INFO:tasks.workunit.client.1.smithi133.stdout:2/366: mkdir da/d1d/d60/d74 0 2023-12-16T07:40:44.589 INFO:tasks.workunit.client.1.smithi133.stdout:2/367: dread da/d15/d1b/f34 [0,4194304] 0 2023-12-16T07:40:44.590 INFO:tasks.workunit.client.1.smithi133.stdout:2/368: creat da/d15/d1b/f75 x:0 0 0 2023-12-16T07:40:44.591 INFO:tasks.workunit.client.1.smithi133.stdout:2/369: mknod da/d1d/d60/d71/d2e/d47/d52/d6e/c76 0 2023-12-16T07:40:44.591 INFO:tasks.workunit.client.1.smithi133.stdout:2/370: chown da/d1d/d60/d71/l6c 105 1 2023-12-16T07:40:44.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/371: creat da/d1d/d60/d71/d3a/d61/f77 x:0 0 0 2023-12-16T07:40:44.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/372: stat da/d1d/d60/d71/d2e/c5b 0 2023-12-16T07:40:44.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/373: write da/d1d/f6a [503514,71881] 0 2023-12-16T07:40:44.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/374: fdatasync da/fe 0 2023-12-16T07:40:44.594 INFO:tasks.workunit.client.1.smithi133.stdout:2/375: readlink da/d1d/l1f 0 2023-12-16T07:40:44.595 INFO:tasks.workunit.client.1.smithi133.stdout:2/376: creat da/d15/d1b/f78 x:0 0 0 2023-12-16T07:40:44.599 INFO:tasks.workunit.client.1.smithi133.stdout:2/377: dread da/d1d/f32 [0,4194304] 0 2023-12-16T07:40:44.599 INFO:tasks.workunit.client.1.smithi133.stdout:2/378: read da/d1d/f46 [283095,100327] 0 2023-12-16T07:40:44.663 INFO:tasks.workunit.client.1.smithi133.stdout:1/529: sync 2023-12-16T07:40:44.664 INFO:tasks.workunit.client.1.smithi133.stdout:1/530: fsync d0/d12/d51/f64 0 2023-12-16T07:40:44.664 INFO:tasks.workunit.client.1.smithi133.stdout:1/531: write d0/d12/d51/dac/d24/d32/d3e/d70/d8f/fab [90979,117364] 0 2023-12-16T07:40:44.679 INFO:tasks.workunit.client.1.smithi133.stdout:1/532: dwrite d0/d12/d51/dac/d24/d32/f86 [0,4194304] 0 2023-12-16T07:40:44.696 INFO:tasks.workunit.client.1.smithi133.stdout:1/533: dwrite d0/d12/d51/dac/d24/d32/d56/d59/d66/fa9 [0,4194304] 0 2023-12-16T07:40:44.696 INFO:tasks.workunit.client.1.smithi133.stdout:1/534: fsync d0/f29 0 2023-12-16T07:40:44.696 INFO:tasks.workunit.client.1.smithi133.stdout:1/535: truncate d0/da/d3d/f50 1642377 0 2023-12-16T07:40:44.700 INFO:tasks.workunit.client.1.smithi133.stdout:1/536: getdents d0 0 2023-12-16T07:40:44.701 INFO:tasks.workunit.client.1.smithi133.stdout:1/537: rmdir d0/d12/d51/dac/d24/d32/d56/d59/d66 39 2023-12-16T07:40:44.706 INFO:tasks.workunit.client.1.smithi133.stdout:1/538: rename d0/d12/f1b to d0/faf 0 2023-12-16T07:40:44.706 INFO:tasks.workunit.client.1.smithi133.stdout:1/539: stat d0/d12/d51/dac/f2f 0 2023-12-16T07:40:44.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/540: symlink d0/d12/d51/dac/d24/d32/d3e/d70/d8f/lb0 0 2023-12-16T07:40:44.710 INFO:tasks.workunit.client.1.smithi133.stdout:1/541: creat d0/d12/d51/dac/d24/d32/d56/fb1 x:0 0 0 2023-12-16T07:40:44.711 INFO:tasks.workunit.client.1.smithi133.stdout:1/542: dread - d0/d12/d51/dac/d24/d5a/d68/fa5 zero size 2023-12-16T07:40:44.715 INFO:tasks.workunit.client.1.smithi133.stdout:1/543: dread d0/d12/d51/dac/d24/d32/d56/d59/d66/f74 [0,4194304] 0 2023-12-16T07:40:44.716 INFO:tasks.workunit.client.1.smithi133.stdout:1/544: stat d0/d12/d51/f9d 0 2023-12-16T07:40:44.716 INFO:tasks.workunit.client.1.smithi133.stdout:1/545: creat d0/d12/d51/dac/d24/d32/fb2 x:0 0 0 2023-12-16T07:40:44.717 INFO:tasks.workunit.client.1.smithi133.stdout:1/546: truncate d0/d12/f40 1572354 0 2023-12-16T07:40:44.718 INFO:tasks.workunit.client.1.smithi133.stdout:1/547: creat d0/d12/fb3 x:0 0 0 2023-12-16T07:40:44.720 INFO:tasks.workunit.client.1.smithi133.stdout:1/548: rename d0/d12/d51/c7f to d0/d12/d51/dac/d24/d32/d3e/cb4 0 2023-12-16T07:40:44.722 INFO:tasks.workunit.client.1.smithi133.stdout:1/549: dread d0/d1c/f5c [0,4194304] 0 2023-12-16T07:40:44.722 INFO:tasks.workunit.client.1.smithi133.stdout:0/507: sync 2023-12-16T07:40:44.722 INFO:tasks.workunit.client.1.smithi133.stdout:5/385: sync 2023-12-16T07:40:44.722 INFO:tasks.workunit.client.1.smithi133.stdout:6/721: sync 2023-12-16T07:40:44.722 INFO:tasks.workunit.client.1.smithi133.stdout:9/532: sync 2023-12-16T07:40:44.723 INFO:tasks.workunit.client.1.smithi133.stdout:9/533: truncate fc 3955607 0 2023-12-16T07:40:44.724 INFO:tasks.workunit.client.1.smithi133.stdout:6/722: mkdir d0/d4/d21/d35/d7e/ded 0 2023-12-16T07:40:44.724 INFO:tasks.workunit.client.1.smithi133.stdout:6/723: fsync d0/d4/d21/d35/d4e/d84/fb3 0 2023-12-16T07:40:44.726 INFO:tasks.workunit.client.1.smithi133.stdout:0/508: creat d2/d17/d2b/d31/d4d/fa1 x:0 0 0 2023-12-16T07:40:44.726 INFO:tasks.workunit.client.1.smithi133.stdout:0/509: fdatasync d2/f8 0 2023-12-16T07:40:44.726 INFO:tasks.workunit.client.1.smithi133.stdout:0/510: chown d2 21524 1 2023-12-16T07:40:44.727 INFO:tasks.workunit.client.1.smithi133.stdout:5/386: symlink d1/d1c/d80/d64/l90 0 2023-12-16T07:40:44.728 INFO:tasks.workunit.client.1.smithi133.stdout:5/387: write d1/d18/f42 [1348415,119907] 0 2023-12-16T07:40:44.728 INFO:tasks.workunit.client.1.smithi133.stdout:5/388: truncate d1/de/d57/d74/d89/f8b 1100100 0 2023-12-16T07:40:44.729 INFO:tasks.workunit.client.1.smithi133.stdout:1/550: dread d0/d1c/d37/f9e [0,4194304] 0 2023-12-16T07:40:44.742 INFO:tasks.workunit.client.1.smithi133.stdout:1/551: dwrite d0/d12/d51/dac/f35 [0,4194304] 0 2023-12-16T07:40:44.754 INFO:tasks.workunit.client.1.smithi133.stdout:1/552: dwrite d0/d12/d51/dac/d24/f6b [0,4194304] 0 2023-12-16T07:40:44.763 INFO:tasks.workunit.client.1.smithi133.stdout:1/553: dread d0/d12/d51/dac/d24/d32/d56/d59/d66/f85 [0,4194304] 0 2023-12-16T07:40:44.829 INFO:tasks.workunit.client.1.smithi133.stdout:9/534: symlink d15/d18/d80/d73/lb3 0 2023-12-16T07:40:44.831 INFO:tasks.workunit.client.1.smithi133.stdout:6/724: rename d0/d4/d21/d8a/ddc to d0/d4/dee 0 2023-12-16T07:40:44.834 INFO:tasks.workunit.client.1.smithi133.stdout:0/511: mkdir d2/d9/d20/d5e/d89/da2 0 2023-12-16T07:40:44.834 INFO:tasks.workunit.client.1.smithi133.stdout:0/512: chown d2/d17/l85 138 1 2023-12-16T07:40:44.836 INFO:tasks.workunit.client.1.smithi133.stdout:5/389: rmdir d1/de/d35 39 2023-12-16T07:40:44.841 INFO:tasks.workunit.client.1.smithi133.stdout:1/554: creat d0/da/fb5 x:0 0 0 2023-12-16T07:40:44.844 INFO:tasks.workunit.client.1.smithi133.stdout:9/535: mknod d15/d18/d4d/d94/cb4 0 2023-12-16T07:40:44.845 INFO:tasks.workunit.client.1.smithi133.stdout:9/536: write d15/d18/d5b/d71/f89 [4989626,129008] 0 2023-12-16T07:40:44.845 INFO:tasks.workunit.client.1.smithi133.stdout:1/555: read d0/d12/d51/dac/ff [3521908,111889] 0 2023-12-16T07:40:44.845 INFO:tasks.workunit.client.1.smithi133.stdout:6/725: dwrite d0/d4/d21/d35/d4e/d84/f70 [0,4194304] 0 2023-12-16T07:40:44.845 INFO:tasks.workunit.client.1.smithi133.stdout:6/726: chown d0/l5b 6300671 1 2023-12-16T07:40:44.846 INFO:tasks.workunit.client.1.smithi133.stdout:0/513: rename d2/f9b to d2/d9/d20/d5e/fa3 0 2023-12-16T07:40:44.846 INFO:tasks.workunit.client.1.smithi133.stdout:0/514: chown d2/d9/d8f 6 1 2023-12-16T07:40:44.848 INFO:tasks.workunit.client.1.smithi133.stdout:5/390: creat d1/d1c/f91 x:0 0 0 2023-12-16T07:40:44.849 INFO:tasks.workunit.client.1.smithi133.stdout:1/556: mkdir d0/d12/d51/db6 0 2023-12-16T07:40:44.853 INFO:tasks.workunit.client.1.smithi133.stdout:9/537: rename d15/d18/d4d/f6b to d15/d18/d2c/d68/da3/fb5 0 2023-12-16T07:40:44.853 INFO:tasks.workunit.client.1.smithi133.stdout:6/727: rename d0/d4/dee to d0/d4/dee/def 22 2023-12-16T07:40:44.854 INFO:tasks.workunit.client.1.smithi133.stdout:9/538: write d15/d18/d2c/d68/da3/fb5 [998727,21242] 0 2023-12-16T07:40:44.854 INFO:tasks.workunit.client.1.smithi133.stdout:9/539: write d15/d18/d4d/d7e/f95 [631615,93006] 0 2023-12-16T07:40:44.854 INFO:tasks.workunit.client.1.smithi133.stdout:9/540: write d15/d18/d2c/f93 [785288,93734] 0 2023-12-16T07:40:44.854 INFO:tasks.workunit.client.1.smithi133.stdout:0/515: unlink d2/d17/d2b/d67/c9c 0 2023-12-16T07:40:44.857 INFO:tasks.workunit.client.1.smithi133.stdout:0/516: dread d2/d9/d12/f65 [0,4194304] 0 2023-12-16T07:40:44.862 INFO:tasks.workunit.client.1.smithi133.stdout:1/557: creat d0/d12/d51/dac/d24/d32/d3e/fb7 x:0 0 0 2023-12-16T07:40:44.864 INFO:tasks.workunit.client.1.smithi133.stdout:5/391: link d1/de/d35/l68 d1/de/d67/l92 0 2023-12-16T07:40:44.864 INFO:tasks.workunit.client.1.smithi133.stdout:5/392: fsync d1/d18/f4e 0 2023-12-16T07:40:44.864 INFO:tasks.workunit.client.1.smithi133.stdout:5/393: chown d1/de/d67/d7c/f8e 354 1 2023-12-16T07:40:44.864 INFO:tasks.workunit.client.1.smithi133.stdout:5/394: dread - d1/d1c/d80/d64/f84 zero size 2023-12-16T07:40:44.864 INFO:tasks.workunit.client.1.smithi133.stdout:5/395: write d1/de/d52/f78 [855533,59194] 0 2023-12-16T07:40:44.872 INFO:tasks.workunit.client.1.smithi133.stdout:6/728: rmdir d0 39 2023-12-16T07:40:44.873 INFO:tasks.workunit.client.1.smithi133.stdout:1/558: unlink d0/d12/d51/dac/f35 0 2023-12-16T07:40:44.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/559: write d0/d1c/d37/f43 [2815085,40939] 0 2023-12-16T07:40:44.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/560: truncate d0/d12/d51/dac/f2f 3490705 0 2023-12-16T07:40:44.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/561: fdatasync d0/d1c/d37/f9e 0 2023-12-16T07:40:44.879 INFO:tasks.workunit.client.1.smithi133.stdout:9/541: dwrite d15/d18/d2c/d3a/f6f [0,4194304] 0 2023-12-16T07:40:44.879 INFO:tasks.workunit.client.1.smithi133.stdout:0/517: dwrite d2/d17/d40/f9f [0,4194304] 0 2023-12-16T07:40:44.881 INFO:tasks.workunit.client.1.smithi133.stdout:1/562: unlink d0/d12/d51/dac/d24/d32/d56/d59/d66/f85 0 2023-12-16T07:40:44.882 INFO:tasks.workunit.client.1.smithi133.stdout:5/396: dwrite d1/f75 [0,4194304] 0 2023-12-16T07:40:44.891 INFO:tasks.workunit.client.1.smithi133.stdout:9/542: mknod d15/d18/d80/cb6 0 2023-12-16T07:40:44.894 INFO:tasks.workunit.client.1.smithi133.stdout:0/518: getdents d2 0 2023-12-16T07:40:44.896 INFO:tasks.workunit.client.1.smithi133.stdout:1/563: creat d0/d1c/d9b/fb8 x:0 0 0 2023-12-16T07:40:44.897 INFO:tasks.workunit.client.1.smithi133.stdout:9/543: mkdir d15/d42/d8d/db7 0 2023-12-16T07:40:44.897 INFO:tasks.workunit.client.1.smithi133.stdout:9/544: dread - d15/d18/d2c/d68/da3/faf zero size 2023-12-16T07:40:44.897 INFO:tasks.workunit.client.1.smithi133.stdout:0/519: link d2/d9/d20/d5e/d92/c87 d2/d9/d12/d76/ca4 0 2023-12-16T07:40:44.898 INFO:tasks.workunit.client.1.smithi133.stdout:9/545: symlink d15/d42/d8d/lb8 0 2023-12-16T07:40:44.899 INFO:tasks.workunit.client.1.smithi133.stdout:0/520: creat d2/d17/d2b/fa5 x:0 0 0 2023-12-16T07:40:44.900 INFO:tasks.workunit.client.1.smithi133.stdout:9/546: symlink d15/lb9 0 2023-12-16T07:40:44.900 INFO:tasks.workunit.client.1.smithi133.stdout:0/521: symlink d2/d9/d12/d35/d4f/d93/la6 0 2023-12-16T07:40:44.900 INFO:tasks.workunit.client.1.smithi133.stdout:0/522: fdatasync d2/d17/d2b/f88 0 2023-12-16T07:40:44.902 INFO:tasks.workunit.client.1.smithi133.stdout:5/397: dwrite d1/f24 [4194304,4194304] 0 2023-12-16T07:40:44.902 INFO:tasks.workunit.client.1.smithi133.stdout:9/547: dread d15/d18/fa5 [0,4194304] 0 2023-12-16T07:40:44.902 INFO:tasks.workunit.client.1.smithi133.stdout:9/548: chown d15/d18/d4d/d7e/c91 1562667120 1 2023-12-16T07:40:44.902 INFO:tasks.workunit.client.1.smithi133.stdout:9/549: fsync d15/d18/d2c/d68/f8e 0 2023-12-16T07:40:44.902 INFO:tasks.workunit.client.1.smithi133.stdout:9/550: fdatasync d15/f16 0 2023-12-16T07:40:44.902 INFO:tasks.workunit.client.1.smithi133.stdout:5/398: write d1/f6b [1026675,130785] 0 2023-12-16T07:40:44.902 INFO:tasks.workunit.client.1.smithi133.stdout:6/729: dwrite d0/d4/d21/d35/d36/f9f [0,4194304] 0 2023-12-16T07:40:44.904 INFO:tasks.workunit.client.1.smithi133.stdout:9/551: mkdir d15/d18/d80/d97/dba 0 2023-12-16T07:40:44.908 INFO:tasks.workunit.client.1.smithi133.stdout:9/552: dread d15/f17 [0,4194304] 0 2023-12-16T07:40:44.909 INFO:tasks.workunit.client.1.smithi133.stdout:9/553: chown d15/d18/d80/d97/f9a 153724 1 2023-12-16T07:40:44.909 INFO:tasks.workunit.client.1.smithi133.stdout:0/523: dread d2/d17/f1b [0,4194304] 0 2023-12-16T07:40:44.912 INFO:tasks.workunit.client.1.smithi133.stdout:5/399: dread d1/fb [0,4194304] 0 2023-12-16T07:40:44.914 INFO:tasks.workunit.client.1.smithi133.stdout:0/524: mkdir d2/d17/d2b/d31/d4d/da7 0 2023-12-16T07:40:44.916 INFO:tasks.workunit.client.1.smithi133.stdout:9/554: link d15/d18/d2c/d3a/f3c d15/d18/d5b/d71/d78/d6e/d9b/fbb 0 2023-12-16T07:40:44.916 INFO:tasks.workunit.client.1.smithi133.stdout:9/555: write d15/d18/d5b/fb0 [4286771,45340] 0 2023-12-16T07:40:44.917 INFO:tasks.workunit.client.1.smithi133.stdout:0/525: stat d2/d9/l2f 0 2023-12-16T07:40:44.919 INFO:tasks.workunit.client.1.smithi133.stdout:9/556: symlink d15/d18/d2c/d68/lbc 0 2023-12-16T07:40:44.919 INFO:tasks.workunit.client.1.smithi133.stdout:9/557: chown l7 990345 1 2023-12-16T07:40:44.919 INFO:tasks.workunit.client.1.smithi133.stdout:9/558: stat l8 0 2023-12-16T07:40:44.926 INFO:tasks.workunit.client.1.smithi133.stdout:4/703: sync 2023-12-16T07:40:44.926 INFO:tasks.workunit.client.1.smithi133.stdout:4/704: stat d3/db6/fc7 0 2023-12-16T07:40:44.926 INFO:tasks.workunit.client.1.smithi133.stdout:3/392: sync 2023-12-16T07:40:44.926 INFO:tasks.workunit.client.1.smithi133.stdout:4/705: getdents d3/d7/d1c/d2a/d91/dbe 0 2023-12-16T07:40:44.926 INFO:tasks.workunit.client.1.smithi133.stdout:3/393: fdatasync d7/d8/d1d/f1e 0 2023-12-16T07:40:44.926 INFO:tasks.workunit.client.1.smithi133.stdout:4/706: chown d3/d7/d38/dd5/d63/fe2 17708 1 2023-12-16T07:40:44.927 INFO:tasks.workunit.client.1.smithi133.stdout:3/394: truncate d7/d8/d1c/f41 983925 0 2023-12-16T07:40:44.930 INFO:tasks.workunit.client.1.smithi133.stdout:6/730: dread d0/d4/f5c [0,4194304] 0 2023-12-16T07:40:44.930 INFO:tasks.workunit.client.1.smithi133.stdout:4/707: creat d3/d7/d38/dd5/dac/dbc/feb x:0 0 0 2023-12-16T07:40:44.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/708: stat d3/d7/d38/d57/d75/l97 0 2023-12-16T07:40:44.932 INFO:tasks.workunit.client.1.smithi133.stdout:0/526: dread d2/d9/d12/f3f [0,4194304] 0 2023-12-16T07:40:44.932 INFO:tasks.workunit.client.1.smithi133.stdout:3/395: creat d7/d8/d1c/fa5 x:0 0 0 2023-12-16T07:40:44.934 INFO:tasks.workunit.client.1.smithi133.stdout:0/527: creat d2/d9/d20/d5e/d89/fa8 x:0 0 0 2023-12-16T07:40:44.937 INFO:tasks.workunit.client.1.smithi133.stdout:6/731: dread d0/d4/d21/f87 [0,4194304] 0 2023-12-16T07:40:44.938 INFO:tasks.workunit.client.1.smithi133.stdout:0/528: unlink d2/d9/db/l1a 0 2023-12-16T07:40:44.938 INFO:tasks.workunit.client.1.smithi133.stdout:8/492: sync 2023-12-16T07:40:44.938 INFO:tasks.workunit.client.1.smithi133.stdout:7/811: sync 2023-12-16T07:40:44.938 INFO:tasks.workunit.client.1.smithi133.stdout:2/379: sync 2023-12-16T07:40:44.939 INFO:tasks.workunit.client.1.smithi133.stdout:5/400: dwrite d1/f6b [0,4194304] 0 2023-12-16T07:40:44.939 INFO:tasks.workunit.client.1.smithi133.stdout:5/401: stat d1/d4b 0 2023-12-16T07:40:44.939 INFO:tasks.workunit.client.1.smithi133.stdout:9/559: dwrite d15/d18/d2c/d3a/f6f [0,4194304] 0 2023-12-16T07:40:44.939 INFO:tasks.workunit.client.1.smithi133.stdout:3/396: rename d7/d8/d1c/d2b/d2d/l8a to d7/d8/la6 0 2023-12-16T07:40:44.941 INFO:tasks.workunit.client.1.smithi133.stdout:6/732: creat d0/ff0 x:0 0 0 2023-12-16T07:40:44.942 INFO:tasks.workunit.client.1.smithi133.stdout:0/529: link d2/d9/l9d d2/d9/d20/d5e/d89/da2/la9 0 2023-12-16T07:40:44.945 INFO:tasks.workunit.client.1.smithi133.stdout:8/493: creat d9/dc/de/fa4 x:0 0 0 2023-12-16T07:40:44.945 INFO:tasks.workunit.client.1.smithi133.stdout:7/812: creat db/d21/d2c/d31/d59/f108 x:0 0 0 2023-12-16T07:40:44.945 INFO:tasks.workunit.client.1.smithi133.stdout:7/813: readlink db/d12/l1d 0 2023-12-16T07:40:44.947 INFO:tasks.workunit.client.1.smithi133.stdout:2/380: link da/d1d/d60/d71/d3a/d61/f68 da/d1d/d60/d71/d3a/d61/f79 0 2023-12-16T07:40:44.949 INFO:tasks.workunit.client.1.smithi133.stdout:5/402: unlink d1/d4b/c5a 0 2023-12-16T07:40:44.949 INFO:tasks.workunit.client.1.smithi133.stdout:5/403: write d1/d18/d2c/f53 [915712,36585] 0 2023-12-16T07:40:44.951 INFO:tasks.workunit.client.1.smithi133.stdout:9/560: truncate d15/d18/f24 1455904 0 2023-12-16T07:40:44.951 INFO:tasks.workunit.client.1.smithi133.stdout:9/561: stat d15/d18/d4d/d94 0 2023-12-16T07:40:44.953 INFO:tasks.workunit.client.1.smithi133.stdout:3/397: creat d7/d8/d72/d86/fa7 x:0 0 0 2023-12-16T07:40:44.954 INFO:tasks.workunit.client.1.smithi133.stdout:8/494: dread d9/f6c [0,4194304] 0 2023-12-16T07:40:44.954 INFO:tasks.workunit.client.1.smithi133.stdout:8/495: write d9/d10/d39/d48/d44/d6e/f7c [868312,87814] 0 2023-12-16T07:40:44.955 INFO:tasks.workunit.client.1.smithi133.stdout:0/530: rename d2/d9/db/l1f to d2/d9/d20/laa 0 2023-12-16T07:40:44.956 INFO:tasks.workunit.client.1.smithi133.stdout:3/398: dread d7/d8/d78/f8b [0,4194304] 0 2023-12-16T07:40:44.956 INFO:tasks.workunit.client.1.smithi133.stdout:3/399: write d7/d8/f84 [940024,49036] 0 2023-12-16T07:40:44.956 INFO:tasks.workunit.client.1.smithi133.stdout:7/814: mknod db/d53/c109 0 2023-12-16T07:40:44.958 INFO:tasks.workunit.client.1.smithi133.stdout:2/381: symlink da/d1d/d60/d74/l7a 0 2023-12-16T07:40:44.960 INFO:tasks.workunit.client.1.smithi133.stdout:5/404: creat d1/d18/d6f/d71/f93 x:0 0 0 2023-12-16T07:40:44.961 INFO:tasks.workunit.client.1.smithi133.stdout:9/562: readlink d15/d18/d2c/d3a/l92 0 2023-12-16T07:40:44.963 INFO:tasks.workunit.client.1.smithi133.stdout:3/400: dread d7/d8/d1c/f50 [0,4194304] 0 2023-12-16T07:40:44.964 INFO:tasks.workunit.client.1.smithi133.stdout:6/733: link d0/d4/d21/d35/d36/c73 d0/d4/d21/d35/d4e/d84/d69/da1/cf1 0 2023-12-16T07:40:44.965 INFO:tasks.workunit.client.1.smithi133.stdout:6/734: write d0/d5e/d8c/f97 [4099884,39512] 0 2023-12-16T07:40:44.966 INFO:tasks.workunit.client.1.smithi133.stdout:8/496: rename d9/d11/d52/f5a to d9/d11/d42/fa5 0 2023-12-16T07:40:44.966 INFO:tasks.workunit.client.1.smithi133.stdout:8/497: write d9/d10/d39/d48/d44/d6e/f94 [918776,78196] 0 2023-12-16T07:40:44.967 INFO:tasks.workunit.client.1.smithi133.stdout:8/498: read d9/dc/d27/f4f [290200,3087] 0 2023-12-16T07:40:44.967 INFO:tasks.workunit.client.1.smithi133.stdout:8/499: write d9/f2e [4844053,71888] 0 2023-12-16T07:40:44.967 INFO:tasks.workunit.client.1.smithi133.stdout:8/500: chown d9/d10/d39/c4b 2765 1 2023-12-16T07:40:44.969 INFO:tasks.workunit.client.1.smithi133.stdout:0/531: symlink d2/d17/d2b/d31/d4d/lab 0 2023-12-16T07:40:44.970 INFO:tasks.workunit.client.1.smithi133.stdout:7/815: symlink db/d21/d2c/l10a 0 2023-12-16T07:40:44.972 INFO:tasks.workunit.client.1.smithi133.stdout:2/382: link f1 da/d1d/d60/d71/d3a/f7b 0 2023-12-16T07:40:44.972 INFO:tasks.workunit.client.1.smithi133.stdout:2/383: chown da/d50 10749693 1 2023-12-16T07:40:44.973 INFO:tasks.workunit.client.1.smithi133.stdout:2/384: fdatasync da/d1d/d60/d71/d3a/d61/f68 0 2023-12-16T07:40:44.973 INFO:tasks.workunit.client.1.smithi133.stdout:2/385: chown da/d15/d1b/l31 2299 1 2023-12-16T07:40:44.975 INFO:tasks.workunit.client.1.smithi133.stdout:5/405: stat d1/de/d52/c88 0 2023-12-16T07:40:44.976 INFO:tasks.workunit.client.1.smithi133.stdout:9/563: mknod d15/d42/d8d/da9/cbd 0 2023-12-16T07:40:44.976 INFO:tasks.workunit.client.1.smithi133.stdout:2/386: dread da/fe [0,4194304] 0 2023-12-16T07:40:44.976 INFO:tasks.workunit.client.1.smithi133.stdout:2/387: fdatasync da/d1d/f32 0 2023-12-16T07:40:44.976 INFO:tasks.workunit.client.1.smithi133.stdout:2/388: write da/d1d/d60/d71/d3a/d61/f68 [974511,39775] 0 2023-12-16T07:40:44.979 INFO:tasks.workunit.client.1.smithi133.stdout:6/735: write d0/d4/d21/d8a/d93/d8e/f9c [1426466,93921] 0 2023-12-16T07:40:44.987 INFO:tasks.workunit.client.1.smithi133.stdout:0/532: dwrite d2/d17/d2b/d31/d4d/fa1 [0,4194304] 0 2023-12-16T07:40:45.063 INFO:tasks.workunit.client.1.smithi133.stdout:5/406: getdents d1/de/d57/d74/d89 0 2023-12-16T07:40:45.063 INFO:tasks.workunit.client.1.smithi133.stdout:5/407: write d1/d1c/d80/d64/f65 [582431,56216] 0 2023-12-16T07:40:45.064 INFO:tasks.workunit.client.1.smithi133.stdout:9/564: mknod d15/d18/d2c/d68/db2/cbe 0 2023-12-16T07:40:45.065 INFO:tasks.workunit.client.1.smithi133.stdout:2/389: creat da/d15/d17/d40/f7c x:0 0 0 2023-12-16T07:40:45.067 INFO:tasks.workunit.client.1.smithi133.stdout:6/736: symlink d0/d5e/d75/d81/lf2 0 2023-12-16T07:40:45.070 INFO:tasks.workunit.client.1.smithi133.stdout:0/533: creat d2/d17/fac x:0 0 0 2023-12-16T07:40:45.071 INFO:tasks.workunit.client.1.smithi133.stdout:0/534: chown d2/d17/d40 1055858 1 2023-12-16T07:40:45.072 INFO:tasks.workunit.client.1.smithi133.stdout:5/408: mkdir d1/d18/d2c/d94 0 2023-12-16T07:40:45.072 INFO:tasks.workunit.client.1.smithi133.stdout:5/409: stat d1/de 0 2023-12-16T07:40:45.072 INFO:tasks.workunit.client.1.smithi133.stdout:5/410: chown d1/d18/c58 20 1 2023-12-16T07:40:45.072 INFO:tasks.workunit.client.1.smithi133.stdout:5/411: stat d1/d18/c2f 0 2023-12-16T07:40:45.073 INFO:tasks.workunit.client.1.smithi133.stdout:5/412: write d1/de/d35/f37 [4409035,129472] 0 2023-12-16T07:40:45.075 INFO:tasks.workunit.client.1.smithi133.stdout:9/565: symlink d15/d18/lbf 0 2023-12-16T07:40:45.075 INFO:tasks.workunit.client.1.smithi133.stdout:9/566: readlink l5 0 2023-12-16T07:40:45.076 INFO:tasks.workunit.client.1.smithi133.stdout:0/535: rmdir d2 39 2023-12-16T07:40:45.076 INFO:tasks.workunit.client.1.smithi133.stdout:5/413: dread d1/f17 [0,4194304] 0 2023-12-16T07:40:45.076 INFO:tasks.workunit.client.1.smithi133.stdout:5/414: write d1/d1c/f77 [1888274,18170] 0 2023-12-16T07:40:45.077 INFO:tasks.workunit.client.1.smithi133.stdout:9/567: truncate d15/d18/d2c/d68/f83 2281726 0 2023-12-16T07:40:45.079 INFO:tasks.workunit.client.1.smithi133.stdout:0/536: creat d2/d17/d2b/d67/fad x:0 0 0 2023-12-16T07:40:45.083 INFO:tasks.workunit.client.1.smithi133.stdout:5/415: rename d1/d18/d2c/d94 to d1/de/d52/d95 0 2023-12-16T07:40:45.083 INFO:tasks.workunit.client.1.smithi133.stdout:5/416: fsync d1/d18/f1b 0 2023-12-16T07:40:45.085 INFO:tasks.workunit.client.1.smithi133.stdout:2/390: dwrite da/d15/d17/f33 [0,4194304] 0 2023-12-16T07:40:45.088 INFO:tasks.workunit.client.1.smithi133.stdout:9/568: rename d15/d18/d2c/f30 to d15/d42/fc0 0 2023-12-16T07:40:45.088 INFO:tasks.workunit.client.1.smithi133.stdout:9/569: fsync d15/d18/d2c/d68/f8e 0 2023-12-16T07:40:45.088 INFO:tasks.workunit.client.1.smithi133.stdout:9/570: readlink l4 0 2023-12-16T07:40:45.089 INFO:tasks.workunit.client.1.smithi133.stdout:2/391: write da/f11 [4041016,111607] 0 2023-12-16T07:40:45.089 INFO:tasks.workunit.client.1.smithi133.stdout:2/392: getdents da/d15 0 2023-12-16T07:40:45.094 INFO:tasks.workunit.client.1.smithi133.stdout:6/737: dwrite d0/d5e/f76 [0,4194304] 0 2023-12-16T07:40:45.094 INFO:tasks.workunit.client.1.smithi133.stdout:2/393: rmdir da/d15/d17 39 2023-12-16T07:40:45.094 INFO:tasks.workunit.client.1.smithi133.stdout:0/537: dread d2/f6 [0,4194304] 0 2023-12-16T07:40:45.094 INFO:tasks.workunit.client.1.smithi133.stdout:0/538: write d2/d9/d20/f29 [5110548,36369] 0 2023-12-16T07:40:45.094 INFO:tasks.workunit.client.1.smithi133.stdout:6/738: creat d0/d4/d21/d8a/d93/d8e/ff3 x:0 0 0 2023-12-16T07:40:45.094 INFO:tasks.workunit.client.1.smithi133.stdout:6/739: fsync d0/d4/d21/d35/f79 0 2023-12-16T07:40:45.095 INFO:tasks.workunit.client.1.smithi133.stdout:0/539: write d2/f8 [761923,76032] 0 2023-12-16T07:40:45.095 INFO:tasks.workunit.client.1.smithi133.stdout:0/540: stat d2/d17/d2b/d31/d4d/da7 0 2023-12-16T07:40:45.097 INFO:tasks.workunit.client.1.smithi133.stdout:5/417: dread d1/de/f13 [0,4194304] 0 2023-12-16T07:40:45.100 INFO:tasks.workunit.client.1.smithi133.stdout:6/740: rmdir d0/d4/d21/d8a 39 2023-12-16T07:40:45.101 INFO:tasks.workunit.client.1.smithi133.stdout:0/541: creat d2/d9/d12/d45/d9e/da0/fae x:0 0 0 2023-12-16T07:40:45.105 INFO:tasks.workunit.client.1.smithi133.stdout:5/418: creat d1/de/d52/d95/f96 x:0 0 0 2023-12-16T07:40:45.106 INFO:tasks.workunit.client.1.smithi133.stdout:2/394: dwrite da/d1d/f6a [0,4194304] 0 2023-12-16T07:40:45.106 INFO:tasks.workunit.client.1.smithi133.stdout:6/741: symlink d0/d4/d21/d35/d4e/d84/d69/da1/lf4 0 2023-12-16T07:40:45.106 INFO:tasks.workunit.client.1.smithi133.stdout:6/742: fsync d0/d4/fa7 0 2023-12-16T07:40:45.108 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T07:40:45.108 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-16T07:40:45.109 INFO:tasks.workunit.client.1.smithi133.stdout:0/542: rename d2/d9/d8f/c78 to d2/d17/d2b/d31/caf 0 2023-12-16T07:40:45.109 INFO:tasks.workunit.client.1.smithi133.stdout:0/543: fdatasync d2/d17/d2b/d31/d4d/f9a 0 2023-12-16T07:40:45.109 INFO:tasks.workunit.client.1.smithi133.stdout:2/395: write f4 [2391303,31445] 0 2023-12-16T07:40:45.110 INFO:tasks.workunit.client.1.smithi133.stdout:0/544: write d2/d17/d2b/f59 [299869,101386] 0 2023-12-16T07:40:45.110 INFO:tasks.workunit.client.1.smithi133.stdout:5/419: mknod d1/d18/d2c/c97 0 2023-12-16T07:40:45.110 INFO:tasks.workunit.client.1.smithi133.stdout:5/420: fsync d1/f34 0 2023-12-16T07:40:45.110 INFO:tasks.workunit.client.1.smithi133.stdout:2/396: read da/d1d/d60/d71/d3a/f7b [307250,31197] 0 2023-12-16T07:40:45.110 INFO:tasks.workunit.client.1.smithi133.stdout:1/564: sync 2023-12-16T07:40:45.112 INFO:tasks.workunit.client.1.smithi133.stdout:0/545: rename d2/d9/d20/f44 to d2/d9/d20/fb0 0 2023-12-16T07:40:45.113 INFO:tasks.workunit.client.1.smithi133.stdout:0/546: stat d2/d17/d2b/d31/d4d/fa1 0 2023-12-16T07:40:45.113 INFO:tasks.workunit.client.1.smithi133.stdout:5/421: mknod d1/de/d52/d95/c98 0 2023-12-16T07:40:45.113 INFO:tasks.workunit.client.1.smithi133.stdout:5/422: chown d1/d18/d6f/d71/f93 1775 1 2023-12-16T07:40:45.114 INFO:tasks.workunit.client.1.smithi133.stdout:5/423: read d1/d1c/f38 [1744597,57621] 0 2023-12-16T07:40:45.114 INFO:tasks.workunit.client.1.smithi133.stdout:2/397: creat da/d1d/d60/d71/d3a/f7d x:0 0 0 2023-12-16T07:40:45.115 INFO:tasks.workunit.client.1.smithi133.stdout:1/565: symlink d0/da/d3d/lb9 0 2023-12-16T07:40:45.117 INFO:tasks.workunit.client.1.smithi133.stdout:6/743: unlink d0/d4/d21/d8a/d93/ce0 0 2023-12-16T07:40:45.117 INFO:tasks.workunit.client.1.smithi133.stdout:6/744: write d0/d4/d21/d35/f42 [4391876,108724] 0 2023-12-16T07:40:45.117 INFO:tasks.workunit.client.1.smithi133.stdout:0/547: creat d2/d17/d2b/d31/d4d/fb1 x:0 0 0 2023-12-16T07:40:45.118 INFO:tasks.workunit.client.1.smithi133.stdout:0/548: dread - d2/d17/d2b/d31/d4d/f9a zero size 2023-12-16T07:40:45.120 INFO:tasks.workunit.client.1.smithi133.stdout:5/424: rename d1/d1c/f91 to d1/d1c/f99 0 2023-12-16T07:40:45.123 INFO:tasks.workunit.client.1.smithi133.stdout:2/398: creat da/d1d/d60/d71/d2e/d59/f7e x:0 0 0 2023-12-16T07:40:45.123 INFO:tasks.workunit.client.1.smithi133.stdout:2/399: write f2 [1852484,104331] 0 2023-12-16T07:40:45.124 INFO:tasks.workunit.client.1.smithi133.stdout:6/745: symlink d0/d4/d21/d35/d4e/d84/d69/dbd/lf5 0 2023-12-16T07:40:45.125 INFO:tasks.workunit.client.1.smithi133.stdout:0/549: mkdir d2/db2 0 2023-12-16T07:40:45.126 INFO:tasks.workunit.client.1.smithi133.stdout:5/425: creat d1/d18/d2c/f9a x:0 0 0 2023-12-16T07:40:45.128 INFO:tasks.workunit.client.1.smithi133.stdout:2/400: symlink da/d1d/d60/d71/d2e/d59/l7f 0 2023-12-16T07:40:45.130 INFO:tasks.workunit.client.1.smithi133.stdout:1/566: dwrite d0/d12/d51/dac/f2f [0,4194304] 0 2023-12-16T07:40:45.130 INFO:tasks.workunit.client.1.smithi133.stdout:0/550: unlink d2/d9/d12/d35/f8b 0 2023-12-16T07:40:45.130 INFO:tasks.workunit.client.1.smithi133.stdout:0/551: chown d2/d17/d2b/d31/caf 34048319 1 2023-12-16T07:40:45.132 INFO:tasks.workunit.client.1.smithi133.stdout:1/567: rmdir d0/d12/d51/dac/d24/d32/d56/d59/d66 39 2023-12-16T07:40:45.135 INFO:tasks.workunit.client.1.smithi133.stdout:2/401: dread da/d1d/f21 [0,4194304] 0 2023-12-16T07:40:45.135 INFO:tasks.workunit.client.1.smithi133.stdout:2/402: readlink da/l4a 0 2023-12-16T07:40:45.143 INFO:tasks.workunit.client.1.smithi133.stdout:5/426: dwrite d1/f1f [0,4194304] 0 2023-12-16T07:40:45.143 INFO:tasks.workunit.client.1.smithi133.stdout:5/427: fdatasync d1/d1c/f99 0 2023-12-16T07:40:45.144 INFO:tasks.workunit.client.1.smithi133.stdout:1/568: dread d0/d1c/d37/f4a [0,4194304] 0 2023-12-16T07:40:45.147 INFO:tasks.workunit.client.1.smithi133.stdout:5/428: rename d1/d18/l25 to d1/d18/d2c/l9b 0 2023-12-16T07:40:45.149 INFO:tasks.workunit.client.1.smithi133.stdout:1/569: rmdir d0/d12/d51/dac/d24/d32 39 2023-12-16T07:40:45.155 INFO:tasks.workunit.client.1.smithi133.stdout:1/570: unlink d0/d12/d51/dac/d24/d32/d56/d59/d5f/la8 0 2023-12-16T07:40:45.155 INFO:tasks.workunit.client.1.smithi133.stdout:1/571: stat d0/d12/d51/dac/d24/d32/d3e/d70/d8f/la1 0 2023-12-16T07:40:45.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/572: creat d0/da/d3d/fba x:0 0 0 2023-12-16T07:40:45.157 INFO:tasks.workunit.client.1.smithi133.stdout:1/573: mknod d0/d12/d51/dac/d24/d5a/d68/cbb 0 2023-12-16T07:40:45.158 INFO:tasks.workunit.client.1.smithi133.stdout:1/574: creat d0/d12/d51/dac/d24/d5a/d68/fbc x:0 0 0 2023-12-16T07:40:45.160 INFO:tasks.workunit.client.1.smithi133.stdout:2/403: dwrite da/d1d/f21 [0,4194304] 0 2023-12-16T07:40:45.162 INFO:tasks.workunit.client.1.smithi133.stdout:5/429: dwrite d1/f10 [4194304,4194304] 0 2023-12-16T07:40:45.163 INFO:tasks.workunit.client.1.smithi133.stdout:5/430: rename d1/de/f23 to d1/d18/d26/f9c 0 2023-12-16T07:40:45.165 INFO:tasks.workunit.client.1.smithi133.stdout:5/431: link d1/ca d1/de/d52/d95/c9d 0 2023-12-16T07:40:45.165 INFO:tasks.workunit.client.1.smithi133.stdout:5/432: chown d1/c21 42258 1 2023-12-16T07:40:45.165 INFO:tasks.workunit.client.1.smithi133.stdout:5/433: mkdir d1/d18/d6f/d9e 0 2023-12-16T07:40:45.166 INFO:tasks.workunit.client.1.smithi133.stdout:5/434: write d1/f24 [3479080,28765] 0 2023-12-16T07:40:45.167 INFO:tasks.workunit.client.1.smithi133.stdout:5/435: chown d1/d18/d2c/c97 36 1 2023-12-16T07:40:45.177 INFO:tasks.workunit.client.1.smithi133.stdout:1/575: dwrite d0/d12/d51/dac/fd [0,4194304] 0 2023-12-16T07:40:45.179 INFO:tasks.workunit.client.1.smithi133.stdout:1/576: creat d0/d1c/d9b/fbd x:0 0 0 2023-12-16T07:40:45.180 INFO:tasks.workunit.client.1.smithi133.stdout:1/577: unlink d0/d12/d51/dac/d24/d5a/d68/f99 0 2023-12-16T07:40:45.187 INFO:tasks.workunit.client.1.smithi133.stdout:2/404: dwrite da/d1d/d60/d71/d3a/d61/f68 [0,4194304] 0 2023-12-16T07:40:45.187 INFO:tasks.workunit.client.1.smithi133.stdout:2/405: truncate da/f3d 100856 0 2023-12-16T07:40:45.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:40:45.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:40:45.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:40:45.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:40:45.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:44 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.190 INFO:tasks.workunit.client.1.smithi133.stdout:2/406: write da/d1d/f21 [3940553,121395] 0 2023-12-16T07:40:45.190 INFO:tasks.workunit.client.1.smithi133.stdout:2/407: fsync da/d15/d1b/d43/f45 0 2023-12-16T07:40:45.190 INFO:tasks.workunit.client.1.smithi133.stdout:2/408: rename da/d1d/d60/d71/d2e/d47/d52/d6e to da/d1d/d60/d71/d2e/d47/d52/d80 0 2023-12-16T07:40:45.191 INFO:tasks.workunit.client.1.smithi133.stdout:2/409: mknod da/d15/d1b/c81 0 2023-12-16T07:40:45.192 INFO:tasks.workunit.client.1.smithi133.stdout:2/410: rename da/d15/d17/f2d to da/d50/f82 0 2023-12-16T07:40:45.194 INFO:tasks.workunit.client.1.smithi133.stdout:1/578: dwrite d0/d60/f8e [0,4194304] 0 2023-12-16T07:40:45.197 INFO:tasks.workunit.client.1.smithi133.stdout:1/579: mknod d0/d12/d51/dac/d24/d32/d56/d59/d5f/cbe 0 2023-12-16T07:40:45.197 INFO:tasks.workunit.client.1.smithi133.stdout:4/709: sync 2023-12-16T07:40:45.198 INFO:tasks.workunit.client.1.smithi133.stdout:3/401: sync 2023-12-16T07:40:45.198 INFO:tasks.workunit.client.1.smithi133.stdout:3/402: stat d7/d8/f10 0 2023-12-16T07:40:45.203 INFO:tasks.workunit.client.1.smithi133.stdout:4/710: dread d3/d7/d38/d57/d67/f6a [0,4194304] 0 2023-12-16T07:40:45.206 INFO:tasks.workunit.client.1.smithi133.stdout:4/711: creat d3/d7/d38/dd5/da7/daa/dc6/fec x:0 0 0 2023-12-16T07:40:45.207 INFO:tasks.workunit.client.1.smithi133.stdout:3/403: dread d7/d8/f11 [0,4194304] 0 2023-12-16T07:40:45.207 INFO:tasks.workunit.client.1.smithi133.stdout:3/404: write d7/d8/d78/d43/d5b/f89 [70186,54717] 0 2023-12-16T07:40:45.207 INFO:tasks.workunit.client.1.smithi133.stdout:3/405: write d7/d8/d72/d86/f7b [526537,1347] 0 2023-12-16T07:40:45.211 INFO:tasks.workunit.client.1.smithi133.stdout:3/406: write d7/d8/d1d/f52 [1538200,120444] 0 2023-12-16T07:40:45.211 INFO:tasks.workunit.client.1.smithi133.stdout:4/712: write d3/d7/f23 [359185,109501] 0 2023-12-16T07:40:45.214 INFO:tasks.workunit.client.1.smithi133.stdout:4/713: write d3/d7/fb [3632971,38073] 0 2023-12-16T07:40:45.214 INFO:tasks.workunit.client.1.smithi133.stdout:4/714: truncate d3/d7/d1c/d2a/d91/dbe/fd4 1047333 0 2023-12-16T07:40:45.214 INFO:tasks.workunit.client.1.smithi133.stdout:1/580: dwrite d0/da/fb5 [0,4194304] 0 2023-12-16T07:40:45.214 INFO:tasks.workunit.client.1.smithi133.stdout:3/407: symlink d7/d8/d1d/la8 0 2023-12-16T07:40:45.218 INFO:tasks.workunit.client.1.smithi133.stdout:4/715: link d3/d7/d38/dd5/da7/dbb/fe6 d3/d7/d38/dd5/da7/daa/dc6/fed 0 2023-12-16T07:40:45.221 INFO:tasks.workunit.client.1.smithi133.stdout:2/411: dwrite da/d1d/d60/d71/d3a/d61/f79 [4194304,4194304] 0 2023-12-16T07:40:45.224 INFO:tasks.workunit.client.1.smithi133.stdout:3/408: unlink d7/l51 0 2023-12-16T07:40:45.228 INFO:tasks.workunit.client.1.smithi133.stdout:1/581: dread d0/d12/f58 [0,4194304] 0 2023-12-16T07:40:45.230 INFO:tasks.workunit.client.1.smithi133.stdout:4/716: truncate d3/d7/d38/dd5/f77 3716136 0 2023-12-16T07:40:45.231 INFO:tasks.workunit.client.1.smithi133.stdout:4/717: read d3/d7/d6d/d89/dbf/fe9 [346254,44417] 0 2023-12-16T07:40:45.232 INFO:tasks.workunit.client.1.smithi133.stdout:4/718: fdatasync d3/d7/d1a/f9c 0 2023-12-16T07:40:45.234 INFO:tasks.workunit.client.1.smithi133.stdout:4/719: mkdir d3/db6/dee 0 2023-12-16T07:40:45.234 INFO:tasks.workunit.client.1.smithi133.stdout:3/409: dread d7/d8/d78/d43/d5b/f8c [0,4194304] 0 2023-12-16T07:40:45.237 INFO:tasks.workunit.client.1.smithi133.stdout:1/582: dread d0/d12/d51/dac/f2f [0,4194304] 0 2023-12-16T07:40:45.237 INFO:tasks.workunit.client.1.smithi133.stdout:1/583: chown d0/d12/c65 0 1 2023-12-16T07:40:45.239 INFO:tasks.workunit.client.1.smithi133.stdout:2/412: dwrite da/d1d/f6a [0,4194304] 0 2023-12-16T07:40:45.242 INFO:tasks.workunit.client.1.smithi133.stdout:4/720: mkdir d3/d7/d38/dd5/d63/d96/def 0 2023-12-16T07:40:45.243 INFO:tasks.workunit.client.1.smithi133.stdout:2/413: write da/d1d/f32 [188268,70723] 0 2023-12-16T07:40:45.245 INFO:tasks.workunit.client.1.smithi133.stdout:1/584: rmdir d0/d12/d51 39 2023-12-16T07:40:45.247 INFO:tasks.workunit.client.1.smithi133.stdout:1/585: write d0/f2a [684902,42287] 0 2023-12-16T07:40:45.248 INFO:tasks.workunit.client.1.smithi133.stdout:1/586: write d0/da/f19 [1696825,100678] 0 2023-12-16T07:40:45.248 INFO:tasks.workunit.client.1.smithi133.stdout:1/587: fsync d0/d12/d51/dac/d24/d5a/d68/fbc 0 2023-12-16T07:40:45.250 INFO:tasks.workunit.client.1.smithi133.stdout:4/721: rename d3/d7/d38/f5a to d3/d7/d6d/d89/dbf/ff0 0 2023-12-16T07:40:45.250 INFO:tasks.workunit.client.1.smithi133.stdout:4/722: truncate d3/d7/d1c/d2a/d91/dbe/fd2 176313 0 2023-12-16T07:40:45.250 INFO:tasks.workunit.client.1.smithi133.stdout:4/723: chown d3/d7/d38/d57/d67/lcc 154685211 1 2023-12-16T07:40:45.252 INFO:tasks.workunit.client.1.smithi133.stdout:2/414: mkdir da/d15/d1b/d83 0 2023-12-16T07:40:45.253 INFO:tasks.workunit.client.1.smithi133.stdout:3/410: dwrite d7/d8/d1c/d2b/f15 [4194304,4194304] 0 2023-12-16T07:40:45.254 INFO:tasks.workunit.client.1.smithi133.stdout:4/724: mkdir d3/d7/d38/dd5/dac/df1 0 2023-12-16T07:40:45.255 INFO:tasks.workunit.client.1.smithi133.stdout:2/415: stat da/d1d/d60/d71/l2a 0 2023-12-16T07:40:45.255 INFO:tasks.workunit.client.1.smithi133.stdout:2/416: dread - da/d15/d17/d40/f7c zero size 2023-12-16T07:40:45.255 INFO:tasks.workunit.client.1.smithi133.stdout:2/417: stat da/d1d/d60/d71/d2e/f35 0 2023-12-16T07:40:45.256 INFO:tasks.workunit.client.1.smithi133.stdout:2/418: write da/d15/d17/f36 [331988,47411] 0 2023-12-16T07:40:45.275 INFO:tasks.workunit.client.1.smithi133.stdout:1/588: truncate d0/f2a 3488194 0 2023-12-16T07:40:45.276 INFO:tasks.workunit.client.1.smithi133.stdout:4/725: rename d3/f25 to d3/d7/d1c/db0/dc8/ff2 0 2023-12-16T07:40:45.277 INFO:tasks.workunit.client.1.smithi133.stdout:4/726: dread d3/d7/d38/dd5/f8f [0,4194304] 0 2023-12-16T07:40:45.280 INFO:tasks.workunit.client.1.smithi133.stdout:2/419: link da/d1d/d60/d71/d3a/d61/f79 da/d15/d17/f84 0 2023-12-16T07:40:45.283 INFO:tasks.workunit.client.1.smithi133.stdout:3/411: read d7/d8/d1c/f41 [281379,129350] 0 2023-12-16T07:40:45.285 INFO:tasks.workunit.client.1.smithi133.stdout:4/727: creat d3/d7/d38/dd5/da7/daa/dc6/ff3 x:0 0 0 2023-12-16T07:40:45.285 INFO:tasks.workunit.client.1.smithi133.stdout:4/728: chown d3/d7/f5c 1 1 2023-12-16T07:40:45.286 INFO:tasks.workunit.client.1.smithi133.stdout:4/729: read d3/db6/fc7 [2371590,54719] 0 2023-12-16T07:40:45.287 INFO:tasks.workunit.client.1.smithi133.stdout:2/420: mkdir da/d15/d1b/d43/d85 0 2023-12-16T07:40:45.289 INFO:tasks.workunit.client.1.smithi133.stdout:3/412: rmdir d7/d8/d1d/d2a 39 2023-12-16T07:40:45.292 INFO:tasks.workunit.client.1.smithi133.stdout:4/730: creat d3/d7/d1c/d2a/d91/dbe/ff4 x:0 0 0 2023-12-16T07:40:45.292 INFO:tasks.workunit.client.1.smithi133.stdout:4/731: fdatasync d3/d7/d38/d57/d67/f6a 0 2023-12-16T07:40:45.297 INFO:tasks.workunit.client.1.smithi133.stdout:2/421: mknod da/d1d/d60/d71/d2e/c86 0 2023-12-16T07:40:45.297 INFO:tasks.workunit.client.1.smithi133.stdout:1/589: dread d0/f2a [0,4194304] 0 2023-12-16T07:40:45.298 INFO:tasks.workunit.client.1.smithi133.stdout:2/422: unlink da/d1d/f46 0 2023-12-16T07:40:45.300 INFO:tasks.workunit.client.1.smithi133.stdout:2/423: creat da/d1d/f87 x:0 0 0 2023-12-16T07:40:45.302 INFO:tasks.workunit.client.1.smithi133.stdout:2/424: link da/d15/d1b/c28 da/d15/d1b/d43/d85/c88 0 2023-12-16T07:40:45.302 INFO:tasks.workunit.client.1.smithi133.stdout:2/425: readlink da/d1d/d60/d71/l69 0 2023-12-16T07:40:45.303 INFO:tasks.workunit.client.1.smithi133.stdout:2/426: rmdir da/d50 39 2023-12-16T07:40:45.306 INFO:tasks.workunit.client.1.smithi133.stdout:3/413: dwrite d7/d8/d1c/f67 [0,4194304] 0 2023-12-16T07:40:45.309 INFO:tasks.workunit.client.1.smithi133.stdout:1/590: dread d0/da/d3d/d41/f79 [0,4194304] 0 2023-12-16T07:40:45.312 INFO:tasks.workunit.client.1.smithi133.stdout:4/732: dwrite d3/d7/d38/d57/d75/f7e [4194304,4194304] 0 2023-12-16T07:40:45.312 INFO:tasks.workunit.client.1.smithi133.stdout:3/414: rename d7/d8/f58 to d7/d8/d78/d43/d7f/fa9 0 2023-12-16T07:40:45.312 INFO:tasks.workunit.client.1.smithi133.stdout:3/415: write d7/d8/d78/d43/d7f/fa9 [667959,6435] 0 2023-12-16T07:40:45.312 INFO:tasks.workunit.client.1.smithi133.stdout:3/416: chown d7/d8/d1d/d2a/c60 38 1 2023-12-16T07:40:45.312 INFO:tasks.workunit.client.1.smithi133.stdout:3/417: fsync d7/d8/d78/f69 0 2023-12-16T07:40:45.316 INFO:tasks.workunit.client.1.smithi133.stdout:4/733: rename d3/d7/d6d/c7b to d3/d7/db1/cf5 0 2023-12-16T07:40:45.318 INFO:tasks.workunit.client.1.smithi133.stdout:3/418: creat d7/d8/d1c/faa x:0 0 0 2023-12-16T07:40:45.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/419: rename d7/d8/f11 to d7/d8/d78/d43/d7f/fab 0 2023-12-16T07:40:45.321 INFO:tasks.workunit.client.1.smithi133.stdout:2/427: dwrite da/d15/d17/f84 [0,4194304] 0 2023-12-16T07:40:45.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/420: write d7/d8/d78/d43/d5b/f8c [677838,41318] 0 2023-12-16T07:40:45.326 INFO:tasks.workunit.client.1.smithi133.stdout:2/428: rename da/f3d to da/d1d/d60/d71/f89 0 2023-12-16T07:40:45.330 INFO:tasks.workunit.client.1.smithi133.stdout:3/421: rename d7/d8/d72/d77/f81 to d7/d8/d1d/d2a/da2/fac 0 2023-12-16T07:40:45.331 INFO:tasks.workunit.client.1.smithi133.stdout:4/734: dwrite d3/d7/d38/dd5/f55 [4194304,4194304] 0 2023-12-16T07:40:45.331 INFO:tasks.workunit.client.1.smithi133.stdout:4/735: chown d3/d7/ce5 13487324 1 2023-12-16T07:40:45.331 INFO:tasks.workunit.client.1.smithi133.stdout:4/736: fdatasync d3/d7/d38/d57/fc0 0 2023-12-16T07:40:45.334 INFO:tasks.workunit.client.1.smithi133.stdout:3/422: rename d7/d8/d96 to d7/d8/d1c/d87/dad 0 2023-12-16T07:40:45.345 INFO:tasks.workunit.client.1.smithi133.stdout:3/423: rename d7/d8/d1d/d2a/da2/fac to d7/d8/d78/d43/d7f/d85/d8f/fae 0 2023-12-16T07:40:45.346 INFO:tasks.workunit.client.1.smithi133.stdout:3/424: chown d7/d8/d1c/d2b 102226 1 2023-12-16T07:40:45.347 INFO:tasks.workunit.client.1.smithi133.stdout:4/737: dwrite d3/d7/d1c/d2a/fb3 [0,4194304] 0 2023-12-16T07:40:45.347 INFO:tasks.workunit.client.1.smithi133.stdout:3/425: dread d7/d8/d78/f5d [0,4194304] 0 2023-12-16T07:40:45.348 INFO:tasks.workunit.client.1.smithi133.stdout:3/426: read d7/f8e [5407655,83253] 0 2023-12-16T07:40:45.351 INFO:tasks.workunit.client.1.smithi133.stdout:2/429: dwrite da/d15/d1b/f34 [0,4194304] 0 2023-12-16T07:40:45.351 INFO:tasks.workunit.client.1.smithi133.stdout:8/501: sync 2023-12-16T07:40:45.352 INFO:tasks.workunit.client.1.smithi133.stdout:7/816: sync 2023-12-16T07:40:45.352 INFO:tasks.workunit.client.1.smithi133.stdout:8/502: fsync d9/dc/d27/f2b 0 2023-12-16T07:40:45.352 INFO:tasks.workunit.client.1.smithi133.stdout:8/503: dread - d9/d2d/f40 zero size 2023-12-16T07:40:45.352 INFO:tasks.workunit.client.1.smithi133.stdout:4/738: truncate d3/d7/d38/d57/d75/f88 251143 0 2023-12-16T07:40:45.352 INFO:tasks.workunit.client.1.smithi133.stdout:2/430: write da/f5c [6274374,83057] 0 2023-12-16T07:40:45.352 INFO:tasks.workunit.client.1.smithi133.stdout:7/817: write db/d12/f45 [2979329,5186] 0 2023-12-16T07:40:45.353 INFO:tasks.workunit.client.1.smithi133.stdout:3/427: creat d7/d8/d1c/d7e/d95/faf x:0 0 0 2023-12-16T07:40:45.357 INFO:tasks.workunit.client.1.smithi133.stdout:8/504: mkdir d9/d10/d39/d48/d44/d6e/d78/da6 0 2023-12-16T07:40:45.357 INFO:tasks.workunit.client.1.smithi133.stdout:8/505: write d9/d10/d39/d48/d44/d6e/f7c [590783,65612] 0 2023-12-16T07:40:45.360 INFO:tasks.workunit.client.1.smithi133.stdout:4/739: rename d3/d7/d1c/d2a/c85 to d3/d7/d38/d57/cf6 0 2023-12-16T07:40:45.362 INFO:tasks.workunit.client.1.smithi133.stdout:2/431: link da/d15/d1b/f70 da/d15/f8a 0 2023-12-16T07:40:45.365 INFO:tasks.workunit.client.1.smithi133.stdout:7/818: mkdir db/d12/d3a/df7/d10b 0 2023-12-16T07:40:45.366 INFO:tasks.workunit.client.1.smithi133.stdout:8/506: mknod d9/d11/d52/ca7 0 2023-12-16T07:40:45.366 INFO:tasks.workunit.client.1.smithi133.stdout:3/428: dwrite d7/d8/d1c/faa [0,4194304] 0 2023-12-16T07:40:45.367 INFO:tasks.workunit.client.1.smithi133.stdout:3/429: truncate d7/d8/f5c 623618 0 2023-12-16T07:40:45.367 INFO:tasks.workunit.client.1.smithi133.stdout:3/430: chown d7/d8/d1c/f66 840573 1 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:44 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:45.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/740: rename d3/d7/d1a/f33 to d3/d7/d38/dd5/da7/ff7 0 2023-12-16T07:40:45.369 INFO:tasks.workunit.client.1.smithi133.stdout:3/431: write d7/d8/fa [567115,51236] 0 2023-12-16T07:40:45.369 INFO:tasks.workunit.client.1.smithi133.stdout:2/432: creat da/d1d/d60/d71/d2e/d47/d52/d80/f8b x:0 0 0 2023-12-16T07:40:45.370 INFO:tasks.workunit.client.1.smithi133.stdout:7/819: rmdir db/d21/db1 39 2023-12-16T07:40:45.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/507: symlink d9/d11/d33/d9c/la8 0 2023-12-16T07:40:45.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/508: fdatasync d9/dc/d27/f29 0 2023-12-16T07:40:45.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/509: readlink l7 0 2023-12-16T07:40:45.375 INFO:tasks.workunit.client.1.smithi133.stdout:4/741: rmdir d3/d7/d38/dd5/da7/daa 39 2023-12-16T07:40:45.375 INFO:tasks.workunit.client.1.smithi133.stdout:4/742: write d3/d7/d38/d57/d67/f6a [729081,123172] 0 2023-12-16T07:40:45.376 INFO:tasks.workunit.client.1.smithi133.stdout:3/432: creat d7/d8/d1d/d2a/d5f/fb0 x:0 0 0 2023-12-16T07:40:45.376 INFO:tasks.workunit.client.1.smithi133.stdout:3/433: chown d7/d8/d72/d77/l9d 244868 1 2023-12-16T07:40:45.376 INFO:tasks.workunit.client.1.smithi133.stdout:2/433: dread f4 [4194304,4194304] 0 2023-12-16T07:40:45.377 INFO:tasks.workunit.client.1.smithi133.stdout:7/820: truncate db/f85 1948329 0 2023-12-16T07:40:45.379 INFO:tasks.workunit.client.1.smithi133.stdout:8/510: creat d9/d10/d39/d48/d44/d69/fa9 x:0 0 0 2023-12-16T07:40:45.383 INFO:tasks.workunit.client.1.smithi133.stdout:3/434: dread d7/d8/d78/d43/d7f/d85/f98 [0,4194304] 0 2023-12-16T07:40:45.384 INFO:tasks.workunit.client.1.smithi133.stdout:4/743: creat d3/db6/dee/ff8 x:0 0 0 2023-12-16T07:40:45.387 INFO:tasks.workunit.client.1.smithi133.stdout:2/434: symlink da/d1d/d60/d71/d3a/d61/l8c 0 2023-12-16T07:40:45.387 INFO:tasks.workunit.client.1.smithi133.stdout:2/435: chown da/d50 1478017 1 2023-12-16T07:40:45.388 INFO:tasks.workunit.client.1.smithi133.stdout:2/436: chown da/d1d/l67 131 1 2023-12-16T07:40:45.388 INFO:tasks.workunit.client.1.smithi133.stdout:7/821: creat db/d12/d98/f10c x:0 0 0 2023-12-16T07:40:45.390 INFO:tasks.workunit.client.1.smithi133.stdout:3/435: symlink d7/d8/d78/d43/d7f/lb1 0 2023-12-16T07:40:45.396 INFO:tasks.workunit.client.1.smithi133.stdout:8/511: dwrite d9/d11/f16 [0,4194304] 0 2023-12-16T07:40:45.441 INFO:tasks.workunit.client.1.smithi133.stdout:2/437: mknod da/d1d/d60/d71/d2e/d47/d52/d80/c8d 0 2023-12-16T07:40:45.441 INFO:tasks.workunit.client.1.smithi133.stdout:3/436: mknod d7/d8/d78/cb2 0 2023-12-16T07:40:45.447 INFO:tasks.workunit.client.1.smithi133.stdout:2/438: write da/d1d/d60/d71/d3a/d5a/f5f [2186239,4262] 0 2023-12-16T07:40:45.447 INFO:tasks.workunit.client.1.smithi133.stdout:2/439: dread - da/d1d/f87 zero size 2023-12-16T07:40:45.447 INFO:tasks.workunit.client.1.smithi133.stdout:2/440: write da/d1d/d60/d71/d3a/f7d [32870,118773] 0 2023-12-16T07:40:45.447 INFO:tasks.workunit.client.1.smithi133.stdout:2/441: chown da/d1d/d60/l65 59643328 1 2023-12-16T07:40:45.447 INFO:tasks.workunit.client.1.smithi133.stdout:2/442: chown da/l16 2128632655 1 2023-12-16T07:40:45.448 INFO:tasks.workunit.client.1.smithi133.stdout:3/437: creat d7/d8/d1c/d7e/d95/fb3 x:0 0 0 2023-12-16T07:40:45.450 INFO:tasks.workunit.client.1.smithi133.stdout:2/443: unlink da/d1d/f32 0 2023-12-16T07:40:45.451 INFO:tasks.workunit.client.1.smithi133.stdout:3/438: unlink d7/d8/d1c/f50 0 2023-12-16T07:40:45.452 INFO:tasks.workunit.client.1.smithi133.stdout:2/444: unlink da/d1d/d60/d71/l6f 0 2023-12-16T07:40:45.452 INFO:tasks.workunit.client.1.smithi133.stdout:2/445: fdatasync da/d15/d1b/f75 0 2023-12-16T07:40:45.453 INFO:tasks.workunit.client.1.smithi133.stdout:3/439: mkdir d7/d8/d1c/d7e/d95/db4 0 2023-12-16T07:40:45.453 INFO:tasks.workunit.client.1.smithi133.stdout:2/446: write da/f10 [3420023,76921] 0 2023-12-16T07:40:45.453 INFO:tasks.workunit.client.1.smithi133.stdout:2/447: dread - da/d15/d17/d40/f7c zero size 2023-12-16T07:40:45.455 INFO:tasks.workunit.client.1.smithi133.stdout:3/440: dread d7/d8/d78/f5d [0,4194304] 0 2023-12-16T07:40:45.455 INFO:tasks.workunit.client.1.smithi133.stdout:2/448: mkdir da/d50/d8e 0 2023-12-16T07:40:45.455 INFO:tasks.workunit.client.1.smithi133.stdout:2/449: chown da/d1d/d60/d71/d2e/l3c 187 1 2023-12-16T07:40:45.456 INFO:tasks.workunit.client.1.smithi133.stdout:4/744: dwrite d3/d7/f5c [8388608,4194304] 0 2023-12-16T07:40:45.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/512: dwrite d9/d10/f91 [0,4194304] 0 2023-12-16T07:40:45.457 INFO:tasks.workunit.client.1.smithi133.stdout:3/441: mkdir d7/d8/d72/d77/db5 0 2023-12-16T07:40:45.457 INFO:tasks.workunit.client.1.smithi133.stdout:2/450: truncate da/d1d/d60/d71/f37 124372 0 2023-12-16T07:40:45.460 INFO:tasks.workunit.client.1.smithi133.stdout:7/822: dwrite db/d21/f70 [0,4194304] 0 2023-12-16T07:40:45.461 INFO:tasks.workunit.client.1.smithi133.stdout:8/513: write d9/dc/d27/f29 [2463015,63206] 0 2023-12-16T07:40:45.461 INFO:tasks.workunit.client.1.smithi133.stdout:8/514: chown d9/d11/d33/d9c/la8 2961021 1 2023-12-16T07:40:45.469 INFO:tasks.workunit.client.1.smithi133.stdout:3/442: mknod d7/d8/d78/d43/cb6 0 2023-12-16T07:40:45.471 INFO:tasks.workunit.client.1.smithi133.stdout:2/451: rename da/f64 to da/f8f 0 2023-12-16T07:40:45.471 INFO:tasks.workunit.client.1.smithi133.stdout:2/452: fdatasync f1 0 2023-12-16T07:40:45.471 INFO:tasks.workunit.client.1.smithi133.stdout:7/823: dread db/d21/f2f [0,4194304] 0 2023-12-16T07:40:45.471 INFO:tasks.workunit.client.1.smithi133.stdout:2/453: write da/d1d/d60/d71/d3a/d61/f68 [8287922,112657] 0 2023-12-16T07:40:45.472 INFO:tasks.workunit.client.1.smithi133.stdout:8/515: unlink d9/f6c 0 2023-12-16T07:40:45.472 INFO:tasks.workunit.client.1.smithi133.stdout:8/516: dread - d9/d85/fa2 zero size 2023-12-16T07:40:45.473 INFO:tasks.workunit.client.1.smithi133.stdout:3/443: creat d7/d8/d1c/fb7 x:0 0 0 2023-12-16T07:40:45.474 INFO:tasks.workunit.client.1.smithi133.stdout:7/824: mknod db/d12/d3a/c10d 0 2023-12-16T07:40:45.475 INFO:tasks.workunit.client.1.smithi133.stdout:2/454: mknod da/d1d/d60/d71/c90 0 2023-12-16T07:40:45.475 INFO:tasks.workunit.client.1.smithi133.stdout:2/455: chown da/lf 20928 1 2023-12-16T07:40:45.476 INFO:tasks.workunit.client.1.smithi133.stdout:8/517: creat d9/d11/d33/faa x:0 0 0 2023-12-16T07:40:45.476 INFO:tasks.workunit.client.1.smithi133.stdout:8/518: chown d9/dc/d27/c83 1042391 1 2023-12-16T07:40:45.477 INFO:tasks.workunit.client.1.smithi133.stdout:3/444: mknod d7/d8/d1d/d2a/cb8 0 2023-12-16T07:40:45.477 INFO:tasks.workunit.client.1.smithi133.stdout:8/519: read d9/dc/d27/f28 [3912933,91744] 0 2023-12-16T07:40:45.477 INFO:tasks.workunit.client.1.smithi133.stdout:8/520: truncate d9/d10/d39/d48/d44/f89 164832 0 2023-12-16T07:40:45.477 INFO:tasks.workunit.client.1.smithi133.stdout:7/825: symlink db/d12/l10e 0 2023-12-16T07:40:45.478 INFO:tasks.workunit.client.1.smithi133.stdout:7/826: read db/d21/d2c/d31/d6e/fb6 [2018037,41343] 0 2023-12-16T07:40:45.478 INFO:tasks.workunit.client.1.smithi133.stdout:7/827: fdatasync db/d12/d3a/db5/fbd 0 2023-12-16T07:40:45.479 INFO:tasks.workunit.client.1.smithi133.stdout:3/445: creat d7/d8/d72/d86/fb9 x:0 0 0 2023-12-16T07:40:45.479 INFO:tasks.workunit.client.1.smithi133.stdout:3/446: write d7/d8/d1c/f26 [389409,113388] 0 2023-12-16T07:40:45.480 INFO:tasks.workunit.client.1.smithi133.stdout:8/521: rename d9/d2d/f34 to d9/d85/fab 0 2023-12-16T07:40:45.481 INFO:tasks.workunit.client.1.smithi133.stdout:2/456: mknod da/d1d/c91 0 2023-12-16T07:40:45.483 INFO:tasks.workunit.client.1.smithi133.stdout:7/828: rmdir db/d53 39 2023-12-16T07:40:45.485 INFO:tasks.workunit.client.1.smithi133.stdout:3/447: mknod d7/d8/d78/d43/d7f/d85/cba 0 2023-12-16T07:40:45.488 INFO:tasks.workunit.client.1.smithi133.stdout:2/457: symlink da/d15/d17/l92 0 2023-12-16T07:40:45.488 INFO:tasks.workunit.client.1.smithi133.stdout:9/571: sync 2023-12-16T07:40:45.489 INFO:tasks.workunit.client.1.smithi133.stdout:2/458: write da/f8f [225046,65439] 0 2023-12-16T07:40:45.490 INFO:tasks.workunit.client.1.smithi133.stdout:9/572: creat d15/d18/d2c/d68/fc1 x:0 0 0 2023-12-16T07:40:45.493 INFO:tasks.workunit.client.1.smithi133.stdout:3/448: getdents d7/d8/d72/d77 0 2023-12-16T07:40:45.493 INFO:tasks.workunit.client.1.smithi133.stdout:3/449: chown d7/d8/d1c/d2b/c2f 7908 1 2023-12-16T07:40:45.494 INFO:tasks.workunit.client.1.smithi133.stdout:2/459: mknod da/d15/d1b/d83/c93 0 2023-12-16T07:40:45.497 INFO:tasks.workunit.client.1.smithi133.stdout:3/450: symlink d7/d8/d1c/d7e/d95/db4/lbb 0 2023-12-16T07:40:45.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/451: write d7/d8/d1c/f31 [407859,120102] 0 2023-12-16T07:40:45.509 INFO:tasks.workunit.client.1.smithi133.stdout:9/573: dwrite d15/fb1 [0,4194304] 0 2023-12-16T07:40:45.509 INFO:tasks.workunit.client.1.smithi133.stdout:8/522: dwrite d9/d11/d42/f80 [0,4194304] 0 2023-12-16T07:40:45.509 INFO:tasks.workunit.client.1.smithi133.stdout:9/574: write d15/fac [327241,71395] 0 2023-12-16T07:40:45.512 INFO:tasks.workunit.client.1.smithi133.stdout:2/460: write da/d1d/d60/d71/f37 [10795,36178] 0 2023-12-16T07:40:45.512 INFO:tasks.workunit.client.1.smithi133.stdout:7/829: dwrite db/d3e/d4a/d58/d86/d8b/def/fff [0,4194304] 0 2023-12-16T07:40:45.512 INFO:tasks.workunit.client.1.smithi133.stdout:8/523: mknod d9/d3f/cac 0 2023-12-16T07:40:45.513 INFO:tasks.workunit.client.1.smithi133.stdout:9/575: mknod d15/d42/d8d/da9/cc2 0 2023-12-16T07:40:45.517 INFO:tasks.workunit.client.1.smithi133.stdout:7/830: creat db/d3e/d4a/d58/d86/da8/f10f x:0 0 0 2023-12-16T07:40:45.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/524: truncate d9/d10/f45 54132 0 2023-12-16T07:40:45.521 INFO:tasks.workunit.client.1.smithi133.stdout:9/576: creat d15/d42/d8d/da9/fc3 x:0 0 0 2023-12-16T07:40:45.522 INFO:tasks.workunit.client.1.smithi133.stdout:3/452: dwrite d7/d8/d1c/d7e/d95/fb3 [0,4194304] 0 2023-12-16T07:40:45.522 INFO:tasks.workunit.client.1.smithi133.stdout:7/831: rmdir db/d3e/d4a/dfb 39 2023-12-16T07:40:45.523 INFO:tasks.workunit.client.1.smithi133.stdout:8/525: creat d9/d10/d39/d48/fad x:0 0 0 2023-12-16T07:40:45.524 INFO:tasks.workunit.client.1.smithi133.stdout:8/526: dread - d9/dc/f65 zero size 2023-12-16T07:40:45.524 INFO:tasks.workunit.client.1.smithi133.stdout:8/527: write d9/d10/d39/d48/d44/f89 [802718,4346] 0 2023-12-16T07:40:45.526 INFO:tasks.workunit.client.1.smithi133.stdout:9/577: read d15/d18/f2f [2516427,93114] 0 2023-12-16T07:40:45.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/453: symlink d7/d8/d1d/lbc 0 2023-12-16T07:40:45.528 INFO:tasks.workunit.client.1.smithi133.stdout:7/832: mknod db/c110 0 2023-12-16T07:40:45.529 INFO:tasks.workunit.client.1.smithi133.stdout:8/528: rmdir d9/d11/d33/d9c 39 2023-12-16T07:40:45.531 INFO:tasks.workunit.client.1.smithi133.stdout:7/833: write db/d12/fbe [4631752,4172] 0 2023-12-16T07:40:45.533 INFO:tasks.workunit.client.1.smithi133.stdout:9/578: creat d15/d18/d2c/d68/fc4 x:0 0 0 2023-12-16T07:40:45.534 INFO:tasks.workunit.client.1.smithi133.stdout:3/454: rename d7/d8/d78/d43/c4a to d7/cbd 0 2023-12-16T07:40:45.536 INFO:tasks.workunit.client.1.smithi133.stdout:2/461: dwrite da/d1d/d60/d71/d3a/d61/f68 [0,4194304] 0 2023-12-16T07:40:45.536 INFO:tasks.workunit.client.1.smithi133.stdout:2/462: stat da/d1d/d60/d71/d2e/d47/d52/f63 0 2023-12-16T07:40:45.536 INFO:tasks.workunit.client.1.smithi133.stdout:7/834: write db/d12/fbe [7573017,71445] 0 2023-12-16T07:40:45.537 INFO:tasks.workunit.client.1.smithi133.stdout:9/579: creat d15/d18/d4d/d7e/fc5 x:0 0 0 2023-12-16T07:40:45.537 INFO:tasks.workunit.client.1.smithi133.stdout:2/463: write da/d15/d17/d40/f49 [1564714,59408] 0 2023-12-16T07:40:45.537 INFO:tasks.workunit.client.1.smithi133.stdout:7/835: write db/d12/d98/fb2 [1690696,76893] 0 2023-12-16T07:40:45.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/455: symlink d7/d8/d1d/d2a/lbe 0 2023-12-16T07:40:45.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/456: chown d7/d8/d78/d43/d7f/lb1 6 1 2023-12-16T07:40:45.540 INFO:tasks.workunit.client.1.smithi133.stdout:7/836: dread db/d3e/d4a/f60 [0,4194304] 0 2023-12-16T07:40:45.546 INFO:tasks.workunit.client.1.smithi133.stdout:9/580: rename d15/d18/d2c/d3a/l53 to d15/d18/d4d/lc6 0 2023-12-16T07:40:45.547 INFO:tasks.workunit.client.1.smithi133.stdout:9/581: write d15/d18/d5b/d71/d78/d6e/f75 [1398153,82426] 0 2023-12-16T07:40:45.547 INFO:tasks.workunit.client.1.smithi133.stdout:9/582: chown d15/d18/d4d/d7e/f9d 296033 1 2023-12-16T07:40:45.547 INFO:tasks.workunit.client.1.smithi133.stdout:9/583: dread - d15/d42/d8d/da9/fc3 zero size 2023-12-16T07:40:45.547 INFO:tasks.workunit.client.1.smithi133.stdout:3/457: mkdir d7/d8/d72/d86/dbf 0 2023-12-16T07:40:45.549 INFO:tasks.workunit.client.1.smithi133.stdout:7/837: rmdir db/d21/d2c/dbc 39 2023-12-16T07:40:45.554 INFO:tasks.workunit.client.1.smithi133.stdout:9/584: creat d15/d18/d5b/d71/d78/d6e/fc7 x:0 0 0 2023-12-16T07:40:45.554 INFO:tasks.workunit.client.1.smithi133.stdout:9/585: stat d15/d18/d2c/d3a/l69 0 2023-12-16T07:40:45.554 INFO:tasks.workunit.client.1.smithi133.stdout:9/586: stat d15/d18/d2c/c43 0 2023-12-16T07:40:45.555 INFO:tasks.workunit.client.1.smithi133.stdout:7/838: rename db/f85 to db/d3e/d4a/d58/d86/d8b/d8d/f111 0 2023-12-16T07:40:45.559 INFO:tasks.workunit.client.1.smithi133.stdout:9/587: mknod d15/d18/d5b/d71/cc8 0 2023-12-16T07:40:45.560 INFO:tasks.workunit.client.1.smithi133.stdout:7/839: mkdir db/d3e/d4a/d112 0 2023-12-16T07:40:45.560 INFO:tasks.workunit.client.1.smithi133.stdout:7/840: chown db/d21/d2c/f48 9945 1 2023-12-16T07:40:45.560 INFO:tasks.workunit.client.1.smithi133.stdout:7/841: fsync db/d21/d2c/f56 0 2023-12-16T07:40:45.561 INFO:tasks.workunit.client.1.smithi133.stdout:2/464: truncate da/f8f 1030682 0 2023-12-16T07:40:45.561 INFO:tasks.workunit.client.1.smithi133.stdout:2/465: write da/d1d/d60/d71/d3a/d61/f77 [723638,94107] 0 2023-12-16T07:40:45.564 INFO:tasks.workunit.client.1.smithi133.stdout:7/842: creat db/d12/d3a/d6c/dc8/f113 x:0 0 0 2023-12-16T07:40:45.564 INFO:tasks.workunit.client.1.smithi133.stdout:7/843: read - db/d12/d3a/df7/fd6 zero size 2023-12-16T07:40:45.565 INFO:tasks.workunit.client.1.smithi133.stdout:2/466: symlink da/d1d/d60/d71/d2e/d59/l94 0 2023-12-16T07:40:45.567 INFO:tasks.workunit.client.1.smithi133.stdout:7/844: mkdir db/d21/d2c/d31/d59/de7/d114 0 2023-12-16T07:40:45.568 INFO:tasks.workunit.client.1.smithi133.stdout:2/467: creat da/d1d/d60/d74/f95 x:0 0 0 2023-12-16T07:40:45.569 INFO:tasks.workunit.client.1.smithi133.stdout:2/468: write da/d50/f82 [3370220,53952] 0 2023-12-16T07:40:45.570 INFO:tasks.workunit.client.1.smithi133.stdout:2/469: fsync da/d15/d1b/f34 0 2023-12-16T07:40:45.573 INFO:tasks.workunit.client.1.smithi133.stdout:7/845: creat db/d12/d3a/d6c/f115 x:0 0 0 2023-12-16T07:40:45.575 INFO:tasks.workunit.client.1.smithi133.stdout:9/588: dwrite d15/d18/d2c/d68/fc1 [0,4194304] 0 2023-12-16T07:40:45.576 INFO:tasks.workunit.client.1.smithi133.stdout:7/846: mkdir db/d12/d3a/db5/df9/d116 0 2023-12-16T07:40:45.584 INFO:tasks.workunit.client.1.smithi133.stdout:2/470: dread da/d1d/d60/d71/d3a/d5a/f5f [0,4194304] 0 2023-12-16T07:40:45.586 INFO:tasks.workunit.client.1.smithi133.stdout:9/589: getdents d15/d42 0 2023-12-16T07:40:45.588 INFO:tasks.workunit.client.1.smithi133.stdout:7/847: mkdir db/d21/d2c/d31/d59/de7/d117 0 2023-12-16T07:40:45.588 INFO:tasks.workunit.client.1.smithi133.stdout:2/471: getdents da/d1d/d60/d71/d2e/d47 0 2023-12-16T07:40:45.589 INFO:tasks.workunit.client.1.smithi133.stdout:2/472: stat da/d1d/d60/d71/d3a/d61/f79 0 2023-12-16T07:40:45.589 INFO:tasks.workunit.client.1.smithi133.stdout:2/473: write da/d1d/f21 [2444146,94860] 0 2023-12-16T07:40:45.590 INFO:tasks.workunit.client.1.smithi133.stdout:2/474: write da/d1d/d60/d71/d2e/f35 [3048590,55237] 0 2023-12-16T07:40:45.590 INFO:tasks.workunit.client.1.smithi133.stdout:2/475: read da/d1d/d60/d71/d2e/f57 [26012,14353] 0 2023-12-16T07:40:45.591 INFO:tasks.workunit.client.1.smithi133.stdout:9/590: mknod d15/d18/d2c/d68/da3/cc9 0 2023-12-16T07:40:45.591 INFO:tasks.workunit.client.1.smithi133.stdout:7/848: mknod db/d12/d98/c118 0 2023-12-16T07:40:45.592 INFO:tasks.workunit.client.1.smithi133.stdout:6/746: sync 2023-12-16T07:40:45.592 INFO:tasks.workunit.client.1.smithi133.stdout:0/552: sync 2023-12-16T07:40:45.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/476: getdents da/d15/d1b 0 2023-12-16T07:40:45.593 INFO:tasks.workunit.client.1.smithi133.stdout:5/436: sync 2023-12-16T07:40:45.608 INFO:tasks.workunit.client.1.smithi133.stdout:7/849: dwrite db/d3e/f69 [0,4194304] 0 2023-12-16T07:40:45.626 INFO:tasks.workunit.client.1.smithi133.stdout:9/591: mknod d15/d18/d80/d73/cca 0 2023-12-16T07:40:45.626 INFO:tasks.workunit.client.1.smithi133.stdout:9/592: dread - d15/d18/d4d/f84 zero size 2023-12-16T07:40:45.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/553: creat d2/d9/d12/d35/fb3 x:0 0 0 2023-12-16T07:40:45.630 INFO:tasks.workunit.client.1.smithi133.stdout:6/747: creat d0/d4/d21/d8a/ff6 x:0 0 0 2023-12-16T07:40:45.631 INFO:tasks.workunit.client.1.smithi133.stdout:2/477: creat da/d1d/f96 x:0 0 0 2023-12-16T07:40:45.631 INFO:tasks.workunit.client.1.smithi133.stdout:2/478: fdatasync da/d1d/d60/d71/d3a/f7d 0 2023-12-16T07:40:45.633 INFO:tasks.workunit.client.1.smithi133.stdout:2/479: write da/d1d/d60/d71/d3a/f7b [3585277,93696] 0 2023-12-16T07:40:45.633 INFO:tasks.workunit.client.1.smithi133.stdout:2/480: fsync da/d15/d1b/f78 0 2023-12-16T07:40:45.633 INFO:tasks.workunit.client.1.smithi133.stdout:2/481: chown da/d1d/d60/d71/d2e 1 1 2023-12-16T07:40:45.633 INFO:tasks.workunit.client.1.smithi133.stdout:5/437: getdents d1/d1c 0 2023-12-16T07:40:45.636 INFO:tasks.workunit.client.1.smithi133.stdout:9/593: dread d15/d18/d2c/f4c [0,4194304] 0 2023-12-16T07:40:45.637 INFO:tasks.workunit.client.1.smithi133.stdout:7/850: rename db/d12/d3a to db/d21/d2c/d31/d59/de7/d119 0 2023-12-16T07:40:45.637 INFO:tasks.workunit.client.1.smithi133.stdout:7/851: write db/d3e/f4f [1389419,80626] 0 2023-12-16T07:40:45.639 INFO:tasks.workunit.client.1.smithi133.stdout:6/748: creat d0/d4/d21/d8a/da4/ff7 x:0 0 0 2023-12-16T07:40:45.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/482: creat da/d15/d17/d40/f97 x:0 0 0 2023-12-16T07:40:45.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/483: read - da/d1d/f96 zero size 2023-12-16T07:40:45.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/484: write da/d1d/d60/d71/d2e/d47/d52/f63 [1510538,91204] 0 2023-12-16T07:40:45.642 INFO:tasks.workunit.client.1.smithi133.stdout:9/594: mkdir d15/d18/d2c/d68/da3/dcb 0 2023-12-16T07:40:45.644 INFO:tasks.workunit.client.1.smithi133.stdout:0/554: dwrite d2/d9/d20/d5e/d92/f81 [0,4194304] 0 2023-12-16T07:40:45.644 INFO:tasks.workunit.client.1.smithi133.stdout:0/555: fsync d2/d9/db/f6c 0 2023-12-16T07:40:45.644 INFO:tasks.workunit.client.1.smithi133.stdout:7/852: rename db/d21/f2f to db/d21/d2c/d31/d59/de7/d119/d6c/dc8/f11a 0 2023-12-16T07:40:45.646 INFO:tasks.workunit.client.1.smithi133.stdout:6/749: mkdir d0/d4/df8 0 2023-12-16T07:40:45.647 INFO:tasks.workunit.client.1.smithi133.stdout:0/556: write d2/d9/d8f/f6e [455267,61185] 0 2023-12-16T07:40:45.650 INFO:tasks.workunit.client.1.smithi133.stdout:2/485: mkdir da/d15/d17/d40/d98 0 2023-12-16T07:40:45.652 INFO:tasks.workunit.client.1.smithi133.stdout:9/595: getdents d15/d18/d2c/d3a/d8a 0 2023-12-16T07:40:45.652 INFO:tasks.workunit.client.1.smithi133.stdout:5/438: dwrite d1/de/d67/d7c/f8f [0,4194304] 0 2023-12-16T07:40:45.655 INFO:tasks.workunit.client.1.smithi133.stdout:2/486: dread da/d1d/d60/d71/d3a/d61/f77 [0,4194304] 0 2023-12-16T07:40:45.656 INFO:tasks.workunit.client.1.smithi133.stdout:6/750: rename d0/d4/d21/f98 to d0/d5e/d8c/dc5/ff9 0 2023-12-16T07:40:45.658 INFO:tasks.workunit.client.1.smithi133.stdout:0/557: unlink d2/d9/d20/d5e/fa3 0 2023-12-16T07:40:45.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/558: read d2/d17/d2b/d31/d4d/f53 [3360440,28194] 0 2023-12-16T07:40:45.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/439: creat d1/de/d35/f9f x:0 0 0 2023-12-16T07:40:45.661 INFO:tasks.workunit.client.1.smithi133.stdout:2/487: rmdir da/d1d/d60/d71 39 2023-12-16T07:40:45.662 INFO:tasks.workunit.client.1.smithi133.stdout:6/751: rename d0/d4/d21/d35/d36/l63 to d0/d4/d21/d60/lfa 0 2023-12-16T07:40:45.663 INFO:tasks.workunit.client.1.smithi133.stdout:0/559: mknod d2/d9/d20/d5e/d89/da2/cb4 0 2023-12-16T07:40:45.664 INFO:tasks.workunit.client.1.smithi133.stdout:5/440: symlink d1/de/d57/d74/la0 0 2023-12-16T07:40:45.665 INFO:tasks.workunit.client.1.smithi133.stdout:2/488: link da/d1d/d60/d71/d2e/d59/l94 da/d1d/d60/d71/d2e/d47/d52/d80/l99 0 2023-12-16T07:40:45.667 INFO:tasks.workunit.client.1.smithi133.stdout:0/560: symlink d2/d9/d12/d45/d9e/lb5 0 2023-12-16T07:40:45.667 INFO:tasks.workunit.client.1.smithi133.stdout:7/853: dwrite db/d12/fbe [0,4194304] 0 2023-12-16T07:40:45.667 INFO:tasks.workunit.client.1.smithi133.stdout:7/854: write db/d3e/d4a/d58/d86/f106 [178894,108668] 0 2023-12-16T07:40:45.669 INFO:tasks.workunit.client.1.smithi133.stdout:2/489: creat da/d15/d17/d40/d98/f9a x:0 0 0 2023-12-16T07:40:45.669 INFO:tasks.workunit.client.1.smithi133.stdout:2/490: getdents da/d1d/d60/d71/d2e/d47 0 2023-12-16T07:40:45.670 INFO:tasks.workunit.client.1.smithi133.stdout:0/561: truncate d2/f8 857265 0 2023-12-16T07:40:45.675 INFO:tasks.workunit.client.1.smithi133.stdout:7/855: rename db/d21/d2c/dbc/fc5 to db/d21/d2c/d31/d59/de7/d119/f11b 0 2023-12-16T07:40:45.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/596: dwrite d15/d18/d2c/d68/f8e [0,4194304] 0 2023-12-16T07:40:45.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/597: read - d15/d42/d8d/f90 zero size 2023-12-16T07:40:45.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/598: write d15/f35 [4433557,28103] 0 2023-12-16T07:40:45.678 INFO:tasks.workunit.client.1.smithi133.stdout:2/491: rmdir da/d1d/d60/d71 39 2023-12-16T07:40:45.686 INFO:tasks.workunit.client.1.smithi133.stdout:9/599: mkdir d15/d18/d4d/d94/dcc 0 2023-12-16T07:40:45.687 INFO:tasks.workunit.client.1.smithi133.stdout:9/600: creat d15/d18/d4d/d94/dab/fcd x:0 0 0 2023-12-16T07:40:45.689 INFO:tasks.workunit.client.1.smithi133.stdout:7/856: dread db/d21/f23 [0,4194304] 0 2023-12-16T07:40:45.692 INFO:tasks.workunit.client.1.smithi133.stdout:9/601: rename d15/d18/d2c/d3a/l92 to d15/d18/d5b/lce 0 2023-12-16T07:40:45.692 INFO:tasks.workunit.client.1.smithi133.stdout:9/602: chown f9 11818 1 2023-12-16T07:40:45.692 INFO:tasks.workunit.client.1.smithi133.stdout:2/492: dread da/f10 [0,4194304] 0 2023-12-16T07:40:45.695 INFO:tasks.workunit.client.1.smithi133.stdout:9/603: mknod d15/d18/d2c/d68/da6/ccf 0 2023-12-16T07:40:45.695 INFO:tasks.workunit.client.1.smithi133.stdout:9/604: chown fc 1793011 1 2023-12-16T07:40:45.698 INFO:tasks.workunit.client.1.smithi133.stdout:6/752: dwrite d0/d5e/d8c/dc5/ff9 [0,4194304] 0 2023-12-16T07:40:45.698 INFO:tasks.workunit.client.1.smithi133.stdout:6/753: chown d0/d4/dee/fe1 199 1 2023-12-16T07:40:45.699 INFO:tasks.workunit.client.1.smithi133.stdout:5/441: dwrite d1/d18/d26/f9c [0,4194304] 0 2023-12-16T07:40:45.699 INFO:tasks.workunit.client.1.smithi133.stdout:5/442: chown d1/d18/f47 343166 1 2023-12-16T07:40:45.699 INFO:tasks.workunit.client.1.smithi133.stdout:5/443: chown d1/d1c/f40 236635 1 2023-12-16T07:40:45.699 INFO:tasks.workunit.client.1.smithi133.stdout:0/562: dwrite d2/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:45.700 INFO:tasks.workunit.client.1.smithi133.stdout:2/493: stat da/d15/d1b/c28 0 2023-12-16T07:40:45.700 INFO:tasks.workunit.client.1.smithi133.stdout:2/494: dread - da/d15/d1b/f78 zero size 2023-12-16T07:40:45.701 INFO:tasks.workunit.client.1.smithi133.stdout:7/857: dread db/d3e/d4a/d58/d86/d8b/def/fff [0,4194304] 0 2023-12-16T07:40:45.702 INFO:tasks.workunit.client.1.smithi133.stdout:5/444: write d1/f75 [126994,75462] 0 2023-12-16T07:40:45.704 INFO:tasks.workunit.client.1.smithi133.stdout:6/754: symlink d0/d4/d21/d35/lfb 0 2023-12-16T07:40:45.709 INFO:tasks.workunit.client.1.smithi133.stdout:0/563: getdents d2/d9/d20/d5e/d89/da2 0 2023-12-16T07:40:45.709 INFO:tasks.workunit.client.1.smithi133.stdout:0/564: stat d2/d9/d12/d45/d9e/da0 0 2023-12-16T07:40:45.713 INFO:tasks.workunit.client.1.smithi133.stdout:2/495: stat da/l4a 0 2023-12-16T07:40:45.714 INFO:tasks.workunit.client.1.smithi133.stdout:2/496: write da/d15/d17/f33 [1697284,52530] 0 2023-12-16T07:40:45.718 INFO:tasks.workunit.client.1.smithi133.stdout:5/445: symlink d1/de/d57/d74/la1 0 2023-12-16T07:40:45.718 INFO:tasks.workunit.client.1.smithi133.stdout:9/605: dwrite d15/d18/d5b/fb0 [0,4194304] 0 2023-12-16T07:40:45.719 INFO:tasks.workunit.client.1.smithi133.stdout:6/755: rename d0/d4/d21/d35/d36/ca8 to d0/d4/d21/d35/d4e/d84/d69/cfc 0 2023-12-16T07:40:45.720 INFO:tasks.workunit.client.1.smithi133.stdout:6/756: read d0/fcd [51612,114574] 0 2023-12-16T07:40:45.720 INFO:tasks.workunit.client.1.smithi133.stdout:7/858: dwrite db/f1c [4194304,4194304] 0 2023-12-16T07:40:45.720 INFO:tasks.workunit.client.1.smithi133.stdout:5/446: creat d1/de/fa2 x:0 0 0 2023-12-16T07:40:45.731 INFO:tasks.workunit.client.1.smithi133.stdout:9/606: rename d15/d18/d2c/d3a/f3c to d15/d18/d80/fd0 0 2023-12-16T07:40:45.733 INFO:tasks.workunit.client.1.smithi133.stdout:2/497: dwrite da/d15/d17/f84 [4194304,4194304] 0 2023-12-16T07:40:45.733 INFO:tasks.workunit.client.1.smithi133.stdout:0/565: truncate d2/f6 3922158 0 2023-12-16T07:40:45.733 INFO:tasks.workunit.client.1.smithi133.stdout:0/566: stat d2/d17/d2b/d31/c3e 0 2023-12-16T07:40:45.733 INFO:tasks.workunit.client.1.smithi133.stdout:0/567: chown d2/d9/d20/d5e 52466548 1 2023-12-16T07:40:45.734 INFO:tasks.workunit.client.1.smithi133.stdout:6/757: creat d0/d5e/d75/dcf/ffd x:0 0 0 2023-12-16T07:40:45.736 INFO:tasks.workunit.client.1.smithi133.stdout:6/758: dread d0/d5e/d75/dcf/fe9 [0,4194304] 0 2023-12-16T07:40:45.737 INFO:tasks.workunit.client.1.smithi133.stdout:7/859: creat db/d21/d2c/d31/d59/de7/d119/d6c/f11c x:0 0 0 2023-12-16T07:40:45.738 INFO:tasks.workunit.client.1.smithi133.stdout:5/447: mkdir d1/de/d52/da3 0 2023-12-16T07:40:45.738 INFO:tasks.workunit.client.1.smithi133.stdout:5/448: readlink d1/d18/d2c/l7f 0 2023-12-16T07:40:45.740 INFO:tasks.workunit.client.1.smithi133.stdout:2/498: creat da/d1d/d60/d71/d2e/d59/f9b x:0 0 0 2023-12-16T07:40:45.741 INFO:tasks.workunit.client.1.smithi133.stdout:9/607: dread d15/d18/d2c/d68/f8e [0,4194304] 0 2023-12-16T07:40:45.741 INFO:tasks.workunit.client.1.smithi133.stdout:9/608: write d15/d18/d2c/d3a/f74 [999993,68423] 0 2023-12-16T07:40:45.741 INFO:tasks.workunit.client.1.smithi133.stdout:9/609: chown d15/d18/d5b/d71/d78/d6e/fc7 210 1 2023-12-16T07:40:45.742 INFO:tasks.workunit.client.1.smithi133.stdout:0/568: mknod d2/d9/d12/d45/cb6 0 2023-12-16T07:40:45.742 INFO:tasks.workunit.client.1.smithi133.stdout:6/759: write d0/d4/d21/d35/d4e/d84/fb3 [1016168,35536] 0 2023-12-16T07:40:45.744 INFO:tasks.workunit.client.1.smithi133.stdout:7/860: mknod db/c11d 0 2023-12-16T07:40:45.749 INFO:tasks.workunit.client.1.smithi133.stdout:5/449: symlink d1/de/d57/la4 0 2023-12-16T07:40:45.751 INFO:tasks.workunit.client.1.smithi133.stdout:2/499: link da/d15/d17/d40/f49 da/f9c 0 2023-12-16T07:40:45.754 INFO:tasks.workunit.client.1.smithi133.stdout:7/861: dread db/d3e/d4a/d58/d86/d8b/d8d/f95 [0,4194304] 0 2023-12-16T07:40:45.756 INFO:tasks.workunit.client.1.smithi133.stdout:6/760: mknod d0/d4/d21/d35/d4e/d84/d69/cfe 0 2023-12-16T07:40:45.759 INFO:tasks.workunit.client.1.smithi133.stdout:5/450: rename d1/de/d57/d74/d89 to d1/d4b/da5 0 2023-12-16T07:40:45.761 INFO:tasks.workunit.client.1.smithi133.stdout:2/500: symlink da/d15/l9d 0 2023-12-16T07:40:45.762 INFO:tasks.workunit.client.1.smithi133.stdout:2/501: dread - da/d1d/d60/d71/d2e/d47/f5e zero size 2023-12-16T07:40:45.762 INFO:tasks.workunit.client.1.smithi133.stdout:6/761: symlink d0/d4/d21/d35/d4e/d84/d69/lff 0 2023-12-16T07:40:45.762 INFO:tasks.workunit.client.1.smithi133.stdout:6/762: readlink d0/d4/d21/d62/le5 0 2023-12-16T07:40:45.762 INFO:tasks.workunit.client.1.smithi133.stdout:6/763: write d0/fcd [1051521,30633] 0 2023-12-16T07:40:45.764 INFO:tasks.workunit.client.1.smithi133.stdout:5/451: creat d1/de/d52/d95/fa6 x:0 0 0 2023-12-16T07:40:45.764 INFO:tasks.workunit.client.1.smithi133.stdout:5/452: write d1/d1c/f38 [3787469,99584] 0 2023-12-16T07:40:45.766 INFO:tasks.workunit.client.1.smithi133.stdout:2/502: creat da/d1d/d60/d71/d2e/d47/f9e x:0 0 0 2023-12-16T07:40:45.766 INFO:tasks.workunit.client.1.smithi133.stdout:2/503: fdatasync da/d1d/d60/d71/f37 0 2023-12-16T07:40:45.769 INFO:tasks.workunit.client.1.smithi133.stdout:7/862: dread db/d3e/d4a/d58/d86/fa4 [0,4194304] 0 2023-12-16T07:40:45.769 INFO:tasks.workunit.client.1.smithi133.stdout:7/863: stat db/d21/d2c/d31/lac 0 2023-12-16T07:40:45.769 INFO:tasks.workunit.client.1.smithi133.stdout:6/764: truncate d0/d5e/d75/fd1 2293204 0 2023-12-16T07:40:45.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/610: dwrite d15/d18/d80/d73/f7b [0,4194304] 0 2023-12-16T07:40:45.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/611: chown d15/d18/d2c/d68/f8e 229137922 1 2023-12-16T07:40:45.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/612: readlink l4 0 2023-12-16T07:40:45.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/613: chown d15/d18/d4d/d7e/f9d 0 1 2023-12-16T07:40:45.770 INFO:tasks.workunit.client.1.smithi133.stdout:7/864: creat db/d21/d2c/d31/d59/f11e x:0 0 0 2023-12-16T07:40:45.770 INFO:tasks.workunit.client.1.smithi133.stdout:7/865: write db/fa0 [686352,91248] 0 2023-12-16T07:40:45.771 INFO:tasks.workunit.client.1.smithi133.stdout:0/569: dwrite d2/d17/d2b/fa5 [0,4194304] 0 2023-12-16T07:40:45.771 INFO:tasks.workunit.client.1.smithi133.stdout:7/866: write db/d3e/d4a/d58/d86/d8b/d8d/f95 [1631266,81004] 0 2023-12-16T07:40:45.772 INFO:tasks.workunit.client.1.smithi133.stdout:1/591: sync 2023-12-16T07:40:45.773 INFO:tasks.workunit.client.1.smithi133.stdout:6/765: truncate d0/d4/d21/d35/d36/f9f 194752 0 2023-12-16T07:40:45.774 INFO:tasks.workunit.client.1.smithi133.stdout:7/867: write db/d3e/d4a/d58/d86/fa4 [1649432,108942] 0 2023-12-16T07:40:45.775 INFO:tasks.workunit.client.1.smithi133.stdout:0/570: creat d2/d17/d2b/d31/d63/fb7 x:0 0 0 2023-12-16T07:40:45.775 INFO:tasks.workunit.client.1.smithi133.stdout:0/571: chown d2/d9/d20/d5e/d92/c94 0 1 2023-12-16T07:40:45.776 INFO:tasks.workunit.client.1.smithi133.stdout:1/592: write d0/d1c/d37/f4a [1440561,88157] 0 2023-12-16T07:40:45.778 INFO:tasks.workunit.client.1.smithi133.stdout:6/766: rename d0/d5e/d75/d81/laf to d0/d4/df8/l100 0 2023-12-16T07:40:45.779 INFO:tasks.workunit.client.1.smithi133.stdout:3/458: sync 2023-12-16T07:40:45.779 INFO:tasks.workunit.client.1.smithi133.stdout:4/745: sync 2023-12-16T07:40:45.779 INFO:tasks.workunit.client.1.smithi133.stdout:8/529: sync 2023-12-16T07:40:45.782 INFO:tasks.workunit.client.1.smithi133.stdout:0/572: mknod d2/d9/d20/d5e/d89/da2/cb8 0 2023-12-16T07:40:45.783 INFO:tasks.workunit.client.1.smithi133.stdout:1/593: symlink d0/da/d3d/d41/d9f/lbf 0 2023-12-16T07:40:45.783 INFO:tasks.workunit.client.1.smithi133.stdout:1/594: fsync d0/d12/d51/dac/d24/d32/d56/fb1 0 2023-12-16T07:40:45.785 INFO:tasks.workunit.client.1.smithi133.stdout:7/868: dread db/d3e/d4a/d58/d86/d8b/f90 [0,4194304] 0 2023-12-16T07:40:45.786 INFO:tasks.workunit.client.1.smithi133.stdout:6/767: rename d0/d4/d21/d8a/d93/d8e/fbe to d0/d4/d21/d35/d7e/dac/f101 0 2023-12-16T07:40:45.786 INFO:tasks.workunit.client.1.smithi133.stdout:6/768: readlink d0/d5e/d75/dad/lc9 0 2023-12-16T07:40:45.786 INFO:tasks.workunit.client.1.smithi133.stdout:7/869: dread db/d21/d2c/f48 [0,4194304] 0 2023-12-16T07:40:45.787 INFO:tasks.workunit.client.1.smithi133.stdout:8/530: creat d9/d85/fae x:0 0 0 2023-12-16T07:40:45.787 INFO:tasks.workunit.client.1.smithi133.stdout:5/453: dwrite d1/d1c/d80/d64/f65 [0,4194304] 0 2023-12-16T07:40:45.788 INFO:tasks.workunit.client.1.smithi133.stdout:2/504: dwrite da/d1d/d60/d71/d3a/d61/f68 [0,4194304] 0 2023-12-16T07:40:45.788 INFO:tasks.workunit.client.1.smithi133.stdout:2/505: chown da/d15/d1b/d83/c93 18934302 1 2023-12-16T07:40:45.789 INFO:tasks.workunit.client.1.smithi133.stdout:3/459: symlink d7/d8/d1c/d87/dad/lc0 0 2023-12-16T07:40:45.789 INFO:tasks.workunit.client.1.smithi133.stdout:2/506: read da/d15/d1b/d43/f45 [229027,80832] 0 2023-12-16T07:40:45.791 INFO:tasks.workunit.client.1.smithi133.stdout:0/573: link d2/d17/d2b/d67/f73 d2/d9/d20/d5e/fb9 0 2023-12-16T07:40:45.792 INFO:tasks.workunit.client.1.smithi133.stdout:0/574: write d2/d17/d2b/f88 [317755,79117] 0 2023-12-16T07:40:45.792 INFO:tasks.workunit.client.1.smithi133.stdout:1/595: symlink d0/da/d3d/d41/d9f/lc0 0 2023-12-16T07:40:45.792 INFO:tasks.workunit.client.1.smithi133.stdout:1/596: write d0/d12/f40 [2498910,40785] 0 2023-12-16T07:40:45.793 INFO:tasks.workunit.client.1.smithi133.stdout:5/454: write d1/d1c/f3b [5955625,40455] 0 2023-12-16T07:40:45.793 INFO:tasks.workunit.client.1.smithi133.stdout:5/455: dread - d1/d1c/d80/d64/f7a zero size 2023-12-16T07:40:45.797 INFO:tasks.workunit.client.1.smithi133.stdout:7/870: link db/d21/d2c/lb0 db/d21/db1/l11f 0 2023-12-16T07:40:45.797 INFO:tasks.workunit.client.1.smithi133.stdout:7/871: write db/d21/d2c/d31/d59/de7/d119/df7/fd6 [877011,90384] 0 2023-12-16T07:40:45.799 INFO:tasks.workunit.client.1.smithi133.stdout:4/746: dwrite d3/d7/d38/dd5/da7/daa/dc6/ff3 [0,4194304] 0 2023-12-16T07:40:45.800 INFO:tasks.workunit.client.1.smithi133.stdout:8/531: rename d9/d11/d42/c9f to d9/d3f/caf 0 2023-12-16T07:40:45.802 INFO:tasks.workunit.client.1.smithi133.stdout:3/460: creat d7/d8/d1c/d7e/fc1 x:0 0 0 2023-12-16T07:40:45.805 INFO:tasks.workunit.client.1.smithi133.stdout:2/507: creat da/d15/f9f x:0 0 0 2023-12-16T07:40:45.805 INFO:tasks.workunit.client.1.smithi133.stdout:2/508: chown da/l1c 6 1 2023-12-16T07:40:45.808 INFO:tasks.workunit.client.1.smithi133.stdout:5/456: rmdir d1/d18/d6f/d71 39 2023-12-16T07:40:45.809 INFO:tasks.workunit.client.1.smithi133.stdout:1/597: dwrite d0/d12/f3f [4194304,4194304] 0 2023-12-16T07:40:45.809 INFO:tasks.workunit.client.1.smithi133.stdout:1/598: truncate d0/d12/d51/f9d 406939 0 2023-12-16T07:40:45.810 INFO:tasks.workunit.client.1.smithi133.stdout:6/769: truncate d0/d4/d21/d8a/d93/fa0 1827824 0 2023-12-16T07:40:45.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/872: creat db/d21/d2c/d31/d59/de7/d119/db5/f120 x:0 0 0 2023-12-16T07:40:45.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/575: dwrite d2/d17/d2b/d31/d4d/f9a [0,4194304] 0 2023-12-16T07:40:45.818 INFO:tasks.workunit.client.1.smithi133.stdout:4/747: getdents d3/d7/d6d/d89/dbf 0 2023-12-16T07:40:45.818 INFO:tasks.workunit.client.1.smithi133.stdout:4/748: chown d3 25637 1 2023-12-16T07:40:45.821 INFO:tasks.workunit.client.1.smithi133.stdout:8/532: truncate d9/d10/f91 1687830 0 2023-12-16T07:40:45.822 INFO:tasks.workunit.client.1.smithi133.stdout:3/461: creat d7/d8/d1c/d2b/d2d/fc2 x:0 0 0 2023-12-16T07:40:45.824 INFO:tasks.workunit.client.1.smithi133.stdout:2/509: link da/d1d/d60/d71/d2e/d59/f9b da/d15/d17/fa0 0 2023-12-16T07:40:45.824 INFO:tasks.workunit.client.1.smithi133.stdout:2/510: chown da/d1d/d60/d71/d2e/d59/l66 1385424 1 2023-12-16T07:40:45.824 INFO:tasks.workunit.client.1.smithi133.stdout:2/511: fdatasync da/d1d/f2f 0 2023-12-16T07:40:45.825 INFO:tasks.workunit.client.1.smithi133.stdout:5/457: getdents d1/d1c/d80 0 2023-12-16T07:40:45.825 INFO:tasks.workunit.client.1.smithi133.stdout:5/458: dread - d1/de/f76 zero size 2023-12-16T07:40:45.827 INFO:tasks.workunit.client.1.smithi133.stdout:7/873: dwrite db/d21/d2c/d31/d79/ffe [0,4194304] 0 2023-12-16T07:40:45.830 INFO:tasks.workunit.client.1.smithi133.stdout:1/599: link d0/l62 d0/da/d3d/d41/lc1 0 2023-12-16T07:40:45.831 INFO:tasks.workunit.client.1.smithi133.stdout:6/770: creat d0/d5e/d75/d81/f102 x:0 0 0 2023-12-16T07:40:45.832 INFO:tasks.workunit.client.1.smithi133.stdout:6/771: dread - d0/d5e/d75/dad/fbf zero size 2023-12-16T07:40:45.837 INFO:tasks.workunit.client.1.smithi133.stdout:0/576: getdents d2/d17/d2b/d31/d4d 0 2023-12-16T07:40:45.838 INFO:tasks.workunit.client.1.smithi133.stdout:0/577: fsync d2/f8 0 2023-12-16T07:40:45.840 INFO:tasks.workunit.client.1.smithi133.stdout:4/749: rename d3/d7/d38/dd5/f55 to d3/d7/d6d/d89/dbf/ff9 0 2023-12-16T07:40:45.841 INFO:tasks.workunit.client.1.smithi133.stdout:8/533: getdents d9/dc/d27 0 2023-12-16T07:40:45.844 INFO:tasks.workunit.client.1.smithi133.stdout:3/462: link d7/d8/d1d/d2a/d62/l6f d7/d8/d78/d43/lc3 0 2023-12-16T07:40:45.845 INFO:tasks.workunit.client.1.smithi133.stdout:2/512: creat da/d1d/d60/d71/d3a/fa1 x:0 0 0 2023-12-16T07:40:45.850 INFO:tasks.workunit.client.1.smithi133.stdout:7/874: symlink db/d21/d2c/d31/d59/l121 0 2023-12-16T07:40:45.858 INFO:tasks.workunit.client.1.smithi133.stdout:1/600: rmdir d0/d12/d51 39 2023-12-16T07:40:45.860 INFO:tasks.workunit.client.1.smithi133.stdout:6/772: link d0/l6d d0/d4/d21/d35/d7e/ded/l103 0 2023-12-16T07:40:45.860 INFO:tasks.workunit.client.1.smithi133.stdout:6/773: truncate d0/d4/d21/d35/f79 4159364 0 2023-12-16T07:40:45.861 INFO:tasks.workunit.client.1.smithi133.stdout:6/774: write d0/d5e/d75/d81/d99/fd6 [472723,18253] 0 2023-12-16T07:40:45.861 INFO:tasks.workunit.client.1.smithi133.stdout:6/775: dread - d0/d5e/d75/dcf/ffd zero size 2023-12-16T07:40:45.863 INFO:tasks.workunit.client.1.smithi133.stdout:0/578: creat d2/d9/d20/d5e/d89/fba x:0 0 0 2023-12-16T07:40:45.863 INFO:tasks.workunit.client.1.smithi133.stdout:0/579: truncate d2/d17/d2b/d31/d4d/fa1 4970767 0 2023-12-16T07:40:45.865 INFO:tasks.workunit.client.1.smithi133.stdout:0/580: write d2/d9/d12/f14 [1437410,62263] 0 2023-12-16T07:40:45.867 INFO:tasks.workunit.client.1.smithi133.stdout:8/534: getdents d9/d10/d39/d48/d44/d6e 0 2023-12-16T07:40:45.867 INFO:tasks.workunit.client.1.smithi133.stdout:8/535: write d9/d11/f7d [227080,39594] 0 2023-12-16T07:40:45.869 INFO:tasks.workunit.client.1.smithi133.stdout:3/463: rmdir d7/d8/d78/d43/d7f/d85 39 2023-12-16T07:40:45.870 INFO:tasks.workunit.client.1.smithi133.stdout:8/536: write d9/dc/f4c [2776617,61755] 0 2023-12-16T07:40:45.870 INFO:tasks.workunit.client.1.smithi133.stdout:8/537: dread - d9/f6a zero size 2023-12-16T07:40:45.870 INFO:tasks.workunit.client.1.smithi133.stdout:0/581: dread d2/d17/d2b/f4b [0,4194304] 0 2023-12-16T07:40:45.870 INFO:tasks.workunit.client.1.smithi133.stdout:2/513: creat da/d15/d17/d40/fa2 x:0 0 0 2023-12-16T07:40:45.871 INFO:tasks.workunit.client.1.smithi133.stdout:2/514: truncate da/d1d/d60/d71/d3a/f7d 1042196 0 2023-12-16T07:40:45.871 INFO:tasks.workunit.client.1.smithi133.stdout:2/515: readlink da/d1d/d60/d71/d2e/d59/l66 0 2023-12-16T07:40:45.872 INFO:tasks.workunit.client.1.smithi133.stdout:7/875: creat db/d21/d2c/d31/d6e/dad/f122 x:0 0 0 2023-12-16T07:40:45.874 INFO:tasks.workunit.client.1.smithi133.stdout:1/601: mkdir d0/da/d3d/dc2 0 2023-12-16T07:40:45.876 INFO:tasks.workunit.client.1.smithi133.stdout:6/776: getdents d0/d4/dee 0 2023-12-16T07:40:45.878 INFO:tasks.workunit.client.1.smithi133.stdout:3/464: symlink d7/d8/d72/d77/lc4 0 2023-12-16T07:40:45.879 INFO:tasks.workunit.client.1.smithi133.stdout:2/516: mkdir da/d15/d1b/d83/da3 0 2023-12-16T07:40:45.879 INFO:tasks.workunit.client.1.smithi133.stdout:2/517: stat da/d50 0 2023-12-16T07:40:45.881 INFO:tasks.workunit.client.1.smithi133.stdout:7/876: creat db/d53/f123 x:0 0 0 2023-12-16T07:40:45.882 INFO:tasks.workunit.client.1.smithi133.stdout:1/602: mkdir d0/d12/d51/dac/dc3 0 2023-12-16T07:40:45.882 INFO:tasks.workunit.client.1.smithi133.stdout:1/603: fdatasync d0/d12/d51/dac/d24/d5a/d68/f76 0 2023-12-16T07:40:45.882 INFO:tasks.workunit.client.1.smithi133.stdout:1/604: stat d0/d1c/d37/c7b 0 2023-12-16T07:40:45.883 INFO:tasks.workunit.client.1.smithi133.stdout:6/777: symlink d0/d5e/d75/l104 0 2023-12-16T07:40:45.885 INFO:tasks.workunit.client.1.smithi133.stdout:3/465: mknod d7/d8/d1d/d2a/d62/cc5 0 2023-12-16T07:40:45.886 INFO:tasks.workunit.client.1.smithi133.stdout:2/518: creat da/d50/d8e/fa4 x:0 0 0 2023-12-16T07:40:45.886 INFO:tasks.workunit.client.1.smithi133.stdout:7/877: symlink db/d3e/d4a/d58/db9/l124 0 2023-12-16T07:40:45.888 INFO:tasks.workunit.client.1.smithi133.stdout:1/605: mkdir d0/dc4 0 2023-12-16T07:40:45.888 INFO:tasks.workunit.client.1.smithi133.stdout:6/778: read d0/d4/d21/d8a/d93/fa5 [169892,128746] 0 2023-12-16T07:40:45.890 INFO:tasks.workunit.client.1.smithi133.stdout:3/466: symlink d7/d8/d72/d86/lc6 0 2023-12-16T07:40:45.890 INFO:tasks.workunit.client.1.smithi133.stdout:0/582: dwrite d2/d17/f1b [4194304,4194304] 0 2023-12-16T07:40:45.892 INFO:tasks.workunit.client.1.smithi133.stdout:8/538: dwrite d9/dc/f30 [0,4194304] 0 2023-12-16T07:40:45.892 INFO:tasks.workunit.client.1.smithi133.stdout:8/539: read - d9/d10/d39/d48/d92/f95 zero size 2023-12-16T07:40:45.892 INFO:tasks.workunit.client.1.smithi133.stdout:8/540: truncate d9/d10/d39/d48/d44/d6e/f94 1830257 0 2023-12-16T07:40:45.892 INFO:tasks.workunit.client.1.smithi133.stdout:2/519: link da/d15/d1b/f75 da/d15/d17/d40/fa5 0 2023-12-16T07:40:45.895 INFO:tasks.workunit.client.1.smithi133.stdout:7/878: link db/d3e/d4a/d58/lda db/d3e/d4a/d58/d86/d8b/l125 0 2023-12-16T07:40:45.896 INFO:tasks.workunit.client.1.smithi133.stdout:1/606: creat d0/d12/d51/db6/fc5 x:0 0 0 2023-12-16T07:40:45.897 INFO:tasks.workunit.client.1.smithi133.stdout:3/467: mknod d7/d8/d78/d43/d7f/cc7 0 2023-12-16T07:40:45.897 INFO:tasks.workunit.client.1.smithi133.stdout:3/468: chown d7/d8/d1d/d2a/d5f/c73 3161989 1 2023-12-16T07:40:45.898 INFO:tasks.workunit.client.1.smithi133.stdout:8/541: truncate d9/d10/d39/d48/d44/f6b 3406936 0 2023-12-16T07:40:45.900 INFO:tasks.workunit.client.1.smithi133.stdout:2/520: mkdir da/d1d/d60/d71/d3a/da6 0 2023-12-16T07:40:45.900 INFO:tasks.workunit.client.1.smithi133.stdout:2/521: dread - da/d15/d17/d40/fa2 zero size 2023-12-16T07:40:45.900 INFO:tasks.workunit.client.1.smithi133.stdout:2/522: chown da/d1d/d60/d71 0 1 2023-12-16T07:40:45.901 INFO:tasks.workunit.client.1.smithi133.stdout:7/879: creat db/d3e/d4a/d58/d86/f126 x:0 0 0 2023-12-16T07:40:45.907 INFO:tasks.workunit.client.1.smithi133.stdout:1/607: truncate d0/d12/d51/f64 1579450 0 2023-12-16T07:40:45.907 INFO:tasks.workunit.client.1.smithi133.stdout:1/608: read d0/d12/d51/dac/d24/d32/d3e/d70/d8f/fab [6452,73849] 0 2023-12-16T07:40:45.908 INFO:tasks.workunit.client.1.smithi133.stdout:3/469: truncate d7/d8/d1c/f41 183511 0 2023-12-16T07:40:45.909 INFO:tasks.workunit.client.1.smithi133.stdout:6/779: dwrite d0/d4/d21/d35/f95 [0,4194304] 0 2023-12-16T07:40:45.909 INFO:tasks.workunit.client.1.smithi133.stdout:6/780: dread - d0/d4/d21/d60/f66 zero size 2023-12-16T07:40:45.913 INFO:tasks.workunit.client.1.smithi133.stdout:2/523: mkdir da/d15/d1b/d83/da7 0 2023-12-16T07:40:45.913 INFO:tasks.workunit.client.1.smithi133.stdout:6/781: unlink d0/d4/d21/d8a/d93/d8e/l8f 0 2023-12-16T07:40:45.914 INFO:tasks.workunit.client.1.smithi133.stdout:0/583: dwrite d2/d17/d2b/f77 [0,4194304] 0 2023-12-16T07:40:45.915 INFO:tasks.workunit.client.1.smithi133.stdout:1/609: dread d0/d12/d51/dac/f2f [0,4194304] 0 2023-12-16T07:40:45.915 INFO:tasks.workunit.client.1.smithi133.stdout:1/610: chown d0/d1c/d71/l87 5666584 1 2023-12-16T07:40:45.915 INFO:tasks.workunit.client.1.smithi133.stdout:1/611: write d0/da/fb5 [4382824,96937] 0 2023-12-16T07:40:45.915 INFO:tasks.workunit.client.1.smithi133.stdout:1/612: stat d0/d1c/d37/f84 0 2023-12-16T07:40:45.915 INFO:tasks.workunit.client.1.smithi133.stdout:1/613: write d0/d12/d51/dac/f21 [1943433,102050] 0 2023-12-16T07:40:45.915 INFO:tasks.workunit.client.1.smithi133.stdout:1/614: fdatasync d0/d12/f58 0 2023-12-16T07:40:45.916 INFO:tasks.workunit.client.1.smithi133.stdout:6/782: mknod d0/d4/d21/d35/d4e/d84/d69/dbd/c105 0 2023-12-16T07:40:45.917 INFO:tasks.workunit.client.1.smithi133.stdout:0/584: symlink d2/d9/d20/lbb 0 2023-12-16T07:40:45.918 INFO:tasks.workunit.client.1.smithi133.stdout:1/615: mknod d0/d12/d51/db6/cc6 0 2023-12-16T07:40:45.919 INFO:tasks.workunit.client.1.smithi133.stdout:6/783: creat d0/d5e/d75/dad/f106 x:0 0 0 2023-12-16T07:40:45.921 INFO:tasks.workunit.client.1.smithi133.stdout:0/585: unlink d2/d9/d8f/l8e 0 2023-12-16T07:40:45.933 INFO:tasks.workunit.client.1.smithi133.stdout:4/750: rename d3/d7/d6d to d3/d7/d1c/d2a/d91/dbe/dfa 0 2023-12-16T07:40:45.934 INFO:tasks.workunit.client.1.smithi133.stdout:2/524: rename f2 to da/d15/fa8 0 2023-12-16T07:40:45.935 INFO:tasks.workunit.client.1.smithi133.stdout:4/751: rename d3/c32 to d3/d7/d38/dd5/da7/daa/dc6/cfb 0 2023-12-16T07:40:45.937 INFO:tasks.workunit.client.1.smithi133.stdout:2/525: truncate da/d15/d17/f84 4909265 0 2023-12-16T07:40:45.937 INFO:tasks.workunit.client.1.smithi133.stdout:2/526: readlink da/d1d/d60/l65 0 2023-12-16T07:40:45.937 INFO:tasks.workunit.client.1.smithi133.stdout:2/527: write da/d1d/d60/d71/d2e/d59/f9b [577876,127661] 0 2023-12-16T07:40:45.937 INFO:tasks.workunit.client.1.smithi133.stdout:2/528: chown da/d1d/f2f 5 1 2023-12-16T07:40:45.937 INFO:tasks.workunit.client.1.smithi133.stdout:2/529: chown da/d15/d1b/f78 115683 1 2023-12-16T07:40:45.937 INFO:tasks.workunit.client.1.smithi133.stdout:4/752: rmdir d3/d7/d38/dd5/dac 39 2023-12-16T07:40:45.938 INFO:tasks.workunit.client.1.smithi133.stdout:2/530: mknod da/d1d/d60/d71/d2e/d47/d52/d80/ca9 0 2023-12-16T07:40:45.939 INFO:tasks.workunit.client.1.smithi133.stdout:2/531: write da/d1d/d60/d74/f95 [804884,92967] 0 2023-12-16T07:40:45.942 INFO:tasks.workunit.client.1.smithi133.stdout:0/586: dwrite d2/d17/d2b/d31/d4d/fa1 [0,4194304] 0 2023-12-16T07:40:45.942 INFO:tasks.workunit.client.1.smithi133.stdout:0/587: fsync d2/d17/d2b/d31/d4d/d54/f80 0 2023-12-16T07:40:45.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/588: read d2/d17/d2b/f4b [1131729,5978] 0 2023-12-16T07:40:45.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/589: chown d2/d9/db/c5b 2406818 1 2023-12-16T07:40:45.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/590: truncate d2/d9/d20/d5e/d92/f81 4537475 0 2023-12-16T07:40:45.945 INFO:tasks.workunit.client.1.smithi133.stdout:0/591: creat d2/d9/d12/d35/d4f/d93/fbc x:0 0 0 2023-12-16T07:40:45.945 INFO:tasks.workunit.client.1.smithi133.stdout:0/592: stat d2/d9/d12/d76/l99 0 2023-12-16T07:40:45.991 INFO:tasks.workunit.client.1.smithi133.stdout:3/470: dread d7/d8/d1d/d2a/f3c [0,4194304] 0 2023-12-16T07:40:45.997 INFO:tasks.workunit.client.1.smithi133.stdout:6/784: rmdir d0/d4/d21/d8a 39 2023-12-16T07:40:45.998 INFO:tasks.workunit.client.1.smithi133.stdout:6/785: write d0/fd9 [550608,83647] 0 2023-12-16T07:40:45.998 INFO:tasks.workunit.client.1.smithi133.stdout:6/786: chown d0/d4/d21/d35/f6c 7942044 1 2023-12-16T07:40:46.000 INFO:tasks.workunit.client.1.smithi133.stdout:6/787: mkdir d0/d5e/d8c/d107 0 2023-12-16T07:40:46.001 INFO:tasks.workunit.client.1.smithi133.stdout:8/542: dread d9/d10/d39/d48/d44/f6b [0,4194304] 0 2023-12-16T07:40:46.002 INFO:tasks.workunit.client.1.smithi133.stdout:8/543: dread - d9/d11/d52/f9b zero size 2023-12-16T07:40:46.003 INFO:tasks.workunit.client.1.smithi133.stdout:6/788: creat d0/d4/dee/f108 x:0 0 0 2023-12-16T07:40:46.003 INFO:tasks.workunit.client.1.smithi133.stdout:6/789: truncate d0/d4/d21/d35/f6c 1230564 0 2023-12-16T07:40:46.003 INFO:tasks.workunit.client.1.smithi133.stdout:6/790: fdatasync d0/f4d 0 2023-12-16T07:40:46.004 INFO:tasks.workunit.client.1.smithi133.stdout:4/753: dwrite d3/d7/d38/d57/f66 [0,4194304] 0 2023-12-16T07:40:46.004 INFO:tasks.workunit.client.1.smithi133.stdout:4/754: fdatasync d3/d7/f23 0 2023-12-16T07:40:46.005 INFO:tasks.workunit.client.1.smithi133.stdout:8/544: link d9/d10/d39/d48/f7f d9/dc/d27/fb0 0 2023-12-16T07:40:46.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/791: creat d0/d4/d21/d35/d4e/d84/d69/da1/f109 x:0 0 0 2023-12-16T07:40:46.008 INFO:tasks.workunit.client.1.smithi133.stdout:8/545: creat d9/d10/d39/d48/d44/d6e/d78/fb1 x:0 0 0 2023-12-16T07:40:46.008 INFO:tasks.workunit.client.1.smithi133.stdout:8/546: fdatasync d9/d10/d39/d48/d44/d69/fa9 0 2023-12-16T07:40:46.009 INFO:tasks.workunit.client.1.smithi133.stdout:6/792: creat d0/d4/d21/d8a/da4/f10a x:0 0 0 2023-12-16T07:40:46.009 INFO:tasks.workunit.client.1.smithi133.stdout:4/755: write d3/fa [3511819,98441] 0 2023-12-16T07:40:46.009 INFO:tasks.workunit.client.1.smithi133.stdout:8/547: creat d9/d11/d52/fb2 x:0 0 0 2023-12-16T07:40:46.010 INFO:tasks.workunit.client.1.smithi133.stdout:4/756: write d3/f59 [791237,110919] 0 2023-12-16T07:40:46.011 INFO:tasks.workunit.client.1.smithi133.stdout:6/793: rename d0/d5e/d75/lce to d0/d4/d21/d8a/d93/d8e/l10b 0 2023-12-16T07:40:46.011 INFO:tasks.workunit.client.1.smithi133.stdout:8/548: getdents d9/d3f 0 2023-12-16T07:40:46.013 INFO:tasks.workunit.client.1.smithi133.stdout:4/757: dread d3/d7/d38/d57/d67/f6a [0,4194304] 0 2023-12-16T07:40:46.013 INFO:tasks.workunit.client.1.smithi133.stdout:4/758: truncate d3/d7/d1c/d2a/d91/dbe/dfa/fbd 4844686 0 2023-12-16T07:40:46.013 INFO:tasks.workunit.client.1.smithi133.stdout:6/794: creat d0/d4/d21/d35/d4e/d84/d69/da1/f10c x:0 0 0 2023-12-16T07:40:46.013 INFO:tasks.workunit.client.1.smithi133.stdout:4/759: write d3/d7/d38/dd5/f94 [4731133,26120] 0 2023-12-16T07:40:46.013 INFO:tasks.workunit.client.1.smithi133.stdout:6/795: fsync d0/d4/d21/d35/f6c 0 2023-12-16T07:40:46.013 INFO:tasks.workunit.client.1.smithi133.stdout:6/796: chown d0/d4 196 1 2023-12-16T07:40:46.013 INFO:tasks.workunit.client.1.smithi133.stdout:6/797: chown d0/d4/c2f 239 1 2023-12-16T07:40:46.014 INFO:tasks.workunit.client.1.smithi133.stdout:8/549: creat d9/dc/de/fb3 x:0 0 0 2023-12-16T07:40:46.017 INFO:tasks.workunit.client.1.smithi133.stdout:3/471: dwrite d7/d8/d1c/f26 [0,4194304] 0 2023-12-16T07:40:46.017 INFO:tasks.workunit.client.1.smithi133.stdout:1/616: dwrite d0/d12/d51/dac/d24/f5d [0,4194304] 0 2023-12-16T07:40:46.018 INFO:tasks.workunit.client.1.smithi133.stdout:4/760: rename d3/d7/d1c/d2a/f7c to d3/d7/d1c/db0/dc8/ffc 0 2023-12-16T07:40:46.020 INFO:tasks.workunit.client.1.smithi133.stdout:6/798: rmdir d0/d4/d21/d35/d7e 39 2023-12-16T07:40:46.022 INFO:tasks.workunit.client.1.smithi133.stdout:8/550: symlink d9/d10/d39/d48/d92/lb4 0 2023-12-16T07:40:46.025 INFO:tasks.workunit.client.1.smithi133.stdout:6/799: dread d0/d4/d21/d35/f6c [0,4194304] 0 2023-12-16T07:40:46.026 INFO:tasks.workunit.client.1.smithi133.stdout:3/472: symlink d7/d8/d78/d43/lc8 0 2023-12-16T07:40:46.027 INFO:tasks.workunit.client.1.smithi133.stdout:4/761: rename d3/d7/d38/d57/d75/cc9 to d3/d7/d38/dd5/dac/dcf/cfd 0 2023-12-16T07:40:46.028 INFO:tasks.workunit.client.1.smithi133.stdout:6/800: symlink d0/d4/l10d 0 2023-12-16T07:40:46.028 INFO:tasks.workunit.client.1.smithi133.stdout:6/801: truncate d0/d4/f1c 1644384 0 2023-12-16T07:40:46.029 INFO:tasks.workunit.client.1.smithi133.stdout:3/473: mkdir d7/d8/d1d/dc9 0 2023-12-16T07:40:46.033 INFO:tasks.workunit.client.1.smithi133.stdout:6/802: unlink d0/d4/f11 0 2023-12-16T07:40:46.035 INFO:tasks.workunit.client.1.smithi133.stdout:3/474: write d7/d8/d1d/f52 [2838034,58452] 0 2023-12-16T07:40:46.047 INFO:tasks.workunit.client.1.smithi133.stdout:3/475: creat d7/d8/d1d/d2a/fca x:0 0 0 2023-12-16T07:40:46.048 INFO:tasks.workunit.client.1.smithi133.stdout:6/803: symlink d0/d4/d21/d8a/d93/l10e 0 2023-12-16T07:40:46.050 INFO:tasks.workunit.client.1.smithi133.stdout:6/804: read d0/d4/d21/d60/fbb [565672,112918] 0 2023-12-16T07:40:46.053 INFO:tasks.workunit.client.1.smithi133.stdout:8/551: dwrite d9/d85/fae [0,4194304] 0 2023-12-16T07:40:46.053 INFO:tasks.workunit.client.1.smithi133.stdout:8/552: write d9/d10/d39/d48/d92/f95 [97302,2241] 0 2023-12-16T07:40:46.056 INFO:tasks.workunit.client.1.smithi133.stdout:1/617: dwrite d0/d12/d51/dac/d24/d32/f86 [0,4194304] 0 2023-12-16T07:40:46.058 INFO:tasks.workunit.client.1.smithi133.stdout:8/553: write d9/d2d/f8a [6190127,53866] 0 2023-12-16T07:40:46.066 INFO:tasks.workunit.client.1.smithi133.stdout:8/554: dread d9/f70 [0,4194304] 0 2023-12-16T07:40:46.068 INFO:tasks.workunit.client.1.smithi133.stdout:4/762: dwrite d3/db6/fc7 [4194304,4194304] 0 2023-12-16T07:40:46.075 INFO:tasks.workunit.client.1.smithi133.stdout:8/555: dread d9/d10/d39/d48/f51 [4194304,4194304] 0 2023-12-16T07:40:46.081 INFO:tasks.workunit.client.1.smithi133.stdout:4/763: symlink d3/d7/d1c/d2a/d91/dbe/dd0/de8/lfe 0 2023-12-16T07:40:46.094 INFO:tasks.workunit.client.1.smithi133.stdout:6/805: dwrite d0/d4/d21/d8a/d93/d8e/ff3 [0,4194304] 0 2023-12-16T07:40:46.096 INFO:tasks.workunit.client.1.smithi133.stdout:3/476: dwrite d7/d8/d78/f69 [0,4194304] 0 2023-12-16T07:40:46.096 INFO:tasks.workunit.client.1.smithi133.stdout:3/477: truncate d7/d8/d72/d86/fb9 320558 0 2023-12-16T07:40:46.098 INFO:tasks.workunit.client.1.smithi133.stdout:6/806: read d0/d4/d21/d35/d4e/d84/f58 [152531,64728] 0 2023-12-16T07:40:46.099 INFO:tasks.workunit.client.1.smithi133.stdout:1/618: dwrite d0/d12/d51/f9d [0,4194304] 0 2023-12-16T07:40:46.099 INFO:tasks.workunit.client.1.smithi133.stdout:1/619: chown d0/d12/d51/dac/dc3 3 1 2023-12-16T07:40:46.101 INFO:tasks.workunit.client.1.smithi133.stdout:8/556: dread d9/f5e [0,4194304] 0 2023-12-16T07:40:46.101 INFO:tasks.workunit.client.1.smithi133.stdout:8/557: read - d9/d11/d42/f63 zero size 2023-12-16T07:40:46.104 INFO:tasks.workunit.client.1.smithi133.stdout:4/764: getdents d3/d7/d38/dd5/da7 0 2023-12-16T07:40:46.111 INFO:tasks.workunit.client.1.smithi133.stdout:3/478: mknod d7/d8/d1d/d2a/d62/ccb 0 2023-12-16T07:40:46.112 INFO:tasks.workunit.client.1.smithi133.stdout:6/807: creat d0/d4/dee/f10f x:0 0 0 2023-12-16T07:40:46.112 INFO:tasks.workunit.client.1.smithi133.stdout:6/808: readlink d0/d4/d21/d35/d36/l3f 0 2023-12-16T07:40:46.112 INFO:tasks.workunit.client.1.smithi133.stdout:6/809: fsync d0/d5e/f6f 0 2023-12-16T07:40:46.115 INFO:tasks.workunit.client.1.smithi133.stdout:8/558: mknod d9/cb5 0 2023-12-16T07:40:46.115 INFO:tasks.workunit.client.1.smithi133.stdout:8/559: fdatasync d9/d11/d52/f9b 0 2023-12-16T07:40:46.117 INFO:tasks.workunit.client.1.smithi133.stdout:3/479: mknod d7/d8/d78/d43/ccc 0 2023-12-16T07:40:46.119 INFO:tasks.workunit.client.1.smithi133.stdout:8/560: creat d9/d3f/fb6 x:0 0 0 2023-12-16T07:40:46.119 INFO:tasks.workunit.client.1.smithi133.stdout:8/561: write d9/dc/de/fa4 [383540,11624] 0 2023-12-16T07:40:46.122 INFO:tasks.workunit.client.1.smithi133.stdout:4/765: truncate d3/d7/d1c/d2a/d91/dbe/dfa/d89/dbf/fe9 35399 0 2023-12-16T07:40:46.123 INFO:tasks.workunit.client.1.smithi133.stdout:1/620: dwrite d0/da/f4b [0,4194304] 0 2023-12-16T07:40:46.128 INFO:tasks.workunit.client.1.smithi133.stdout:3/480: write d7/d8/d78/f69 [633283,40575] 0 2023-12-16T07:40:46.130 INFO:tasks.workunit.client.1.smithi133.stdout:8/562: mknod d9/dc/d27/cb7 0 2023-12-16T07:40:46.130 INFO:tasks.workunit.client.1.smithi133.stdout:8/563: chown d9/dc/f4c 1067499192 1 2023-12-16T07:40:46.131 INFO:tasks.workunit.client.1.smithi133.stdout:1/621: symlink d0/da/d3d/dc2/lc7 0 2023-12-16T07:40:46.133 INFO:tasks.workunit.client.1.smithi133.stdout:3/481: creat d7/d8/d72/d86/fcd x:0 0 0 2023-12-16T07:40:46.134 INFO:tasks.workunit.client.1.smithi133.stdout:3/482: dread - d7/d8/d1c/d2b/f9c zero size 2023-12-16T07:40:46.138 INFO:tasks.workunit.client.1.smithi133.stdout:1/622: creat d0/d1c/fc8 x:0 0 0 2023-12-16T07:40:46.140 INFO:tasks.workunit.client.1.smithi133.stdout:3/483: symlink d7/d8/d1c/d7e/lce 0 2023-12-16T07:40:46.144 INFO:tasks.workunit.client.1.smithi133.stdout:1/623: unlink d0/da/d3d/fba 0 2023-12-16T07:40:46.144 INFO:tasks.workunit.client.1.smithi133.stdout:6/810: dwrite d0/d4/d21/f87 [0,4194304] 0 2023-12-16T07:40:46.144 INFO:tasks.workunit.client.1.smithi133.stdout:6/811: read - d0/d4/d21/d8a/da4/ff7 zero size 2023-12-16T07:40:46.144 INFO:tasks.workunit.client.1.smithi133.stdout:6/812: truncate d0/d4/d21/d35/d4e/d84/d69/fa3 901098 0 2023-12-16T07:40:46.144 INFO:tasks.workunit.client.1.smithi133.stdout:6/813: chown d0/d4/d21/d35/d7e 250257 1 2023-12-16T07:40:46.147 INFO:tasks.workunit.client.1.smithi133.stdout:3/484: mknod d7/d8/d1c/d2b/d2d/ccf 0 2023-12-16T07:40:46.154 INFO:tasks.workunit.client.1.smithi133.stdout:6/814: dread d0/d4/f28 [0,4194304] 0 2023-12-16T07:40:46.159 INFO:tasks.workunit.client.1.smithi133.stdout:6/815: creat d0/d4/f110 x:0 0 0 2023-12-16T07:40:46.159 INFO:tasks.workunit.client.1.smithi133.stdout:6/816: write d0/fcd [1844840,38279] 0 2023-12-16T07:40:46.162 INFO:tasks.workunit.client.1.smithi133.stdout:4/766: dwrite d3/d7/d1c/d2a/d91/dbe/fdc [0,4194304] 0 2023-12-16T07:40:46.163 INFO:tasks.workunit.client.1.smithi133.stdout:6/817: dread - d0/d4/d21/d8a/d93/fdf zero size 2023-12-16T07:40:46.168 INFO:tasks.workunit.client.1.smithi133.stdout:4/767: creat d3/d7/d38/dd5/d63/d96/def/fff x:0 0 0 2023-12-16T07:40:46.169 INFO:tasks.workunit.client.1.smithi133.stdout:6/818: creat d0/d4/d21/d8a/d93/d8e/f111 x:0 0 0 2023-12-16T07:40:46.169 INFO:tasks.workunit.client.1.smithi133.stdout:3/485: dwrite d7/d8/d1c/f74 [0,4194304] 0 2023-12-16T07:40:46.169 INFO:tasks.workunit.client.1.smithi133.stdout:3/486: chown d7/d8/d1d/d2a/d62/l6f 5 1 2023-12-16T07:40:46.172 INFO:tasks.workunit.client.1.smithi133.stdout:4/768: mkdir d3/d7/d38/dd5/d63/d96/def/d100 0 2023-12-16T07:40:46.172 INFO:tasks.workunit.client.1.smithi133.stdout:4/769: readlink d3/d7/d1c/l53 0 2023-12-16T07:40:46.174 INFO:tasks.workunit.client.1.smithi133.stdout:6/819: getdents d0/d4/d21/d35/d7e/dac 0 2023-12-16T07:40:46.177 INFO:tasks.workunit.client.1.smithi133.stdout:1/624: dwrite d0/da/f3a [0,4194304] 0 2023-12-16T07:40:46.181 INFO:tasks.workunit.client.1.smithi133.stdout:4/770: truncate d3/d7/d38/d57/f5f 1489137 0 2023-12-16T07:40:46.181 INFO:tasks.workunit.client.1.smithi133.stdout:3/487: creat d7/d8/d72/d77/fd0 x:0 0 0 2023-12-16T07:40:46.182 INFO:tasks.workunit.client.1.smithi133.stdout:3/488: truncate d7/d8/d1c/f38 4263357 0 2023-12-16T07:40:46.183 INFO:tasks.workunit.client.1.smithi133.stdout:6/820: unlink d0/d4/d21/d35/d4e/d84/d69/fc8 0 2023-12-16T07:40:46.186 INFO:tasks.workunit.client.1.smithi133.stdout:6/821: dread d0/d4/d21/d35/d7e/dac/f101 [0,4194304] 0 2023-12-16T07:40:46.190 INFO:tasks.workunit.client.1.smithi133.stdout:1/625: mknod d0/da/d3d/cc9 0 2023-12-16T07:40:46.191 INFO:tasks.workunit.client.1.smithi133.stdout:4/771: mknod d3/d7/d38/d57/c101 0 2023-12-16T07:40:46.195 INFO:tasks.workunit.client.1.smithi133.stdout:3/489: mknod d7/d8/d1c/d7e/d95/cd1 0 2023-12-16T07:40:46.195 INFO:tasks.workunit.client.1.smithi133.stdout:6/822: mknod d0/d5e/d75/d81/d99/c112 0 2023-12-16T07:40:46.200 INFO:tasks.workunit.client.1.smithi133.stdout:4/772: mknod d3/d7/d1c/d2a/d91/dd1/c102 0 2023-12-16T07:40:46.201 INFO:tasks.workunit.client.1.smithi133.stdout:1/626: rename d0/da/d3d/cc9 to d0/d12/cca 0 2023-12-16T07:40:46.201 INFO:tasks.workunit.client.1.smithi133.stdout:1/627: stat d0/d12/f3f 0 2023-12-16T07:40:46.205 INFO:tasks.workunit.client.1.smithi133.stdout:1/628: mknod d0/d12/d51/dac/d24/d32/d56/d59/d66/ccb 0 2023-12-16T07:40:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:45 smithi049 ceph-mon[111939]: Reconfiguring node-exporter.smithi049 (dependencies changed)... 2023-12-16T07:40:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:45 smithi049 ceph-mon[111939]: Reconfiguring daemon node-exporter.smithi049 on smithi049 2023-12-16T07:40:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:45 smithi049 ceph-mon[111939]: pgmap v19: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 171 MiB/s wr, 363 op/s 2023-12-16T07:40:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:45 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:45 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:46.209 INFO:tasks.workunit.client.1.smithi133.stdout:1/629: mkdir d0/d1c/d37/dcc 0 2023-12-16T07:40:46.209 INFO:tasks.workunit.client.1.smithi133.stdout:1/630: write d0/d12/d51/dac/d24/d5a/d68/fbc [558487,69059] 0 2023-12-16T07:40:46.215 INFO:tasks.workunit.client.1.smithi133.stdout:1/631: creat d0/d12/d51/dac/d24/d32/d56/d59/d66/fcd x:0 0 0 2023-12-16T07:40:46.215 INFO:tasks.workunit.client.1.smithi133.stdout:9/614: sync 2023-12-16T07:40:46.217 INFO:tasks.workunit.client.1.smithi133.stdout:1/632: write d0/d12/f40 [650159,115405] 0 2023-12-16T07:40:46.218 INFO:tasks.workunit.client.1.smithi133.stdout:9/615: mknod d15/cd1 0 2023-12-16T07:40:46.218 INFO:tasks.workunit.client.1.smithi133.stdout:9/616: chown d15/d18/f4e 635327085 1 2023-12-16T07:40:46.259 INFO:tasks.workunit.client.1.smithi133.stdout:3/490: dwrite d7/d8/d72/d86/fcd [0,4194304] 0 2023-12-16T07:40:46.260 INFO:tasks.workunit.client.1.smithi133.stdout:6/823: dwrite d0/d5e/d8c/dc5/ff9 [0,4194304] 0 2023-12-16T07:40:46.260 INFO:tasks.workunit.client.1.smithi133.stdout:1/633: rename d0/d12/d51/dac/dc3 to d0/da/d3d/dce 0 2023-12-16T07:40:46.260 INFO:tasks.workunit.client.1.smithi133.stdout:1/634: write d0/d12/d51/dac/d24/d32/d3e/d70/f7c [4593757,104643] 0 2023-12-16T07:40:46.263 INFO:tasks.workunit.client.1.smithi133.stdout:3/491: creat d7/d8/d78/d43/d5b/fd2 x:0 0 0 2023-12-16T07:40:46.263 INFO:tasks.workunit.client.1.smithi133.stdout:6/824: mknod d0/d5e/d75/d81/c113 0 2023-12-16T07:40:46.264 INFO:tasks.workunit.client.1.smithi133.stdout:1/635: mkdir d0/d1c/d71/dcf 0 2023-12-16T07:40:46.265 INFO:tasks.workunit.client.1.smithi133.stdout:3/492: getdents d7/d8 0 2023-12-16T07:40:46.266 INFO:tasks.workunit.client.1.smithi133.stdout:3/493: truncate d7/d8/d1c/fa0 267583 0 2023-12-16T07:40:46.266 INFO:tasks.workunit.client.1.smithi133.stdout:3/494: write d7/d8/f75 [31777,38363] 0 2023-12-16T07:40:46.267 INFO:tasks.workunit.client.1.smithi133.stdout:3/495: write d7/d8/d1c/d2b/f7a [597998,123821] 0 2023-12-16T07:40:46.267 INFO:tasks.workunit.client.1.smithi133.stdout:3/496: stat f6 0 2023-12-16T07:40:46.267 INFO:tasks.workunit.client.1.smithi133.stdout:1/636: mknod d0/da/d3d/dc2/cd0 0 2023-12-16T07:40:46.267 INFO:tasks.workunit.client.1.smithi133.stdout:3/497: creat d7/d8/d1d/d2a/fd3 x:0 0 0 2023-12-16T07:40:46.268 INFO:tasks.workunit.client.1.smithi133.stdout:1/637: symlink d0/d12/d51/dac/d24/d5a/ld1 0 2023-12-16T07:40:46.268 INFO:tasks.workunit.client.1.smithi133.stdout:1/638: chown d0/d12/d51/dac/d24/d32/d56 54210 1 2023-12-16T07:40:46.269 INFO:tasks.workunit.client.1.smithi133.stdout:3/498: symlink d7/d8/d1d/ld4 0 2023-12-16T07:40:46.275 INFO:tasks.workunit.client.1.smithi133.stdout:9/617: dwrite d15/d42/d8d/da9/fc3 [0,4194304] 0 2023-12-16T07:40:46.275 INFO:tasks.workunit.client.1.smithi133.stdout:4/773: dwrite d3/d7/d38/d57/d75/f8a [0,4194304] 0 2023-12-16T07:40:46.293 INFO:tasks.workunit.client.1.smithi133.stdout:6/825: dwrite d0/d4/d21/d8a/d93/fe4 [0,4194304] 0 2023-12-16T07:40:46.293 INFO:tasks.workunit.client.1.smithi133.stdout:6/826: write d0/d5e/d75/dad/f106 [498765,109085] 0 2023-12-16T07:40:46.296 INFO:tasks.workunit.client.1.smithi133.stdout:1/639: dwrite d0/d12/d51/f97 [0,4194304] 0 2023-12-16T07:40:46.297 INFO:tasks.workunit.client.1.smithi133.stdout:1/640: stat d0/lc 0 2023-12-16T07:40:46.297 INFO:tasks.workunit.client.1.smithi133.stdout:9/618: dwrite d15/d18/d2c/d3a/f74 [0,4194304] 0 2023-12-16T07:40:46.298 INFO:tasks.workunit.client.1.smithi133.stdout:4/774: symlink d3/l103 0 2023-12-16T07:40:46.298 INFO:tasks.workunit.client.1.smithi133.stdout:4/775: read - d3/db6/fd6 zero size 2023-12-16T07:40:46.300 INFO:tasks.workunit.client.1.smithi133.stdout:6/827: rmdir d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/dec 0 2023-12-16T07:40:46.304 INFO:tasks.workunit.client.1.smithi133.stdout:6/828: write d0/d4/d21/d8a/d93/fe4 [1379716,26423] 0 2023-12-16T07:40:46.310 INFO:tasks.workunit.client.1.smithi133.stdout:9/619: creat d15/fd2 x:0 0 0 2023-12-16T07:40:46.315 INFO:tasks.workunit.client.1.smithi133.stdout:9/620: mknod d15/d18/cd3 0 2023-12-16T07:40:46.326 INFO:tasks.workunit.client.1.smithi133.stdout:1/641: dwrite d0/d12/d51/dac/f2f [4194304,4194304] 0 2023-12-16T07:40:46.326 INFO:tasks.workunit.client.1.smithi133.stdout:4/776: dwrite d3/d7/d1c/d2a/d91/dbe/dfa/d89/fc5 [0,4194304] 0 2023-12-16T07:40:46.326 INFO:tasks.workunit.client.1.smithi133.stdout:9/621: dread d15/d18/d80/fd0 [0,4194304] 0 2023-12-16T07:40:46.326 INFO:tasks.workunit.client.1.smithi133.stdout:9/622: chown d15/lae 33773 1 2023-12-16T07:40:46.328 INFO:tasks.workunit.client.1.smithi133.stdout:6/829: dwrite d0/d4/f110 [0,4194304] 0 2023-12-16T07:40:46.328 INFO:tasks.workunit.client.1.smithi133.stdout:1/642: creat d0/da/d3d/dce/fd2 x:0 0 0 2023-12-16T07:40:46.328 INFO:tasks.workunit.client.1.smithi133.stdout:1/643: write d0/d12/d51/db6/fc5 [510366,54834] 0 2023-12-16T07:40:46.329 INFO:tasks.workunit.client.1.smithi133.stdout:1/644: write d0/d12/d51/dac/d24/d32/d56/d59/d66/fcd [726351,129720] 0 2023-12-16T07:40:46.329 INFO:tasks.workunit.client.1.smithi133.stdout:1/645: write d0/d12/d51/dac/d24/fae [760323,45219] 0 2023-12-16T07:40:46.329 INFO:tasks.workunit.client.1.smithi133.stdout:1/646: chown d0/da/d3d/d41/d9f/lc0 3 1 2023-12-16T07:40:46.336 INFO:tasks.workunit.client.1.smithi133.stdout:5/459: sync 2023-12-16T07:40:46.337 INFO:tasks.workunit.client.1.smithi133.stdout:5/460: rmdir d1/de/d67 39 2023-12-16T07:40:46.339 INFO:tasks.workunit.client.1.smithi133.stdout:5/461: mkdir d1/d1c/d80/da7 0 2023-12-16T07:40:46.347 INFO:tasks.workunit.client.1.smithi133.stdout:9/623: dwrite f13 [4194304,4194304] 0 2023-12-16T07:40:46.348 INFO:tasks.workunit.client.1.smithi133.stdout:4/777: dwrite d3/d7/d1a/f27 [0,4194304] 0 2023-12-16T07:40:46.348 INFO:tasks.workunit.client.1.smithi133.stdout:4/778: read - d3/d7/d1c/d2a/d91/dbe/fce zero size 2023-12-16T07:40:46.349 INFO:tasks.workunit.client.1.smithi133.stdout:9/624: mkdir d15/d42/d8d/db7/dd4 0 2023-12-16T07:40:46.351 INFO:tasks.workunit.client.1.smithi133.stdout:4/779: truncate d3/d7/d1c/d2a/d91/dbe/fdc 2539208 0 2023-12-16T07:40:46.352 INFO:tasks.workunit.client.1.smithi133.stdout:4/780: chown d3/d7/d1a/f26 1958035138 1 2023-12-16T07:40:46.352 INFO:tasks.workunit.client.1.smithi133.stdout:4/781: write d3/d7/d1c/d2a/d91/dbe/fd2 [402220,79493] 0 2023-12-16T07:40:46.352 INFO:tasks.workunit.client.1.smithi133.stdout:4/782: dread - d3/d7/d38/dd5/da7/daa/dc6/fe3 zero size 2023-12-16T07:40:46.355 INFO:tasks.workunit.client.1.smithi133.stdout:4/783: creat d3/d7/db1/f104 x:0 0 0 2023-12-16T07:40:46.355 INFO:tasks.workunit.client.1.smithi133.stdout:5/462: dwrite d1/de/f76 [0,4194304] 0 2023-12-16T07:40:46.356 INFO:tasks.workunit.client.1.smithi133.stdout:4/784: write d3/d7/d38/dd5/f94 [2828482,89521] 0 2023-12-16T07:40:46.356 INFO:tasks.workunit.client.1.smithi133.stdout:5/463: write d1/d1c/d80/f81 [3960189,36504] 0 2023-12-16T07:40:46.358 INFO:tasks.workunit.client.1.smithi133.stdout:1/647: dwrite d0/d12/d51/dac/f23 [0,4194304] 0 2023-12-16T07:40:46.364 INFO:tasks.workunit.client.1.smithi133.stdout:4/785: creat d3/d7/d38/dd5/da7/f105 x:0 0 0 2023-12-16T07:40:46.365 INFO:tasks.workunit.client.1.smithi133.stdout:5/464: link d1/c6 d1/de/d57/ca8 0 2023-12-16T07:40:46.366 INFO:tasks.workunit.client.1.smithi133.stdout:5/465: read d1/f1a [2268021,74809] 0 2023-12-16T07:40:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:45 smithi133 ceph-mon[120445]: Reconfiguring node-exporter.smithi049 (dependencies changed)... 2023-12-16T07:40:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:45 smithi133 ceph-mon[120445]: Reconfiguring daemon node-exporter.smithi049 on smithi049 2023-12-16T07:40:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:45 smithi133 ceph-mon[120445]: pgmap v19: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 171 MiB/s wr, 363 op/s 2023-12-16T07:40:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:45 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:45 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:46.367 INFO:tasks.workunit.client.1.smithi133.stdout:4/786: read d3/d7/d38/d57/d75/f7e [2089606,42866] 0 2023-12-16T07:40:46.368 INFO:tasks.workunit.client.1.smithi133.stdout:9/625: dwrite d15/fd2 [0,4194304] 0 2023-12-16T07:40:46.369 INFO:tasks.workunit.client.1.smithi133.stdout:1/648: link d0/d12/c49 d0/d1c/d71/cd3 0 2023-12-16T07:40:46.371 INFO:tasks.workunit.client.1.smithi133.stdout:4/787: creat d3/d7/db1/f106 x:0 0 0 2023-12-16T07:40:46.375 INFO:tasks.workunit.client.1.smithi133.stdout:9/626: mknod d15/d18/d80/d73/cd5 0 2023-12-16T07:40:46.381 INFO:tasks.workunit.client.1.smithi133.stdout:9/627: mkdir d15/d18/d5b/dd6 0 2023-12-16T07:40:46.381 INFO:tasks.workunit.client.1.smithi133.stdout:5/466: dwrite d1/de/d57/f8c [0,4194304] 0 2023-12-16T07:40:46.383 INFO:tasks.workunit.client.1.smithi133.stdout:9/628: getdents d15/d42/d8d/da9 0 2023-12-16T07:40:46.388 INFO:tasks.workunit.client.1.smithi133.stdout:5/467: mkdir d1/d18/da9 0 2023-12-16T07:40:46.388 INFO:tasks.workunit.client.1.smithi133.stdout:5/468: fsync d1/d1c/f38 0 2023-12-16T07:40:46.388 INFO:tasks.workunit.client.1.smithi133.stdout:5/469: write d1/d18/d2c/f9a [1026745,28904] 0 2023-12-16T07:40:46.389 INFO:tasks.workunit.client.1.smithi133.stdout:9/629: mknod d15/d18/d2c/d68/da6/cd7 0 2023-12-16T07:40:46.392 INFO:tasks.workunit.client.1.smithi133.stdout:5/470: creat d1/d18/d6f/faa x:0 0 0 2023-12-16T07:40:46.393 INFO:tasks.workunit.client.1.smithi133.stdout:5/471: getdents d1/d18/da9 0 2023-12-16T07:40:46.393 INFO:tasks.workunit.client.1.smithi133.stdout:9/630: mknod d15/d18/d5b/dd6/cd8 0 2023-12-16T07:40:46.394 INFO:tasks.workunit.client.1.smithi133.stdout:9/631: chown d15/c4f 44546 1 2023-12-16T07:40:46.395 INFO:tasks.workunit.client.1.smithi133.stdout:9/632: symlink d15/d42/d8d/ld9 0 2023-12-16T07:40:46.396 INFO:tasks.workunit.client.1.smithi133.stdout:4/788: dwrite d3/d7/d1c/db0/dc8/fb9 [0,4194304] 0 2023-12-16T07:40:46.402 INFO:tasks.workunit.client.1.smithi133.stdout:5/472: dread d1/d18/f42 [0,4194304] 0 2023-12-16T07:40:46.414 INFO:tasks.workunit.client.1.smithi133.stdout:4/789: dwrite d3/d7/d38/dd5/f78 [0,4194304] 0 2023-12-16T07:40:46.442 INFO:tasks.workunit.client.1.smithi133.stdout:9/633: mknod d15/d18/d4d/d94/dab/cda 0 2023-12-16T07:40:46.450 INFO:tasks.workunit.client.1.smithi133.stdout:9/634: dread d15/d18/d5b/fb0 [0,4194304] 0 2023-12-16T07:40:46.450 INFO:tasks.workunit.client.1.smithi133.stdout:9/635: write d15/f16 [1358685,53121] 0 2023-12-16T07:40:46.455 INFO:tasks.workunit.client.1.smithi133.stdout:4/790: mkdir d3/d7/d38/dd5/d63/d96/def/d100/d107 0 2023-12-16T07:40:46.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/791: symlink d3/d7/d1c/d2a/d91/dbe/l108 0 2023-12-16T07:40:46.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/792: write d3/d7/d38/d57/d67/f92 [1000081,30151] 0 2023-12-16T07:40:46.459 INFO:tasks.workunit.client.1.smithi133.stdout:4/793: truncate d3/d7/d1c/d2a/d91/dbe/dfa/fda 431683 0 2023-12-16T07:40:46.460 INFO:tasks.workunit.client.1.smithi133.stdout:9/636: dread d15/fd2 [0,4194304] 0 2023-12-16T07:40:46.461 INFO:tasks.workunit.client.1.smithi133.stdout:4/794: creat d3/d7/d38/dd5/d63/f109 x:0 0 0 2023-12-16T07:40:46.500 INFO:tasks.workunit.client.1.smithi133.stdout:4/795: link d3/d7/db1/cf5 d3/d7/d38/dd5/da7/dbb/dd8/c10a 0 2023-12-16T07:40:46.504 INFO:tasks.workunit.client.1.smithi133.stdout:7/880: sync 2023-12-16T07:40:46.504 INFO:tasks.workunit.client.1.smithi133.stdout:7/881: stat db/c29 0 2023-12-16T07:40:46.510 INFO:tasks.workunit.client.1.smithi133.stdout:7/882: dread db/d21/d2c/d31/d59/de7/d119/db5/fbd [0,4194304] 0 2023-12-16T07:40:46.510 INFO:tasks.workunit.client.1.smithi133.stdout:7/883: fdatasync db/d21/d2c/d31/d59/de7/d119/d6c/fc9 0 2023-12-16T07:40:46.513 INFO:tasks.workunit.client.1.smithi133.stdout:7/884: rename db/d21/c42 to db/d21/d2c/d31/d59/de7/c127 0 2023-12-16T07:40:46.513 INFO:tasks.workunit.client.1.smithi133.stdout:7/885: write db/d21/f2a [5035521,4293] 0 2023-12-16T07:40:46.536 INFO:tasks.workunit.client.1.smithi133.stdout:4/796: dwrite d3/d7/d1c/db0/dc8/fb9 [0,4194304] 0 2023-12-16T07:40:46.536 INFO:tasks.workunit.client.1.smithi133.stdout:7/886: dwrite db/d21/d2c/d31/d59/de7/d119/d6c/fc9 [0,4194304] 0 2023-12-16T07:40:46.536 INFO:tasks.workunit.client.1.smithi133.stdout:7/887: dread - db/d21/d2c/d31/d59/de7/d119/d6c/dc8/f113 zero size 2023-12-16T07:40:46.537 INFO:tasks.workunit.client.1.smithi133.stdout:7/888: dread - db/d53/f123 zero size 2023-12-16T07:40:46.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/797: write d3/d7/f86 [3129339,63287] 0 2023-12-16T07:40:46.539 INFO:tasks.workunit.client.1.smithi133.stdout:4/798: truncate d3/d7/d1a/f26 1273130 0 2023-12-16T07:40:46.545 INFO:tasks.workunit.client.1.smithi133.stdout:4/799: rename d3/d7/d38/dd5/d63/d96/def to d3/d7/d38/dd5/da7/daa/dc6/d10b 0 2023-12-16T07:40:46.546 INFO:tasks.workunit.client.1.smithi133.stdout:4/800: dread d3/d7/d1c/d2a/d91/dbe/fd2 [0,4194304] 0 2023-12-16T07:40:46.547 INFO:tasks.workunit.client.1.smithi133.stdout:4/801: fsync d3/d7/db1/f104 0 2023-12-16T07:40:46.563 INFO:tasks.workunit.client.1.smithi133.stdout:4/802: dwrite d3/d7/d1c/db0/dc8/f68 [0,4194304] 0 2023-12-16T07:40:46.570 INFO:tasks.workunit.client.1.smithi133.stdout:9/637: creat d15/d18/d2c/fdb x:0 0 0 2023-12-16T07:40:46.571 INFO:tasks.workunit.client.1.smithi133.stdout:4/803: creat d3/d7/d38/dd5/dac/f10c x:0 0 0 2023-12-16T07:40:46.574 INFO:tasks.workunit.client.1.smithi133.stdout:9/638: rmdir d15/d18/d80 39 2023-12-16T07:40:46.576 INFO:tasks.workunit.client.1.smithi133.stdout:4/804: mknod d3/d7/d38/d57/d67/c10d 0 2023-12-16T07:40:46.592 INFO:tasks.workunit.client.1.smithi133.stdout:9/639: dwrite d15/d18/f24 [0,4194304] 0 2023-12-16T07:40:46.593 INFO:tasks.workunit.client.1.smithi133.stdout:9/640: rename d15/d18/d2c/d3a/d8a/fa0 to d15/d42/d8d/da9/fdc 0 2023-12-16T07:40:46.595 INFO:tasks.workunit.client.1.smithi133.stdout:4/805: dwrite d3/d7/d38/dd5/f78 [0,4194304] 0 2023-12-16T07:40:46.596 INFO:tasks.workunit.client.1.smithi133.stdout:9/641: mknod d15/d18/d2c/d68/da3/dcb/cdd 0 2023-12-16T07:40:46.601 INFO:tasks.workunit.client.1.smithi133.stdout:9/642: rmdir d15/d42 39 2023-12-16T07:40:46.602 INFO:tasks.workunit.client.1.smithi133.stdout:4/806: dread d3/d7/d1c/db0/dc8/ff2 [0,4194304] 0 2023-12-16T07:40:46.602 INFO:tasks.workunit.client.1.smithi133.stdout:4/807: chown d3/d7/d38/d57/d75/lae 16591655 1 2023-12-16T07:40:46.603 INFO:tasks.workunit.client.1.smithi133.stdout:4/808: write d3/db6/dee/ff8 [174005,19216] 0 2023-12-16T07:40:46.603 INFO:tasks.workunit.client.1.smithi133.stdout:4/809: chown d3/d7/d38/d57/fc0 13 1 2023-12-16T07:40:46.603 INFO:tasks.workunit.client.1.smithi133.stdout:4/810: fsync d3/d7/d1c/db0/dc8/f68 0 2023-12-16T07:40:46.603 INFO:tasks.workunit.client.1.smithi133.stdout:9/643: write d15/d18/d5b/fb0 [696304,92689] 0 2023-12-16T07:40:46.605 INFO:tasks.workunit.client.1.smithi133.stdout:9/644: unlink d15/d18/d80/cb6 0 2023-12-16T07:40:46.622 INFO:tasks.workunit.client.1.smithi133.stdout:9/645: dwrite d15/d18/d5b/d71/d78/d6e/f72 [0,4194304] 0 2023-12-16T07:40:46.624 INFO:tasks.workunit.client.1.smithi133.stdout:9/646: rename d15/d18/d2c/f3d to d15/d18/d2c/d68/da3/fde 0 2023-12-16T07:40:46.641 INFO:tasks.workunit.client.1.smithi133.stdout:0/593: sync 2023-12-16T07:40:46.641 INFO:tasks.workunit.client.1.smithi133.stdout:8/564: sync 2023-12-16T07:40:46.641 INFO:tasks.workunit.client.1.smithi133.stdout:2/532: sync 2023-12-16T07:40:46.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/594: fdatasync d2/f38 0 2023-12-16T07:40:46.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/533: dread - da/d15/d17/d40/fa2 zero size 2023-12-16T07:40:46.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/595: stat d2/d9/d12/f14 0 2023-12-16T07:40:46.642 INFO:tasks.workunit.client.1.smithi133.stdout:8/565: symlink d9/d10/d39/d48/d44/d6e/d78/da6/lb8 0 2023-12-16T07:40:46.643 INFO:tasks.workunit.client.1.smithi133.stdout:2/534: mknod da/d15/d1b/caa 0 2023-12-16T07:40:46.643 INFO:tasks.workunit.client.1.smithi133.stdout:0/596: chown d2/d9/c42 198 1 2023-12-16T07:40:46.646 INFO:tasks.workunit.client.1.smithi133.stdout:8/566: mknod d9/d2d/cb9 0 2023-12-16T07:40:46.646 INFO:tasks.workunit.client.1.smithi133.stdout:8/567: write d9/d85/fab [801137,55497] 0 2023-12-16T07:40:46.648 INFO:tasks.workunit.client.1.smithi133.stdout:8/568: truncate d9/d2d/f8a 4695035 0 2023-12-16T07:40:46.659 INFO:tasks.workunit.client.1.smithi133.stdout:2/535: dwrite da/d15/d17/d40/fa5 [0,4194304] 0 2023-12-16T07:40:46.664 INFO:tasks.workunit.client.1.smithi133.stdout:2/536: link da/d1d/d60/d71/d2e/c86 da/d15/d17/cab 0 2023-12-16T07:40:46.664 INFO:tasks.workunit.client.1.smithi133.stdout:2/537: fsync da/d15/d17/f36 0 2023-12-16T07:40:46.666 INFO:tasks.workunit.client.1.smithi133.stdout:2/538: truncate da/d1d/d60/d71/d3a/d61/f68 4571144 0 2023-12-16T07:40:46.667 INFO:tasks.workunit.client.1.smithi133.stdout:2/539: write da/f5c [4906211,126782] 0 2023-12-16T07:40:46.669 INFO:tasks.workunit.client.1.smithi133.stdout:2/540: rename da/d1d/d60/d71/d2e/f38 to da/d15/fac 0 2023-12-16T07:40:46.670 INFO:tasks.workunit.client.1.smithi133.stdout:2/541: write da/d15/d17/fa0 [1114666,102614] 0 2023-12-16T07:40:46.676 INFO:tasks.workunit.client.1.smithi133.stdout:2/542: dread da/d1d/f2f [0,4194304] 0 2023-12-16T07:40:46.679 INFO:tasks.workunit.client.1.smithi133.stdout:2/543: link da/d1d/d60/l65 da/d15/d17/d40/lad 0 2023-12-16T07:40:46.680 INFO:tasks.workunit.client.1.smithi133.stdout:2/544: write da/d1d/d60/d71/d3a/d5a/f5f [5213456,94649] 0 2023-12-16T07:40:46.681 INFO:tasks.workunit.client.1.smithi133.stdout:2/545: dread da/d1d/d60/d71/f37 [0,4194304] 0 2023-12-16T07:40:46.681 INFO:tasks.workunit.client.1.smithi133.stdout:2/546: write da/d1d/f72 [127892,48549] 0 2023-12-16T07:40:46.683 INFO:tasks.workunit.client.1.smithi133.stdout:2/547: symlink da/d15/d17/d40/d98/lae 0 2023-12-16T07:40:46.754 INFO:tasks.workunit.client.1.smithi133.stdout:2/548: dwrite da/d1d/f29 [0,4194304] 0 2023-12-16T07:40:46.754 INFO:tasks.workunit.client.1.smithi133.stdout:2/549: truncate da/d15/f9f 505407 0 2023-12-16T07:40:46.757 INFO:tasks.workunit.client.1.smithi133.stdout:2/550: creat da/d1d/faf x:0 0 0 2023-12-16T07:40:46.757 INFO:tasks.workunit.client.1.smithi133.stdout:2/551: fdatasync da/d15/d1b/f34 0 2023-12-16T07:40:46.757 INFO:tasks.workunit.client.1.smithi133.stdout:2/552: fsync da/d15/d17/d40/d98/f9a 0 2023-12-16T07:40:46.758 INFO:tasks.workunit.client.1.smithi133.stdout:2/553: write da/d1d/d60/d71/d3a/f7d [170106,97019] 0 2023-12-16T07:40:46.758 INFO:tasks.workunit.client.1.smithi133.stdout:2/554: write da/d1d/faf [6276,88283] 0 2023-12-16T07:40:46.758 INFO:tasks.workunit.client.1.smithi133.stdout:2/555: read - da/d15/d1b/f70 zero size 2023-12-16T07:40:46.774 INFO:tasks.workunit.client.1.smithi133.stdout:3/499: sync 2023-12-16T07:40:46.776 INFO:tasks.workunit.client.1.smithi133.stdout:2/556: dwrite da/d1d/d60/d71/d3a/d61/f77 [0,4194304] 0 2023-12-16T07:40:46.780 INFO:tasks.workunit.client.1.smithi133.stdout:2/557: getdents da/d1d/d60/d71/d2e/d59 0 2023-12-16T07:40:46.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/558: write da/d1d/d60/d71/d3a/f7b [1239324,97336] 0 2023-12-16T07:40:46.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/559: chown da/d1d/d60/d74 4025559 1 2023-12-16T07:40:46.804 INFO:tasks.workunit.client.1.smithi133.stdout:2/560: dwrite da/d1d/f6a [4194304,4194304] 0 2023-12-16T07:40:46.808 INFO:tasks.workunit.client.1.smithi133.stdout:2/561: symlink da/d15/lb0 0 2023-12-16T07:40:46.808 INFO:tasks.workunit.client.1.smithi133.stdout:2/562: fdatasync da/d15/d17/d40/fa2 0 2023-12-16T07:40:46.813 INFO:tasks.workunit.client.1.smithi133.stdout:2/563: truncate da/d1d/d60/d71/d3a/f7b 2564108 0 2023-12-16T07:40:46.815 INFO:tasks.workunit.client.1.smithi133.stdout:2/564: rename da/d15/d1b/f78 to da/d50/fb1 0 2023-12-16T07:40:46.817 INFO:tasks.workunit.client.1.smithi133.stdout:2/565: mkdir da/d1d/d60/d71/d3a/da6/db2 0 2023-12-16T07:40:46.831 INFO:tasks.workunit.client.1.smithi133.stdout:2/566: dwrite da/d15/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:46.831 INFO:tasks.workunit.client.1.smithi133.stdout:2/567: readlink da/l4a 0 2023-12-16T07:40:46.831 INFO:tasks.workunit.client.1.smithi133.stdout:2/568: rename da/d15 to da/d15/d1b/d83/db3 22 2023-12-16T07:40:46.847 INFO:tasks.workunit.client.1.smithi133.stdout:2/569: dwrite da/d15/d17/fa0 [0,4194304] 0 2023-12-16T07:40:46.847 INFO:tasks.workunit.client.1.smithi133.stdout:2/570: write da/d1d/d60/d71/d2e/d47/f9e [294590,62010] 0 2023-12-16T07:40:46.847 INFO:tasks.workunit.client.1.smithi133.stdout:2/571: write da/d15/fac [52309,106590] 0 2023-12-16T07:40:46.864 INFO:tasks.workunit.client.1.smithi133.stdout:2/572: dwrite da/d15/d1b/d43/f45 [0,4194304] 0 2023-12-16T07:40:46.864 INFO:tasks.workunit.client.1.smithi133.stdout:2/573: chown da/d15/d1b/c4c 3149909 1 2023-12-16T07:40:46.878 INFO:tasks.workunit.client.1.smithi133.stdout:2/574: dwrite da/d15/d1b/f70 [0,4194304] 0 2023-12-16T07:40:46.885 INFO:tasks.workunit.client.1.smithi133.stdout:2/575: dread da/f11 [0,4194304] 0 2023-12-16T07:40:46.887 INFO:tasks.workunit.client.1.smithi133.stdout:2/576: symlink da/d1d/d60/d71/d2e/d47/d52/lb4 0 2023-12-16T07:40:46.887 INFO:tasks.workunit.client.1.smithi133.stdout:2/577: write da/d15/d17/f33 [21543,2044] 0 2023-12-16T07:40:46.891 INFO:tasks.workunit.client.1.smithi133.stdout:2/578: link da/d15/d17/f36 da/d1d/d60/d71/d3a/d61/fb5 0 2023-12-16T07:40:46.891 INFO:tasks.workunit.client.1.smithi133.stdout:2/579: getdents da/d1d/d60/d71/d2e/d59 0 2023-12-16T07:40:46.891 INFO:tasks.workunit.client.1.smithi133.stdout:2/580: write da/d1d/d60/d71/d2e/d47/f9e [274606,81615] 0 2023-12-16T07:40:46.891 INFO:tasks.workunit.client.1.smithi133.stdout:2/581: chown da/d1d/d60/d71/d2e/d47 6907876 1 2023-12-16T07:40:46.892 INFO:tasks.workunit.client.1.smithi133.stdout:2/582: mkdir da/d50/db6 0 2023-12-16T07:40:46.894 INFO:tasks.workunit.client.1.smithi133.stdout:2/583: dread da/d1d/d60/d71/f89 [0,4194304] 0 2023-12-16T07:40:46.897 INFO:tasks.workunit.client.1.smithi133.stdout:2/584: symlink da/d15/d17/d40/lb7 0 2023-12-16T07:40:46.898 INFO:tasks.workunit.client.1.smithi133.stdout:2/585: write da/d15/f8a [1532593,37985] 0 2023-12-16T07:40:46.902 INFO:tasks.workunit.client.1.smithi133.stdout:6/830: sync 2023-12-16T07:40:46.903 INFO:tasks.workunit.client.1.smithi133.stdout:5/473: sync 2023-12-16T07:40:46.903 INFO:tasks.workunit.client.1.smithi133.stdout:1/649: sync 2023-12-16T07:40:46.903 INFO:tasks.workunit.client.1.smithi133.stdout:6/831: write d0/d4/d21/d35/d4e/d84/d69/da1/f10c [594477,46212] 0 2023-12-16T07:40:46.905 INFO:tasks.workunit.client.1.smithi133.stdout:6/832: creat d0/d4/d21/d35/d36/f114 x:0 0 0 2023-12-16T07:40:46.906 INFO:tasks.workunit.client.1.smithi133.stdout:1/650: write d0/d1c/d37/f43 [310490,4224] 0 2023-12-16T07:40:46.907 INFO:tasks.workunit.client.1.smithi133.stdout:6/833: truncate d0/f3a 172463 0 2023-12-16T07:40:46.907 INFO:tasks.workunit.client.1.smithi133.stdout:6/834: write d0/d4/d21/d35/d4e/d84/f5a [442094,2991] 0 2023-12-16T07:40:46.912 INFO:tasks.workunit.client.1.smithi133.stdout:1/651: mkdir d0/dd4 0 2023-12-16T07:40:46.916 INFO:tasks.workunit.client.1.smithi133.stdout:2/586: dwrite da/d1d/d60/d71/d3a/f7b [0,4194304] 0 2023-12-16T07:40:46.917 INFO:tasks.workunit.client.1.smithi133.stdout:6/835: creat d0/d5e/d75/d81/d99/f115 x:0 0 0 2023-12-16T07:40:46.918 INFO:tasks.workunit.client.1.smithi133.stdout:1/652: mkdir d0/d12/d51/dac/d24/d5a/d68/dd5 0 2023-12-16T07:40:46.918 INFO:tasks.workunit.client.1.smithi133.stdout:1/653: fdatasync d0/da/d3d/f50 0 2023-12-16T07:40:46.921 INFO:tasks.workunit.client.1.smithi133.stdout:2/587: creat da/d1d/d60/d71/d2e/fb8 x:0 0 0 2023-12-16T07:40:46.924 INFO:tasks.workunit.client.1.smithi133.stdout:2/588: rename da/d15/d17/f33 to da/d1d/d60/d71/d2e/d47/fb9 0 2023-12-16T07:40:46.925 INFO:tasks.workunit.client.1.smithi133.stdout:2/589: mknod da/d1d/d60/d71/d3a/da6/db2/cba 0 2023-12-16T07:40:46.925 INFO:tasks.workunit.client.1.smithi133.stdout:2/590: stat da/f5c 0 2023-12-16T07:40:46.925 INFO:tasks.workunit.client.1.smithi133.stdout:2/591: dread - da/d15/d17/d40/fa2 zero size 2023-12-16T07:40:46.930 INFO:tasks.workunit.client.1.smithi133.stdout:1/654: dread d0/f29 [0,4194304] 0 2023-12-16T07:40:46.933 INFO:tasks.workunit.client.1.smithi133.stdout:1/655: creat d0/d12/d51/dac/d24/d32/d56/d59/d66/fd6 x:0 0 0 2023-12-16T07:40:46.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/836: dwrite d0/d5e/d75/dad/f106 [0,4194304] 0 2023-12-16T07:40:46.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/837: write d0/d4/d21/d8a/d93/fa5 [685710,8972] 0 2023-12-16T07:40:46.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/838: fsync d0/d4/d21/d35/d4e/d84/f70 0 2023-12-16T07:40:46.938 INFO:tasks.workunit.client.1.smithi133.stdout:2/592: rmdir da/d1d/d60/d71/d2e/d47 39 2023-12-16T07:40:46.938 INFO:tasks.workunit.client.1.smithi133.stdout:1/656: mknod d0/d12/d51/db6/cd7 0 2023-12-16T07:40:46.938 INFO:tasks.workunit.client.1.smithi133.stdout:1/657: fdatasync d0/da/d3d/d41/fa4 0 2023-12-16T07:40:46.943 INFO:tasks.workunit.client.1.smithi133.stdout:2/593: symlink da/d15/d1b/d83/da3/lbb 0 2023-12-16T07:40:46.944 INFO:tasks.workunit.client.1.smithi133.stdout:1/658: mknod d0/d12/d51/dac/d24/d32/d3e/d70/d8f/cd8 0 2023-12-16T07:40:46.945 INFO:tasks.workunit.client.1.smithi133.stdout:6/839: mknod d0/d4/d21/d35/d36/c116 0 2023-12-16T07:40:46.945 INFO:tasks.workunit.client.1.smithi133.stdout:6/840: write d0/d4/d21/d8a/d93/fdf [595338,99315] 0 2023-12-16T07:40:46.947 INFO:tasks.workunit.client.1.smithi133.stdout:2/594: link da/d1d/l1f da/d15/d1b/d43/d85/lbc 0 2023-12-16T07:40:46.948 INFO:tasks.workunit.client.1.smithi133.stdout:1/659: creat d0/d12/d51/db6/fd9 x:0 0 0 2023-12-16T07:40:46.948 INFO:tasks.workunit.client.1.smithi133.stdout:1/660: stat d0/f17 0 2023-12-16T07:40:46.949 INFO:tasks.workunit.client.1.smithi133.stdout:6/841: mknod d0/d4/d21/d8a/d93/d8e/c117 0 2023-12-16T07:40:46.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/661: mkdir d0/d12/dda 0 2023-12-16T07:40:46.951 INFO:tasks.workunit.client.1.smithi133.stdout:6/842: truncate d0/d5e/d75/d81/f86 1415436 0 2023-12-16T07:40:46.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/662: write d0/d12/d51/dac/d24/d32/d3e/d70/f7c [1615788,15067] 0 2023-12-16T07:40:46.953 INFO:tasks.workunit.client.1.smithi133.stdout:6/843: creat d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/f118 x:0 0 0 2023-12-16T07:40:46.953 INFO:tasks.workunit.client.1.smithi133.stdout:6/844: write d0/d4/d21/d60/f89 [4669331,3847] 0 2023-12-16T07:40:46.953 INFO:tasks.workunit.client.1.smithi133.stdout:6/845: readlink d0/d4/d21/d35/d36/l3f 0 2023-12-16T07:40:46.954 INFO:tasks.workunit.client.1.smithi133.stdout:6/846: stat d0/f4d 0 2023-12-16T07:40:46.956 INFO:tasks.workunit.client.1.smithi133.stdout:2/595: dread da/d1d/d60/d71/d2e/d59/f9b [0,4194304] 0 2023-12-16T07:40:46.957 INFO:tasks.workunit.client.1.smithi133.stdout:1/663: symlink d0/dc4/ldb 0 2023-12-16T07:40:46.963 INFO:tasks.workunit.client.1.smithi133.stdout:1/664: dread d0/faf [0,4194304] 0 2023-12-16T07:40:46.963 INFO:tasks.workunit.client.1.smithi133.stdout:1/665: fdatasync d0/d12/d51/dac/ff 0 2023-12-16T07:40:46.964 INFO:tasks.workunit.client.1.smithi133.stdout:6/847: mkdir d0/d4/d21/d35/d7e/ded/d119 0 2023-12-16T07:40:46.965 INFO:tasks.workunit.client.1.smithi133.stdout:1/666: dread d0/d12/d51/db6/fc5 [0,4194304] 0 2023-12-16T07:40:46.968 INFO:tasks.workunit.client.1.smithi133.stdout:6/848: rename d0/l5b to d0/d4/l11a 0 2023-12-16T07:40:46.968 INFO:tasks.workunit.client.1.smithi133.stdout:1/667: write d0/da/f2e [1171625,10584] 0 2023-12-16T07:40:46.968 INFO:tasks.workunit.client.1.smithi133.stdout:1/668: write d0/d1c/d37/f43 [4711569,93644] 0 2023-12-16T07:40:46.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/849: creat d0/d5e/d75/dad/f11b x:0 0 0 2023-12-16T07:40:46.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/850: chown d0/d4/d21/d35/d36/f114 1264831190 1 2023-12-16T07:40:46.974 INFO:tasks.workunit.client.1.smithi133.stdout:2/596: dwrite da/d1d/d60/d71/f37 [0,4194304] 0 2023-12-16T07:40:46.974 INFO:tasks.workunit.client.1.smithi133.stdout:6/851: dread d0/d4/fae [0,4194304] 0 2023-12-16T07:40:46.974 INFO:tasks.workunit.client.1.smithi133.stdout:6/852: stat d0/d4/fae 0 2023-12-16T07:40:46.975 INFO:tasks.workunit.client.1.smithi133.stdout:2/597: symlink da/d1d/d60/d74/lbd 0 2023-12-16T07:40:46.976 INFO:tasks.workunit.client.1.smithi133.stdout:2/598: write da/fe [721571,59304] 0 2023-12-16T07:40:46.977 INFO:tasks.workunit.client.1.smithi133.stdout:6/853: rmdir d0/d4/d21 39 2023-12-16T07:40:46.980 INFO:tasks.workunit.client.1.smithi133.stdout:2/599: rename da/d1d/d60/d71/d3a/da6 to da/d15/dbe 0 2023-12-16T07:40:46.982 INFO:tasks.workunit.client.1.smithi133.stdout:6/854: truncate d0/d5e/d75/d81/d99/fd6 947879 0 2023-12-16T07:40:46.983 INFO:tasks.workunit.client.1.smithi133.stdout:2/600: mknod da/d1d/d60/d71/d2e/d47/d52/cbf 0 2023-12-16T07:40:46.985 INFO:tasks.workunit.client.1.smithi133.stdout:6/855: rename d0/d4/d21/d60/leb to d0/d4/d21/d35/d4e/d84/l11c 0 2023-12-16T07:40:46.986 INFO:tasks.workunit.client.1.smithi133.stdout:1/669: dwrite d0/d1c/d37/f84 [0,4194304] 0 2023-12-16T07:40:46.987 INFO:tasks.workunit.client.1.smithi133.stdout:2/601: creat da/d1d/d60/d74/fc0 x:0 0 0 2023-12-16T07:40:46.995 INFO:tasks.workunit.client.1.smithi133.stdout:1/670: symlink d0/d1c/d9b/ldc 0 2023-12-16T07:40:46.996 INFO:tasks.workunit.client.1.smithi133.stdout:2/602: link da/d15/d1b/c4c da/cc1 0 2023-12-16T07:40:46.997 INFO:tasks.workunit.client.1.smithi133.stdout:2/603: write da/d1d/f96 [74497,123093] 0 2023-12-16T07:40:46.997 INFO:tasks.workunit.client.1.smithi133.stdout:2/604: fdatasync da/d50/d8e/fa4 0 2023-12-16T07:40:46.998 INFO:tasks.workunit.client.1.smithi133.stdout:6/856: dwrite d0/d4/d21/d8a/da4/ff7 [0,4194304] 0 2023-12-16T07:40:46.998 INFO:tasks.workunit.client.1.smithi133.stdout:1/671: rename d0/d12/d51/dac/d24/d5a/d68/l69 to d0/d12/d51/dac/d24/d32/d3e/d70/d8f/ldd 0 2023-12-16T07:40:47.002 INFO:tasks.workunit.client.1.smithi133.stdout:1/672: write d0/da/fb5 [3323272,97902] 0 2023-12-16T07:40:47.003 INFO:tasks.workunit.client.1.smithi133.stdout:6/857: getdents d0/d4/d21/d35/d4e/d84/d69/dbd/dcb 0 2023-12-16T07:40:47.005 INFO:tasks.workunit.client.1.smithi133.stdout:1/673: mkdir d0/d12/d51/db6/dde 0 2023-12-16T07:40:47.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/858: rmdir d0/d5e/d75/dad 39 2023-12-16T07:40:47.010 INFO:tasks.workunit.client.1.smithi133.stdout:1/674: creat d0/d12/d51/db6/dde/fdf x:0 0 0 2023-12-16T07:40:47.015 INFO:tasks.workunit.client.1.smithi133.stdout:1/675: mkdir d0/d12/dda/de0 0 2023-12-16T07:40:47.015 INFO:tasks.workunit.client.1.smithi133.stdout:1/676: dread - d0/da/d3d/d41/f6a zero size 2023-12-16T07:40:47.017 INFO:tasks.workunit.client.1.smithi133.stdout:1/677: creat d0/d12/d51/dac/d24/d32/d56/d59/d66/fe1 x:0 0 0 2023-12-16T07:40:47.017 INFO:tasks.workunit.client.1.smithi133.stdout:1/678: chown d0/d12/d51/dac/d24/f5d 380 1 2023-12-16T07:40:47.019 INFO:tasks.workunit.client.1.smithi133.stdout:2/605: dwrite da/d15/fac [0,4194304] 0 2023-12-16T07:40:47.021 INFO:tasks.workunit.client.1.smithi133.stdout:7/889: sync 2023-12-16T07:40:47.021 INFO:tasks.workunit.client.1.smithi133.stdout:9/647: sync 2023-12-16T07:40:47.021 INFO:tasks.workunit.client.1.smithi133.stdout:7/890: stat db/d21/d2c/d31/d59/f11e 0 2023-12-16T07:40:47.022 INFO:tasks.workunit.client.1.smithi133.stdout:3/500: sync 2023-12-16T07:40:47.022 INFO:tasks.workunit.client.1.smithi133.stdout:4/811: sync 2023-12-16T07:40:47.022 INFO:tasks.workunit.client.1.smithi133.stdout:0/597: sync 2023-12-16T07:40:47.022 INFO:tasks.workunit.client.1.smithi133.stdout:8/569: sync 2023-12-16T07:40:47.026 INFO:tasks.workunit.client.1.smithi133.stdout:7/891: dread db/d3e/d4a/d58/d86/d8b/f90 [0,4194304] 0 2023-12-16T07:40:47.026 INFO:tasks.workunit.client.1.smithi133.stdout:6/859: dread d0/d4/d21/d35/d36/f50 [0,4194304] 0 2023-12-16T07:40:47.026 INFO:tasks.workunit.client.1.smithi133.stdout:9/648: symlink d15/d18/d2c/ldf 0 2023-12-16T07:40:47.027 INFO:tasks.workunit.client.1.smithi133.stdout:9/649: stat d15/d18 0 2023-12-16T07:40:47.027 INFO:tasks.workunit.client.1.smithi133.stdout:1/679: dread d0/d12/d51/dac/d24/d32/d56/d59/d66/fa9 [0,4194304] 0 2023-12-16T07:40:47.028 INFO:tasks.workunit.client.1.smithi133.stdout:4/812: getdents d3/d7/d1c/d2a/d91/dbe/dd0 0 2023-12-16T07:40:47.030 INFO:tasks.workunit.client.1.smithi133.stdout:4/813: write d3/d7/d38/dd5/da7/ff7 [3633466,29182] 0 2023-12-16T07:40:47.031 INFO:tasks.workunit.client.1.smithi133.stdout:2/606: dread da/f10 [0,4194304] 0 2023-12-16T07:40:47.031 INFO:tasks.workunit.client.1.smithi133.stdout:2/607: dread - da/d1d/f87 zero size 2023-12-16T07:40:47.031 INFO:tasks.workunit.client.1.smithi133.stdout:2/608: write da/d15/d17/f36 [5215962,101538] 0 2023-12-16T07:40:47.033 INFO:tasks.workunit.client.1.smithi133.stdout:3/501: mknod d7/d8/d1d/d2a/d5f/cd5 0 2023-12-16T07:40:47.034 INFO:tasks.workunit.client.1.smithi133.stdout:0/598: creat d2/d17/d2b/d31/d63/d98/fbd x:0 0 0 2023-12-16T07:40:47.035 INFO:tasks.workunit.client.1.smithi133.stdout:3/502: write d7/f1b [1962037,89098] 0 2023-12-16T07:40:47.038 INFO:tasks.workunit.client.1.smithi133.stdout:8/570: link d9/d10/d39/d48/d44/d69/fa9 d9/d11/d33/d9c/fba 0 2023-12-16T07:40:47.039 INFO:tasks.workunit.client.1.smithi133.stdout:0/599: dread d2/d9/f47 [0,4194304] 0 2023-12-16T07:40:47.041 INFO:tasks.workunit.client.1.smithi133.stdout:7/892: dwrite db/d21/d2c/d31/d59/f11e [0,4194304] 0 2023-12-16T07:40:47.041 INFO:tasks.workunit.client.1.smithi133.stdout:6/860: mkdir d0/d5e/d75/d81/d99/d11d 0 2023-12-16T07:40:47.041 INFO:tasks.workunit.client.1.smithi133.stdout:6/861: readlink d0/d4/d21/d35/d4e/d84/d69/lff 0 2023-12-16T07:40:47.041 INFO:tasks.workunit.client.1.smithi133.stdout:7/893: write db/d3e/d4a/d58/ff2 [755517,3674] 0 2023-12-16T07:40:47.041 INFO:tasks.workunit.client.1.smithi133.stdout:6/862: write d0/d4/dee/f10f [313830,91785] 0 2023-12-16T07:40:47.051 INFO:tasks.workunit.client.1.smithi133.stdout:2/609: dwrite da/d1d/d60/d71/d3a/d61/f68 [0,4194304] 0 2023-12-16T07:40:47.051 INFO:tasks.workunit.client.1.smithi133.stdout:9/650: mknod d15/d18/d4d/d7e/ce0 0 2023-12-16T07:40:47.052 INFO:tasks.workunit.client.1.smithi133.stdout:1/680: symlink d0/d1c/d71/dcf/le2 0 2023-12-16T07:40:47.053 INFO:tasks.workunit.client.1.smithi133.stdout:4/814: creat d3/d7/d38/dd5/dac/dbc/f10e x:0 0 0 2023-12-16T07:40:47.057 INFO:tasks.workunit.client.1.smithi133.stdout:3/503: creat d7/d8/d1d/d2a/fd6 x:0 0 0 2023-12-16T07:40:47.057 INFO:tasks.workunit.client.1.smithi133.stdout:3/504: chown d7/d8/d1c/d7e/c93 0 1 2023-12-16T07:40:47.058 INFO:tasks.workunit.client.1.smithi133.stdout:0/600: creat d2/d9/d12/d35/d4f/fbe x:0 0 0 2023-12-16T07:40:47.059 INFO:tasks.workunit.client.1.smithi133.stdout:0/601: fdatasync d2/d17/d2b/d31/d4d/f9a 0 2023-12-16T07:40:47.059 INFO:tasks.workunit.client.1.smithi133.stdout:0/602: chown d2/d9/d12/d35 41 1 2023-12-16T07:40:47.064 INFO:tasks.workunit.client.1.smithi133.stdout:2/610: mkdir da/dc2 0 2023-12-16T07:40:47.067 INFO:tasks.workunit.client.1.smithi133.stdout:9/651: link l4 d15/d18/d4d/d94/dcc/le1 0 2023-12-16T07:40:47.068 INFO:tasks.workunit.client.1.smithi133.stdout:9/652: chown d15/d18/d5b/dd6/cd8 174 1 2023-12-16T07:40:47.069 INFO:tasks.workunit.client.1.smithi133.stdout:8/571: dwrite d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:47.070 INFO:tasks.workunit.client.1.smithi133.stdout:4/815: rmdir d3/db6 39 2023-12-16T07:40:47.071 INFO:tasks.workunit.client.1.smithi133.stdout:7/894: dwrite db/d21/d2c/f56 [0,4194304] 0 2023-12-16T07:40:47.071 INFO:tasks.workunit.client.1.smithi133.stdout:7/895: fdatasync db/d3e/d4a/d58/d86/da9/fe5 0 2023-12-16T07:40:47.072 INFO:tasks.workunit.client.1.smithi133.stdout:7/896: read - db/d3e/d4a/d58/d86/da9/fe5 zero size 2023-12-16T07:40:47.073 INFO:tasks.workunit.client.1.smithi133.stdout:3/505: creat d7/d8/d1c/d2b/d2d/fd7 x:0 0 0 2023-12-16T07:40:47.073 INFO:tasks.workunit.client.1.smithi133.stdout:3/506: fsync d7/d8/d1d/f57 0 2023-12-16T07:40:47.073 INFO:tasks.workunit.client.1.smithi133.stdout:3/507: write d7/d8/d1d/d2a/fca [910282,88278] 0 2023-12-16T07:40:47.075 INFO:tasks.workunit.client.1.smithi133.stdout:0/603: getdents d2/d17 0 2023-12-16T07:40:47.077 INFO:tasks.workunit.client.1.smithi133.stdout:6/863: symlink d0/d4/d21/d35/d36/l11e 0 2023-12-16T07:40:47.078 INFO:tasks.workunit.client.1.smithi133.stdout:9/653: rmdir d15/d18/d2c/d3a 39 2023-12-16T07:40:47.078 INFO:tasks.workunit.client.1.smithi133.stdout:1/681: dwrite d0/d12/d51/dac/d24/d5a/d68/f88 [0,4194304] 0 2023-12-16T07:40:47.079 INFO:tasks.workunit.client.1.smithi133.stdout:9/654: write d15/d18/f2f [1154032,130874] 0 2023-12-16T07:40:47.081 INFO:tasks.workunit.client.1.smithi133.stdout:8/572: link d9/d10/d39/f5c d9/d10/d39/d48/d92/fbb 0 2023-12-16T07:40:47.085 INFO:tasks.workunit.client.1.smithi133.stdout:4/816: symlink d3/l10f 0 2023-12-16T07:40:47.089 INFO:tasks.workunit.client.1.smithi133.stdout:7/897: mknod db/d21/db1/c128 0 2023-12-16T07:40:47.090 INFO:tasks.workunit.client.1.smithi133.stdout:7/898: readlink db/d21/d2c/l10a 0 2023-12-16T07:40:47.092 INFO:tasks.workunit.client.1.smithi133.stdout:3/508: creat d7/d8/d78/d43/fd8 x:0 0 0 2023-12-16T07:40:47.092 INFO:tasks.workunit.client.1.smithi133.stdout:3/509: stat d7/d8/d1d/ld4 0 2023-12-16T07:40:47.092 INFO:tasks.workunit.client.1.smithi133.stdout:0/604: creat d2/d17/fbf x:0 0 0 2023-12-16T07:40:47.094 INFO:tasks.workunit.client.1.smithi133.stdout:8/573: dwrite d9/dc/d27/f4f [0,4194304] 0 2023-12-16T07:40:47.094 INFO:tasks.workunit.client.1.smithi133.stdout:8/574: write d9/d10/f97 [444184,56000] 0 2023-12-16T07:40:47.095 INFO:tasks.workunit.client.1.smithi133.stdout:6/864: unlink d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/fda 0 2023-12-16T07:40:47.097 INFO:tasks.workunit.client.1.smithi133.stdout:6/865: dread d0/d4/d21/d35/d7e/dac/f101 [0,4194304] 0 2023-12-16T07:40:47.099 INFO:tasks.workunit.client.1.smithi133.stdout:1/682: mknod d0/da/ce3 0 2023-12-16T07:40:47.108 INFO:tasks.workunit.client.1.smithi133.stdout:4/817: symlink d3/d7/d38/dd5/da7/daa/l110 0 2023-12-16T07:40:47.109 INFO:tasks.workunit.client.1.smithi133.stdout:7/899: symlink db/d21/d2c/d31/d59/de7/d119/d6c/dc8/l129 0 2023-12-16T07:40:47.109 INFO:tasks.workunit.client.1.smithi133.stdout:7/900: write db/d3e/d4a/d58/d86/fd5 [485136,75775] 0 2023-12-16T07:40:47.110 INFO:tasks.workunit.client.1.smithi133.stdout:7/901: write db/d3e/d4a/f7c [3578461,42124] 0 2023-12-16T07:40:47.110 INFO:tasks.workunit.client.1.smithi133.stdout:3/510: symlink d7/d8/d72/d86/ld9 0 2023-12-16T07:40:47.113 INFO:tasks.workunit.client.1.smithi133.stdout:0/605: write d2/d17/d2b/f59 [33673,5131] 0 2023-12-16T07:40:47.113 INFO:tasks.workunit.client.1.smithi133.stdout:0/606: dread - d2/d9/d12/d35/d4f/fbe zero size 2023-12-16T07:40:47.114 INFO:tasks.workunit.client.1.smithi133.stdout:8/575: rmdir d9/d11/d33 39 2023-12-16T07:40:47.116 INFO:tasks.workunit.client.1.smithi133.stdout:5/474: sync 2023-12-16T07:40:47.117 INFO:tasks.workunit.client.1.smithi133.stdout:1/683: creat d0/d60/fe4 x:0 0 0 2023-12-16T07:40:47.117 INFO:tasks.workunit.client.1.smithi133.stdout:1/684: write d0/d1c/d9b/fbd [171668,54105] 0 2023-12-16T07:40:47.119 INFO:tasks.workunit.client.1.smithi133.stdout:4/818: chown d3/d7/d1c/d2a/d91/dbe/dfa/d89/dbf/ff0 14028945 1 2023-12-16T07:40:47.120 INFO:tasks.workunit.client.1.smithi133.stdout:3/511: mknod d7/d8/d78/d43/cda 0 2023-12-16T07:40:47.122 INFO:tasks.workunit.client.1.smithi133.stdout:5/475: dread d1/f17 [0,4194304] 0 2023-12-16T07:40:47.122 INFO:tasks.workunit.client.1.smithi133.stdout:5/476: readlink d1/de/d67/l62 0 2023-12-16T07:40:47.124 INFO:tasks.workunit.client.1.smithi133.stdout:0/607: creat d2/d9/d20/d5e/d92/fc0 x:0 0 0 2023-12-16T07:40:47.124 INFO:tasks.workunit.client.1.smithi133.stdout:0/608: write d2/d17/d2b/d31/d63/fb7 [626941,37035] 0 2023-12-16T07:40:47.127 INFO:tasks.workunit.client.1.smithi133.stdout:8/576: rmdir d9/d11 39 2023-12-16T07:40:47.128 INFO:tasks.workunit.client.1.smithi133.stdout:8/577: read d9/d10/f74 [2063686,54345] 0 2023-12-16T07:40:47.128 INFO:tasks.workunit.client.1.smithi133.stdout:1/685: mknod d0/da/d3d/ce5 0 2023-12-16T07:40:47.128 INFO:tasks.workunit.client.1.smithi133.stdout:1/686: stat d0/d12/d51/f9d 0 2023-12-16T07:40:47.130 INFO:tasks.workunit.client.1.smithi133.stdout:8/578: write d9/d11/f16 [4113993,36469] 0 2023-12-16T07:40:47.130 INFO:tasks.workunit.client.1.smithi133.stdout:8/579: fsync d9/d11/d52/fb2 0 2023-12-16T07:40:47.130 INFO:tasks.workunit.client.1.smithi133.stdout:8/580: write d9/d11/d33/faa [875358,29163] 0 2023-12-16T07:40:47.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/819: mkdir d3/d7/d1a/d111 0 2023-12-16T07:40:47.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/820: dread - d3/d7/d38/dd5/da7/daa/dc6/fec zero size 2023-12-16T07:40:47.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/821: chown d3/d7/d1c/d2a/d91/dbe/l108 2 1 2023-12-16T07:40:47.135 INFO:tasks.workunit.client.1.smithi133.stdout:3/512: rename d7/d8/d1c/d7e to d7/d8/d1c/ddb 0 2023-12-16T07:40:47.135 INFO:tasks.workunit.client.1.smithi133.stdout:3/513: write d7/d8/d78/f69 [4916829,36410] 0 2023-12-16T07:40:47.140 INFO:tasks.workunit.client.1.smithi133.stdout:0/609: getdents d2 0 2023-12-16T07:40:47.140 INFO:tasks.workunit.client.1.smithi133.stdout:5/477: creat d1/de/d52/d95/fab x:0 0 0 2023-12-16T07:40:47.145 INFO:tasks.workunit.client.1.smithi133.stdout:5/478: rmdir d1/d18/d2c 39 2023-12-16T07:40:47.146 INFO:tasks.workunit.client.1.smithi133.stdout:5/479: fdatasync d1/de/d52/d95/fab 0 2023-12-16T07:40:47.147 INFO:tasks.workunit.client.1.smithi133.stdout:6/866: dwrite d0/d4/d21/d8a/d93/fa9 [0,4194304] 0 2023-12-16T07:40:47.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/867: fsync d0/d4/d21/d8a/d93/fdf 0 2023-12-16T07:40:47.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/868: chown d0/d4/d21/d35/d7e/ded/l103 76879143 1 2023-12-16T07:40:47.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/869: write d0/d4/fa7 [734175,43433] 0 2023-12-16T07:40:47.148 INFO:tasks.workunit.client.1.smithi133.stdout:0/610: creat d2/d17/d2b/fc1 x:0 0 0 2023-12-16T07:40:47.148 INFO:tasks.workunit.client.1.smithi133.stdout:0/611: stat d2/f38 0 2023-12-16T07:40:47.153 INFO:tasks.workunit.client.1.smithi133.stdout:6/870: mkdir d0/d5e/d8c/d107/d11f 0 2023-12-16T07:40:47.154 INFO:tasks.workunit.client.1.smithi133.stdout:0/612: unlink d2/d9/db/c5b 0 2023-12-16T07:40:47.155 INFO:tasks.workunit.client.1.smithi133.stdout:0/613: chown d2/d9/l2f 38386770 1 2023-12-16T07:40:47.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/687: dwrite d0/da/f4b [0,4194304] 0 2023-12-16T07:40:47.156 INFO:tasks.workunit.client.1.smithi133.stdout:3/514: dwrite d7/d8/d72/d86/fcd [0,4194304] 0 2023-12-16T07:40:47.157 INFO:tasks.workunit.client.1.smithi133.stdout:0/614: chown d2/d17/d40/c8d 4842452 1 2023-12-16T07:40:47.164 INFO:tasks.workunit.client.1.smithi133.stdout:3/515: mknod d7/d8/d78/d43/d5b/cdc 0 2023-12-16T07:40:47.165 INFO:tasks.workunit.client.1.smithi133.stdout:0/615: getdents d2/d9/d8f 0 2023-12-16T07:40:47.165 INFO:tasks.workunit.client.1.smithi133.stdout:0/616: getdents d2/db2 0 2023-12-16T07:40:47.166 INFO:tasks.workunit.client.1.smithi133.stdout:0/617: write d2/f38 [4964922,113913] 0 2023-12-16T07:40:47.166 INFO:tasks.workunit.client.1.smithi133.stdout:0/618: truncate d2/d9/d12/d35/d4f/fbe 711591 0 2023-12-16T07:40:47.167 INFO:tasks.workunit.client.1.smithi133.stdout:3/516: symlink d7/d8/d1d/d2a/ldd 0 2023-12-16T07:40:47.168 INFO:tasks.workunit.client.1.smithi133.stdout:3/517: truncate d7/d8/d1d/f57 158284 0 2023-12-16T07:40:47.168 INFO:tasks.workunit.client.1.smithi133.stdout:3/518: write d7/d8/d1d/d2a/d5f/fb0 [776527,107150] 0 2023-12-16T07:40:47.168 INFO:tasks.workunit.client.1.smithi133.stdout:0/619: dread d2/d17/d2b/f88 [0,4194304] 0 2023-12-16T07:40:47.168 INFO:tasks.workunit.client.1.smithi133.stdout:0/620: write d2/d17/d2b/d31/d4d/fb1 [413334,19932] 0 2023-12-16T07:40:47.168 INFO:tasks.workunit.client.1.smithi133.stdout:3/519: link d7/d8/d1c/ddb/d95/faf d7/d8/d1c/ddb/fde 0 2023-12-16T07:40:47.169 INFO:tasks.workunit.client.1.smithi133.stdout:0/621: write d2/d9/d12/f14 [2143738,89922] 0 2023-12-16T07:40:47.172 INFO:tasks.workunit.client.1.smithi133.stdout:5/480: dwrite d1/d1c/d80/d64/f7a [0,4194304] 0 2023-12-16T07:40:47.172 INFO:tasks.workunit.client.1.smithi133.stdout:5/481: dread - d1/d18/d6f/faa zero size 2023-12-16T07:40:47.172 INFO:tasks.workunit.client.1.smithi133.stdout:0/622: mkdir d2/d17/dc2 0 2023-12-16T07:40:47.172 INFO:tasks.workunit.client.1.smithi133.stdout:0/623: write d2/d17/d2b/d31/d4d/fb1 [452707,98288] 0 2023-12-16T07:40:47.174 INFO:tasks.workunit.client.1.smithi133.stdout:5/482: mkdir d1/d1c/d80/da7/dac 0 2023-12-16T07:40:47.174 INFO:tasks.workunit.client.1.smithi133.stdout:5/483: write d1/de/f76 [4374241,29110] 0 2023-12-16T07:40:47.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:46 smithi049 ceph-mon[111939]: Reconfiguring alertmanager.smithi049 (dependencies changed)... 2023-12-16T07:40:47.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:46 smithi049 ceph-mon[111939]: Reconfiguring daemon alertmanager.smithi049 on smithi049 2023-12-16T07:40:47.176 INFO:tasks.workunit.client.1.smithi133.stdout:0/624: rename d2/d9/d20/l28 to d2/d17/d40/lc3 0 2023-12-16T07:40:47.178 INFO:tasks.workunit.client.1.smithi133.stdout:3/520: dread d7/d8/d78/d43/d7f/d85/f98 [0,4194304] 0 2023-12-16T07:40:47.178 INFO:tasks.workunit.client.1.smithi133.stdout:0/625: dread d2/d17/d2b/f88 [0,4194304] 0 2023-12-16T07:40:47.179 INFO:tasks.workunit.client.1.smithi133.stdout:5/484: creat d1/d18/d26/fad x:0 0 0 2023-12-16T07:40:47.180 INFO:tasks.workunit.client.1.smithi133.stdout:5/485: chown d1/d4b/f4c 1 1 2023-12-16T07:40:47.180 INFO:tasks.workunit.client.1.smithi133.stdout:5/486: chown d1/de/c4f 6942418 1 2023-12-16T07:40:47.180 INFO:tasks.workunit.client.1.smithi133.stdout:3/521: symlink d7/d8/d1c/d2b/ldf 0 2023-12-16T07:40:47.181 INFO:tasks.workunit.client.1.smithi133.stdout:0/626: rename d2/d9/d20/d5e/d89/da2/cb4 to d2/d17/d2b/d67/cc4 0 2023-12-16T07:40:47.183 INFO:tasks.workunit.client.1.smithi133.stdout:5/487: mkdir d1/de/dae 0 2023-12-16T07:40:47.184 INFO:tasks.workunit.client.1.smithi133.stdout:5/488: read d1/de/d57/f8c [3688424,95180] 0 2023-12-16T07:40:47.184 INFO:tasks.workunit.client.1.smithi133.stdout:5/489: truncate d1/de/d35/f37 5208127 0 2023-12-16T07:40:47.184 INFO:tasks.workunit.client.1.smithi133.stdout:3/522: mkdir d7/d8/d78/de0 0 2023-12-16T07:40:47.187 INFO:tasks.workunit.client.1.smithi133.stdout:0/627: write d2/d17/fac [236288,49156] 0 2023-12-16T07:40:47.188 INFO:tasks.workunit.client.1.smithi133.stdout:5/490: link d1/d18/d6f/d71/l83 d1/d1c/d80/d8d/laf 0 2023-12-16T07:40:47.188 INFO:tasks.workunit.client.1.smithi133.stdout:5/491: write d1/d1c/d80/f81 [4736141,23241] 0 2023-12-16T07:40:47.189 INFO:tasks.workunit.client.1.smithi133.stdout:3/523: creat d7/d8/d1d/d2a/d5f/fe1 x:0 0 0 2023-12-16T07:40:47.191 INFO:tasks.workunit.client.1.smithi133.stdout:5/492: rename d1/d1c/d80/d8d/laf to d1/de/d57/lb0 0 2023-12-16T07:40:47.192 INFO:tasks.workunit.client.1.smithi133.stdout:3/524: symlink d7/d8/d1d/le2 0 2023-12-16T07:40:47.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/628: mkdir d2/d9/dc5 0 2023-12-16T07:40:47.193 INFO:tasks.workunit.client.1.smithi133.stdout:3/525: write d7/d8/d1c/f74 [566096,121849] 0 2023-12-16T07:40:47.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/629: fsync d2/d17/d2b/d31/d4d/d54/f80 0 2023-12-16T07:40:47.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/630: readlink d2/d9/d12/d35/d4f/l8a 0 2023-12-16T07:40:47.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/631: stat d2/d17/d2b/d31/d7f/c96 0 2023-12-16T07:40:47.194 INFO:tasks.workunit.client.1.smithi133.stdout:5/493: link d1/d18/d26/l48 d1/d4b/lb1 0 2023-12-16T07:40:47.197 INFO:tasks.workunit.client.1.smithi133.stdout:0/632: symlink d2/d9/d12/d35/lc6 0 2023-12-16T07:40:47.199 INFO:tasks.workunit.client.1.smithi133.stdout:0/633: creat d2/d17/d2b/d31/d4d/d54/fc7 x:0 0 0 2023-12-16T07:40:47.199 INFO:tasks.workunit.client.1.smithi133.stdout:0/634: chown d2/d9/d12/d45/d9e/da0/fae 35773 1 2023-12-16T07:40:47.201 INFO:tasks.workunit.client.1.smithi133.stdout:0/635: unlink d2/d9/l34 0 2023-12-16T07:40:47.202 INFO:tasks.workunit.client.1.smithi133.stdout:0/636: creat d2/d17/fc8 x:0 0 0 2023-12-16T07:40:47.206 INFO:tasks.workunit.client.1.smithi133.stdout:5/494: dread d1/f1a [0,4194304] 0 2023-12-16T07:40:47.207 INFO:tasks.workunit.client.1.smithi133.stdout:3/526: dwrite d7/d8/d78/d43/d7f/fab [0,4194304] 0 2023-12-16T07:40:47.208 INFO:tasks.workunit.client.1.smithi133.stdout:5/495: dread d1/de/d52/f78 [0,4194304] 0 2023-12-16T07:40:47.209 INFO:tasks.workunit.client.1.smithi133.stdout:3/527: mkdir d7/d8/d1d/d2a/d62/de3 0 2023-12-16T07:40:47.214 INFO:tasks.workunit.client.1.smithi133.stdout:5/496: truncate d1/de/d67/d7c/f8f 2317181 0 2023-12-16T07:40:47.214 INFO:tasks.workunit.client.1.smithi133.stdout:5/497: readlink d1/l49 0 2023-12-16T07:40:47.222 INFO:tasks.workunit.client.1.smithi133.stdout:3/528: dwrite d7/d8/d1c/ddb/fc1 [0,4194304] 0 2023-12-16T07:40:47.222 INFO:tasks.workunit.client.1.smithi133.stdout:3/529: fsync d7/d8/d72/d86/f7b 0 2023-12-16T07:40:47.222 INFO:tasks.workunit.client.1.smithi133.stdout:3/530: write d7/d8/d72/d86/f7b [578478,46148] 0 2023-12-16T07:40:47.225 INFO:tasks.workunit.client.1.smithi133.stdout:5/498: rename d1/d1c/d80/f81 to d1/de/d67/d7c/fb2 0 2023-12-16T07:40:47.225 INFO:tasks.workunit.client.1.smithi133.stdout:5/499: readlink d1/d18/d2c/l9b 0 2023-12-16T07:40:47.232 INFO:tasks.workunit.client.1.smithi133.stdout:5/500: rename d1/c4a to d1/d1c/d80/da7/cb3 0 2023-12-16T07:40:47.237 INFO:tasks.workunit.client.1.smithi133.stdout:5/501: rename d1/d18/d6f to d1/de/d67/d7c/db4 0 2023-12-16T07:40:47.239 INFO:tasks.workunit.client.1.smithi133.stdout:5/502: symlink d1/d1c/d80/d8d/lb5 0 2023-12-16T07:40:47.239 INFO:tasks.workunit.client.1.smithi133.stdout:5/503: readlink d1/d18/l69 0 2023-12-16T07:40:47.240 INFO:tasks.workunit.client.1.smithi133.stdout:5/504: symlink d1/de/lb6 0 2023-12-16T07:40:47.241 INFO:tasks.workunit.client.1.smithi133.stdout:5/505: symlink d1/de/d52/lb7 0 2023-12-16T07:40:47.242 INFO:tasks.workunit.client.1.smithi133.stdout:5/506: truncate d1/de/d57/f8c 1610339 0 2023-12-16T07:40:47.242 INFO:tasks.workunit.client.1.smithi133.stdout:5/507: fdatasync d1/d18/d26/f5e 0 2023-12-16T07:40:47.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/508: creat d1/d1c/d80/d8d/fb8 x:0 0 0 2023-12-16T07:40:47.245 INFO:tasks.workunit.client.1.smithi133.stdout:5/509: mknod d1/d4b/da5/cb9 0 2023-12-16T07:40:47.248 INFO:tasks.workunit.client.1.smithi133.stdout:5/510: mkdir d1/de/dba 0 2023-12-16T07:40:47.253 INFO:tasks.workunit.client.1.smithi133.stdout:5/511: creat d1/de/d35/fbb x:0 0 0 2023-12-16T07:40:47.253 INFO:tasks.workunit.client.1.smithi133.stdout:5/512: stat d1/de/d52/d95/fab 0 2023-12-16T07:40:47.258 INFO:tasks.workunit.client.1.smithi133.stdout:5/513: creat d1/de/d67/d7c/db4/fbc x:0 0 0 2023-12-16T07:40:47.261 INFO:tasks.workunit.client.1.smithi133.stdout:5/514: rename d1/de/d35/l68 to d1/de/dba/lbd 0 2023-12-16T07:40:47.264 INFO:tasks.workunit.client.1.smithi133.stdout:5/515: link d1/d18/d2c/l7f d1/de/d57/lbe 0 2023-12-16T07:40:47.264 INFO:tasks.workunit.client.1.smithi133.stdout:5/516: write d1/de/f13 [4282604,20061] 0 2023-12-16T07:40:47.265 INFO:tasks.workunit.client.1.smithi133.stdout:5/517: symlink d1/d18/lbf 0 2023-12-16T07:40:47.267 INFO:tasks.workunit.client.1.smithi133.stdout:5/518: rmdir d1/d1c 39 2023-12-16T07:40:47.269 INFO:tasks.workunit.client.1.smithi133.stdout:5/519: creat d1/de/d67/d7c/db4/d71/fc0 x:0 0 0 2023-12-16T07:40:47.276 INFO:tasks.workunit.client.1.smithi133.stdout:5/520: dread d1/f10 [4194304,4194304] 0 2023-12-16T07:40:47.279 INFO:tasks.workunit.client.1.smithi133.stdout:5/521: mkdir d1/d1c/d80/d64/dc1 0 2023-12-16T07:40:47.281 INFO:tasks.workunit.client.1.smithi133.stdout:5/522: write d1/d1c/f3b [3985201,128972] 0 2023-12-16T07:40:47.282 INFO:tasks.workunit.client.1.smithi133.stdout:5/523: write d1/d18/f42 [3598153,80352] 0 2023-12-16T07:40:47.282 INFO:tasks.workunit.client.1.smithi133.stdout:5/524: truncate d1/f75 4460580 0 2023-12-16T07:40:47.286 INFO:tasks.workunit.client.1.smithi133.stdout:5/525: creat d1/de/d67/d7c/db4/fc2 x:0 0 0 2023-12-16T07:40:47.289 INFO:tasks.workunit.client.1.smithi133.stdout:5/526: rmdir d1/d18/da9 0 2023-12-16T07:40:47.289 INFO:tasks.workunit.client.1.smithi133.stdout:5/527: rename d1/d1c to d1/d1c/d80/d64/dc1/dc3 22 2023-12-16T07:40:47.289 INFO:tasks.workunit.client.1.smithi133.stdout:5/528: write d1/de/d35/fbb [272024,53098] 0 2023-12-16T07:40:47.290 INFO:tasks.workunit.client.1.smithi133.stdout:5/529: creat d1/d4b/fc4 x:0 0 0 2023-12-16T07:40:47.291 INFO:tasks.workunit.client.1.smithi133.stdout:5/530: write d1/d18/f41 [3646603,43132] 0 2023-12-16T07:40:47.293 INFO:tasks.workunit.client.1.smithi133.stdout:5/531: rmdir d1/de/d52/d95 39 2023-12-16T07:40:47.295 INFO:tasks.workunit.client.1.smithi133.stdout:5/532: mkdir d1/de/d57/dc5 0 2023-12-16T07:40:47.295 INFO:tasks.workunit.client.1.smithi133.stdout:5/533: chown d1/de/d67/c66 10464 1 2023-12-16T07:40:47.296 INFO:tasks.workunit.client.1.smithi133.stdout:5/534: write d1/de/f32 [3279375,75187] 0 2023-12-16T07:40:47.298 INFO:tasks.workunit.client.1.smithi133.stdout:5/535: rmdir d1/de/d52 39 2023-12-16T07:40:47.302 INFO:tasks.workunit.client.1.smithi133.stdout:5/536: rename d1/de/d67/d7c to d1/de/d35/dc6 0 2023-12-16T07:40:47.305 INFO:tasks.workunit.client.1.smithi133.stdout:2/611: sync 2023-12-16T07:40:47.305 INFO:tasks.workunit.client.1.smithi133.stdout:9/655: sync 2023-12-16T07:40:47.306 INFO:tasks.workunit.client.1.smithi133.stdout:5/537: rmdir d1 39 2023-12-16T07:40:47.309 INFO:tasks.workunit.client.1.smithi133.stdout:9/656: rename d15/d18/d2c/d68/f7f to d15/d18/d2c/d68/da3/fe2 0 2023-12-16T07:40:47.309 INFO:tasks.workunit.client.1.smithi133.stdout:2/612: mknod da/d15/d17/d40/cc3 0 2023-12-16T07:40:47.312 INFO:tasks.workunit.client.1.smithi133.stdout:5/538: mkdir d1/de/dc7 0 2023-12-16T07:40:47.312 INFO:tasks.workunit.client.1.smithi133.stdout:5/539: creat d1/d4b/fc8 x:0 0 0 2023-12-16T07:40:47.313 INFO:tasks.workunit.client.1.smithi133.stdout:5/540: chown d1/de/d57/la4 484 1 2023-12-16T07:40:47.313 INFO:tasks.workunit.client.1.smithi133.stdout:5/541: write d1/de/f50 [342546,31276] 0 2023-12-16T07:40:47.316 INFO:tasks.workunit.client.1.smithi133.stdout:5/542: creat d1/de/d57/fc9 x:0 0 0 2023-12-16T07:40:47.317 INFO:tasks.workunit.client.1.smithi133.stdout:2/613: dread da/d1d/d60/d71/d3a/d5a/f5f [0,4194304] 0 2023-12-16T07:40:47.319 INFO:tasks.workunit.client.1.smithi133.stdout:2/614: mkdir da/d50/db6/dc4 0 2023-12-16T07:40:47.327 INFO:tasks.workunit.client.1.smithi133.stdout:9/657: dwrite d15/d18/d2c/f93 [0,4194304] 0 2023-12-16T07:40:47.327 INFO:tasks.workunit.client.1.smithi133.stdout:2/615: dread da/f8f [0,4194304] 0 2023-12-16T07:40:47.327 INFO:tasks.workunit.client.1.smithi133.stdout:2/616: fdatasync da/d15/d17/d40/f49 0 2023-12-16T07:40:47.329 INFO:tasks.workunit.client.1.smithi133.stdout:2/617: write da/d1d/d60/d71/d3a/d61/f79 [1292914,52867] 0 2023-12-16T07:40:47.332 INFO:tasks.workunit.client.1.smithi133.stdout:9/658: getdents d15/d18/d2c 0 2023-12-16T07:40:47.337 INFO:tasks.workunit.client.1.smithi133.stdout:9/659: mknod d15/d18/d2c/d68/da6/ce3 0 2023-12-16T07:40:47.337 INFO:tasks.workunit.client.1.smithi133.stdout:9/660: truncate d15/d18/d2c/fdb 346234 0 2023-12-16T07:40:47.337 INFO:tasks.workunit.client.1.smithi133.stdout:9/661: truncate d15/d18/fa5 791798 0 2023-12-16T07:40:47.337 INFO:tasks.workunit.client.1.smithi133.stdout:9/662: getdents d15/d18/d4d/d94 0 2023-12-16T07:40:47.340 INFO:tasks.workunit.client.1.smithi133.stdout:9/663: dread d15/d18/d4d/d7e/fa8 [0,4194304] 0 2023-12-16T07:40:47.341 INFO:tasks.workunit.client.1.smithi133.stdout:9/664: mknod d15/ce4 0 2023-12-16T07:40:47.342 INFO:tasks.workunit.client.1.smithi133.stdout:9/665: creat d15/d18/d4d/d94/dab/fe5 x:0 0 0 2023-12-16T07:40:47.342 INFO:tasks.workunit.client.1.smithi133.stdout:9/666: chown d15/l1e 16 1 2023-12-16T07:40:47.344 INFO:tasks.workunit.client.1.smithi133.stdout:9/667: link d15/d18/f54 d15/fe6 0 2023-12-16T07:40:47.344 INFO:tasks.workunit.client.1.smithi133.stdout:2/618: dwrite da/d1d/d60/d71/d3a/d5a/f5f [4194304,4194304] 0 2023-12-16T07:40:47.345 INFO:tasks.workunit.client.1.smithi133.stdout:9/668: truncate d15/d18/f41 274186 0 2023-12-16T07:40:47.347 INFO:tasks.workunit.client.1.smithi133.stdout:9/669: mkdir d15/d42/d8d/de7 0 2023-12-16T07:40:47.348 INFO:tasks.workunit.client.1.smithi133.stdout:2/619: dread da/d15/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:47.348 INFO:tasks.workunit.client.1.smithi133.stdout:9/670: rename d15/d18/d80/d73 to d15/d18/de8 0 2023-12-16T07:40:47.357 INFO:tasks.workunit.client.1.smithi133.stdout:9/671: dread d15/d18/d80/f98 [0,4194304] 0 2023-12-16T07:40:47.357 INFO:tasks.workunit.client.1.smithi133.stdout:2/620: dread da/d1d/d60/d71/d3a/d61/fb5 [0,4194304] 0 2023-12-16T07:40:47.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:46 smithi133 ceph-mon[120445]: Reconfiguring alertmanager.smithi049 (dependencies changed)... 2023-12-16T07:40:47.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:46 smithi133 ceph-mon[120445]: Reconfiguring daemon alertmanager.smithi049 on smithi049 2023-12-16T07:40:47.369 INFO:tasks.workunit.client.1.smithi133.stdout:9/672: dread fc [0,4194304] 0 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:4/822: sync 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:8/581: sync 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:1/688: sync 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:7/902: sync 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:7/903: readlink db/d21/d2c/l9b 0 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:6/871: sync 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:6/872: fdatasync d0/d5e/d75/d81/d99/fd6 0 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/673: read d15/d18/f54 [1366306,29642] 0 2023-12-16T07:40:47.371 INFO:tasks.workunit.client.1.smithi133.stdout:2/621: dread f1 [0,4194304] 0 2023-12-16T07:40:47.372 INFO:tasks.workunit.client.1.smithi133.stdout:1/689: write d0/d12/f40 [939303,117790] 0 2023-12-16T07:40:47.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/582: write d9/dc/d27/f4f [556065,93885] 0 2023-12-16T07:40:47.373 INFO:tasks.workunit.client.1.smithi133.stdout:7/904: mkdir db/d21/d2c/d31/d6e/d12a 0 2023-12-16T07:40:47.375 INFO:tasks.workunit.client.1.smithi133.stdout:6/873: mkdir d0/d5e/d75/d81/d120 0 2023-12-16T07:40:47.377 INFO:tasks.workunit.client.1.smithi133.stdout:9/674: creat d15/d18/d2c/fe9 x:0 0 0 2023-12-16T07:40:47.379 INFO:tasks.workunit.client.1.smithi133.stdout:9/675: write d15/f37 [3925866,14906] 0 2023-12-16T07:40:47.379 INFO:tasks.workunit.client.1.smithi133.stdout:9/676: getdents d15/d18/d4d/d94 0 2023-12-16T07:40:47.379 INFO:tasks.workunit.client.1.smithi133.stdout:9/677: fsync d15/d18/fa5 0 2023-12-16T07:40:47.380 INFO:tasks.workunit.client.1.smithi133.stdout:1/690: creat d0/d12/d51/dac/fe6 x:0 0 0 2023-12-16T07:40:47.381 INFO:tasks.workunit.client.1.smithi133.stdout:9/678: dread d15/fac [0,4194304] 0 2023-12-16T07:40:47.382 INFO:tasks.workunit.client.1.smithi133.stdout:8/583: link d9/d11/d42/f63 d9/d10/fbc 0 2023-12-16T07:40:47.384 INFO:tasks.workunit.client.1.smithi133.stdout:6/874: creat d0/d4/d21/d35/d4e/d84/d69/da1/f121 x:0 0 0 2023-12-16T07:40:47.385 INFO:tasks.workunit.client.1.smithi133.stdout:8/584: dread d9/d3f/f66 [0,4194304] 0 2023-12-16T07:40:47.385 INFO:tasks.workunit.client.1.smithi133.stdout:8/585: chown d9/f5e 1747199 1 2023-12-16T07:40:47.386 INFO:tasks.workunit.client.1.smithi133.stdout:1/691: creat d0/d12/dda/de0/fe7 x:0 0 0 2023-12-16T07:40:47.387 INFO:tasks.workunit.client.1.smithi133.stdout:1/692: read d0/d12/f40 [1612353,79572] 0 2023-12-16T07:40:47.387 INFO:tasks.workunit.client.1.smithi133.stdout:1/693: fsync d0/d1c/d37/f55 0 2023-12-16T07:40:47.388 INFO:tasks.workunit.client.1.smithi133.stdout:9/679: unlink d15/d18/d2c/caa 0 2023-12-16T07:40:47.391 INFO:tasks.workunit.client.1.smithi133.stdout:6/875: mknod d0/d4/d21/d35/d4e/d84/d69/da1/c122 0 2023-12-16T07:40:47.393 INFO:tasks.workunit.client.1.smithi133.stdout:8/586: rename d9/d3f/l8d to d9/d10/d39/d48/d44/d6e/d78/da6/lbd 0 2023-12-16T07:40:47.394 INFO:tasks.workunit.client.1.smithi133.stdout:8/587: truncate d9/d11/d42/fa5 4383768 0 2023-12-16T07:40:47.395 INFO:tasks.workunit.client.1.smithi133.stdout:1/694: creat d0/d12/d51/dac/fe8 x:0 0 0 2023-12-16T07:40:47.395 INFO:tasks.workunit.client.1.smithi133.stdout:1/695: write d0/da/d3d/dce/fd2 [885889,83024] 0 2023-12-16T07:40:47.396 INFO:tasks.workunit.client.1.smithi133.stdout:6/876: creat d0/f123 x:0 0 0 2023-12-16T07:40:47.397 INFO:tasks.workunit.client.1.smithi133.stdout:6/877: fdatasync d0/d4/f31 0 2023-12-16T07:40:47.397 INFO:tasks.workunit.client.1.smithi133.stdout:7/905: dwrite db/d21/d2c/d31/d59/de7/d119/d6c/dc8/f11a [0,4194304] 0 2023-12-16T07:40:47.398 INFO:tasks.workunit.client.1.smithi133.stdout:7/906: write db/d12/d98/fe2 [983933,101789] 0 2023-12-16T07:40:47.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/588: mknod d9/d11/d42/cbe 0 2023-12-16T07:40:47.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/589: write d9/d11/d42/f63 [441412,57886] 0 2023-12-16T07:40:47.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/590: chown d9/dc/de/f7b 1680 1 2023-12-16T07:40:47.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/591: chown d9/d10/d39/d48/d92 693316 1 2023-12-16T07:40:47.399 INFO:tasks.workunit.client.1.smithi133.stdout:1/696: rmdir d0/d1c/d37 39 2023-12-16T07:40:47.399 INFO:tasks.workunit.client.1.smithi133.stdout:1/697: chown d0/da/d3d/d41/l4f 7290 1 2023-12-16T07:40:47.399 INFO:tasks.workunit.client.1.smithi133.stdout:1/698: chown d0/d1c/d9b/fb8 185 1 2023-12-16T07:40:47.401 INFO:tasks.workunit.client.1.smithi133.stdout:6/878: link d0/d4/d21/d35/f6c d0/d5e/d8c/d107/d11f/f124 0 2023-12-16T07:40:47.402 INFO:tasks.workunit.client.1.smithi133.stdout:7/907: symlink db/d21/d2c/d31/d59/de7/d117/l12b 0 2023-12-16T07:40:47.402 INFO:tasks.workunit.client.1.smithi133.stdout:7/908: truncate db/d3e/d4a/d58/d86/da9/fe5 686832 0 2023-12-16T07:40:47.402 INFO:tasks.workunit.client.1.smithi133.stdout:7/909: truncate db/d3e/d4a/d58/d86/d8b/d8d/ff3 124617 0 2023-12-16T07:40:47.402 INFO:tasks.workunit.client.1.smithi133.stdout:7/910: chown db/d21/d2c/d31/d6e/fb6 6 1 2023-12-16T07:40:47.404 INFO:tasks.workunit.client.1.smithi133.stdout:8/592: rename d9/cb5 to d9/d10/d39/d48/d92/cbf 0 2023-12-16T07:40:47.405 INFO:tasks.workunit.client.1.smithi133.stdout:8/593: write d9/dc/d27/f4f [4124768,100978] 0 2023-12-16T07:40:47.406 INFO:tasks.workunit.client.1.smithi133.stdout:6/879: mknod d0/d5e/d75/dcf/c125 0 2023-12-16T07:40:47.410 INFO:tasks.workunit.client.1.smithi133.stdout:8/594: symlink d9/d10/d39/d48/d44/d69/lc0 0 2023-12-16T07:40:47.411 INFO:tasks.workunit.client.1.smithi133.stdout:6/880: rmdir d0/d5e/d8c/d107/d11f 39 2023-12-16T07:40:47.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/881: creat d0/d4/d21/d62/f126 x:0 0 0 2023-12-16T07:40:47.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/882: truncate d0/d4/d21/d35/d4e/d84/d69/fca 356209 0 2023-12-16T07:40:47.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/883: chown d0/d4/d21/d35/d7e/l9a 17956 1 2023-12-16T07:40:47.421 INFO:tasks.workunit.client.1.smithi133.stdout:9/680: dwrite d15/d18/f77 [0,4194304] 0 2023-12-16T07:40:47.423 INFO:tasks.workunit.client.1.smithi133.stdout:7/911: dwrite db/d21/d2c/d31/d59/de7/d119/d6c/f83 [0,4194304] 0 2023-12-16T07:40:47.423 INFO:tasks.workunit.client.1.smithi133.stdout:7/912: write db/d3e/d4a/d58/d86/da9/fca [2430261,70428] 0 2023-12-16T07:40:47.432 INFO:tasks.workunit.client.1.smithi133.stdout:7/913: dread db/d12/f34 [0,4194304] 0 2023-12-16T07:40:47.438 INFO:tasks.workunit.client.1.smithi133.stdout:8/595: dwrite d9/d10/d39/d48/f68 [4194304,4194304] 0 2023-12-16T07:40:47.441 INFO:tasks.workunit.client.1.smithi133.stdout:1/699: dwrite d0/d12/f40 [0,4194304] 0 2023-12-16T07:40:47.442 INFO:tasks.workunit.client.1.smithi133.stdout:9/681: dwrite f13 [0,4194304] 0 2023-12-16T07:40:47.442 INFO:tasks.workunit.client.1.smithi133.stdout:9/682: write d15/d18/d2c/d68/da3/fe2 [4463748,31514] 0 2023-12-16T07:40:47.449 INFO:tasks.workunit.client.1.smithi133.stdout:7/914: dread db/d12/fcb [0,4194304] 0 2023-12-16T07:40:47.449 INFO:tasks.workunit.client.1.smithi133.stdout:9/683: symlink d15/d42/d8d/db7/lea 0 2023-12-16T07:40:47.450 INFO:tasks.workunit.client.1.smithi133.stdout:7/915: symlink db/d21/d2c/d31/d59/de7/d119/d6c/dc8/dd9/l12c 0 2023-12-16T07:40:47.450 INFO:tasks.workunit.client.1.smithi133.stdout:7/916: readlink db/d12/l63 0 2023-12-16T07:40:47.454 INFO:tasks.workunit.client.1.smithi133.stdout:9/684: write d15/d18/d2c/d68/da3/fe2 [3939566,38301] 0 2023-12-16T07:40:47.454 INFO:tasks.workunit.client.1.smithi133.stdout:9/685: fdatasync d15/d18/d2c/d68/da3/faf 0 2023-12-16T07:40:47.454 INFO:tasks.workunit.client.1.smithi133.stdout:9/686: fsync d15/d18/d5b/d71/d78/d6e/d9b/fbb 0 2023-12-16T07:40:47.454 INFO:tasks.workunit.client.1.smithi133.stdout:9/687: stat d15/f39 0 2023-12-16T07:40:47.454 INFO:tasks.workunit.client.1.smithi133.stdout:9/688: readlink d15/d18/d4d/l87 0 2023-12-16T07:40:47.454 INFO:tasks.workunit.client.1.smithi133.stdout:9/689: write d15/d18/d2c/f33 [492659,74680] 0 2023-12-16T07:40:47.456 INFO:tasks.workunit.client.1.smithi133.stdout:9/690: rename d15/d18/d5b/lce to d15/d18/d5b/d71/d78/d6e/d9b/leb 0 2023-12-16T07:40:47.464 INFO:tasks.workunit.client.1.smithi133.stdout:6/884: dwrite d0/d4/f47 [0,4194304] 0 2023-12-16T07:40:47.464 INFO:tasks.workunit.client.1.smithi133.stdout:1/700: dwrite d0/d12/d51/db6/fc5 [0,4194304] 0 2023-12-16T07:40:47.465 INFO:tasks.workunit.client.1.smithi133.stdout:6/885: mkdir d0/d4/d21/d35/d4e/d127 0 2023-12-16T07:40:47.465 INFO:tasks.workunit.client.1.smithi133.stdout:6/886: readlink d0/d4/d21/d35/l53 0 2023-12-16T07:40:47.466 INFO:tasks.workunit.client.1.smithi133.stdout:8/596: dwrite d9/d11/d33/d9c/fba [0,4194304] 0 2023-12-16T07:40:47.466 INFO:tasks.workunit.client.1.smithi133.stdout:9/691: dread d15/f35 [0,4194304] 0 2023-12-16T07:40:47.466 INFO:tasks.workunit.client.1.smithi133.stdout:9/692: chown d15/d18/d2c/fdb 24 1 2023-12-16T07:40:47.469 INFO:tasks.workunit.client.1.smithi133.stdout:8/597: dread d9/dc/d27/fb0 [0,4194304] 0 2023-12-16T07:40:47.469 INFO:tasks.workunit.client.1.smithi133.stdout:1/701: link d0/d12/d51/dac/d24/d5a/d68/fbc d0/d12/dda/de0/fe9 0 2023-12-16T07:40:47.470 INFO:tasks.workunit.client.1.smithi133.stdout:1/702: write d0/d1c/d37/f43 [1000015,114666] 0 2023-12-16T07:40:47.474 INFO:tasks.workunit.client.1.smithi133.stdout:6/887: mkdir d0/d5e/d75/dcf/d128 0 2023-12-16T07:40:47.477 INFO:tasks.workunit.client.1.smithi133.stdout:9/693: mknod d15/d18/cec 0 2023-12-16T07:40:47.477 INFO:tasks.workunit.client.1.smithi133.stdout:9/694: stat d15/d18/d2c/d68/db2/cbe 0 2023-12-16T07:40:47.479 INFO:tasks.workunit.client.1.smithi133.stdout:8/598: rename d9/d3f to d9/d2d/dc1 0 2023-12-16T07:40:47.481 INFO:tasks.workunit.client.1.smithi133.stdout:6/888: mknod d0/d4/d21/d35/d7e/ded/c129 0 2023-12-16T07:40:47.500 INFO:tasks.workunit.client.1.smithi133.stdout:8/599: rename d9/d10/d39/d48/d44/d6e/l99 to d9/lc2 0 2023-12-16T07:40:47.503 INFO:tasks.workunit.client.1.smithi133.stdout:6/889: rmdir d0/d5e/d75/dad 39 2023-12-16T07:40:47.503 INFO:tasks.workunit.client.1.smithi133.stdout:6/890: fsync d0/d5e/d75/d81/f102 0 2023-12-16T07:40:47.504 INFO:tasks.workunit.client.1.smithi133.stdout:6/891: mknod d0/d4/d21/d35/d7e/ded/c12a 0 2023-12-16T07:40:47.506 INFO:tasks.workunit.client.1.smithi133.stdout:6/892: symlink d0/d5e/d75/d81/d120/l12b 0 2023-12-16T07:40:47.510 INFO:tasks.workunit.client.1.smithi133.stdout:6/893: creat d0/d4/df8/f12c x:0 0 0 2023-12-16T07:40:47.511 INFO:tasks.workunit.client.1.smithi133.stdout:6/894: dread d0/d4/d21/d60/f9d [0,4194304] 0 2023-12-16T07:40:47.521 INFO:tasks.workunit.client.1.smithi133.stdout:6/895: dread d0/d4/d21/f59 [0,4194304] 0 2023-12-16T07:40:47.521 INFO:tasks.workunit.client.1.smithi133.stdout:6/896: write d0/d4/dee/f108 [423311,60193] 0 2023-12-16T07:40:47.529 INFO:tasks.workunit.client.1.smithi133.stdout:3/531: sync 2023-12-16T07:40:47.529 INFO:tasks.workunit.client.1.smithi133.stdout:0/637: sync 2023-12-16T07:40:47.531 INFO:tasks.workunit.client.1.smithi133.stdout:0/638: unlink d2/d17/d40/f70 0 2023-12-16T07:40:47.533 INFO:tasks.workunit.client.1.smithi133.stdout:3/532: dread d7/d8/f5c [0,4194304] 0 2023-12-16T07:40:47.535 INFO:tasks.workunit.client.1.smithi133.stdout:3/533: rename d7/d8/d1d/l45 to d7/d8/d1c/ddb/le4 0 2023-12-16T07:40:47.535 INFO:tasks.workunit.client.1.smithi133.stdout:3/534: chown d7/d8/d1c/c36 1 1 2023-12-16T07:40:47.536 INFO:tasks.workunit.client.1.smithi133.stdout:3/535: creat d7/d8/d1c/ddb/d95/fe5 x:0 0 0 2023-12-16T07:40:47.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/536: link d7/d8/d1c/fa0 d7/d8/d72/d86/fe6 0 2023-12-16T07:40:47.547 INFO:tasks.workunit.client.1.smithi133.stdout:0/639: dwrite d2/d9/d20/d5e/d92/fc0 [0,4194304] 0 2023-12-16T07:40:47.552 INFO:tasks.workunit.client.1.smithi133.stdout:0/640: stat d2/d9/d12/d35/d4f/l6b 0 2023-12-16T07:40:47.555 INFO:tasks.workunit.client.1.smithi133.stdout:0/641: symlink d2/lc9 0 2023-12-16T07:40:47.557 INFO:tasks.workunit.client.1.smithi133.stdout:0/642: creat d2/d9/d8f/fca x:0 0 0 2023-12-16T07:40:47.558 INFO:tasks.workunit.client.1.smithi133.stdout:0/643: fsync d2/d9/d12/d35/d4f/d93/fbc 0 2023-12-16T07:40:47.558 INFO:tasks.workunit.client.1.smithi133.stdout:0/644: write d2/d9/f47 [1395713,97075] 0 2023-12-16T07:40:47.558 INFO:tasks.workunit.client.1.smithi133.stdout:0/645: dread - d2/d17/fc8 zero size 2023-12-16T07:40:47.558 INFO:tasks.workunit.client.1.smithi133.stdout:0/646: truncate d2/d9/d12/d45/d9e/da0/fae 737437 0 2023-12-16T07:40:47.560 INFO:tasks.workunit.client.1.smithi133.stdout:0/647: link d2/d9/d12/c32 d2/d9/d8f/ccb 0 2023-12-16T07:40:47.562 INFO:tasks.workunit.client.1.smithi133.stdout:0/648: unlink d2/d9/d12/d35/d4f/l6b 0 2023-12-16T07:40:47.562 INFO:tasks.workunit.client.1.smithi133.stdout:0/649: write d2/d17/d2b/d67/fad [876843,44371] 0 2023-12-16T07:40:47.563 INFO:tasks.workunit.client.1.smithi133.stdout:0/650: mkdir d2/d9/d8f/dcc 0 2023-12-16T07:40:47.565 INFO:tasks.workunit.client.1.smithi133.stdout:0/651: getdents d2/d17/d2b/d31/d63/d98 0 2023-12-16T07:40:47.573 INFO:tasks.workunit.client.1.smithi133.stdout:0/652: dread d2/d9/db/f6c [4194304,4194304] 0 2023-12-16T07:40:47.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/653: creat d2/d9/d20/d5e/d89/fcd x:0 0 0 2023-12-16T07:40:47.578 INFO:tasks.workunit.client.1.smithi133.stdout:0/654: creat d2/fce x:0 0 0 2023-12-16T07:40:47.579 INFO:tasks.workunit.client.1.smithi133.stdout:0/655: symlink d2/lcf 0 2023-12-16T07:40:47.579 INFO:tasks.workunit.client.1.smithi133.stdout:0/656: fdatasync d2/d9/d20/d5e/d89/fcd 0 2023-12-16T07:40:47.580 INFO:tasks.workunit.client.1.smithi133.stdout:0/657: symlink d2/d17/d2b/d31/d63/d98/ld0 0 2023-12-16T07:40:47.580 INFO:tasks.workunit.client.1.smithi133.stdout:0/658: write d2/d9/db/fe [5019236,76174] 0 2023-12-16T07:40:47.597 INFO:tasks.workunit.client.1.smithi133.stdout:0/659: dwrite d2/d17/d2b/d67/fad [0,4194304] 0 2023-12-16T07:40:47.606 INFO:tasks.workunit.client.1.smithi133.stdout:0/660: dread d2/d17/f26 [0,4194304] 0 2023-12-16T07:40:47.606 INFO:tasks.workunit.client.1.smithi133.stdout:0/661: write d2/d17/d2b/f4b [4901514,36508] 0 2023-12-16T07:40:47.608 INFO:tasks.workunit.client.1.smithi133.stdout:0/662: creat d2/d9/d8f/dcc/fd1 x:0 0 0 2023-12-16T07:40:47.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/663: dwrite d2/d17/d2b/f59 [0,4194304] 0 2023-12-16T07:40:47.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/664: dread - d2/d9/d20/d5e/d89/fa8 zero size 2023-12-16T07:40:47.640 INFO:tasks.workunit.client.1.smithi133.stdout:0/665: dwrite d2/d9/d8f/dcc/fd1 [0,4194304] 0 2023-12-16T07:40:47.640 INFO:tasks.workunit.client.1.smithi133.stdout:0/666: read - d2/d9/d20/d5e/d89/fcd zero size 2023-12-16T07:40:47.655 INFO:tasks.workunit.client.1.smithi133.stdout:0/667: dwrite d2/d17/d2b/d31/d4d/f53 [0,4194304] 0 2023-12-16T07:40:47.655 INFO:tasks.workunit.client.1.smithi133.stdout:0/668: fsync d2/d17/fbf 0 2023-12-16T07:40:47.656 INFO:tasks.workunit.client.1.smithi133.stdout:0/669: creat d2/d17/d2b/d31/d4d/da7/fd2 x:0 0 0 2023-12-16T07:40:47.662 INFO:tasks.workunit.client.1.smithi133.stdout:0/670: dread d2/f6 [0,4194304] 0 2023-12-16T07:40:47.679 INFO:tasks.workunit.client.1.smithi133.stdout:0/671: dwrite d2/d17/fac [0,4194304] 0 2023-12-16T07:40:47.694 INFO:tasks.workunit.client.1.smithi133.stdout:0/672: dwrite d2/d17/d2b/fa5 [0,4194304] 0 2023-12-16T07:40:47.708 INFO:tasks.workunit.client.1.smithi133.stdout:5/543: sync 2023-12-16T07:40:47.709 INFO:tasks.workunit.client.1.smithi133.stdout:5/544: rename d1/de/d35/dc6/db4/d9e to d1/d1c/d80/d64/dc1/dca 0 2023-12-16T07:40:47.709 INFO:tasks.workunit.client.1.smithi133.stdout:5/545: readlink d1/de/lb6 0 2023-12-16T07:40:47.732 INFO:tasks.workunit.client.1.smithi133.stdout:5/546: dwrite d1/d4b/f5f [0,4194304] 0 2023-12-16T07:40:47.740 INFO:tasks.workunit.client.1.smithi133.stdout:5/547: dread d1/d18/f42 [0,4194304] 0 2023-12-16T07:40:47.740 INFO:tasks.workunit.client.1.smithi133.stdout:5/548: fsync d1/f24 0 2023-12-16T07:40:47.860 INFO:tasks.workunit.client.1.smithi133.stdout:5/549: link d1/d18/f41 d1/d1c/d80/d64/dc1/dca/fcb 0 2023-12-16T07:40:47.874 INFO:tasks.workunit.client.1.smithi133.stdout:5/550: dwrite d1/de/f3c [0,4194304] 0 2023-12-16T07:40:47.879 INFO:tasks.workunit.client.1.smithi133.stdout:4/823: sync 2023-12-16T07:40:47.880 INFO:tasks.workunit.client.1.smithi133.stdout:4/824: truncate d3/d7/d38/dd5/da7/daa/dc6/d10b/fff 382539 0 2023-12-16T07:40:47.881 INFO:tasks.workunit.client.1.smithi133.stdout:5/551: dread d1/f10 [0,4194304] 0 2023-12-16T07:40:47.882 INFO:tasks.workunit.client.1.smithi133.stdout:5/552: fsync d1/d4b/da5/f8b 0 2023-12-16T07:40:47.882 INFO:tasks.workunit.client.1.smithi133.stdout:4/825: symlink d3/d7/d38/dd5/dac/dbc/l112 0 2023-12-16T07:40:47.883 INFO:tasks.workunit.client.1.smithi133.stdout:4/826: dread d3/d7/d1c/d2a/d91/dbe/dfa/fda [0,4194304] 0 2023-12-16T07:40:47.925 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:47 smithi049 ceph-mon[111939]: pgmap v20: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 171 MiB/s wr, 291 op/s 2023-12-16T07:40:47.999 INFO:tasks.workunit.client.1.smithi133.stdout:1/703: sync 2023-12-16T07:40:47.999 INFO:tasks.workunit.client.1.smithi133.stdout:7/917: sync 2023-12-16T07:40:47.999 INFO:tasks.workunit.client.1.smithi133.stdout:2/622: sync 2023-12-16T07:40:47.999 INFO:tasks.workunit.client.1.smithi133.stdout:7/918: read - db/d3e/d4a/fec zero size 2023-12-16T07:40:47.999 INFO:tasks.workunit.client.1.smithi133.stdout:7/919: chown db/d21/d2c/d31/d59/de7/d119/d6c/f11c 4546 1 2023-12-16T07:40:47.999 INFO:tasks.workunit.client.1.smithi133.stdout:7/920: chown db/d21/d2c/d31/d6e/f97 162752 1 2023-12-16T07:40:48.000 INFO:tasks.workunit.client.1.smithi133.stdout:7/921: write db/d3e/d4a/f9a [3038253,15600] 0 2023-12-16T07:40:48.000 INFO:tasks.workunit.client.1.smithi133.stdout:7/922: fsync db/d3e/d4a/d58/d86/d8b/f90 0 2023-12-16T07:40:48.000 INFO:tasks.workunit.client.1.smithi133.stdout:2/623: creat da/d15/d1b/d43/fc5 x:0 0 0 2023-12-16T07:40:48.003 INFO:tasks.workunit.client.1.smithi133.stdout:7/923: truncate db/d12/d98/fe2 104465 0 2023-12-16T07:40:48.007 INFO:tasks.workunit.client.1.smithi133.stdout:1/704: dread d0/d12/d51/dac/d24/d32/f57 [0,4194304] 0 2023-12-16T07:40:48.007 INFO:tasks.workunit.client.1.smithi133.stdout:1/705: chown d0/da/d3d/d41/fa4 2106486154 1 2023-12-16T07:40:48.007 INFO:tasks.workunit.client.1.smithi133.stdout:1/706: stat d0/d12/d51/dac/d24/d5a/d68/c6f 0 2023-12-16T07:40:48.007 INFO:tasks.workunit.client.1.smithi133.stdout:7/924: write db/d3e/d4a/f9a [3990146,49752] 0 2023-12-16T07:40:48.009 INFO:tasks.workunit.client.1.smithi133.stdout:1/707: symlink d0/d12/d51/lea 0 2023-12-16T07:40:48.010 INFO:tasks.workunit.client.1.smithi133.stdout:1/708: readlink d0/d12/l67 0 2023-12-16T07:40:48.010 INFO:tasks.workunit.client.1.smithi133.stdout:2/624: dread da/d1d/f25 [0,4194304] 0 2023-12-16T07:40:48.013 INFO:tasks.workunit.client.1.smithi133.stdout:7/925: mknod db/d21/d2c/d31/d59/de7/d119/df7/d10b/c12d 0 2023-12-16T07:40:48.015 INFO:tasks.workunit.client.1.smithi133.stdout:2/625: truncate da/d1d/d60/d71/d3a/d5a/f5f 2627518 0 2023-12-16T07:40:48.016 INFO:tasks.workunit.client.1.smithi133.stdout:1/709: dread d0/d12/d51/dac/d24/d32/d56/d59/d66/fa9 [0,4194304] 0 2023-12-16T07:40:48.017 INFO:tasks.workunit.client.1.smithi133.stdout:2/626: creat da/d15/d17/d40/d98/fc6 x:0 0 0 2023-12-16T07:40:48.018 INFO:tasks.workunit.client.1.smithi133.stdout:2/627: chown da/d15/d1b/f44 138 1 2023-12-16T07:40:48.020 INFO:tasks.workunit.client.1.smithi133.stdout:1/710: truncate d0/f17 3786083 0 2023-12-16T07:40:48.022 INFO:tasks.workunit.client.1.smithi133.stdout:2/628: creat da/d50/db6/dc4/fc7 x:0 0 0 2023-12-16T07:40:48.022 INFO:tasks.workunit.client.1.smithi133.stdout:2/629: readlink da/l4a 0 2023-12-16T07:40:48.024 INFO:tasks.workunit.client.1.smithi133.stdout:1/711: mknod d0/d1c/d37/da6/ceb 0 2023-12-16T07:40:48.031 INFO:tasks.workunit.client.1.smithi133.stdout:1/712: link d0/d12/d51/dac/l15 d0/dc4/lec 0 2023-12-16T07:40:48.034 INFO:tasks.workunit.client.1.smithi133.stdout:1/713: mknod d0/d1c/ced 0 2023-12-16T07:40:48.034 INFO:tasks.workunit.client.1.smithi133.stdout:1/714: dread - d0/d1c/d9b/fb8 zero size 2023-12-16T07:40:48.035 INFO:tasks.workunit.client.1.smithi133.stdout:7/926: dwrite db/d21/d2c/d31/d59/de7/d119/d6c/f11c [0,4194304] 0 2023-12-16T07:40:48.035 INFO:tasks.workunit.client.1.smithi133.stdout:1/715: rmdir d0/da/d3d/dce 39 2023-12-16T07:40:48.037 INFO:tasks.workunit.client.1.smithi133.stdout:7/927: write db/d21/f52 [212375,95988] 0 2023-12-16T07:40:48.040 INFO:tasks.workunit.client.1.smithi133.stdout:7/928: dread db/d3e/d4a/d58/d86/fa1 [0,4194304] 0 2023-12-16T07:40:48.040 INFO:tasks.workunit.client.1.smithi133.stdout:7/929: fsync db/d12/f45 0 2023-12-16T07:40:48.040 INFO:tasks.workunit.client.1.smithi133.stdout:7/930: dread - db/d21/d2c/d31/dd2/feb zero size 2023-12-16T07:40:48.041 INFO:tasks.workunit.client.1.smithi133.stdout:1/716: creat d0/dc4/fee x:0 0 0 2023-12-16T07:40:48.043 INFO:tasks.workunit.client.1.smithi133.stdout:7/931: rename db/d21/d2c/f56 to db/d21/d2c/d31/d59/de7/d114/f12e 0 2023-12-16T07:40:48.043 INFO:tasks.workunit.client.1.smithi133.stdout:7/932: truncate db/d3e/f40 4556520 0 2023-12-16T07:40:48.043 INFO:tasks.workunit.client.1.smithi133.stdout:1/717: mknod d0/d1c/d71/dcf/cef 0 2023-12-16T07:40:48.044 INFO:tasks.workunit.client.1.smithi133.stdout:1/718: chown d0/c20 180 1 2023-12-16T07:40:48.046 INFO:tasks.workunit.client.1.smithi133.stdout:7/933: mknod db/d21/d2c/d31/d59/de7/d119/df7/c12f 0 2023-12-16T07:40:48.050 INFO:tasks.workunit.client.1.smithi133.stdout:7/934: unlink db/c17 0 2023-12-16T07:40:48.052 INFO:tasks.workunit.client.1.smithi133.stdout:2/630: dwrite da/d1d/d60/d71/d3a/fa1 [0,4194304] 0 2023-12-16T07:40:48.057 INFO:tasks.workunit.client.1.smithi133.stdout:2/631: dread da/d1d/f96 [0,4194304] 0 2023-12-16T07:40:48.061 INFO:tasks.workunit.client.1.smithi133.stdout:1/719: dwrite d0/d12/d51/dac/d24/f6b [0,4194304] 0 2023-12-16T07:40:48.061 INFO:tasks.workunit.client.1.smithi133.stdout:2/632: mknod da/d15/d17/cc8 0 2023-12-16T07:40:48.063 INFO:tasks.workunit.client.1.smithi133.stdout:1/720: mkdir d0/da/d3d/d41/df0 0 2023-12-16T07:40:48.063 INFO:tasks.workunit.client.1.smithi133.stdout:1/721: fsync d0/f2a 0 2023-12-16T07:40:48.063 INFO:tasks.workunit.client.1.smithi133.stdout:1/722: chown d0/f2a 1 1 2023-12-16T07:40:48.064 INFO:tasks.workunit.client.1.smithi133.stdout:2/633: symlink da/d15/d17/d40/d98/lc9 0 2023-12-16T07:40:48.064 INFO:tasks.workunit.client.1.smithi133.stdout:2/634: stat da/d15/d1b 0 2023-12-16T07:40:48.066 INFO:tasks.workunit.client.1.smithi133.stdout:1/723: symlink d0/d12/d51/dac/d24/d5a/d68/lf1 0 2023-12-16T07:40:48.066 INFO:tasks.workunit.client.1.smithi133.stdout:1/724: stat d0/d12/d51/db6/cc6 0 2023-12-16T07:40:48.071 INFO:tasks.workunit.client.1.smithi133.stdout:7/935: dwrite db/f1c [4194304,4194304] 0 2023-12-16T07:40:48.077 INFO:tasks.workunit.client.1.smithi133.stdout:2/635: dread da/d50/f82 [0,4194304] 0 2023-12-16T07:40:48.077 INFO:tasks.workunit.client.1.smithi133.stdout:2/636: chown da/d50/db6 3 1 2023-12-16T07:40:48.077 INFO:tasks.workunit.client.1.smithi133.stdout:2/637: readlink da/d1d/d60/d71/l69 0 2023-12-16T07:40:48.081 INFO:tasks.workunit.client.1.smithi133.stdout:2/638: write da/d1d/f29 [3351212,49221] 0 2023-12-16T07:40:48.081 INFO:tasks.workunit.client.1.smithi133.stdout:2/639: readlink da/d1d/d60/d71/d2e/d59/l66 0 2023-12-16T07:40:48.087 INFO:tasks.workunit.client.1.smithi133.stdout:1/725: dwrite d0/f2a [4194304,4194304] 0 2023-12-16T07:40:48.088 INFO:tasks.workunit.client.1.smithi133.stdout:7/936: dwrite db/d21/f5b [4194304,4194304] 0 2023-12-16T07:40:48.088 INFO:tasks.workunit.client.1.smithi133.stdout:2/640: dread da/d1d/d60/d71/d3a/d5a/f5f [0,4194304] 0 2023-12-16T07:40:48.088 INFO:tasks.workunit.client.1.smithi133.stdout:2/641: chown da/d15/f9f 90348 1 2023-12-16T07:40:48.088 INFO:tasks.workunit.client.1.smithi133.stdout:2/642: chown da/d1d/d60/d71/d3a/fa1 3 1 2023-12-16T07:40:48.088 INFO:tasks.workunit.client.1.smithi133.stdout:7/937: write db/d21/f80 [1760017,82198] 0 2023-12-16T07:40:48.091 INFO:tasks.workunit.client.1.smithi133.stdout:1/726: creat d0/da/ff2 x:0 0 0 2023-12-16T07:40:48.094 INFO:tasks.workunit.client.1.smithi133.stdout:2/643: rmdir da/d15/d1b/d43/d85 39 2023-12-16T07:40:48.095 INFO:tasks.workunit.client.1.smithi133.stdout:2/644: write da/f8f [1497670,98021] 0 2023-12-16T07:40:48.095 INFO:tasks.workunit.client.1.smithi133.stdout:2/645: chown da/d1d/f29 1568784102 1 2023-12-16T07:40:48.095 INFO:tasks.workunit.client.1.smithi133.stdout:1/727: mknod d0/da/d3d/dc2/cf3 0 2023-12-16T07:40:48.095 INFO:tasks.workunit.client.1.smithi133.stdout:1/728: chown d0/d12/d51/dac/d24/d32/d56/d59/d5f 8148 1 2023-12-16T07:40:48.097 INFO:tasks.workunit.client.1.smithi133.stdout:1/729: rename d0/da/f4b to d0/d12/d51/db6/ff4 0 2023-12-16T07:40:48.097 INFO:tasks.workunit.client.1.smithi133.stdout:1/730: write d0/da/d3d/d41/f6a [52791,84629] 0 2023-12-16T07:40:48.097 INFO:tasks.workunit.client.1.smithi133.stdout:1/731: chown d0/d12/d51/f64 433 1 2023-12-16T07:40:48.097 INFO:tasks.workunit.client.1.smithi133.stdout:1/732: write d0/d12/d51/dac/f2f [4334979,48777] 0 2023-12-16T07:40:48.097 INFO:tasks.workunit.client.1.smithi133.stdout:7/938: dread db/d3e/d4a/d58/f62 [0,4194304] 0 2023-12-16T07:40:48.098 INFO:tasks.workunit.client.1.smithi133.stdout:7/939: write db/d21/d2c/d31/d59/de7/d119/df7/fd6 [2010446,23323] 0 2023-12-16T07:40:48.098 INFO:tasks.workunit.client.1.smithi133.stdout:7/940: write db/d21/d2c/d31/d59/de7/d119/d6c/f115 [630914,60559] 0 2023-12-16T07:40:48.098 INFO:tasks.workunit.client.1.smithi133.stdout:7/941: creat db/d21/d2c/d31/d59/de7/d119/d6c/dc8/dd9/f130 x:0 0 0 2023-12-16T07:40:48.099 INFO:tasks.workunit.client.1.smithi133.stdout:7/942: chown db/d3e/d4a/dfb 2169 1 2023-12-16T07:40:48.100 INFO:tasks.workunit.client.1.smithi133.stdout:7/943: chown db/d12/d98/c118 1639253953 1 2023-12-16T07:40:48.102 INFO:tasks.workunit.client.1.smithi133.stdout:7/944: creat db/d21/d2c/d31/d59/de7/d119/d6c/f131 x:0 0 0 2023-12-16T07:40:48.103 INFO:tasks.workunit.client.1.smithi133.stdout:2/646: dread da/d1d/d60/d71/d3a/fa1 [0,4194304] 0 2023-12-16T07:40:48.106 INFO:tasks.workunit.client.1.smithi133.stdout:7/945: mkdir db/d21/d2c/d31/d79/dcf/d132 0 2023-12-16T07:40:48.106 INFO:tasks.workunit.client.1.smithi133.stdout:7/946: chown db/d53/ldd 79560574 1 2023-12-16T07:40:48.108 INFO:tasks.workunit.client.1.smithi133.stdout:1/733: dread d0/d12/d51/dac/fd [0,4194304] 0 2023-12-16T07:40:48.108 INFO:tasks.workunit.client.1.smithi133.stdout:7/947: truncate db/d12/f71 4971795 0 2023-12-16T07:40:48.108 INFO:tasks.workunit.client.1.smithi133.stdout:7/948: write db/d3e/d4a/d58/d86/da9/fe5 [952764,17557] 0 2023-12-16T07:40:48.109 INFO:tasks.workunit.client.1.smithi133.stdout:1/734: read d0/da/f2e [4033781,88324] 0 2023-12-16T07:40:48.112 INFO:tasks.workunit.client.1.smithi133.stdout:1/735: mkdir d0/da/d3d/dce/df5 0 2023-12-16T07:40:48.112 INFO:tasks.workunit.client.1.smithi133.stdout:1/736: dread - d0/d1c/d9b/fb8 zero size 2023-12-16T07:40:48.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/737: truncate d0/d12/d51/dac/f21 525978 0 2023-12-16T07:40:48.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/738: dread - d0/d12/d51/dac/d24/d32/d56/d59/d66/fd6 zero size 2023-12-16T07:40:48.114 INFO:tasks.workunit.client.1.smithi133.stdout:1/739: creat d0/da/d3d/ff6 x:0 0 0 2023-12-16T07:40:48.114 INFO:tasks.workunit.client.1.smithi133.stdout:1/740: rmdir d0/da/d3d/d41/d9f 39 2023-12-16T07:40:48.118 INFO:tasks.workunit.client.1.smithi133.stdout:7/949: dread db/d21/f23 [0,4194304] 0 2023-12-16T07:40:48.120 INFO:tasks.workunit.client.1.smithi133.stdout:7/950: rename db/d12/d98/l9e to db/d21/d2c/d31/d59/l133 0 2023-12-16T07:40:48.126 INFO:tasks.workunit.client.1.smithi133.stdout:7/951: dread db/d3e/d4a/d58/d86/d8b/f90 [0,4194304] 0 2023-12-16T07:40:48.143 INFO:tasks.workunit.client.1.smithi133.stdout:7/952: dwrite db/d3e/d4a/d58/d86/da8/f10f [0,4194304] 0 2023-12-16T07:40:48.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/953: dread db/ff [0,4194304] 0 2023-12-16T07:40:48.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/954: readlink db/d3e/d4a/d58/l72 0 2023-12-16T07:40:48.154 INFO:tasks.workunit.client.1.smithi133.stdout:7/955: mkdir db/d3e/d4a/d112/d134 0 2023-12-16T07:40:48.176 INFO:tasks.workunit.client.1.smithi133.stdout:7/956: dwrite db/d21/d2c/f48 [0,4194304] 0 2023-12-16T07:40:48.178 INFO:tasks.workunit.client.1.smithi133.stdout:7/957: mknod db/d21/d2c/d31/d59/de7/d119/d6c/c135 0 2023-12-16T07:40:48.178 INFO:tasks.workunit.client.1.smithi133.stdout:7/958: write db/d12/d98/fa2 [1203584,59321] 0 2023-12-16T07:40:48.179 INFO:tasks.workunit.client.1.smithi133.stdout:7/959: chown db/d21/db1/c128 3 1 2023-12-16T07:40:48.179 INFO:tasks.workunit.client.1.smithi133.stdout:7/960: stat db/d3e/d4a/d58/d86/d8b/d8d/ff3 0 2023-12-16T07:40:48.179 INFO:tasks.workunit.client.1.smithi133.stdout:7/961: link db/c13 db/d21/d2c/d31/d59/c136 0 2023-12-16T07:40:48.181 INFO:tasks.workunit.client.1.smithi133.stdout:7/962: mkdir db/d21/d2c/d31/dd2/d137 0 2023-12-16T07:40:48.181 INFO:tasks.workunit.client.1.smithi133.stdout:7/963: truncate db/f7b 1535505 0 2023-12-16T07:40:48.182 INFO:tasks.workunit.client.1.smithi133.stdout:7/964: link db/d12/d98/fb2 db/d3e/d4a/f138 0 2023-12-16T07:40:48.209 INFO:tasks.workunit.client.1.smithi133.stdout:1/741: dread d0/d1c/d37/f84 [0,4194304] 0 2023-12-16T07:40:48.210 INFO:tasks.workunit.client.1.smithi133.stdout:1/742: unlink d0/da/c7a 0 2023-12-16T07:40:48.212 INFO:tasks.workunit.client.1.smithi133.stdout:1/743: creat d0/d12/d51/dac/d24/d5a/d68/ff7 x:0 0 0 2023-12-16T07:40:48.214 INFO:tasks.workunit.client.1.smithi133.stdout:1/744: creat d0/d1c/ff8 x:0 0 0 2023-12-16T07:40:48.216 INFO:tasks.workunit.client.1.smithi133.stdout:1/745: symlink d0/d12/d51/db6/lf9 0 2023-12-16T07:40:48.216 INFO:tasks.workunit.client.1.smithi133.stdout:1/746: dread - d0/da/ff2 zero size 2023-12-16T07:40:48.217 INFO:tasks.workunit.client.1.smithi133.stdout:1/747: rmdir d0/da/d3d/dce 39 2023-12-16T07:40:48.218 INFO:tasks.workunit.client.1.smithi133.stdout:1/748: truncate d0/d1c/d37/f9e 2732183 0 2023-12-16T07:40:48.219 INFO:tasks.workunit.client.1.smithi133.stdout:1/749: stat d0/da/d3d/d41/f79 0 2023-12-16T07:40:48.222 INFO:tasks.workunit.client.1.smithi133.stdout:1/750: dread d0/d12/d51/f64 [0,4194304] 0 2023-12-16T07:40:48.223 INFO:tasks.workunit.client.1.smithi133.stdout:1/751: rmdir d0/d12/d51/dac/d24 39 2023-12-16T07:40:48.225 INFO:tasks.workunit.client.1.smithi133.stdout:1/752: symlink d0/d12/lfa 0 2023-12-16T07:40:48.229 INFO:tasks.workunit.client.1.smithi133.stdout:1/753: symlink d0/d12/d51/dac/d24/d32/d56/d59/d66/lfb 0 2023-12-16T07:40:48.229 INFO:tasks.workunit.client.1.smithi133.stdout:1/754: chown d0/d12/d51/dac/d24/d5a/d68/cbb 1965 1 2023-12-16T07:40:48.232 INFO:tasks.workunit.client.1.smithi133.stdout:1/755: creat d0/d12/d51/dac/d24/d32/ffc x:0 0 0 2023-12-16T07:40:48.235 INFO:tasks.workunit.client.1.smithi133.stdout:1/756: rmdir d0/da/d3d/d41 39 2023-12-16T07:40:48.236 INFO:tasks.workunit.client.1.smithi133.stdout:1/757: write d0/d60/f8e [3734685,71238] 0 2023-12-16T07:40:48.238 INFO:tasks.workunit.client.1.smithi133.stdout:1/758: creat d0/d1c/d37/ffd x:0 0 0 2023-12-16T07:40:48.238 INFO:tasks.workunit.client.1.smithi133.stdout:1/759: chown d0/d12/d51/dac/d24/d5a/d68/dd5 9529 1 2023-12-16T07:40:48.240 INFO:tasks.workunit.client.1.smithi133.stdout:1/760: link d0/d12/d51/dac/d24/d5a/d68/lf1 d0/d12/dda/lfe 0 2023-12-16T07:40:48.240 INFO:tasks.workunit.client.1.smithi133.stdout:1/761: chown d0/da/d3d/d41/lc1 0 1 2023-12-16T07:40:48.240 INFO:tasks.workunit.client.1.smithi133.stdout:1/762: write d0/da/d3d/f50 [1255879,88700] 0 2023-12-16T07:40:48.240 INFO:tasks.workunit.client.1.smithi133.stdout:1/763: chown d0/d1c/d71/c90 31272 1 2023-12-16T07:40:48.242 INFO:tasks.workunit.client.1.smithi133.stdout:1/764: creat d0/da/d3d/d41/df0/fff x:0 0 0 2023-12-16T07:40:48.242 INFO:tasks.workunit.client.1.smithi133.stdout:1/765: fsync d0/d12/d51/db6/dde/fdf 0 2023-12-16T07:40:48.243 INFO:tasks.workunit.client.1.smithi133.stdout:1/766: creat d0/da/d3d/dce/df5/f100 x:0 0 0 2023-12-16T07:40:48.245 INFO:tasks.workunit.client.1.smithi133.stdout:1/767: dread d0/d1c/f5c [0,4194304] 0 2023-12-16T07:40:48.248 INFO:tasks.workunit.client.1.smithi133.stdout:1/768: symlink d0/d1c/d37/l101 0 2023-12-16T07:40:48.252 INFO:tasks.workunit.client.1.smithi133.stdout:1/769: rename d0/d12/d51/dac/d24/d32/d3e to d0/d1c/d102 0 2023-12-16T07:40:48.252 INFO:tasks.workunit.client.1.smithi133.stdout:1/770: write d0/d12/d51/db6/dde/fdf [717598,27537] 0 2023-12-16T07:40:48.252 INFO:tasks.workunit.client.1.smithi133.stdout:1/771: write d0/da/d3d/dce/df5/f100 [420074,121995] 0 2023-12-16T07:40:48.264 INFO:tasks.workunit.client.1.smithi133.stdout:1/772: dwrite d0/da/d3d/d41/f79 [4194304,4194304] 0 2023-12-16T07:40:48.283 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:47 smithi133 ceph-mon[120445]: pgmap v20: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 171 MiB/s wr, 291 op/s 2023-12-16T07:40:48.286 INFO:tasks.workunit.client.1.smithi133.stdout:1/773: mkdir d0/d1c/d37/d103 0 2023-12-16T07:40:48.288 INFO:tasks.workunit.client.1.smithi133.stdout:1/774: mkdir d0/d12/d51/dac/d24/d32/d56/d59/d104 0 2023-12-16T07:40:48.289 INFO:tasks.workunit.client.1.smithi133.stdout:1/775: truncate d0/d12/d51/dac/d24/d32/f57 657757 0 2023-12-16T07:40:48.289 INFO:tasks.workunit.client.1.smithi133.stdout:1/776: truncate d0/da/d3d/d41/fa4 802665 0 2023-12-16T07:40:48.292 INFO:tasks.workunit.client.1.smithi133.stdout:1/777: mkdir d0/d1c/d102/d70/d105 0 2023-12-16T07:40:48.294 INFO:tasks.workunit.client.1.smithi133.stdout:1/778: mknod d0/d12/d51/dac/d24/d32/d56/d59/d104/c106 0 2023-12-16T07:40:48.296 INFO:tasks.workunit.client.1.smithi133.stdout:1/779: getdents d0/d12/dda/de0 0 2023-12-16T07:40:48.299 INFO:tasks.workunit.client.1.smithi133.stdout:1/780: creat d0/d1c/d9b/f107 x:0 0 0 2023-12-16T07:40:48.299 INFO:tasks.workunit.client.1.smithi133.stdout:1/781: readlink d0/d60/l8c 0 2023-12-16T07:40:48.313 INFO:tasks.workunit.client.1.smithi133.stdout:1/782: dwrite d0/d12/d51/dac/d24/f6b [0,4194304] 0 2023-12-16T07:40:48.316 INFO:tasks.workunit.client.1.smithi133.stdout:1/783: link d0/da/d3d/dce/fd2 d0/da/d3d/d41/d9f/f108 0 2023-12-16T07:40:48.317 INFO:tasks.workunit.client.1.smithi133.stdout:1/784: creat d0/da/d3d/dc2/f109 x:0 0 0 2023-12-16T07:40:48.352 INFO:tasks.workunit.client.1.smithi133.stdout:9/695: sync 2023-12-16T07:40:48.352 INFO:tasks.workunit.client.1.smithi133.stdout:8/600: sync 2023-12-16T07:40:48.352 INFO:tasks.workunit.client.1.smithi133.stdout:9/696: symlink d15/led 0 2023-12-16T07:40:48.354 INFO:tasks.workunit.client.1.smithi133.stdout:9/697: mknod d15/d42/d8d/db7/dd4/cee 0 2023-12-16T07:40:48.354 INFO:tasks.workunit.client.1.smithi133.stdout:9/698: dread - d15/d18/d2c/d68/fc4 zero size 2023-12-16T07:40:48.356 INFO:tasks.workunit.client.1.smithi133.stdout:9/699: creat d15/d18/d5b/dd6/fef x:0 0 0 2023-12-16T07:40:48.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/700: creat d15/d18/d2c/d3a/d8a/ff0 x:0 0 0 2023-12-16T07:40:48.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/701: truncate d15/f29 1874513 0 2023-12-16T07:40:48.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/702: stat d15/d18/d2c/d68/da3/dcb/cdd 0 2023-12-16T07:40:48.360 INFO:tasks.workunit.client.1.smithi133.stdout:9/703: unlink d15/c8c 0 2023-12-16T07:40:48.365 INFO:tasks.workunit.client.1.smithi133.stdout:9/704: dread d15/d18/d2c/f3e [0,4194304] 0 2023-12-16T07:40:48.368 INFO:tasks.workunit.client.1.smithi133.stdout:9/705: rename d15/d18/d4d/d7e/ce0 to d15/d18/d2c/d3a/cf1 0 2023-12-16T07:40:48.368 INFO:tasks.workunit.client.1.smithi133.stdout:9/706: fdatasync d15/d18/f24 0 2023-12-16T07:40:48.368 INFO:tasks.workunit.client.1.smithi133.stdout:9/707: fsync d15/d18/d2c/fdb 0 2023-12-16T07:40:48.368 INFO:tasks.workunit.client.1.smithi133.stdout:8/601: dwrite d9/d10/d39/d48/d44/f89 [0,4194304] 0 2023-12-16T07:40:48.370 INFO:tasks.workunit.client.1.smithi133.stdout:8/602: creat d9/dc/fc3 x:0 0 0 2023-12-16T07:40:48.370 INFO:tasks.workunit.client.1.smithi133.stdout:8/603: truncate d9/dc/de/fb3 415313 0 2023-12-16T07:40:48.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/604: mknod d9/d10/d39/cc4 0 2023-12-16T07:40:48.373 INFO:tasks.workunit.client.1.smithi133.stdout:8/605: rename d9/d85/fa2 to d9/d10/d39/d48/d44/d6e/d78/fc5 0 2023-12-16T07:40:48.375 INFO:tasks.workunit.client.1.smithi133.stdout:8/606: symlink d9/d10/d39/d48/lc6 0 2023-12-16T07:40:48.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/607: rename d9/d11/d33/d9c to d9/d10/dc7 0 2023-12-16T07:40:48.379 INFO:tasks.workunit.client.1.smithi133.stdout:8/608: unlink l5 0 2023-12-16T07:40:48.380 INFO:tasks.workunit.client.1.smithi133.stdout:8/609: rename d9/d10/d39/d48/d44/f6b to d9/d10/d39/d48/d44/d69/fc8 0 2023-12-16T07:40:48.382 INFO:tasks.workunit.client.1.smithi133.stdout:8/610: link d9/d2d/dc1/f66 d9/d2d/fc9 0 2023-12-16T07:40:48.385 INFO:tasks.workunit.client.1.smithi133.stdout:8/611: rename d9/d11/d52/l58 to d9/d11/lca 0 2023-12-16T07:40:48.385 INFO:tasks.workunit.client.1.smithi133.stdout:8/612: write d9/d11/d42/f7a [3882250,100821] 0 2023-12-16T07:40:48.386 INFO:tasks.workunit.client.1.smithi133.stdout:8/613: write d9/d10/f97 [1165524,99440] 0 2023-12-16T07:40:48.388 INFO:tasks.workunit.client.1.smithi133.stdout:8/614: creat d9/dc/d27/fcb x:0 0 0 2023-12-16T07:40:48.390 INFO:tasks.workunit.client.1.smithi133.stdout:8/615: rename d9/d2d/dc1/cac to d9/d10/d39/ccc 0 2023-12-16T07:40:48.435 INFO:tasks.workunit.client.1.smithi133.stdout:6/897: sync 2023-12-16T07:40:48.435 INFO:tasks.workunit.client.1.smithi133.stdout:5/553: sync 2023-12-16T07:40:48.435 INFO:tasks.workunit.client.1.smithi133.stdout:0/673: sync 2023-12-16T07:40:48.435 INFO:tasks.workunit.client.1.smithi133.stdout:3/537: sync 2023-12-16T07:40:48.435 INFO:tasks.workunit.client.1.smithi133.stdout:4/827: sync 2023-12-16T07:40:48.435 INFO:tasks.workunit.client.1.smithi133.stdout:5/554: chown d1/d1c/f99 98425 1 2023-12-16T07:40:48.436 INFO:tasks.workunit.client.1.smithi133.stdout:0/674: fsync d2/d17/d2b/d31/d4d/d54/fc7 0 2023-12-16T07:40:48.436 INFO:tasks.workunit.client.1.smithi133.stdout:4/828: write d3/d7/d38/d57/fc0 [88291,46110] 0 2023-12-16T07:40:48.436 INFO:tasks.workunit.client.1.smithi133.stdout:5/555: write d1/d4b/f4c [4213116,106034] 0 2023-12-16T07:40:48.437 INFO:tasks.workunit.client.1.smithi133.stdout:6/898: rename d0/d5e/d75/d81/d99/c112 to d0/d4/dee/c12d 0 2023-12-16T07:40:48.441 INFO:tasks.workunit.client.1.smithi133.stdout:3/538: mknod d7/d8/d72/ce7 0 2023-12-16T07:40:48.441 INFO:tasks.workunit.client.1.smithi133.stdout:0/675: creat d2/d9/dc5/fd3 x:0 0 0 2023-12-16T07:40:48.447 INFO:tasks.workunit.client.1.smithi133.stdout:0/676: mknod d2/d17/dc2/cd4 0 2023-12-16T07:40:48.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/677: symlink d2/d9/d12/d35/d4f/d93/ld5 0 2023-12-16T07:40:48.455 INFO:tasks.workunit.client.1.smithi133.stdout:0/678: creat d2/d9/d20/fd6 x:0 0 0 2023-12-16T07:40:48.463 INFO:tasks.workunit.client.1.smithi133.stdout:4/829: dwrite d3/d7/d1a/f24 [8388608,4194304] 0 2023-12-16T07:40:48.465 INFO:tasks.workunit.client.1.smithi133.stdout:3/539: dwrite d7/d8/d1c/d2b/d2d/fd7 [0,4194304] 0 2023-12-16T07:40:48.465 INFO:tasks.workunit.client.1.smithi133.stdout:3/540: chown d7/d8/d1d/d2a/c7d 3 1 2023-12-16T07:40:48.465 INFO:tasks.workunit.client.1.smithi133.stdout:4/830: mkdir d3/d7/d38/dd5/da7/daa/dc6/d113 0 2023-12-16T07:40:48.465 INFO:tasks.workunit.client.1.smithi133.stdout:4/831: read - d3/d7/d38/dd5/da7/dbb/fe0 zero size 2023-12-16T07:40:48.465 INFO:tasks.workunit.client.1.smithi133.stdout:6/899: dwrite d0/d4/d21/d35/d7e/fe3 [0,4194304] 0 2023-12-16T07:40:48.470 INFO:tasks.workunit.client.1.smithi133.stdout:3/541: unlink d7/d8/d1d/d2a/d5f/l6e 0 2023-12-16T07:40:48.472 INFO:tasks.workunit.client.1.smithi133.stdout:4/832: creat d3/d7/d38/d57/d75/de4/f114 x:0 0 0 2023-12-16T07:40:48.472 INFO:tasks.workunit.client.1.smithi133.stdout:4/833: write d3/d7/d38/dd5/da7/daa/dc6/fec [187236,70010] 0 2023-12-16T07:40:48.472 INFO:tasks.workunit.client.1.smithi133.stdout:4/834: write d3/d7/d1a/faf [1757019,128142] 0 2023-12-16T07:40:48.477 INFO:tasks.workunit.client.1.smithi133.stdout:6/900: link d0/d5e/d75/d81/f102 d0/d4/d21/d35/d4e/f12e 0 2023-12-16T07:40:48.479 INFO:tasks.workunit.client.1.smithi133.stdout:0/679: dwrite d2/fce [0,4194304] 0 2023-12-16T07:40:48.480 INFO:tasks.workunit.client.1.smithi133.stdout:4/835: symlink d3/d7/d38/d57/d75/de4/l115 0 2023-12-16T07:40:48.484 INFO:tasks.workunit.client.1.smithi133.stdout:6/901: rename d0/f4d to d0/d5e/d75/dcf/d128/f12f 0 2023-12-16T07:40:48.484 INFO:tasks.workunit.client.1.smithi133.stdout:6/902: read - d0/d5e/d75/dcf/d128/f12f zero size 2023-12-16T07:40:48.490 INFO:tasks.workunit.client.1.smithi133.stdout:4/836: mknod d3/d7/c116 0 2023-12-16T07:40:48.502 INFO:tasks.workunit.client.1.smithi133.stdout:0/680: dwrite d2/d17/d2b/d31/d4d/d54/fc7 [0,4194304] 0 2023-12-16T07:40:48.502 INFO:tasks.workunit.client.1.smithi133.stdout:3/542: dwrite d7/d8/d1c/faa [0,4194304] 0 2023-12-16T07:40:48.505 INFO:tasks.workunit.client.1.smithi133.stdout:0/681: symlink d2/d9/d8f/ld7 0 2023-12-16T07:40:48.507 INFO:tasks.workunit.client.1.smithi133.stdout:0/682: chown d2/d9/d12/d45/c6f 649 1 2023-12-16T07:40:48.507 INFO:tasks.workunit.client.1.smithi133.stdout:0/683: truncate d2/d9/d12/d35/fb3 614785 0 2023-12-16T07:40:48.507 INFO:tasks.workunit.client.1.smithi133.stdout:0/684: stat d2/d17/d2b/d31/d7f 0 2023-12-16T07:40:48.507 INFO:tasks.workunit.client.1.smithi133.stdout:0/685: fsync d2/d17/d2b/d67/fad 0 2023-12-16T07:40:48.508 INFO:tasks.workunit.client.1.smithi133.stdout:0/686: mkdir d2/d9/dc5/dd8 0 2023-12-16T07:40:48.508 INFO:tasks.workunit.client.1.smithi133.stdout:0/687: stat d2/d9/d12/d35/d4f/l8a 0 2023-12-16T07:40:48.508 INFO:tasks.workunit.client.1.smithi133.stdout:0/688: chown d2/d9/d12/d45/d9e/da0/fae 968854056 1 2023-12-16T07:40:48.511 INFO:tasks.workunit.client.1.smithi133.stdout:0/689: read d2/f6 [120187,127198] 0 2023-12-16T07:40:48.512 INFO:tasks.workunit.client.1.smithi133.stdout:0/690: symlink d2/d9/d20/d5e/d89/da2/ld9 0 2023-12-16T07:40:48.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/837: dwrite d3/d7/d38/d57/d75/f7e [0,4194304] 0 2023-12-16T07:40:48.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/838: stat d3/d7/d1c/db0/dc8/cd7 0 2023-12-16T07:40:48.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/839: readlink d3/d7/d38/d57/d75/de4/l115 0 2023-12-16T07:40:48.517 INFO:tasks.workunit.client.1.smithi133.stdout:4/840: rename d3/d7/d1c/d2a/d91/dbe/dfa/d89/fc5 to d3/d7/d1c/d2a/d91/f117 0 2023-12-16T07:40:48.519 INFO:tasks.workunit.client.1.smithi133.stdout:6/903: dwrite d0/d5e/d75/dad/fc1 [0,4194304] 0 2023-12-16T07:40:48.521 INFO:tasks.workunit.client.1.smithi133.stdout:6/904: symlink d0/d4/d21/d35/d7e/ded/l130 0 2023-12-16T07:40:48.522 INFO:tasks.workunit.client.1.smithi133.stdout:6/905: getdents d0/d4/d21/d35/d4e/d84/d69/dbd/dcb 0 2023-12-16T07:40:48.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/543: dwrite d7/d8/d1d/f90 [0,4194304] 0 2023-12-16T07:40:48.526 INFO:tasks.workunit.client.1.smithi133.stdout:0/691: dread d2/d17/d2b/f77 [0,4194304] 0 2023-12-16T07:40:48.526 INFO:tasks.workunit.client.1.smithi133.stdout:0/692: chown d2/d9/d12/c32 171364403 1 2023-12-16T07:40:48.529 INFO:tasks.workunit.client.1.smithi133.stdout:4/841: dread d3/d7/d38/f3d [4194304,4194304] 0 2023-12-16T07:40:48.529 INFO:tasks.workunit.client.1.smithi133.stdout:4/842: chown d3/d7/c4a 622 1 2023-12-16T07:40:48.531 INFO:tasks.workunit.client.1.smithi133.stdout:4/843: mkdir d3/d7/d1a/d111/d118 0 2023-12-16T07:40:48.536 INFO:tasks.workunit.client.1.smithi133.stdout:4/844: creat d3/d7/d38/dd5/dac/dcf/f119 x:0 0 0 2023-12-16T07:40:48.536 INFO:tasks.workunit.client.1.smithi133.stdout:4/845: symlink d3/d7/d1a/d111/l11a 0 2023-12-16T07:40:48.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/846: creat d3/d7/d1c/f11b x:0 0 0 2023-12-16T07:40:48.539 INFO:tasks.workunit.client.1.smithi133.stdout:4/847: rename d3/d7/d38/d57/d67/l7a to d3/d7/d38/dd5/da7/daa/dc6/d10b/l11c 0 2023-12-16T07:40:48.540 INFO:tasks.workunit.client.1.smithi133.stdout:4/848: creat d3/d7/d1c/db0/dc8/f11d x:0 0 0 2023-12-16T07:40:48.541 INFO:tasks.workunit.client.1.smithi133.stdout:4/849: readlink d3/d7/d38/d57/d67/ld3 0 2023-12-16T07:40:48.541 INFO:tasks.workunit.client.1.smithi133.stdout:4/850: truncate d3/d7/d38/dd5/dac/f10c 298453 0 2023-12-16T07:40:48.545 INFO:tasks.workunit.client.1.smithi133.stdout:3/544: dwrite d7/d8/fe [0,4194304] 0 2023-12-16T07:40:48.547 INFO:tasks.workunit.client.1.smithi133.stdout:3/545: dread d7/d8/d78/d43/d7f/fa9 [0,4194304] 0 2023-12-16T07:40:48.678 INFO:tasks.workunit.client.1.smithi133.stdout:2/647: sync 2023-12-16T07:40:48.678 INFO:tasks.workunit.client.1.smithi133.stdout:2/648: mkdir da/d1d/d60/d71/d3a/dca 0 2023-12-16T07:40:48.702 INFO:tasks.workunit.client.1.smithi133.stdout:2/649: dwrite da/d15/f8a [4194304,4194304] 0 2023-12-16T07:40:48.706 INFO:tasks.workunit.client.1.smithi133.stdout:2/650: mknod da/d15/d1b/ccb 0 2023-12-16T07:40:48.706 INFO:tasks.workunit.client.1.smithi133.stdout:2/651: chown da/d50/f82 2418 1 2023-12-16T07:40:48.709 INFO:tasks.workunit.client.1.smithi133.stdout:2/652: link da/d50/c5d da/dc2/ccc 0 2023-12-16T07:40:48.725 INFO:tasks.workunit.client.1.smithi133.stdout:2/653: dwrite f1 [0,4194304] 0 2023-12-16T07:40:48.734 INFO:tasks.workunit.client.1.smithi133.stdout:2/654: dread da/d15/d1b/f75 [0,4194304] 0 2023-12-16T07:40:48.750 INFO:tasks.workunit.client.1.smithi133.stdout:2/655: dwrite da/d1d/d60/d71/d3a/d61/f68 [0,4194304] 0 2023-12-16T07:40:48.751 INFO:tasks.workunit.client.1.smithi133.stdout:2/656: creat da/d15/d1b/d43/fcd x:0 0 0 2023-12-16T07:40:48.764 INFO:tasks.workunit.client.1.smithi133.stdout:2/657: dwrite da/f11 [4194304,4194304] 0 2023-12-16T07:40:48.767 INFO:tasks.workunit.client.1.smithi133.stdout:2/658: creat da/d50/d8e/fce x:0 0 0 2023-12-16T07:40:48.767 INFO:tasks.workunit.client.1.smithi133.stdout:2/659: write da/d1d/d60/d74/f95 [1722862,29643] 0 2023-12-16T07:40:48.769 INFO:tasks.workunit.client.1.smithi133.stdout:2/660: mknod da/d1d/d60/d74/ccf 0 2023-12-16T07:40:48.769 INFO:tasks.workunit.client.1.smithi133.stdout:2/661: fsync da/d15/f8a 0 2023-12-16T07:40:48.773 INFO:tasks.workunit.client.1.smithi133.stdout:2/662: creat da/dc2/fd0 x:0 0 0 2023-12-16T07:40:48.776 INFO:tasks.workunit.client.1.smithi133.stdout:2/663: mknod da/d15/d1b/d83/cd1 0 2023-12-16T07:40:48.778 INFO:tasks.workunit.client.1.smithi133.stdout:2/664: creat da/d15/fd2 x:0 0 0 2023-12-16T07:40:48.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/665: dread da/fd [0,4194304] 0 2023-12-16T07:40:48.783 INFO:tasks.workunit.client.1.smithi133.stdout:2/666: unlink da/d15/d1b/c81 0 2023-12-16T07:40:48.822 INFO:tasks.workunit.client.1.smithi133.stdout:2/667: truncate f1 117497 0 2023-12-16T07:40:48.833 INFO:tasks.workunit.client.1.smithi133.stdout:2/668: rename f1 to da/d1d/fd3 0 2023-12-16T07:40:48.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/669: mkdir da/d15/d1b/d83/da3/dd4 0 2023-12-16T07:40:48.839 INFO:tasks.workunit.client.1.smithi133.stdout:2/670: mknod da/d1d/d60/d71/d2e/d59/cd5 0 2023-12-16T07:40:48.842 INFO:tasks.workunit.client.1.smithi133.stdout:2/671: mknod da/dc2/cd6 0 2023-12-16T07:40:48.844 INFO:tasks.workunit.client.1.smithi133.stdout:2/672: symlink da/d1d/d60/d71/d3a/dca/ld7 0 2023-12-16T07:40:48.844 INFO:tasks.workunit.client.1.smithi133.stdout:2/673: write da/d50/d8e/fa4 [516604,14707] 0 2023-12-16T07:40:48.845 INFO:tasks.workunit.client.1.smithi133.stdout:2/674: write f4 [985671,92627] 0 2023-12-16T07:40:48.845 INFO:tasks.workunit.client.1.smithi133.stdout:2/675: readlink da/d1d/d60/d71/d3a/dca/ld7 0 2023-12-16T07:40:48.848 INFO:tasks.workunit.client.1.smithi133.stdout:2/676: unlink da/d15/d17/c4d 0 2023-12-16T07:40:48.862 INFO:tasks.workunit.client.1.smithi133.stdout:2/677: dwrite da/d15/d1b/f44 [0,4194304] 0 2023-12-16T07:40:48.862 INFO:tasks.workunit.client.1.smithi133.stdout:2/678: write da/f8f [1882528,72520] 0 2023-12-16T07:40:48.911 INFO:tasks.workunit.client.1.smithi133.stdout:7/965: sync 2023-12-16T07:40:48.911 INFO:tasks.workunit.client.1.smithi133.stdout:7/966: truncate db/fe 6365025 0 2023-12-16T07:40:48.911 INFO:tasks.workunit.client.1.smithi133.stdout:7/967: fdatasync db/d3e/d4a/d58/d86/da9/fca 0 2023-12-16T07:40:48.912 INFO:tasks.workunit.client.1.smithi133.stdout:7/968: creat db/d3e/d4a/d58/d86/d8b/d8d/f139 x:0 0 0 2023-12-16T07:40:48.913 INFO:tasks.workunit.client.1.smithi133.stdout:7/969: symlink db/d3e/d4a/d112/l13a 0 2023-12-16T07:40:48.915 INFO:tasks.workunit.client.1.smithi133.stdout:7/970: mkdir db/d53/d13b 0 2023-12-16T07:40:48.915 INFO:tasks.workunit.client.1.smithi133.stdout:7/971: read - db/d3e/d4a/d58/d86/f126 zero size 2023-12-16T07:40:48.929 INFO:tasks.workunit.client.1.smithi133.stdout:7/972: dwrite db/d21/d2c/d31/dd2/fee [0,4194304] 0 2023-12-16T07:40:48.929 INFO:tasks.workunit.client.1.smithi133.stdout:7/973: readlink db/d21/l65 0 2023-12-16T07:40:48.936 INFO:tasks.workunit.client.1.smithi133.stdout:7/974: dread db/d3e/d4a/d58/d86/fb3 [0,4194304] 0 2023-12-16T07:40:48.938 INFO:tasks.workunit.client.1.smithi133.stdout:7/975: mkdir db/d21/d2c/d31/d6e/d13c 0 2023-12-16T07:40:48.941 INFO:tasks.workunit.client.1.smithi133.stdout:7/976: symlink db/d21/d2c/d31/d6e/l13d 0 2023-12-16T07:40:48.942 INFO:tasks.workunit.client.1.smithi133.stdout:7/977: mknod db/d53/d13b/c13e 0 2023-12-16T07:40:48.943 INFO:tasks.workunit.client.1.smithi133.stdout:7/978: readlink db/d3e/d4a/d58/l61 0 2023-12-16T07:40:48.943 INFO:tasks.workunit.client.1.smithi133.stdout:7/979: write db/d3e/d4a/d58/d86/f126 [1015971,2131] 0 2023-12-16T07:40:48.944 INFO:tasks.workunit.client.1.smithi133.stdout:7/980: creat db/d21/d2c/d31/d59/de7/d119/d6c/dc8/dd9/f13f x:0 0 0 2023-12-16T07:40:48.944 INFO:tasks.workunit.client.1.smithi133.stdout:7/981: truncate db/ff 4943322 0 2023-12-16T07:40:48.945 INFO:tasks.workunit.client.1.smithi133.stdout:7/982: rename db/d21/d2c/d31/d59/de7/d119/l3d to db/d3e/d4a/d58/d86/db8/l140 0 2023-12-16T07:40:48.945 INFO:tasks.workunit.client.1.smithi133.stdout:7/983: chown db/f1c 893914002 1 2023-12-16T07:40:48.946 INFO:tasks.workunit.client.1.smithi133.stdout:7/984: mknod db/d21/d2c/d31/d6e/dad/c141 0 2023-12-16T07:40:48.947 INFO:tasks.workunit.client.1.smithi133.stdout:7/985: chown db/d3e/faa 6 1 2023-12-16T07:40:48.947 INFO:tasks.workunit.client.1.smithi133.stdout:7/986: write db/d21/d2c/f50 [523139,93873] 0 2023-12-16T07:40:48.947 INFO:tasks.workunit.client.1.smithi133.stdout:7/987: rename db/d3e/d4a/d58/d86/d8b/def/fff to db/d21/d2c/d31/d59/de7/d119/d6c/dc8/de8/f142 0 2023-12-16T07:40:48.949 INFO:tasks.workunit.client.1.smithi133.stdout:7/988: creat db/d21/d2c/d31/d59/de7/d119/df7/d10b/f143 x:0 0 0 2023-12-16T07:40:48.949 INFO:tasks.workunit.client.1.smithi133.stdout:7/989: truncate db/d21/d2c/d31/d59/de7/d119/d6c/dc8/dd9/f13f 395089 0 2023-12-16T07:40:48.950 INFO:tasks.workunit.client.1.smithi133.stdout:7/990: dread db/d21/d2c/d31/d59/de7/d119/d6c/dc8/dd9/f13f [0,4194304] 0 2023-12-16T07:40:48.952 INFO:tasks.workunit.client.1.smithi133.stdout:7/991: rename db/d3e/faa to db/d21/d2c/d31/d59/de7/d119/db5/df9/f144 0 2023-12-16T07:40:49.021 INFO:tasks.workunit.client.1.smithi133.stdout:7/992: getdents db/d21/d2c/d31/d59/de7/d119 0 2023-12-16T07:40:49.030 INFO:tasks.workunit.client.1.smithi133.stdout:7/993: dread db/ff [0,4194304] 0 2023-12-16T07:40:49.030 INFO:tasks.workunit.client.1.smithi133.stdout:7/994: stat db/d3e/d4a/f60 0 2023-12-16T07:40:49.032 INFO:tasks.workunit.client.1.smithi133.stdout:7/995: write db/d21/d2c/d31/f35 [1523056,96372] 0 2023-12-16T07:40:49.035 INFO:tasks.workunit.client.1.smithi133.stdout:7/996: rmdir db/d21/d2c/d31/d6e 39 2023-12-16T07:40:49.054 INFO:tasks.workunit.client.1.smithi133.stdout:7/997: dwrite db/d3e/d4a/d58/d86/da9/fca [0,4194304] 0 2023-12-16T07:40:49.060 INFO:tasks.workunit.client.1.smithi133.stdout:7/998: creat db/d21/d2c/dbc/f145 x:0 0 0 2023-12-16T07:40:49.061 INFO:tasks.workunit.client.1.smithi133.stdout:7/999: fdatasync db/d3e/d4a/d58/ff2 0 2023-12-16T07:40:49.067 INFO:tasks.workunit.client.1.smithi133.stdout:1/785: sync 2023-12-16T07:40:49.069 INFO:tasks.workunit.client.1.smithi133.stdout:1/786: symlink d0/d1c/d37/dcc/l10a 0 2023-12-16T07:40:49.070 INFO:tasks.workunit.client.1.smithi133.stdout:1/787: symlink d0/d12/dda/l10b 0 2023-12-16T07:40:49.072 INFO:tasks.workunit.client.1.smithi133.stdout:1/788: mkdir d0/dc4/d10c 0 2023-12-16T07:40:49.073 INFO:tasks.workunit.client.1.smithi133.stdout:1/789: link d0/l2 d0/d12/d51/dac/d24/d32/d56/d59/l10d 0 2023-12-16T07:40:49.074 INFO:tasks.workunit.client.1.smithi133.stdout:1/790: chown d0/d1c/d102/d70/d8f/cd8 13 1 2023-12-16T07:40:49.091 INFO:tasks.workunit.client.1.smithi133.stdout:1/791: dwrite d0/d12/d51/dac/d24/d32/d56/d59/d66/fcd [0,4194304] 0 2023-12-16T07:40:49.096 INFO:tasks.workunit.client.1.smithi133.stdout:1/792: mknod d0/dc4/c10e 0 2023-12-16T07:40:49.098 INFO:tasks.workunit.client.1.smithi133.stdout:1/793: symlink d0/d12/d51/dac/d24/d32/l10f 0 2023-12-16T07:40:49.102 INFO:tasks.workunit.client.1.smithi133.stdout:1/794: rename d0/d12/d51/dac/d24/d32/d56/d59/d66/la7 to d0/d1c/l110 0 2023-12-16T07:40:49.309 INFO:tasks.workunit.client.1.smithi133.stdout:0/693: sync 2023-12-16T07:40:49.309 INFO:tasks.workunit.client.1.smithi133.stdout:9/708: sync 2023-12-16T07:40:49.309 INFO:tasks.workunit.client.1.smithi133.stdout:8/616: sync 2023-12-16T07:40:49.309 INFO:tasks.workunit.client.1.smithi133.stdout:0/694: write d2/d9/d12/d35/d4f/d93/fbc [133184,23926] 0 2023-12-16T07:40:49.313 INFO:tasks.workunit.client.1.smithi133.stdout:8/617: symlink d9/d10/lcd 0 2023-12-16T07:40:49.313 INFO:tasks.workunit.client.1.smithi133.stdout:8/618: fdatasync d9/d10/d39/d48/d44/f46 0 2023-12-16T07:40:49.313 INFO:tasks.workunit.client.1.smithi133.stdout:8/619: write d9/d10/f37 [4799117,122424] 0 2023-12-16T07:40:49.313 INFO:tasks.workunit.client.1.smithi133.stdout:8/620: fsync d9/d10/d39/d48/d44/f53 0 2023-12-16T07:40:49.313 INFO:tasks.workunit.client.1.smithi133.stdout:8/621: chown d9/d2d/dc1/fb6 26739136 1 2023-12-16T07:40:49.313 INFO:tasks.workunit.client.1.smithi133.stdout:8/622: chown d9/ca 3917 1 2023-12-16T07:40:49.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/695: symlink d2/d9/d20/d5e/d89/da2/lda 0 2023-12-16T07:40:49.315 INFO:tasks.workunit.client.1.smithi133.stdout:8/623: creat d9/d10/d39/d48/d92/fce x:0 0 0 2023-12-16T07:40:49.316 INFO:tasks.workunit.client.1.smithi133.stdout:0/696: symlink d2/d17/d2b/d31/ldb 0 2023-12-16T07:40:49.318 INFO:tasks.workunit.client.1.smithi133.stdout:0/697: symlink d2/d9/d12/d35/ldc 0 2023-12-16T07:40:49.320 INFO:tasks.workunit.client.1.smithi133.stdout:0/698: mkdir d2/d9/d20/d5e/d92/ddd 0 2023-12-16T07:40:49.324 INFO:tasks.workunit.client.1.smithi133.stdout:0/699: creat d2/d17/d2b/d31/d4d/d54/fde x:0 0 0 2023-12-16T07:40:49.324 INFO:tasks.workunit.client.1.smithi133.stdout:8/624: write d9/dc/d27/f2b [3859006,128955] 0 2023-12-16T07:40:49.324 INFO:tasks.workunit.client.1.smithi133.stdout:9/709: dwrite d15/d18/d5b/dd6/fef [0,4194304] 0 2023-12-16T07:40:49.324 INFO:tasks.workunit.client.1.smithi133.stdout:9/710: getdents d15/d42/d8d/de7 0 2023-12-16T07:40:49.330 INFO:tasks.workunit.client.1.smithi133.stdout:9/711: creat d15/d18/d80/ff2 x:0 0 0 2023-12-16T07:40:49.330 INFO:tasks.workunit.client.1.smithi133.stdout:9/712: write fd [2063676,88590] 0 2023-12-16T07:40:49.330 INFO:tasks.workunit.client.1.smithi133.stdout:9/713: fdatasync d15/d18/d2c/d68/fc4 0 2023-12-16T07:40:49.331 INFO:tasks.workunit.client.1.smithi133.stdout:9/714: read d15/d18/d2c/d68/da3/fb5 [376429,60790] 0 2023-12-16T07:40:49.332 INFO:tasks.workunit.client.1.smithi133.stdout:9/715: mkdir d15/d18/d2c/d3a/da4/df3 0 2023-12-16T07:40:49.332 INFO:tasks.workunit.client.1.smithi133.stdout:0/700: dread d2/d17/d2b/f77 [0,4194304] 0 2023-12-16T07:40:49.334 INFO:tasks.workunit.client.1.smithi133.stdout:0/701: mkdir d2/d17/d40/ddf 0 2023-12-16T07:40:49.335 INFO:tasks.workunit.client.1.smithi133.stdout:9/716: dread d15/f29 [0,4194304] 0 2023-12-16T07:40:49.335 INFO:tasks.workunit.client.1.smithi133.stdout:9/717: chown d15/d18/d5b/c64 5 1 2023-12-16T07:40:49.336 INFO:tasks.workunit.client.1.smithi133.stdout:0/702: mkdir d2/d9/d20/d5e/d89/de0 0 2023-12-16T07:40:49.338 INFO:tasks.workunit.client.1.smithi133.stdout:9/718: creat d15/d18/d5b/d71/d78/d6e/d9b/ff4 x:0 0 0 2023-12-16T07:40:49.339 INFO:tasks.workunit.client.1.smithi133.stdout:9/719: dread d15/fac [0,4194304] 0 2023-12-16T07:40:49.340 INFO:tasks.workunit.client.1.smithi133.stdout:0/703: creat d2/d9/db/fe1 x:0 0 0 2023-12-16T07:40:49.342 INFO:tasks.workunit.client.1.smithi133.stdout:9/720: truncate d15/d18/d2c/f46 777883 0 2023-12-16T07:40:49.344 INFO:tasks.workunit.client.1.smithi133.stdout:8/625: dwrite d9/d2d/f8a [0,4194304] 0 2023-12-16T07:40:49.345 INFO:tasks.workunit.client.1.smithi133.stdout:9/721: link d15/d42/d8d/f9e d15/d42/d8d/da9/ff5 0 2023-12-16T07:40:49.346 INFO:tasks.workunit.client.1.smithi133.stdout:8/626: read d9/d10/f3a [3556196,119745] 0 2023-12-16T07:40:49.348 INFO:tasks.workunit.client.1.smithi133.stdout:9/722: unlink d15/d18/d4d/l6a 0 2023-12-16T07:40:49.349 INFO:tasks.workunit.client.1.smithi133.stdout:9/723: chown d15/d42/d8d/da9/fc3 2 1 2023-12-16T07:40:49.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/724: dread d15/d18/d2c/d68/f8e [0,4194304] 0 2023-12-16T07:40:49.359 INFO:tasks.workunit.client.1.smithi133.stdout:0/704: dwrite d2/d9/d20/f29 [0,4194304] 0 2023-12-16T07:40:49.359 INFO:tasks.workunit.client.1.smithi133.stdout:0/705: write d2/d17/d2b/d31/d63/fb7 [1030490,87343] 0 2023-12-16T07:40:49.365 INFO:tasks.workunit.client.1.smithi133.stdout:9/725: rename d15/d42/d8d/da9/fdc to d15/ff6 0 2023-12-16T07:40:49.365 INFO:tasks.workunit.client.1.smithi133.stdout:0/706: symlink d2/d9/d20/d5e/le2 0 2023-12-16T07:40:49.366 INFO:tasks.workunit.client.1.smithi133.stdout:9/726: dread d15/f29 [0,4194304] 0 2023-12-16T07:40:49.369 INFO:tasks.workunit.client.1.smithi133.stdout:0/707: mknod d2/d9/d8f/dcc/ce3 0 2023-12-16T07:40:49.370 INFO:tasks.workunit.client.1.smithi133.stdout:0/708: write d2/d17/d2b/fa5 [1197139,2562] 0 2023-12-16T07:40:49.370 INFO:tasks.workunit.client.1.smithi133.stdout:9/727: truncate f9 2983388 0 2023-12-16T07:40:49.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/728: write d15/d18/d2c/fe9 [767622,123450] 0 2023-12-16T07:40:49.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/729: fsync d15/d18/d2c/f4c 0 2023-12-16T07:40:49.371 INFO:tasks.workunit.client.1.smithi133.stdout:0/709: write d2/d17/d40/f49 [468085,111881] 0 2023-12-16T07:40:49.371 INFO:tasks.workunit.client.1.smithi133.stdout:0/710: write d2/d9/f47 [1020798,136] 0 2023-12-16T07:40:49.371 INFO:tasks.workunit.client.1.smithi133.stdout:0/711: chown d2/d9/d20/d5e/d89/da2/cb8 94 1 2023-12-16T07:40:49.376 INFO:tasks.workunit.client.1.smithi133.stdout:0/712: creat d2/d9/d12/d76/fe4 x:0 0 0 2023-12-16T07:40:49.379 INFO:tasks.workunit.client.1.smithi133.stdout:0/713: creat d2/d9/d20/d5e/d89/de0/fe5 x:0 0 0 2023-12-16T07:40:49.381 INFO:tasks.workunit.client.1.smithi133.stdout:0/714: mkdir d2/d9/d12/d45/d9e/de6 0 2023-12-16T07:40:49.381 INFO:tasks.workunit.client.1.smithi133.stdout:0/715: write d2/d9/d20/d5e/d89/fba [998021,74006] 0 2023-12-16T07:40:49.383 INFO:tasks.workunit.client.1.smithi133.stdout:0/716: write d2/d17/d2b/f77 [2521352,59448] 0 2023-12-16T07:40:49.383 INFO:tasks.workunit.client.1.smithi133.stdout:0/717: truncate d2/d17/fbf 357912 0 2023-12-16T07:40:49.383 INFO:tasks.workunit.client.1.smithi133.stdout:0/718: fsync d2/d17/fbf 0 2023-12-16T07:40:49.383 INFO:tasks.workunit.client.1.smithi133.stdout:0/719: dread - d2/d17/fc8 zero size 2023-12-16T07:40:49.388 INFO:tasks.workunit.client.1.smithi133.stdout:9/730: dwrite d15/d18/f24 [0,4194304] 0 2023-12-16T07:40:49.388 INFO:tasks.workunit.client.1.smithi133.stdout:9/731: fsync d15/d18/d2c/d3a/f74 0 2023-12-16T07:40:49.389 INFO:tasks.workunit.client.1.smithi133.stdout:9/732: unlink d15/d18/d5b/dd6/fef 0 2023-12-16T07:40:49.393 INFO:tasks.workunit.client.1.smithi133.stdout:9/733: creat d15/d18/d2c/d68/da3/dcb/ff7 x:0 0 0 2023-12-16T07:40:49.395 INFO:tasks.workunit.client.1.smithi133.stdout:9/734: rmdir d15/d18/d4d/d7e 39 2023-12-16T07:40:49.397 INFO:tasks.workunit.client.1.smithi133.stdout:0/720: dwrite d2/d9/d12/d35/d4f/d93/fbc [0,4194304] 0 2023-12-16T07:40:49.398 INFO:tasks.workunit.client.1.smithi133.stdout:9/735: rename d15/c19 to d15/d18/d2c/cf8 0 2023-12-16T07:40:49.403 INFO:tasks.workunit.client.1.smithi133.stdout:0/721: creat d2/d17/d2b/d67/fe7 x:0 0 0 2023-12-16T07:40:49.406 INFO:tasks.workunit.client.1.smithi133.stdout:0/722: symlink d2/d17/d40/le8 0 2023-12-16T07:40:49.407 INFO:tasks.workunit.client.1.smithi133.stdout:0/723: write d2/d17/fac [3491358,57563] 0 2023-12-16T07:40:49.407 INFO:tasks.workunit.client.1.smithi133.stdout:9/736: dread d15/d18/d5b/d71/d78/d6e/d9b/fbb [0,4194304] 0 2023-12-16T07:40:49.408 INFO:tasks.workunit.client.1.smithi133.stdout:9/737: read d15/d18/f2f [3935882,47581] 0 2023-12-16T07:40:49.410 INFO:tasks.workunit.client.1.smithi133.stdout:0/724: link d2/d9/d12/d76/l99 d2/d17/d2b/d31/le9 0 2023-12-16T07:40:49.413 INFO:tasks.workunit.client.1.smithi133.stdout:9/738: creat d15/d42/d8d/ff9 x:0 0 0 2023-12-16T07:40:49.415 INFO:tasks.workunit.client.1.smithi133.stdout:9/739: mkdir d15/d18/d5b/d71/d78/dfa 0 2023-12-16T07:40:49.415 INFO:tasks.workunit.client.1.smithi133.stdout:9/740: chown d15/d18/d2c/d3a 260290 1 2023-12-16T07:40:49.415 INFO:tasks.workunit.client.1.smithi133.stdout:9/741: truncate d15/fd2 5185311 0 2023-12-16T07:40:49.417 INFO:tasks.workunit.client.1.smithi133.stdout:9/742: getdents d15/d18/d4d 0 2023-12-16T07:40:49.418 INFO:tasks.workunit.client.1.smithi133.stdout:9/743: mkdir d15/d18/d5b/d71/d78/dfa/dfb 0 2023-12-16T07:40:49.420 INFO:tasks.workunit.client.1.smithi133.stdout:9/744: mkdir d15/d18/d80/dfc 0 2023-12-16T07:40:49.430 INFO:tasks.workunit.client.1.smithi133.stdout:0/725: dwrite d2/d17/d2b/d31/d4d/d54/fde [0,4194304] 0 2023-12-16T07:40:49.430 INFO:tasks.workunit.client.1.smithi133.stdout:0/726: stat d2/d9/d20/lbb 0 2023-12-16T07:40:49.432 INFO:tasks.workunit.client.1.smithi133.stdout:9/745: write d15/f39 [887960,114671] 0 2023-12-16T07:40:49.432 INFO:tasks.workunit.client.1.smithi133.stdout:9/746: stat d15/d18/d2c/d3a/d8a/ff0 0 2023-12-16T07:40:49.439 INFO:tasks.workunit.client.1.smithi133.stdout:0/727: read d2/d9/d12/d35/d4f/fbe [29382,748] 0 2023-12-16T07:40:49.447 INFO:tasks.workunit.client.1.smithi133.stdout:0/728: dread d2/d17/d40/f49 [0,4194304] 0 2023-12-16T07:40:49.448 INFO:tasks.workunit.client.1.smithi133.stdout:0/729: truncate d2/d17/fac 3651243 0 2023-12-16T07:40:49.449 INFO:tasks.workunit.client.1.smithi133.stdout:9/747: dwrite d15/d18/f21 [4194304,4194304] 0 2023-12-16T07:40:49.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/730: rmdir d2/d9/db 39 2023-12-16T07:40:49.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/731: dread - d2/d17/d2b/d67/fe7 zero size 2023-12-16T07:40:49.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/732: write d2/d17/d2b/d31/d4d/da7/fd2 [290740,2125] 0 2023-12-16T07:40:49.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/733: fsync d2/d9/d12/d35/f95 0 2023-12-16T07:40:49.453 INFO:tasks.workunit.client.1.smithi133.stdout:0/734: mkdir d2/d9/d12/d45/d9e/de6/dea 0 2023-12-16T07:40:49.456 INFO:tasks.workunit.client.1.smithi133.stdout:0/735: getdents d2/d9/dc5 0 2023-12-16T07:40:49.456 INFO:tasks.workunit.client.1.smithi133.stdout:0/736: chown d2/d17/fac 0 1 2023-12-16T07:40:49.457 INFO:tasks.workunit.client.1.smithi133.stdout:0/737: stat d2/d17/d2b/d31/d4d/lab 0 2023-12-16T07:40:49.459 INFO:tasks.workunit.client.1.smithi133.stdout:0/738: write d2/d9/d8f/dcc/fd1 [3313453,68686] 0 2023-12-16T07:40:49.462 INFO:tasks.workunit.client.1.smithi133.stdout:0/739: symlink d2/d9/d12/d35/d4f/leb 0 2023-12-16T07:40:49.466 INFO:tasks.workunit.client.1.smithi133.stdout:9/748: dwrite d15/d18/d5b/d71/d78/d6e/d9b/ff4 [0,4194304] 0 2023-12-16T07:40:49.469 INFO:tasks.workunit.client.1.smithi133.stdout:0/740: dread d2/d9/f47 [0,4194304] 0 2023-12-16T07:40:49.475 INFO:tasks.workunit.client.1.smithi133.stdout:9/749: rmdir d15/d18/d5b/d71/d78 39 2023-12-16T07:40:49.476 INFO:tasks.workunit.client.1.smithi133.stdout:0/741: creat d2/d9/dc5/dd8/fec x:0 0 0 2023-12-16T07:40:49.479 INFO:tasks.workunit.client.1.smithi133.stdout:9/750: mknod d15/d18/d4d/d94/dcc/cfd 0 2023-12-16T07:40:49.479 INFO:tasks.workunit.client.1.smithi133.stdout:9/751: readlink d15/d18/d2c/d68/lbc 0 2023-12-16T07:40:49.479 INFO:tasks.workunit.client.1.smithi133.stdout:9/752: fsync d15/d18/d2c/d3a/d8a/ff0 0 2023-12-16T07:40:49.482 INFO:tasks.workunit.client.1.smithi133.stdout:0/742: mkdir d2/d17/d2b/d31/d4d/da7/ded 0 2023-12-16T07:40:49.482 INFO:tasks.workunit.client.1.smithi133.stdout:0/743: chown d2/d9/d12/d35/lc6 4 1 2023-12-16T07:40:49.482 INFO:tasks.workunit.client.1.smithi133.stdout:0/744: readlink d2/d9/d20/d5e/d89/da2/la9 0 2023-12-16T07:40:49.483 INFO:tasks.workunit.client.1.smithi133.stdout:0/745: write d2/d9/d12/f6d [357759,115349] 0 2023-12-16T07:40:49.483 INFO:tasks.workunit.client.1.smithi133.stdout:0/746: dread - d2/d9/d20/d5e/d89/de0/fe5 zero size 2023-12-16T07:40:49.483 INFO:tasks.workunit.client.1.smithi133.stdout:0/747: chown d2/d17/d2b/d31/le9 1 1 2023-12-16T07:40:49.484 INFO:tasks.workunit.client.1.smithi133.stdout:5/556: sync 2023-12-16T07:40:49.484 INFO:tasks.workunit.client.1.smithi133.stdout:4/851: sync 2023-12-16T07:40:49.484 INFO:tasks.workunit.client.1.smithi133.stdout:6/906: sync 2023-12-16T07:40:49.484 INFO:tasks.workunit.client.1.smithi133.stdout:3/546: sync 2023-12-16T07:40:49.484 INFO:tasks.workunit.client.1.smithi133.stdout:3/547: write d7/d8/d1c/f48 [856989,52019] 0 2023-12-16T07:40:49.487 INFO:tasks.workunit.client.1.smithi133.stdout:0/748: rename d2/d9/d12/d35/d4f/d93/la6 to d2/d17/lee 0 2023-12-16T07:40:49.489 INFO:tasks.workunit.client.1.smithi133.stdout:6/907: truncate d0/d4/dee/f108 42418 0 2023-12-16T07:40:49.494 INFO:tasks.workunit.client.1.smithi133.stdout:4/852: dread d3/d7/f86 [0,4194304] 0 2023-12-16T07:40:49.494 INFO:tasks.workunit.client.1.smithi133.stdout:5/557: rename d1/d1c/d80/d64/f84 to d1/de/d52/d95/fcc 0 2023-12-16T07:40:49.494 INFO:tasks.workunit.client.1.smithi133.stdout:6/908: rename d0/d4/d21 to d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/d131 22 2023-12-16T07:40:49.494 INFO:tasks.workunit.client.1.smithi133.stdout:6/909: chown d0/d4/d21/d35/d4e/d84/d69/da1 5 1 2023-12-16T07:40:49.495 INFO:tasks.workunit.client.1.smithi133.stdout:6/910: write d0/d4/fa7 [652397,22447] 0 2023-12-16T07:40:49.496 INFO:tasks.workunit.client.1.smithi133.stdout:0/749: symlink d2/d17/d2b/d31/d63/lef 0 2023-12-16T07:40:49.499 INFO:tasks.workunit.client.1.smithi133.stdout:5/558: truncate d1/de/d35/dc6/fb2 1273737 0 2023-12-16T07:40:49.499 INFO:tasks.workunit.client.1.smithi133.stdout:5/559: write d1/de/d35/fbb [743187,39934] 0 2023-12-16T07:40:49.501 INFO:tasks.workunit.client.1.smithi133.stdout:6/911: getdents d0/d4/d21 0 2023-12-16T07:40:49.501 INFO:tasks.workunit.client.1.smithi133.stdout:6/912: truncate d0/d4/d21/d8a/da4/fb5 5053705 0 2023-12-16T07:40:49.503 INFO:tasks.workunit.client.1.smithi133.stdout:9/753: dwrite d15/d18/d80/d97/f9a [0,4194304] 0 2023-12-16T07:40:49.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/548: dwrite d7/d8/d1d/d2a/d5f/fb0 [0,4194304] 0 2023-12-16T07:40:49.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/549: write d7/d8/d1c/f48 [1030566,1653] 0 2023-12-16T07:40:49.504 INFO:tasks.workunit.client.1.smithi133.stdout:9/754: write d15/d18/d80/d97/f9a [147807,14621] 0 2023-12-16T07:40:49.504 INFO:tasks.workunit.client.1.smithi133.stdout:9/755: truncate d15/d18/d4d/d94/dab/fcd 45764 0 2023-12-16T07:40:49.505 INFO:tasks.workunit.client.1.smithi133.stdout:5/560: truncate d1/d18/f4e 7030533 0 2023-12-16T07:40:49.505 INFO:tasks.workunit.client.1.smithi133.stdout:4/853: dread d3/d7/d1c/d2a/f7f [0,4194304] 0 2023-12-16T07:40:49.506 INFO:tasks.workunit.client.1.smithi133.stdout:4/854: write d3/d7/d1c/d2a/f7f [2771938,1008] 0 2023-12-16T07:40:49.506 INFO:tasks.workunit.client.1.smithi133.stdout:6/913: symlink d0/d4/d21/d62/de7/l132 0 2023-12-16T07:40:49.507 INFO:tasks.workunit.client.1.smithi133.stdout:6/914: read d0/d4/d21/d8a/d93/fa5 [496053,128126] 0 2023-12-16T07:40:49.507 INFO:tasks.workunit.client.1.smithi133.stdout:6/915: fsync d0/d5e/d75/dcf/fe9 0 2023-12-16T07:40:49.507 INFO:tasks.workunit.client.1.smithi133.stdout:6/916: chown d0/d4/d21/d8a/d93/d8e/ld5 1 1 2023-12-16T07:40:49.507 INFO:tasks.workunit.client.1.smithi133.stdout:6/917: chown d0/d5e/d75/fd1 2 1 2023-12-16T07:40:49.509 INFO:tasks.workunit.client.1.smithi133.stdout:0/750: dread d2/d9/d12/d35/fb3 [0,4194304] 0 2023-12-16T07:40:49.509 INFO:tasks.workunit.client.1.smithi133.stdout:0/751: chown d2/d17/d2b/d31/d4d/d54/fc7 231419 1 2023-12-16T07:40:49.518 INFO:tasks.workunit.client.1.smithi133.stdout:0/752: dread d2/d9/d20/d5e/d92/fc0 [0,4194304] 0 2023-12-16T07:40:49.518 INFO:tasks.workunit.client.1.smithi133.stdout:3/550: symlink d7/d8/d1d/d2a/d62/de3/le8 0 2023-12-16T07:40:49.521 INFO:tasks.workunit.client.1.smithi133.stdout:9/756: unlink d15/d18/lbf 0 2023-12-16T07:40:49.523 INFO:tasks.workunit.client.1.smithi133.stdout:5/561: link d1/d18/l59 d1/d4b/da5/lcd 0 2023-12-16T07:40:49.523 INFO:tasks.workunit.client.1.smithi133.stdout:5/562: fdatasync d1/d18/f41 0 2023-12-16T07:40:49.523 INFO:tasks.workunit.client.1.smithi133.stdout:5/563: stat d1/d18/d26/c72 0 2023-12-16T07:40:49.528 INFO:tasks.workunit.client.1.smithi133.stdout:4/855: creat d3/d7/d1a/d111/f11e x:0 0 0 2023-12-16T07:40:49.530 INFO:tasks.workunit.client.1.smithi133.stdout:6/918: unlink d0/d4/d21/d60/c7a 0 2023-12-16T07:40:49.531 INFO:tasks.workunit.client.1.smithi133.stdout:4/856: dread d3/d7/d38/d57/d67/fb2 [0,4194304] 0 2023-12-16T07:40:49.531 INFO:tasks.workunit.client.1.smithi133.stdout:4/857: truncate d3/d7/d38/dd5/da7/f105 405613 0 2023-12-16T07:40:49.539 INFO:tasks.workunit.client.1.smithi133.stdout:3/551: rename d7/d8/d78/d43/d7f/l9b to d7/d8/d1c/ddb/d95/le9 0 2023-12-16T07:40:49.540 INFO:tasks.workunit.client.1.smithi133.stdout:9/757: getdents d15/d18/d80 0 2023-12-16T07:40:49.540 INFO:tasks.workunit.client.1.smithi133.stdout:9/758: chown d15/d18/cd3 8672297 1 2023-12-16T07:40:49.540 INFO:tasks.workunit.client.1.smithi133.stdout:9/759: truncate d15/d42/d8d/ff9 55926 0 2023-12-16T07:40:49.544 INFO:tasks.workunit.client.1.smithi133.stdout:6/919: dwrite d0/d4/d21/f4c [0,4194304] 0 2023-12-16T07:40:49.544 INFO:tasks.workunit.client.1.smithi133.stdout:6/920: fdatasync d0/d4/d21/d35/d7e/fe3 0 2023-12-16T07:40:49.544 INFO:tasks.workunit.client.1.smithi133.stdout:6/921: chown d0/d4/d21/d35/d4e/d84/d69/da1/f109 1 1 2023-12-16T07:40:49.544 INFO:tasks.workunit.client.1.smithi133.stdout:0/753: dread d2/d17/f1b [0,4194304] 0 2023-12-16T07:40:49.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/564: symlink d1/de/d52/d95/lce 0 2023-12-16T07:40:49.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/565: fdatasync d1/d18/f42 0 2023-12-16T07:40:49.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/566: chown d1/d18/f1b 0 1 2023-12-16T07:40:49.554 INFO:tasks.workunit.client.1.smithi133.stdout:3/552: symlink d7/d8/d78/d43/d7f/lea 0 2023-12-16T07:40:49.556 INFO:tasks.workunit.client.1.smithi133.stdout:9/760: rename d15/d18/d5b/d71/d78/d6e/d9b/ff4 to d15/d18/d4d/d7e/ffe 0 2023-12-16T07:40:49.562 INFO:tasks.workunit.client.1.smithi133.stdout:4/858: rmdir d3 39 2023-12-16T07:40:49.564 INFO:tasks.workunit.client.1.smithi133.stdout:4/859: read d3/d7/fb [2894280,83926] 0 2023-12-16T07:40:49.564 INFO:tasks.workunit.client.1.smithi133.stdout:6/922: dwrite d0/d4/dee/f10f [0,4194304] 0 2023-12-16T07:40:49.564 INFO:tasks.workunit.client.1.smithi133.stdout:5/567: creat d1/de/d57/d74/fcf x:0 0 0 2023-12-16T07:40:49.572 INFO:tasks.workunit.client.1.smithi133.stdout:3/553: rmdir d7/d8/d78/d43/d5b 39 2023-12-16T07:40:49.573 INFO:tasks.workunit.client.1.smithi133.stdout:3/554: chown d7/d8/d72/d86/dbf 1 1 2023-12-16T07:40:49.574 INFO:tasks.workunit.client.1.smithi133.stdout:3/555: write d7/d8/d1d/f40 [6320389,43683] 0 2023-12-16T07:40:49.575 INFO:tasks.workunit.client.1.smithi133.stdout:0/754: rename d2/d17/d2b/fc1 to d2/d9/d20/d5e/ff0 0 2023-12-16T07:40:49.576 INFO:tasks.workunit.client.1.smithi133.stdout:9/761: chown d15/d18/d2c/d3a/l6c 0 1 2023-12-16T07:40:49.589 INFO:tasks.workunit.client.1.smithi133.stdout:6/923: unlink d0/d4/d21/d60/f66 0 2023-12-16T07:40:49.592 INFO:tasks.workunit.client.1.smithi133.stdout:5/568: mknod d1/de/d52/da3/cd0 0 2023-12-16T07:40:49.592 INFO:tasks.workunit.client.1.smithi133.stdout:5/569: dread - d1/de/d57/d74/fcf zero size 2023-12-16T07:40:49.592 INFO:tasks.workunit.client.1.smithi133.stdout:5/570: dread - d1/de/d35/dc6/db4/d71/f93 zero size 2023-12-16T07:40:49.596 INFO:tasks.workunit.client.1.smithi133.stdout:3/556: creat d7/d8/d1c/d87/dad/feb x:0 0 0 2023-12-16T07:40:49.597 INFO:tasks.workunit.client.1.smithi133.stdout:4/860: rename d3/d7/d1a/f26 to d3/d7/d1c/d2a/d91/dbe/dd0/f11f 0 2023-12-16T07:40:49.597 INFO:tasks.workunit.client.1.smithi133.stdout:4/861: write d3/d7/d38/d57/d75/de4/f114 [104260,9840] 0 2023-12-16T07:40:49.600 INFO:tasks.workunit.client.1.smithi133.stdout:0/755: link d2/d9/d20/d5e/d92/l7a d2/d9/d12/d76/lf1 0 2023-12-16T07:40:49.600 INFO:tasks.workunit.client.1.smithi133.stdout:0/756: truncate d2/d9/d20/d5e/d92/f81 4738768 0 2023-12-16T07:40:49.600 INFO:tasks.workunit.client.1.smithi133.stdout:0/757: fdatasync d2/d9/d20/d5e/d92/fc0 0 2023-12-16T07:40:49.603 INFO:tasks.workunit.client.1.smithi133.stdout:9/762: symlink d15/d18/d4d/d94/dcc/lff 0 2023-12-16T07:40:49.608 INFO:tasks.workunit.client.1.smithi133.stdout:5/571: rmdir d1/d1c/d80/da7/dac 0 2023-12-16T07:40:49.610 INFO:tasks.workunit.client.1.smithi133.stdout:0/758: mknod d2/d17/d2b/d31/cf2 0 2023-12-16T07:40:49.612 INFO:tasks.workunit.client.1.smithi133.stdout:9/763: rename d15/d18/l40 to d15/d18/d5b/d71/d78/d6e/d9b/l100 0 2023-12-16T07:40:49.613 INFO:tasks.workunit.client.1.smithi133.stdout:5/572: symlink d1/de/d57/dc5/ld1 0 2023-12-16T07:40:49.613 INFO:tasks.workunit.client.1.smithi133.stdout:5/573: write d1/de/d57/fc9 [435471,52420] 0 2023-12-16T07:40:49.614 INFO:tasks.workunit.client.1.smithi133.stdout:5/574: write d1/de/d35/dc6/f8f [2464598,77021] 0 2023-12-16T07:40:49.614 INFO:tasks.workunit.client.1.smithi133.stdout:5/575: fsync d1/de/fa2 0 2023-12-16T07:40:49.615 INFO:tasks.workunit.client.1.smithi133.stdout:3/557: dread d7/d8/d1c/fa0 [0,4194304] 0 2023-12-16T07:40:49.615 INFO:tasks.workunit.client.1.smithi133.stdout:3/558: readlink d7/d8/d1d/la8 0 2023-12-16T07:40:49.615 INFO:tasks.workunit.client.1.smithi133.stdout:3/559: read - d7/d8/d1c/ddb/fde zero size 2023-12-16T07:40:49.615 INFO:tasks.workunit.client.1.smithi133.stdout:0/759: creat d2/d9/d20/ff3 x:0 0 0 2023-12-16T07:40:49.617 INFO:tasks.workunit.client.1.smithi133.stdout:9/764: mkdir d15/d18/d5b/d71/d78/dfa/d101 0 2023-12-16T07:40:49.617 INFO:tasks.workunit.client.1.smithi133.stdout:9/765: readlink l7 0 2023-12-16T07:40:49.618 INFO:tasks.workunit.client.1.smithi133.stdout:5/576: getdents d1/d4b/da5 0 2023-12-16T07:40:49.618 INFO:tasks.workunit.client.1.smithi133.stdout:5/577: fsync d1/d18/d26/fad 0 2023-12-16T07:40:49.618 INFO:tasks.workunit.client.1.smithi133.stdout:5/578: stat d1/d1c/f99 0 2023-12-16T07:40:49.619 INFO:tasks.workunit.client.1.smithi133.stdout:0/760: creat d2/d17/d40/ddf/ff4 x:0 0 0 2023-12-16T07:40:49.619 INFO:tasks.workunit.client.1.smithi133.stdout:0/761: chown d2/d17/d2b/d31/l62 7 1 2023-12-16T07:40:49.621 INFO:tasks.workunit.client.1.smithi133.stdout:9/766: truncate d15/d18/f21 5514113 0 2023-12-16T07:40:49.622 INFO:tasks.workunit.client.1.smithi133.stdout:3/560: dread d7/d8/d1d/d2a/f3c [0,4194304] 0 2023-12-16T07:40:49.622 INFO:tasks.workunit.client.1.smithi133.stdout:9/767: write d15/d18/d2c/d68/da3/dcb/ff7 [641539,51129] 0 2023-12-16T07:40:49.622 INFO:tasks.workunit.client.1.smithi133.stdout:5/579: link d1/d18/f41 d1/d18/d26/fd2 0 2023-12-16T07:40:49.622 INFO:tasks.workunit.client.1.smithi133.stdout:5/580: stat d1/d4b/da5/f8b 0 2023-12-16T07:40:49.624 INFO:tasks.workunit.client.1.smithi133.stdout:3/561: mknod d7/d8/d78/d43/d7f/d85/cec 0 2023-12-16T07:40:49.628 INFO:tasks.workunit.client.1.smithi133.stdout:5/581: creat d1/de/d35/fd3 x:0 0 0 2023-12-16T07:40:49.632 INFO:tasks.workunit.client.1.smithi133.stdout:0/762: dread d2/d17/d2b/fa5 [0,4194304] 0 2023-12-16T07:40:49.635 INFO:tasks.workunit.client.1.smithi133.stdout:5/582: dread d1/d4b/da5/f8b [0,4194304] 0 2023-12-16T07:40:49.635 INFO:tasks.workunit.client.1.smithi133.stdout:6/924: dwrite d0/d4/d21/d35/d4e/d84/f58 [0,4194304] 0 2023-12-16T07:40:49.635 INFO:tasks.workunit.client.1.smithi133.stdout:0/763: mknod d2/db2/cf5 0 2023-12-16T07:40:49.635 INFO:tasks.workunit.client.1.smithi133.stdout:0/764: dread - d2/d9/d12/d76/fe4 zero size 2023-12-16T07:40:49.635 INFO:tasks.workunit.client.1.smithi133.stdout:0/765: fdatasync d2/d9/d8f/fca 0 2023-12-16T07:40:49.636 INFO:tasks.workunit.client.1.smithi133.stdout:4/862: dwrite d3/d7/d1a/d111/f11e [0,4194304] 0 2023-12-16T07:40:49.636 INFO:tasks.workunit.client.1.smithi133.stdout:3/562: dread d7/d8/f10 [0,4194304] 0 2023-12-16T07:40:49.638 INFO:tasks.workunit.client.1.smithi133.stdout:1/795: sync 2023-12-16T07:40:49.639 INFO:tasks.workunit.client.1.smithi133.stdout:2/679: sync 2023-12-16T07:40:49.642 INFO:tasks.workunit.client.1.smithi133.stdout:9/768: dwrite d15/d18/d4d/d7e/fc5 [0,4194304] 0 2023-12-16T07:40:49.642 INFO:tasks.workunit.client.1.smithi133.stdout:9/769: stat d15/d18/d5b/ca1 0 2023-12-16T07:40:49.642 INFO:tasks.workunit.client.1.smithi133.stdout:1/796: write d0/d1c/d37/f55 [10794246,105618] 0 2023-12-16T07:40:49.646 INFO:tasks.workunit.client.1.smithi133.stdout:6/925: symlink d0/d4/d21/d35/d4e/d84/d69/da1/l133 0 2023-12-16T07:40:49.648 INFO:tasks.workunit.client.1.smithi133.stdout:5/583: creat d1/d1c/d80/fd4 x:0 0 0 2023-12-16T07:40:49.648 INFO:tasks.workunit.client.1.smithi133.stdout:5/584: fsync d1/de/d52/d95/f96 0 2023-12-16T07:40:49.651 INFO:tasks.workunit.client.1.smithi133.stdout:0/766: creat d2/d9/d20/d5e/d92/ff6 x:0 0 0 2023-12-16T07:40:49.652 INFO:tasks.workunit.client.1.smithi133.stdout:3/563: dwrite d7/d8/d72/d86/fa7 [0,4194304] 0 2023-12-16T07:40:49.657 INFO:tasks.workunit.client.1.smithi133.stdout:5/585: dread d1/f1f [0,4194304] 0 2023-12-16T07:40:49.660 INFO:tasks.workunit.client.1.smithi133.stdout:6/926: dwrite d0/d5e/d75/f80 [0,4194304] 0 2023-12-16T07:40:49.660 INFO:tasks.workunit.client.1.smithi133.stdout:6/927: stat d0/d4/d21/d60/f9d 0 2023-12-16T07:40:49.665 INFO:tasks.workunit.client.1.smithi133.stdout:4/863: truncate d3/d7/d1c/db0/dc8/f68 1172710 0 2023-12-16T07:40:49.665 INFO:tasks.workunit.client.1.smithi133.stdout:4/864: fdatasync d3/d7/d38/d57/d75/f9d 0 2023-12-16T07:40:49.665 INFO:tasks.workunit.client.1.smithi133.stdout:4/865: write d3/fa [2797428,3869] 0 2023-12-16T07:40:49.666 INFO:tasks.workunit.client.1.smithi133.stdout:2/680: creat da/d1d/d60/d71/d2e/d59/fd8 x:0 0 0 2023-12-16T07:40:49.666 INFO:tasks.workunit.client.1.smithi133.stdout:2/681: fdatasync da/d15/d17/d40/f7c 0 2023-12-16T07:40:49.667 INFO:tasks.workunit.client.1.smithi133.stdout:2/682: write da/d1d/d60/d71/d3a/d5a/f5f [1643463,42858] 0 2023-12-16T07:40:49.667 INFO:tasks.workunit.client.1.smithi133.stdout:2/683: dread - da/d15/d1b/d43/fcd zero size 2023-12-16T07:40:49.669 INFO:tasks.workunit.client.1.smithi133.stdout:9/770: mknod d15/d18/d2c/d3a/d8a/c102 0 2023-12-16T07:40:49.672 INFO:tasks.workunit.client.1.smithi133.stdout:0/767: mknod d2/d17/d40/cf7 0 2023-12-16T07:40:49.672 INFO:tasks.workunit.client.1.smithi133.stdout:0/768: fsync d2/d17/d2b/d67/f73 0 2023-12-16T07:40:49.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/564: symlink d7/d8/d1c/led 0 2023-12-16T07:40:49.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/565: truncate d7/d8/d78/d43/d5b/fd2 243107 0 2023-12-16T07:40:49.678 INFO:tasks.workunit.client.1.smithi133.stdout:5/586: unlink d1/d18/l59 0 2023-12-16T07:40:49.680 INFO:tasks.workunit.client.1.smithi133.stdout:6/928: truncate d0/d4/d21/d35/d4e/d84/d69/fca 678200 0 2023-12-16T07:40:49.681 INFO:tasks.workunit.client.1.smithi133.stdout:4/866: truncate d3/d7/d38/dd5/da7/f105 120993 0 2023-12-16T07:40:49.683 INFO:tasks.workunit.client.1.smithi133.stdout:2/684: creat da/d15/d17/d40/d98/fd9 x:0 0 0 2023-12-16T07:40:49.684 INFO:tasks.workunit.client.1.smithi133.stdout:9/771: unlink d15/d18/d2c/d68/da3/dcb/ff7 0 2023-12-16T07:40:49.686 INFO:tasks.workunit.client.1.smithi133.stdout:1/797: dread d0/da/d3d/d41/fa4 [0,4194304] 0 2023-12-16T07:40:49.686 INFO:tasks.workunit.client.1.smithi133.stdout:1/798: chown d0/da/d3d/d41/f79 7 1 2023-12-16T07:40:49.687 INFO:tasks.workunit.client.1.smithi133.stdout:0/769: creat d2/d9/d20/d5e/ff8 x:0 0 0 2023-12-16T07:40:49.688 INFO:tasks.workunit.client.1.smithi133.stdout:3/566: symlink d7/d8/d1d/d2a/d62/lee 0 2023-12-16T07:40:49.688 INFO:tasks.workunit.client.1.smithi133.stdout:1/799: write d0/da/f3a [3213163,9314] 0 2023-12-16T07:40:49.689 INFO:tasks.workunit.client.1.smithi133.stdout:5/587: mkdir d1/de/d52/d95/dd5 0 2023-12-16T07:40:49.692 INFO:tasks.workunit.client.1.smithi133.stdout:4/867: mknod d3/d7/d38/dd5/dac/dbc/c120 0 2023-12-16T07:40:49.692 INFO:tasks.workunit.client.1.smithi133.stdout:5/588: write d1/d18/d2c/f39 [2173561,104346] 0 2023-12-16T07:40:49.694 INFO:tasks.workunit.client.1.smithi133.stdout:2/685: rename da/d1d/d60/d71/d3a/dca to da/d15/d1b/d83/da3/dd4/dda 0 2023-12-16T07:40:49.695 INFO:tasks.workunit.client.1.smithi133.stdout:9/772: mkdir d15/d18/d5b/d71/d78/dfa/dfb/d103 0 2023-12-16T07:40:49.696 INFO:tasks.workunit.client.1.smithi133.stdout:9/773: write d15/d18/d5b/d71/d78/d6e/f72 [2061698,130905] 0 2023-12-16T07:40:49.697 INFO:tasks.workunit.client.1.smithi133.stdout:3/567: creat d7/d8/d1d/fef x:0 0 0 2023-12-16T07:40:49.701 INFO:tasks.workunit.client.1.smithi133.stdout:9/774: dread d15/d18/d2c/d68/f8e [0,4194304] 0 2023-12-16T07:40:49.701 INFO:tasks.workunit.client.1.smithi133.stdout:6/929: dwrite d0/d5e/d8c/f97 [0,4194304] 0 2023-12-16T07:40:49.701 INFO:tasks.workunit.client.1.smithi133.stdout:6/930: readlink d0/d4/d21/d60/lfa 0 2023-12-16T07:40:49.701 INFO:tasks.workunit.client.1.smithi133.stdout:5/589: dread d1/d4b/f4c [0,4194304] 0 2023-12-16T07:40:49.701 INFO:tasks.workunit.client.1.smithi133.stdout:1/800: unlink d0/da/ff2 0 2023-12-16T07:40:49.702 INFO:tasks.workunit.client.1.smithi133.stdout:1/801: fsync d0/d12/d51/dac/f38 0 2023-12-16T07:40:49.704 INFO:tasks.workunit.client.1.smithi133.stdout:2/686: getdents da/d15/d1b/d43 0 2023-12-16T07:40:49.705 INFO:tasks.workunit.client.1.smithi133.stdout:2/687: write da/d1d/f96 [393877,10245] 0 2023-12-16T07:40:49.706 INFO:tasks.workunit.client.1.smithi133.stdout:4/868: dread d3/d7/d38/dd5/f78 [0,4194304] 0 2023-12-16T07:40:49.711 INFO:tasks.workunit.client.1.smithi133.stdout:8/627: sync 2023-12-16T07:40:49.714 INFO:tasks.workunit.client.1.smithi133.stdout:3/568: creat d7/d8/d1d/dc9/ff0 x:0 0 0 2023-12-16T07:40:49.715 INFO:tasks.workunit.client.1.smithi133.stdout:3/569: chown d7/d8/d1c/d2b/f9c 28 1 2023-12-16T07:40:49.718 INFO:tasks.workunit.client.1.smithi133.stdout:3/570: dread d7/d8/d78/f8b [0,4194304] 0 2023-12-16T07:40:49.722 INFO:tasks.workunit.client.1.smithi133.stdout:6/931: link d0/d4/d21/d8a/d93/fa9 d0/d5e/d8c/f134 0 2023-12-16T07:40:49.722 INFO:tasks.workunit.client.1.smithi133.stdout:6/932: chown d0/d4/d21/d35/d4e/d84/d69/da1/c122 11743 1 2023-12-16T07:40:49.724 INFO:tasks.workunit.client.1.smithi133.stdout:9/775: dwrite d15/d18/f21 [0,4194304] 0 2023-12-16T07:40:49.725 INFO:tasks.workunit.client.1.smithi133.stdout:1/802: mknod d0/da/d3d/dce/df5/c111 0 2023-12-16T07:40:49.727 INFO:tasks.workunit.client.1.smithi133.stdout:2/688: mkdir da/d1d/d60/d74/ddb 0 2023-12-16T07:40:49.727 INFO:tasks.workunit.client.1.smithi133.stdout:2/689: chown da/d1d/d60/l65 103348650 1 2023-12-16T07:40:49.729 INFO:tasks.workunit.client.1.smithi133.stdout:4/869: rename d3/d7/d1c/db0 to d3/d7/d1c/d2a/d91/dbe/d121 0 2023-12-16T07:40:49.730 INFO:tasks.workunit.client.1.smithi133.stdout:5/590: dwrite d1/d1c/f38 [0,4194304] 0 2023-12-16T07:40:49.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/591: write d1/f10 [5212139,81681] 0 2023-12-16T07:40:49.738 INFO:tasks.workunit.client.1.smithi133.stdout:3/571: creat d7/d8/d78/d43/d5b/ff1 x:0 0 0 2023-12-16T07:40:49.738 INFO:tasks.workunit.client.1.smithi133.stdout:3/572: fdatasync d7/d8/d1c/f41 0 2023-12-16T07:40:49.738 INFO:tasks.workunit.client.1.smithi133.stdout:3/573: write f6 [760871,16322] 0 2023-12-16T07:40:49.739 INFO:tasks.workunit.client.1.smithi133.stdout:9/776: creat d15/d18/d2c/d3a/da4/df3/f104 x:0 0 0 2023-12-16T07:40:49.741 INFO:tasks.workunit.client.1.smithi133.stdout:4/870: dread d3/f59 [0,4194304] 0 2023-12-16T07:40:49.742 INFO:tasks.workunit.client.1.smithi133.stdout:1/803: creat d0/d1c/d102/d70/f112 x:0 0 0 2023-12-16T07:40:49.744 INFO:tasks.workunit.client.1.smithi133.stdout:6/933: dwrite d0/d4/f47 [0,4194304] 0 2023-12-16T07:40:49.746 INFO:tasks.workunit.client.1.smithi133.stdout:2/690: truncate da/d1d/d60/d71/d3a/fa1 2104171 0 2023-12-16T07:40:49.747 INFO:tasks.workunit.client.1.smithi133.stdout:2/691: fdatasync da/d1d/f96 0 2023-12-16T07:40:49.755 INFO:tasks.workunit.client.1.smithi133.stdout:9/777: rmdir d15/d42/d8d/db7/dd4 39 2023-12-16T07:40:49.756 INFO:tasks.workunit.client.1.smithi133.stdout:9/778: write d15/d42/d8d/da9/fc3 [3420967,56615] 0 2023-12-16T07:40:49.756 INFO:tasks.workunit.client.1.smithi133.stdout:3/574: dwrite d7/d8/d1c/ddb/fde [0,4194304] 0 2023-12-16T07:40:49.757 INFO:tasks.workunit.client.1.smithi133.stdout:4/871: creat d3/d7/d38/dd5/da7/daa/dc6/d113/f122 x:0 0 0 2023-12-16T07:40:49.758 INFO:tasks.workunit.client.1.smithi133.stdout:4/872: readlink d3/d7/d1c/d2a/d91/dbe/l108 0 2023-12-16T07:40:49.759 INFO:tasks.workunit.client.1.smithi133.stdout:1/804: rename d0/d12/d51/dac/d24/c27 to d0/d60/c113 0 2023-12-16T07:40:49.759 INFO:tasks.workunit.client.1.smithi133.stdout:1/805: chown d0/d1c/d102/d70/f7c 10518325 1 2023-12-16T07:40:49.760 INFO:tasks.workunit.client.1.smithi133.stdout:6/934: creat d0/d4/d21/d60/f135 x:0 0 0 2023-12-16T07:40:49.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/692: creat da/d1d/d60/d71/d2e/d59/fdc x:0 0 0 2023-12-16T07:40:49.761 INFO:tasks.workunit.client.1.smithi133.stdout:8/628: dread d9/dc/de/fb3 [0,4194304] 0 2023-12-16T07:40:49.762 INFO:tasks.workunit.client.1.smithi133.stdout:8/629: read d9/f1c [1523926,39873] 0 2023-12-16T07:40:49.763 INFO:tasks.workunit.client.1.smithi133.stdout:9/779: symlink d15/d18/d5b/d71/d78/d6e/d9b/l105 0 2023-12-16T07:40:49.771 INFO:tasks.workunit.client.1.smithi133.stdout:3/575: mkdir d7/d8/d1d/d2a/df2 0 2023-12-16T07:40:49.772 INFO:tasks.workunit.client.1.smithi133.stdout:4/873: mknod d3/d7/d1c/c123 0 2023-12-16T07:40:49.772 INFO:tasks.workunit.client.1.smithi133.stdout:4/874: write d3/d7/d1c/d2a/d91/dbe/ff4 [31658,16252] 0 2023-12-16T07:40:49.774 INFO:tasks.workunit.client.1.smithi133.stdout:1/806: symlink d0/d1c/d37/da6/l114 0 2023-12-16T07:40:49.774 INFO:tasks.workunit.client.1.smithi133.stdout:1/807: read - d0/d12/d51/dac/d24/d32/d56/d59/d66/fe1 zero size 2023-12-16T07:40:49.776 INFO:tasks.workunit.client.1.smithi133.stdout:6/935: creat d0/d4/f136 x:0 0 0 2023-12-16T07:40:49.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/693: unlink da/d15/d17/l39 0 2023-12-16T07:40:49.785 INFO:tasks.workunit.client.1.smithi133.stdout:3/576: getdents d7/d8/d1d 0 2023-12-16T07:40:49.786 INFO:tasks.workunit.client.1.smithi133.stdout:1/808: dread d0/d12/d51/dac/f23 [0,4194304] 0 2023-12-16T07:40:49.786 INFO:tasks.workunit.client.1.smithi133.stdout:4/875: rmdir d3/d7/d38/dd5 39 2023-12-16T07:40:49.787 INFO:tasks.workunit.client.1.smithi133.stdout:2/694: truncate da/fd 1017140 0 2023-12-16T07:40:49.788 INFO:tasks.workunit.client.1.smithi133.stdout:2/695: readlink da/d1d/d60/d71/l2a 0 2023-12-16T07:40:49.789 INFO:tasks.workunit.client.1.smithi133.stdout:3/577: creat d7/d8/d72/ff3 x:0 0 0 2023-12-16T07:40:49.790 INFO:tasks.workunit.client.1.smithi133.stdout:2/696: write da/d1d/f25 [3680753,76167] 0 2023-12-16T07:40:49.790 INFO:tasks.workunit.client.1.smithi133.stdout:2/697: chown da/d1d/d60/d71/f37 3 1 2023-12-16T07:40:49.792 INFO:tasks.workunit.client.1.smithi133.stdout:1/809: creat d0/dd4/f115 x:0 0 0 2023-12-16T07:40:49.794 INFO:tasks.workunit.client.1.smithi133.stdout:3/578: unlink d7/d8/f10 0 2023-12-16T07:40:49.794 INFO:tasks.workunit.client.1.smithi133.stdout:8/630: dwrite d9/f3e [0,4194304] 0 2023-12-16T07:40:49.795 INFO:tasks.workunit.client.1.smithi133.stdout:9/780: dwrite d15/d42/d8d/f9e [0,4194304] 0 2023-12-16T07:40:49.796 INFO:tasks.workunit.client.1.smithi133.stdout:2/698: unlink da/d1d/d60/d71/d3a/d61/f77 0 2023-12-16T07:40:49.797 INFO:tasks.workunit.client.1.smithi133.stdout:1/810: mknod d0/da/d3d/dce/df5/c116 0 2023-12-16T07:40:49.798 INFO:tasks.workunit.client.1.smithi133.stdout:3/579: creat d7/ff4 x:0 0 0 2023-12-16T07:40:49.798 INFO:tasks.workunit.client.1.smithi133.stdout:3/580: chown d7/d8/d1c/d2b/d2d/fd7 568 1 2023-12-16T07:40:49.798 INFO:tasks.workunit.client.1.smithi133.stdout:9/781: read d15/d18/d2c/d68/fc1 [917090,107255] 0 2023-12-16T07:40:49.799 INFO:tasks.workunit.client.1.smithi133.stdout:6/936: dwrite d0/d5e/d8c/d107/d11f/f124 [0,4194304] 0 2023-12-16T07:40:49.800 INFO:tasks.workunit.client.1.smithi133.stdout:8/631: getdents d9/d10/d39/d48 0 2023-12-16T07:40:49.805 INFO:tasks.workunit.client.1.smithi133.stdout:4/876: dwrite d3/d7/d1c/d2a/d91/dbe/d121/dc8/f65 [0,4194304] 0 2023-12-16T07:40:49.805 INFO:tasks.workunit.client.1.smithi133.stdout:4/877: write d3/d7/d38/dd5/d63/fe2 [739256,113757] 0 2023-12-16T07:40:49.806 INFO:tasks.workunit.client.1.smithi133.stdout:2/699: rename da/d1d/d60/d74/f95 to da/d1d/d60/d71/d2e/d47/fdd 0 2023-12-16T07:40:49.810 INFO:tasks.workunit.client.1.smithi133.stdout:1/811: link d0/d12/lfa d0/da/d3d/d41/df0/l117 0 2023-12-16T07:40:49.810 INFO:tasks.workunit.client.1.smithi133.stdout:1/812: chown d0/d12/d51/dac/d24/d32/d56/d59 7 1 2023-12-16T07:40:49.811 INFO:tasks.workunit.client.1.smithi133.stdout:9/782: dread d15/d18/d2c/f4c [0,4194304] 0 2023-12-16T07:40:49.811 INFO:tasks.workunit.client.1.smithi133.stdout:9/783: fsync d15/d18/d2c/d68/da3/faf 0 2023-12-16T07:40:49.811 INFO:tasks.workunit.client.1.smithi133.stdout:9/784: stat d15/d18/d4d/f84 0 2023-12-16T07:40:49.811 INFO:tasks.workunit.client.1.smithi133.stdout:9/785: chown d15/d18/d80/d97/dba 33606359 1 2023-12-16T07:40:49.812 INFO:tasks.workunit.client.1.smithi133.stdout:2/700: dread da/d15/d17/f36 [4194304,4194304] 0 2023-12-16T07:40:49.812 INFO:tasks.workunit.client.1.smithi133.stdout:3/581: unlink d7/d8/d1d/d2a/fd6 0 2023-12-16T07:40:49.818 INFO:tasks.workunit.client.1.smithi133.stdout:4/878: dread d3/d7/d38/d57/d75/f7e [0,4194304] 0 2023-12-16T07:40:49.821 INFO:tasks.workunit.client.1.smithi133.stdout:6/937: dwrite d0/d4/d21/d35/f6c [0,4194304] 0 2023-12-16T07:40:49.821 INFO:tasks.workunit.client.1.smithi133.stdout:6/938: chown d0/d4/d21/d35/f6c 1633440 1 2023-12-16T07:40:49.824 INFO:tasks.workunit.client.1.smithi133.stdout:1/813: rmdir d0/d12/d51/dac/d24/d32/d56/d59 39 2023-12-16T07:40:49.824 INFO:tasks.workunit.client.1.smithi133.stdout:9/786: dread fc [0,4194304] 0 2023-12-16T07:40:49.824 INFO:tasks.workunit.client.1.smithi133.stdout:9/787: fsync d15/d18/d5b/d71/d78/d6e/d9b/fbb 0 2023-12-16T07:40:49.825 INFO:tasks.workunit.client.1.smithi133.stdout:2/701: rmdir da/d50 39 2023-12-16T07:40:49.831 INFO:tasks.workunit.client.1.smithi133.stdout:4/879: unlink d3/d7/d38/d57/d67/c10d 0 2023-12-16T07:40:49.834 INFO:tasks.workunit.client.1.smithi133.stdout:4/880: write d3/d7/f2e [1053147,76166] 0 2023-12-16T07:40:49.834 INFO:tasks.workunit.client.1.smithi133.stdout:8/632: dwrite d9/d85/fae [4194304,4194304] 0 2023-12-16T07:40:49.835 INFO:tasks.workunit.client.1.smithi133.stdout:1/814: dread d0/faf [0,4194304] 0 2023-12-16T07:40:49.835 INFO:tasks.workunit.client.1.smithi133.stdout:8/633: fdatasync d9/dc/de/fa4 0 2023-12-16T07:40:49.835 INFO:tasks.workunit.client.1.smithi133.stdout:1/815: readlink d0/dc4/ldb 0 2023-12-16T07:40:49.835 INFO:tasks.workunit.client.1.smithi133.stdout:8/634: write d9/d10/d39/d48/d92/fce [390132,114831] 0 2023-12-16T07:40:49.835 INFO:tasks.workunit.client.1.smithi133.stdout:8/635: truncate d9/d11/d52/f9b 232977 0 2023-12-16T07:40:49.836 INFO:tasks.workunit.client.1.smithi133.stdout:9/788: rmdir d15/d18/d2c/d68/da3/dcb 39 2023-12-16T07:40:49.836 INFO:tasks.workunit.client.1.smithi133.stdout:9/789: chown d15/d18/d4d/d94/dab/cda 3294666 1 2023-12-16T07:40:49.837 INFO:tasks.workunit.client.1.smithi133.stdout:9/790: write d15/d18/d2c/fe9 [610030,89181] 0 2023-12-16T07:40:49.838 INFO:tasks.workunit.client.1.smithi133.stdout:2/702: stat da/d50/c5d 0 2023-12-16T07:40:49.842 INFO:tasks.workunit.client.1.smithi133.stdout:1/816: rename d0/d1c/d102/d70/d8f/ldd to d0/d1c/d102/d70/l118 0 2023-12-16T07:40:49.842 INFO:tasks.workunit.client.1.smithi133.stdout:1/817: chown d0/d1c/d71/c90 2860928 1 2023-12-16T07:40:49.842 INFO:tasks.workunit.client.1.smithi133.stdout:1/818: chown d0/d1c/d71 282901 1 2023-12-16T07:40:49.842 INFO:tasks.workunit.client.1.smithi133.stdout:1/819: fdatasync d0/da/d3d/d41/f83 0 2023-12-16T07:40:49.842 INFO:tasks.workunit.client.1.smithi133.stdout:1/820: chown d0/da/d3d/d41 31 1 2023-12-16T07:40:49.843 INFO:tasks.workunit.client.1.smithi133.stdout:1/821: write d0/d1c/d102/d70/f7c [575169,1571] 0 2023-12-16T07:40:49.843 INFO:tasks.workunit.client.1.smithi133.stdout:1/822: dread - d0/d12/d51/db6/fd9 zero size 2023-12-16T07:40:49.844 INFO:tasks.workunit.client.1.smithi133.stdout:8/636: link d9/d10/d39/d48/d92/fbb d9/d2d/fcf 0 2023-12-16T07:40:49.847 INFO:tasks.workunit.client.1.smithi133.stdout:9/791: unlink d15/d18/d2c/d3a/l69 0 2023-12-16T07:40:49.849 INFO:tasks.workunit.client.1.smithi133.stdout:2/703: rmdir da/d50/db6 39 2023-12-16T07:40:49.849 INFO:tasks.workunit.client.1.smithi133.stdout:2/704: readlink da/d15/d17/l92 0 2023-12-16T07:40:49.853 INFO:tasks.workunit.client.1.smithi133.stdout:3/582: dwrite d7/d8/d1c/fa5 [0,4194304] 0 2023-12-16T07:40:49.853 INFO:tasks.workunit.client.1.smithi133.stdout:3/583: chown d7/d8/d1c/ddb/d95/f9f 445486 1 2023-12-16T07:40:49.857 INFO:tasks.workunit.client.1.smithi133.stdout:2/705: write da/d1d/d60/d71/d3a/d5a/f5f [819313,35494] 0 2023-12-16T07:40:49.857 INFO:tasks.workunit.client.1.smithi133.stdout:1/823: dread d0/d12/d51/dac/d24/f6b [0,4194304] 0 2023-12-16T07:40:49.858 INFO:tasks.workunit.client.1.smithi133.stdout:6/939: dwrite d0/d4/d21/d8a/d93/d8e/ff3 [0,4194304] 0 2023-12-16T07:40:49.861 INFO:tasks.workunit.client.1.smithi133.stdout:6/940: dread d0/d5e/f78 [0,4194304] 0 2023-12-16T07:40:49.861 INFO:tasks.workunit.client.1.smithi133.stdout:6/941: chown d0/d5e/d75/d81/c113 145623790 1 2023-12-16T07:40:49.862 INFO:tasks.workunit.client.1.smithi133.stdout:3/584: creat d7/d8/d72/d86/ff5 x:0 0 0 2023-12-16T07:40:49.863 INFO:tasks.workunit.client.1.smithi133.stdout:9/792: dwrite d15/d18/d5b/d71/d78/d6e/f75 [0,4194304] 0 2023-12-16T07:40:49.863 INFO:tasks.workunit.client.1.smithi133.stdout:9/793: truncate d15/d18/d2c/d68/da3/fde 982790 0 2023-12-16T07:40:49.866 INFO:tasks.workunit.client.1.smithi133.stdout:2/706: rename da/d15/d1b/d83/cd1 to da/d1d/d60/d71/d3a/d61/cde 0 2023-12-16T07:40:49.867 INFO:tasks.workunit.client.1.smithi133.stdout:6/942: mkdir d0/d4/d21/d35/d4e/d84/d69/d137 0 2023-12-16T07:40:49.871 INFO:tasks.workunit.client.1.smithi133.stdout:3/585: dread d7/f23 [0,4194304] 0 2023-12-16T07:40:49.876 INFO:tasks.workunit.client.1.smithi133.stdout:9/794: mknod d15/d18/d2c/d68/db2/c106 0 2023-12-16T07:40:49.879 INFO:tasks.workunit.client.1.smithi133.stdout:1/824: rename d0/d1c/d37/da6/l114 to d0/da/d3d/dc2/l119 0 2023-12-16T07:40:49.880 INFO:tasks.workunit.client.1.smithi133.stdout:2/707: creat da/d15/d17/fdf x:0 0 0 2023-12-16T07:40:49.883 INFO:tasks.workunit.client.1.smithi133.stdout:1/825: symlink d0/d1c/d71/dcf/l11a 0 2023-12-16T07:40:49.886 INFO:tasks.workunit.client.1.smithi133.stdout:2/708: getdents da/d1d/d60/d71/d3a 0 2023-12-16T07:40:49.886 INFO:tasks.workunit.client.1.smithi133.stdout:2/709: fdatasync da/d15/d1b/f75 0 2023-12-16T07:40:49.889 INFO:tasks.workunit.client.1.smithi133.stdout:1/826: creat d0/d12/dda/f11b x:0 0 0 2023-12-16T07:40:49.889 INFO:tasks.workunit.client.1.smithi133.stdout:1/827: write d0/d12/d51/dac/f21 [1355222,95901] 0 2023-12-16T07:40:49.890 INFO:tasks.workunit.client.1.smithi133.stdout:2/710: getdents da/d15/d1b 0 2023-12-16T07:40:49.893 INFO:tasks.workunit.client.1.smithi133.stdout:1/828: mknod d0/d1c/d102/d70/d8f/c11c 0 2023-12-16T07:40:49.895 INFO:tasks.workunit.client.1.smithi133.stdout:2/711: rename da/d1d/d60/d71/d2e/d59/l7f to da/d15/d17/le0 0 2023-12-16T07:40:49.897 INFO:tasks.workunit.client.1.smithi133.stdout:6/943: dwrite d0/d5e/d75/fd1 [0,4194304] 0 2023-12-16T07:40:49.897 INFO:tasks.workunit.client.1.smithi133.stdout:6/944: chown d0/d4/d21/d62 201182 1 2023-12-16T07:40:49.897 INFO:tasks.workunit.client.1.smithi133.stdout:9/795: dwrite d15/d18/d2c/d3a/d8a/ff0 [0,4194304] 0 2023-12-16T07:40:49.897 INFO:tasks.workunit.client.1.smithi133.stdout:6/945: write d0/d4/d21/d35/d36/f9f [968739,103571] 0 2023-12-16T07:40:49.897 INFO:tasks.workunit.client.1.smithi133.stdout:3/586: truncate d7/d8/d78/d43/d5b/fd2 141063 0 2023-12-16T07:40:49.897 INFO:tasks.workunit.client.1.smithi133.stdout:3/587: getdents d7/d8/d72/d86/dbf 0 2023-12-16T07:40:49.898 INFO:tasks.workunit.client.1.smithi133.stdout:1/829: mkdir d0/d12/d11d 0 2023-12-16T07:40:49.898 INFO:tasks.workunit.client.1.smithi133.stdout:1/830: chown d0/f2a 7 1 2023-12-16T07:40:49.899 INFO:tasks.workunit.client.1.smithi133.stdout:2/712: truncate da/d1d/f2f 2392482 0 2023-12-16T07:40:49.900 INFO:tasks.workunit.client.1.smithi133.stdout:2/713: dread - da/d50/fb1 zero size 2023-12-16T07:40:49.903 INFO:tasks.workunit.client.1.smithi133.stdout:9/796: getdents d15/d18/d5b/d71/d78/dfa/dfb 0 2023-12-16T07:40:49.903 INFO:tasks.workunit.client.1.smithi133.stdout:9/797: fsync d15/f26 0 2023-12-16T07:40:49.905 INFO:tasks.workunit.client.1.smithi133.stdout:6/946: truncate d0/d4/d21/d35/d4e/d84/d69/da1/f10c 343460 0 2023-12-16T07:40:49.905 INFO:tasks.workunit.client.1.smithi133.stdout:6/947: dread - d0/d4/d21/d35/d4e/d84/d69/da1/f121 zero size 2023-12-16T07:40:49.906 INFO:tasks.workunit.client.1.smithi133.stdout:1/831: mkdir d0/da/d3d/d41/d11e 0 2023-12-16T07:40:49.907 INFO:tasks.workunit.client.1.smithi133.stdout:2/714: unlink da/d50/fb1 0 2023-12-16T07:40:49.909 INFO:tasks.workunit.client.1.smithi133.stdout:9/798: mkdir d15/d18/d2c/d68/d107 0 2023-12-16T07:40:49.909 INFO:tasks.workunit.client.1.smithi133.stdout:6/948: rmdir d0/d5e/d8c/d107/d11f 39 2023-12-16T07:40:49.911 INFO:tasks.workunit.client.1.smithi133.stdout:6/949: write d0/d4/d21/d8a/da4/ff7 [1672715,119874] 0 2023-12-16T07:40:49.911 INFO:tasks.workunit.client.1.smithi133.stdout:1/832: rename d0/d12/d51/dac/d24/d32/d56/d59/d66/fa2 to d0/da/d3d/dce/df5/f11f 0 2023-12-16T07:40:49.911 INFO:tasks.workunit.client.1.smithi133.stdout:6/950: read d0/d5e/d75/dad/f106 [1888497,88393] 0 2023-12-16T07:40:49.912 INFO:tasks.workunit.client.1.smithi133.stdout:1/833: write d0/f2a [5450273,43769] 0 2023-12-16T07:40:49.913 INFO:tasks.workunit.client.1.smithi133.stdout:2/715: creat da/d15/dbe/db2/fe1 x:0 0 0 2023-12-16T07:40:49.914 INFO:tasks.workunit.client.1.smithi133.stdout:2/716: readlink da/l1c 0 2023-12-16T07:40:49.914 INFO:tasks.workunit.client.1.smithi133.stdout:2/717: write da/d1d/f72 [1100282,67012] 0 2023-12-16T07:40:49.914 INFO:tasks.workunit.client.1.smithi133.stdout:9/799: mkdir d15/d42/d8d/de7/d108 0 2023-12-16T07:40:49.916 INFO:tasks.workunit.client.1.smithi133.stdout:1/834: creat d0/d12/f120 x:0 0 0 2023-12-16T07:40:49.916 INFO:tasks.workunit.client.1.smithi133.stdout:2/718: mknod da/d1d/d60/d71/d2e/d47/d52/ce2 0 2023-12-16T07:40:49.918 INFO:tasks.workunit.client.1.smithi133.stdout:9/800: symlink d15/d18/de8/l109 0 2023-12-16T07:40:49.919 INFO:tasks.workunit.client.1.smithi133.stdout:1/835: symlink d0/da/d3d/d41/df0/l121 0 2023-12-16T07:40:49.920 INFO:tasks.workunit.client.1.smithi133.stdout:9/801: link d15/d18/d2c/l67 d15/d18/d4d/d94/dcc/l10a 0 2023-12-16T07:40:49.923 INFO:tasks.workunit.client.1.smithi133.stdout:9/802: unlink d15/d18/d2c/l52 0 2023-12-16T07:40:49.924 INFO:tasks.workunit.client.1.smithi133.stdout:9/803: creat d15/d18/d2c/d3a/f10b x:0 0 0 2023-12-16T07:40:49.925 INFO:tasks.workunit.client.1.smithi133.stdout:2/719: dread da/d15/d1b/d43/f45 [0,4194304] 0 2023-12-16T07:40:49.925 INFO:tasks.workunit.client.1.smithi133.stdout:2/720: write da/dc2/fd0 [109068,116480] 0 2023-12-16T07:40:49.926 INFO:tasks.workunit.client.1.smithi133.stdout:9/804: mknod d15/d42/d8d/de7/d108/c10c 0 2023-12-16T07:40:49.927 INFO:tasks.workunit.client.1.smithi133.stdout:2/721: creat da/d1d/d60/d74/fe3 x:0 0 0 2023-12-16T07:40:49.927 INFO:tasks.workunit.client.1.smithi133.stdout:2/722: write da/f5c [9408200,34012] 0 2023-12-16T07:40:49.932 INFO:tasks.workunit.client.1.smithi133.stdout:9/805: unlink d15/d18/d2c/d3a/c86 0 2023-12-16T07:40:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:1/836: dwrite d0/da/d3d/d41/d9f/f108 [0,4194304] 0 2023-12-16T07:40:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:1/837: read - d0/d1c/d9b/fb8 zero size 2023-12-16T07:40:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:1/838: fdatasync d0/d12/d51/dac/d24/d32/d56/d59/d66/fd6 0 2023-12-16T07:40:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:1/839: truncate d0/dc4/fee 921767 0 2023-12-16T07:40:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:1/840: chown d0/d12/f40 705451 1 2023-12-16T07:40:49.940 INFO:tasks.workunit.client.1.smithi133.stdout:9/806: dread d15/f35 [0,4194304] 0 2023-12-16T07:40:49.940 INFO:tasks.workunit.client.1.smithi133.stdout:9/807: fdatasync d15/d18/f5e 0 2023-12-16T07:40:49.942 INFO:tasks.workunit.client.1.smithi133.stdout:2/723: dwrite da/d15/d17/d40/d98/fc6 [0,4194304] 0 2023-12-16T07:40:49.950 INFO:tasks.workunit.client.1.smithi133.stdout:1/841: dread d0/d12/d51/dac/d24/d5a/d68/f88 [0,4194304] 0 2023-12-16T07:40:49.952 INFO:tasks.workunit.client.1.smithi133.stdout:2/724: unlink da/d15/d17/l92 0 2023-12-16T07:40:49.954 INFO:tasks.workunit.client.1.smithi133.stdout:9/808: dwrite d15/d18/d2c/d68/da3/faf [0,4194304] 0 2023-12-16T07:40:49.955 INFO:tasks.workunit.client.1.smithi133.stdout:1/842: mkdir d0/d1c/d102/d70/d8f/d122 0 2023-12-16T07:40:49.956 INFO:tasks.workunit.client.1.smithi133.stdout:1/843: dread - d0/d12/d51/dac/d24/d5a/d68/ff7 zero size 2023-12-16T07:40:49.956 INFO:tasks.workunit.client.1.smithi133.stdout:1/844: write d0/d1c/d37/ffd [879493,34335] 0 2023-12-16T07:40:49.956 INFO:tasks.workunit.client.1.smithi133.stdout:1/845: chown d0/l2 143 1 2023-12-16T07:40:49.962 INFO:tasks.workunit.client.1.smithi133.stdout:9/809: unlink l11 0 2023-12-16T07:40:49.965 INFO:tasks.workunit.client.1.smithi133.stdout:1/846: unlink d0/d1c/d71/dcf/le2 0 2023-12-16T07:40:49.968 INFO:tasks.workunit.client.1.smithi133.stdout:1/847: mkdir d0/da/d3d/dce/df5/d123 0 2023-12-16T07:40:49.970 INFO:tasks.workunit.client.1.smithi133.stdout:2/725: dwrite da/d1d/d60/d71/d3a/d61/f79 [0,4194304] 0 2023-12-16T07:40:49.970 INFO:tasks.workunit.client.1.smithi133.stdout:2/726: write da/d1d/f21 [4805591,11748] 0 2023-12-16T07:40:49.971 INFO:tasks.workunit.client.1.smithi133.stdout:2/727: write da/d15/f8a [898433,56328] 0 2023-12-16T07:40:49.972 INFO:tasks.workunit.client.1.smithi133.stdout:1/848: truncate d0/d1c/f5c 931346 0 2023-12-16T07:40:49.974 INFO:tasks.workunit.client.1.smithi133.stdout:1/849: read d0/d1c/d102/d70/d8f/f96 [2376311,4089] 0 2023-12-16T07:40:49.974 INFO:tasks.workunit.client.1.smithi133.stdout:1/850: readlink d0/d1c/d102/d70/l118 0 2023-12-16T07:40:49.974 INFO:tasks.workunit.client.1.smithi133.stdout:2/728: write da/d1d/d60/d71/d2e/d59/f9b [942043,35239] 0 2023-12-16T07:40:49.979 INFO:tasks.workunit.client.1.smithi133.stdout:9/810: dwrite d15/d18/d2c/fad [0,4194304] 0 2023-12-16T07:40:49.982 INFO:tasks.workunit.client.1.smithi133.stdout:9/811: unlink d15/d18/d2c/d68/c82 0 2023-12-16T07:40:49.992 INFO:tasks.workunit.client.1.smithi133.stdout:2/729: dread da/d1d/d60/d71/d2e/d47/fb9 [0,4194304] 0 2023-12-16T07:40:49.993 INFO:tasks.workunit.client.1.smithi133.stdout:1/851: dwrite d0/dd4/f115 [0,4194304] 0 2023-12-16T07:40:49.993 INFO:tasks.workunit.client.1.smithi133.stdout:2/730: fsync da/fd 0 2023-12-16T07:40:49.993 INFO:tasks.workunit.client.1.smithi133.stdout:2/731: readlink da/d1d/d60/l65 0 2023-12-16T07:40:49.993 INFO:tasks.workunit.client.1.smithi133.stdout:2/732: write da/d15/d1b/f70 [6484971,57343] 0 2023-12-16T07:40:49.995 INFO:tasks.workunit.client.1.smithi133.stdout:1/852: write d0/da/d3d/d41/f79 [475328,79740] 0 2023-12-16T07:40:49.995 INFO:tasks.workunit.client.1.smithi133.stdout:1/853: chown d0/d12/d51/dac/d24/d32/fb2 14 1 2023-12-16T07:40:49.999 INFO:tasks.workunit.client.1.smithi133.stdout:1/854: dread d0/d1c/d9b/fbd [0,4194304] 0 2023-12-16T07:40:49.999 INFO:tasks.workunit.client.1.smithi133.stdout:1/855: chown d0/da/f2e 305 1 2023-12-16T07:40:50.001 INFO:tasks.workunit.client.1.smithi133.stdout:1/856: rename d0/d1c/d37/c44 to d0/d12/dda/c124 0 2023-12-16T07:40:50.003 INFO:tasks.workunit.client.1.smithi133.stdout:9/812: dwrite d15/d18/d80/d97/f9a [4194304,4194304] 0 2023-12-16T07:40:50.003 INFO:tasks.workunit.client.1.smithi133.stdout:1/857: symlink d0/d1c/d102/d70/d105/l125 0 2023-12-16T07:40:50.005 INFO:tasks.workunit.client.1.smithi133.stdout:1/858: creat d0/d12/d11d/f126 x:0 0 0 2023-12-16T07:40:50.005 INFO:tasks.workunit.client.1.smithi133.stdout:1/859: read d0/d12/d51/dac/f23 [1129195,17] 0 2023-12-16T07:40:50.007 INFO:tasks.workunit.client.1.smithi133.stdout:1/860: creat d0/d12/d51/dac/d24/d5a/d68/dd5/f127 x:0 0 0 2023-12-16T07:40:50.009 INFO:tasks.workunit.client.1.smithi133.stdout:9/813: dread d15/d18/d80/fd0 [0,4194304] 0 2023-12-16T07:40:50.011 INFO:tasks.workunit.client.1.smithi133.stdout:9/814: mknod d15/d18/d2c/d3a/da4/c10d 0 2023-12-16T07:40:50.011 INFO:tasks.workunit.client.1.smithi133.stdout:1/861: dread d0/d12/d51/db6/dde/fdf [0,4194304] 0 2023-12-16T07:40:50.011 INFO:tasks.workunit.client.1.smithi133.stdout:2/733: dwrite f4 [0,4194304] 0 2023-12-16T07:40:50.012 INFO:tasks.workunit.client.1.smithi133.stdout:9/815: mknod d15/d18/d5b/d71/d78/dfa/c10e 0 2023-12-16T07:40:50.028 INFO:tasks.workunit.client.1.smithi133.stdout:1/862: dwrite d0/d1c/d102/d70/d8f/fab [0,4194304] 0 2023-12-16T07:40:50.028 INFO:tasks.workunit.client.1.smithi133.stdout:1/863: dread - d0/da/d3d/dc2/f109 zero size 2023-12-16T07:40:50.028 INFO:tasks.workunit.client.1.smithi133.stdout:1/864: write d0/d1c/d102/d70/d8f/f96 [2397611,97388] 0 2023-12-16T07:40:50.029 INFO:tasks.workunit.client.1.smithi133.stdout:1/865: read - d0/d1c/d102/d70/f112 zero size 2023-12-16T07:40:50.029 INFO:tasks.workunit.client.1.smithi133.stdout:1/866: chown d0/d1c/d102/d70/l118 258 1 2023-12-16T07:40:50.052 INFO:tasks.workunit.client.1.smithi133.stdout:2/734: symlink da/d1d/d60/d71/d2e/d47/le4 0 2023-12-16T07:40:50.053 INFO:tasks.workunit.client.1.smithi133.stdout:9/816: mknod d15/d18/d5b/d71/d78/dfa/dfb/d103/c10f 0 2023-12-16T07:40:50.054 INFO:tasks.workunit.client.1.smithi133.stdout:9/817: write d15/d18/d4d/d7e/fc5 [2203096,105497] 0 2023-12-16T07:40:50.057 INFO:tasks.workunit.client.1.smithi133.stdout:1/867: creat d0/d1c/d37/da6/f128 x:0 0 0 2023-12-16T07:40:50.057 INFO:tasks.workunit.client.1.smithi133.stdout:1/868: write d0/d12/dda/f11b [362775,107473] 0 2023-12-16T07:40:50.059 INFO:tasks.workunit.client.1.smithi133.stdout:2/735: dread da/d1d/d60/d71/f89 [0,4194304] 0 2023-12-16T07:40:50.059 INFO:tasks.workunit.client.1.smithi133.stdout:2/736: fsync da/f5c 0 2023-12-16T07:40:50.060 INFO:tasks.workunit.client.1.smithi133.stdout:2/737: truncate da/d1d/d60/d71/d2e/f57 4597446 0 2023-12-16T07:40:50.060 INFO:tasks.workunit.client.1.smithi133.stdout:1/869: dread d0/d12/d51/dac/d24/fae [0,4194304] 0 2023-12-16T07:40:50.061 INFO:tasks.workunit.client.1.smithi133.stdout:2/738: truncate da/f11 8188792 0 2023-12-16T07:40:50.063 INFO:tasks.workunit.client.1.smithi133.stdout:1/870: rename d0/d60/l8c to d0/l129 0 2023-12-16T07:40:50.064 INFO:tasks.workunit.client.1.smithi133.stdout:2/739: mknod da/d15/d1b/d83/ce5 0 2023-12-16T07:40:50.066 INFO:tasks.workunit.client.1.smithi133.stdout:1/871: link d0/d12/d51/dac/d24/d32/l8b d0/d12/dda/de0/l12a 0 2023-12-16T07:40:50.067 INFO:tasks.workunit.client.1.smithi133.stdout:2/740: creat da/d1d/d60/d74/ddb/fe6 x:0 0 0 2023-12-16T07:40:50.070 INFO:tasks.workunit.client.1.smithi133.stdout:2/741: truncate da/d15/d1b/f44 1271772 0 2023-12-16T07:40:50.072 INFO:tasks.workunit.client.1.smithi133.stdout:2/742: rename da/d1d/f21 to da/d1d/fe7 0 2023-12-16T07:40:50.073 INFO:tasks.workunit.client.1.smithi133.stdout:9/818: dwrite f13 [0,4194304] 0 2023-12-16T07:40:50.076 INFO:tasks.workunit.client.1.smithi133.stdout:9/819: mknod d15/d18/d5b/d71/d78/dfa/d101/c110 0 2023-12-16T07:40:50.076 INFO:tasks.workunit.client.1.smithi133.stdout:9/820: fsync d15/d42/f57 0 2023-12-16T07:40:50.077 INFO:tasks.workunit.client.1.smithi133.stdout:9/821: mkdir d15/d18/d5b/d71/d78/dfa/d101/d111 0 2023-12-16T07:40:50.077 INFO:tasks.workunit.client.1.smithi133.stdout:9/822: dread - d15/d18/d4d/f84 zero size 2023-12-16T07:40:50.087 INFO:tasks.workunit.client.1.smithi133.stdout:2/743: dwrite da/d15/d17/f36 [4194304,4194304] 0 2023-12-16T07:40:50.090 INFO:tasks.workunit.client.1.smithi133.stdout:2/744: write da/d15/d17/f36 [5900038,38091] 0 2023-12-16T07:40:50.095 INFO:tasks.workunit.client.1.smithi133.stdout:2/745: mknod da/d50/ce8 0 2023-12-16T07:40:50.095 INFO:tasks.workunit.client.1.smithi133.stdout:2/746: stat da/dc2/fd0 0 2023-12-16T07:40:50.099 INFO:tasks.workunit.client.1.smithi133.stdout:2/747: symlink da/d15/le9 0 2023-12-16T07:40:50.100 INFO:tasks.workunit.client.1.smithi133.stdout:1/872: getdents d0/d1c/d37 0 2023-12-16T07:40:50.105 INFO:tasks.workunit.client.1.smithi133.stdout:1/873: link d0/d12/d51/dac/l11 d0/da/d3d/dce/df5/l12b 0 2023-12-16T07:40:50.111 INFO:tasks.workunit.client.1.smithi133.stdout:2/748: dread da/d1d/d60/d71/d3a/d61/f68 [0,4194304] 0 2023-12-16T07:40:50.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/874: mkdir d0/d1c/d37/d12c 0 2023-12-16T07:40:50.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/875: dread - d0/d12/dda/de0/fe7 zero size 2023-12-16T07:40:50.126 INFO:tasks.workunit.client.1.smithi133.stdout:1/876: creat d0/da/d3d/dce/df5/d123/f12d x:0 0 0 2023-12-16T07:40:50.126 INFO:tasks.workunit.client.1.smithi133.stdout:1/877: readlink d0/d12/lfa 0 2023-12-16T07:40:50.130 INFO:tasks.workunit.client.1.smithi133.stdout:1/878: rename d0/da/f19 to d0/d12/d51/dac/d24/d32/d56/d59/f12e 0 2023-12-16T07:40:50.132 INFO:tasks.workunit.client.1.smithi133.stdout:2/749: dwrite da/d50/f82 [0,4194304] 0 2023-12-16T07:40:50.136 INFO:tasks.workunit.client.1.smithi133.stdout:1/879: rename d0/d1c/d102/d70/d8f to d0/da/d3d/dce/d12f 0 2023-12-16T07:40:50.136 INFO:tasks.workunit.client.1.smithi133.stdout:1/880: getdents d0/d1c/d37/d12c 0 2023-12-16T07:40:50.143 INFO:tasks.workunit.client.1.smithi133.stdout:1/881: rename d0/d12/d51/dac/d24/d5a/d68/l9a to d0/d12/d51/dac/d24/d5a/d68/dd5/l130 0 2023-12-16T07:40:50.145 INFO:tasks.workunit.client.1.smithi133.stdout:1/882: creat d0/d1c/d37/d103/f131 x:0 0 0 2023-12-16T07:40:50.148 INFO:tasks.workunit.client.1.smithi133.stdout:1/883: rename d0/d12/d51/db6/cd7 to d0/d1c/d37/d12c/c132 0 2023-12-16T07:40:50.157 INFO:tasks.workunit.client.1.smithi133.stdout:2/750: dwrite da/d15/d17/d40/f97 [0,4194304] 0 2023-12-16T07:40:50.157 INFO:tasks.workunit.client.1.smithi133.stdout:2/751: chown da/lf 957 1 2023-12-16T07:40:50.174 INFO:tasks.workunit.client.1.smithi133.stdout:2/752: dwrite da/d15/d1b/f70 [0,4194304] 0 2023-12-16T07:40:50.178 INFO:tasks.workunit.client.1.smithi133.stdout:2/753: mkdir da/d15/dea 0 2023-12-16T07:40:50.178 INFO:tasks.workunit.client.1.smithi133.stdout:0/770: sync 2023-12-16T07:40:50.178 INFO:tasks.workunit.client.1.smithi133.stdout:0/771: stat d2/d9/f7c 0 2023-12-16T07:40:50.179 INFO:tasks.workunit.client.1.smithi133.stdout:2/754: truncate da/d1d/d60/d71/d3a/f7d 851007 0 2023-12-16T07:40:50.180 INFO:tasks.workunit.client.1.smithi133.stdout:1/884: rmdir d0/da/d3d 39 2023-12-16T07:40:50.183 INFO:tasks.workunit.client.1.smithi133.stdout:0/772: rename d2/d17/d40 to d2/d17/d2b/d31/d4d/df9 0 2023-12-16T07:40:50.185 INFO:tasks.workunit.client.1.smithi133.stdout:2/755: creat da/d15/dbe/feb x:0 0 0 2023-12-16T07:40:50.186 INFO:tasks.workunit.client.1.smithi133.stdout:1/885: getdents d0/da/d3d/dce/d12f 0 2023-12-16T07:40:50.187 INFO:tasks.workunit.client.1.smithi133.stdout:1/886: write d0/d12/d51/db6/ff4 [1571831,13271] 0 2023-12-16T07:40:50.190 INFO:tasks.workunit.client.1.smithi133.stdout:2/756: mkdir da/d15/d1b/d43/d85/dec 0 2023-12-16T07:40:50.192 INFO:tasks.workunit.client.1.smithi133.stdout:1/887: symlink d0/d12/d51/dac/l133 0 2023-12-16T07:40:50.195 INFO:tasks.workunit.client.1.smithi133.stdout:0/773: unlink d2/d17/c4a 0 2023-12-16T07:40:50.198 INFO:tasks.workunit.client.1.smithi133.stdout:2/757: creat da/d15/d1b/d83/da3/fed x:0 0 0 2023-12-16T07:40:50.198 INFO:tasks.workunit.client.1.smithi133.stdout:2/758: fsync da/f10 0 2023-12-16T07:40:50.200 INFO:tasks.workunit.client.1.smithi133.stdout:8/637: sync 2023-12-16T07:40:50.200 INFO:tasks.workunit.client.1.smithi133.stdout:4/881: sync 2023-12-16T07:40:50.200 INFO:tasks.workunit.client.1.smithi133.stdout:5/592: sync 2023-12-16T07:40:50.200 INFO:tasks.workunit.client.1.smithi133.stdout:0/774: mknod d2/d17/d2b/d67/cfa 0 2023-12-16T07:40:50.202 INFO:tasks.workunit.client.1.smithi133.stdout:2/759: creat da/d15/d1b/d83/da3/dd4/fee x:0 0 0 2023-12-16T07:40:50.206 INFO:tasks.workunit.client.1.smithi133.stdout:4/882: rmdir d3/d7/d38/d57/d75 39 2023-12-16T07:40:50.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:49 smithi049 ceph-mon[111939]: pgmap v21: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 99 MiB/s rd, 193 MiB/s wr, 326 op/s 2023-12-16T07:40:50.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:49 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:50.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:49 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:50.209 INFO:tasks.workunit.client.1.smithi133.stdout:1/888: dwrite d0/d12/d51/f9d [0,4194304] 0 2023-12-16T07:40:50.209 INFO:tasks.workunit.client.1.smithi133.stdout:1/889: truncate d0/da/d3d/d41/df0/fff 537836 0 2023-12-16T07:40:50.213 INFO:tasks.workunit.client.1.smithi133.stdout:8/638: creat d9/d10/d39/fd0 x:0 0 0 2023-12-16T07:40:50.213 INFO:tasks.workunit.client.1.smithi133.stdout:5/593: mkdir d1/de/d57/dd6 0 2023-12-16T07:40:50.213 INFO:tasks.workunit.client.1.smithi133.stdout:5/594: chown d1/d1c/d80/d64/f65 257889 1 2023-12-16T07:40:50.214 INFO:tasks.workunit.client.1.smithi133.stdout:0/775: mknod d2/d9/d20/cfb 0 2023-12-16T07:40:50.218 INFO:tasks.workunit.client.1.smithi133.stdout:4/883: rmdir d3/d7/d38/dd5/da7/daa/dc6/d10b/d100 39 2023-12-16T07:40:50.221 INFO:tasks.workunit.client.1.smithi133.stdout:1/890: symlink d0/d1c/d37/d103/l134 0 2023-12-16T07:40:50.222 INFO:tasks.workunit.client.1.smithi133.stdout:5/595: mkdir d1/d1c/d80/dd7 0 2023-12-16T07:40:50.224 INFO:tasks.workunit.client.1.smithi133.stdout:5/596: read d1/de/f50 [501993,51646] 0 2023-12-16T07:40:50.224 INFO:tasks.workunit.client.1.smithi133.stdout:0/776: creat d2/d9/d20/d5e/d89/de0/ffc x:0 0 0 2023-12-16T07:40:50.224 INFO:tasks.workunit.client.1.smithi133.stdout:4/884: getdents d3/d7/d38/dd5/da7/daa/dc6/d10b 0 2023-12-16T07:40:50.226 INFO:tasks.workunit.client.1.smithi133.stdout:1/891: rename d0/da/d3d/dc2 to d0/da/d3d/d41/df0/d135 0 2023-12-16T07:40:50.227 INFO:tasks.workunit.client.1.smithi133.stdout:1/892: write d0/da/d3d/dce/d12f/fab [1271158,71949] 0 2023-12-16T07:40:50.228 INFO:tasks.workunit.client.1.smithi133.stdout:1/893: write d0/d12/d51/dac/d24/d5a/d68/f88 [1421952,91991] 0 2023-12-16T07:40:50.228 INFO:tasks.workunit.client.1.smithi133.stdout:1/894: stat d0/da/fb5 0 2023-12-16T07:40:50.228 INFO:tasks.workunit.client.1.smithi133.stdout:1/895: readlink d0/d12/dda/de0/l12a 0 2023-12-16T07:40:50.228 INFO:tasks.workunit.client.1.smithi133.stdout:5/597: creat d1/de/d52/da3/fd8 x:0 0 0 2023-12-16T07:40:50.229 INFO:tasks.workunit.client.1.smithi133.stdout:5/598: chown d1/d1c/f38 0 1 2023-12-16T07:40:50.229 INFO:tasks.workunit.client.1.smithi133.stdout:2/760: dwrite da/d15/d17/d40/d98/fd9 [0,4194304] 0 2023-12-16T07:40:50.229 INFO:tasks.workunit.client.1.smithi133.stdout:0/777: creat d2/d9/d12/d76/ffd x:0 0 0 2023-12-16T07:40:50.229 INFO:tasks.workunit.client.1.smithi133.stdout:4/885: getdents d3/d7/d38/dd5/d63/d96 0 2023-12-16T07:40:50.229 INFO:tasks.workunit.client.1.smithi133.stdout:8/639: dwrite d9/d10/f81 [0,4194304] 0 2023-12-16T07:40:50.234 INFO:tasks.workunit.client.1.smithi133.stdout:1/896: rename d0/l62 to d0/da/d3d/d41/df0/l136 0 2023-12-16T07:40:50.237 INFO:tasks.workunit.client.1.smithi133.stdout:5/599: mknod d1/d1c/d80/da7/cd9 0 2023-12-16T07:40:50.237 INFO:tasks.workunit.client.1.smithi133.stdout:5/600: dread - d1/de/d52/d95/fa6 zero size 2023-12-16T07:40:50.237 INFO:tasks.workunit.client.1.smithi133.stdout:5/601: stat d1/d18/f47 0 2023-12-16T07:40:50.240 INFO:tasks.workunit.client.1.smithi133.stdout:2/761: rename da/d1d/d60/d71/d2e/f35 to da/d1d/d60/d71/d2e/fef 0 2023-12-16T07:40:50.240 INFO:tasks.workunit.client.1.smithi133.stdout:2/762: write da/d15/d17/d40/f7c [632544,62411] 0 2023-12-16T07:40:50.243 INFO:tasks.workunit.client.1.smithi133.stdout:0/778: getdents d2 0 2023-12-16T07:40:50.243 INFO:tasks.workunit.client.1.smithi133.stdout:0/779: readlink d2/d9/d12/d76/l99 0 2023-12-16T07:40:50.245 INFO:tasks.workunit.client.1.smithi133.stdout:4/886: creat d3/d7/d38/dd5/da7/dbb/f124 x:0 0 0 2023-12-16T07:40:50.247 INFO:tasks.workunit.client.1.smithi133.stdout:0/780: dread d2/d9/db/f5d [0,4194304] 0 2023-12-16T07:40:50.249 INFO:tasks.workunit.client.1.smithi133.stdout:0/781: write d2/d17/d2b/d31/d4d/da7/fd2 [201608,7739] 0 2023-12-16T07:40:50.253 INFO:tasks.workunit.client.1.smithi133.stdout:1/897: creat d0/d1c/d37/f137 x:0 0 0 2023-12-16T07:40:50.254 INFO:tasks.workunit.client.1.smithi133.stdout:2/763: mknod da/d15/d1b/d83/da3/dd4/cf0 0 2023-12-16T07:40:50.258 INFO:tasks.workunit.client.1.smithi133.stdout:4/887: symlink d3/d7/d38/d57/d75/de4/l125 0 2023-12-16T07:40:50.259 INFO:tasks.workunit.client.1.smithi133.stdout:0/782: truncate d2/d17/d2b/f59 1793796 0 2023-12-16T07:40:50.260 INFO:tasks.workunit.client.1.smithi133.stdout:8/640: mknod d9/dc/cd1 0 2023-12-16T07:40:50.260 INFO:tasks.workunit.client.1.smithi133.stdout:8/641: dread - d9/d10/d39/d48/d44/d6e/d78/fc5 zero size 2023-12-16T07:40:50.261 INFO:tasks.workunit.client.1.smithi133.stdout:8/642: symlink d9/d10/d39/d48/d44/ld2 0 2023-12-16T07:40:50.261 INFO:tasks.workunit.client.1.smithi133.stdout:4/888: write d3/d7/d1c/d2a/f7f [178432,87954] 0 2023-12-16T07:40:50.263 INFO:tasks.workunit.client.1.smithi133.stdout:1/898: dread d0/d1c/d37/f9e [0,4194304] 0 2023-12-16T07:40:50.263 INFO:tasks.workunit.client.1.smithi133.stdout:1/899: stat d0/d12/d51/dac/fe6 0 2023-12-16T07:40:50.263 INFO:tasks.workunit.client.1.smithi133.stdout:5/602: dwrite d1/de/d52/da3/fd8 [0,4194304] 0 2023-12-16T07:40:50.263 INFO:tasks.workunit.client.1.smithi133.stdout:5/603: readlink d1/d1c/d80/d8d/lb5 0 2023-12-16T07:40:50.263 INFO:tasks.workunit.client.1.smithi133.stdout:8/643: unlink d9/d10/d39/d48/d44/d6e/l87 0 2023-12-16T07:40:50.263 INFO:tasks.workunit.client.1.smithi133.stdout:8/644: chown d9/d2d/dc1/caf 3011736 1 2023-12-16T07:40:50.264 INFO:tasks.workunit.client.1.smithi133.stdout:4/889: write d3/d7/d1a/f27 [1405829,114294] 0 2023-12-16T07:40:50.264 INFO:tasks.workunit.client.1.smithi133.stdout:4/890: chown d3/d7/d38/dd5/da7/ff7 1 1 2023-12-16T07:40:50.264 INFO:tasks.workunit.client.1.smithi133.stdout:4/891: write d3/d7/d1c/d2a/f4c [4398245,32467] 0 2023-12-16T07:40:50.264 INFO:tasks.workunit.client.1.smithi133.stdout:8/645: write d9/d11/f38 [80539,33795] 0 2023-12-16T07:40:50.266 INFO:tasks.workunit.client.1.smithi133.stdout:1/900: link d0/d12/d51/dac/f23 d0/d12/d51/dac/d24/d5a/d68/f138 0 2023-12-16T07:40:50.267 INFO:tasks.workunit.client.1.smithi133.stdout:0/783: dread d2/f6 [0,4194304] 0 2023-12-16T07:40:50.268 INFO:tasks.workunit.client.1.smithi133.stdout:5/604: creat d1/de/dc7/fda x:0 0 0 2023-12-16T07:40:50.271 INFO:tasks.workunit.client.1.smithi133.stdout:4/892: mknod d3/d7/d38/dd5/da7/daa/dc6/d113/c126 0 2023-12-16T07:40:50.271 INFO:tasks.workunit.client.1.smithi133.stdout:4/893: chown d3/d7/d38/dd5/da7/daa/dc6/fed 51970773 1 2023-12-16T07:40:50.271 INFO:tasks.workunit.client.1.smithi133.stdout:2/764: dwrite da/d1d/f87 [0,4194304] 0 2023-12-16T07:40:50.271 INFO:tasks.workunit.client.1.smithi133.stdout:2/765: dread - da/d50/d8e/fce zero size 2023-12-16T07:40:50.271 INFO:tasks.workunit.client.1.smithi133.stdout:2/766: fsync da/d15/d17/d40/fa2 0 2023-12-16T07:40:50.271 INFO:tasks.workunit.client.1.smithi133.stdout:2/767: chown da/d15/d17/d40/lb7 2367614 1 2023-12-16T07:40:50.272 INFO:tasks.workunit.client.1.smithi133.stdout:2/768: write da/d1d/d60/d74/ddb/fe6 [215115,38891] 0 2023-12-16T07:40:50.275 INFO:tasks.workunit.client.1.smithi133.stdout:8/646: truncate d9/d10/d39/d48/d44/d6e/f94 1479202 0 2023-12-16T07:40:50.277 INFO:tasks.workunit.client.1.smithi133.stdout:0/784: mknod d2/d17/d2b/d31/cfe 0 2023-12-16T07:40:50.281 INFO:tasks.workunit.client.1.smithi133.stdout:5/605: mkdir d1/d54/ddb 0 2023-12-16T07:40:50.281 INFO:tasks.workunit.client.1.smithi133.stdout:5/606: dread - d1/d4b/fc8 zero size 2023-12-16T07:40:50.282 INFO:tasks.workunit.client.1.smithi133.stdout:4/894: creat d3/d7/d1a/d111/f127 x:0 0 0 2023-12-16T07:40:50.286 INFO:tasks.workunit.client.1.smithi133.stdout:1/901: dwrite d0/d12/d51/dac/d24/d5a/d68/fa5 [0,4194304] 0 2023-12-16T07:40:50.286 INFO:tasks.workunit.client.1.smithi133.stdout:1/902: chown d0/d1c/d37/dcc/l10a 30 1 2023-12-16T07:40:50.287 INFO:tasks.workunit.client.1.smithi133.stdout:1/903: fdatasync d0/da/d3d/dce/df5/f11f 0 2023-12-16T07:40:50.287 INFO:tasks.workunit.client.1.smithi133.stdout:8/647: getdents d9/d10/d39/d48/d92 0 2023-12-16T07:40:50.287 INFO:tasks.workunit.client.1.smithi133.stdout:8/648: chown d9/d11/d42/f62 15851 1 2023-12-16T07:40:50.288 INFO:tasks.workunit.client.1.smithi133.stdout:5/607: getdents d1/de/d52/d95 0 2023-12-16T07:40:50.288 INFO:tasks.workunit.client.1.smithi133.stdout:5/608: write d1/de/d35/f9f [552749,54521] 0 2023-12-16T07:40:50.290 INFO:tasks.workunit.client.1.smithi133.stdout:2/769: mknod da/d1d/cf1 0 2023-12-16T07:40:50.294 INFO:tasks.workunit.client.1.smithi133.stdout:5/609: write d1/de/d57/f8c [188329,2830] 0 2023-12-16T07:40:50.294 INFO:tasks.workunit.client.1.smithi133.stdout:5/610: truncate d1/d4b/fc4 711130 0 2023-12-16T07:40:50.301 INFO:tasks.workunit.client.1.smithi133.stdout:0/785: dwrite d2/d17/fac [4194304,4194304] 0 2023-12-16T07:40:50.301 INFO:tasks.workunit.client.1.smithi133.stdout:0/786: stat d2/d17/d2b/d31/d4d/da7/fd2 0 2023-12-16T07:40:50.301 INFO:tasks.workunit.client.1.smithi133.stdout:0/787: chown d2/d9/d20/d5e/d89/da2 0 1 2023-12-16T07:40:50.309 INFO:tasks.workunit.client.1.smithi133.stdout:2/770: dread da/d1d/d60/d71/d3a/d5a/f5f [0,4194304] 0 2023-12-16T07:40:50.309 INFO:tasks.workunit.client.1.smithi133.stdout:2/771: chown da/d1d/d60/d71/l51 889228 1 2023-12-16T07:40:50.309 INFO:tasks.workunit.client.1.smithi133.stdout:1/904: mkdir d0/d12/d51/dac/d24/d5a/d139 0 2023-12-16T07:40:50.312 INFO:tasks.workunit.client.1.smithi133.stdout:8/649: creat d9/d10/fd3 x:0 0 0 2023-12-16T07:40:50.316 INFO:tasks.workunit.client.1.smithi133.stdout:2/772: getdents da/d15/d1b/d83/da3/dd4 0 2023-12-16T07:40:50.321 INFO:tasks.workunit.client.1.smithi133.stdout:4/895: dwrite d3/d7/d38/d57/d67/fc1 [0,4194304] 0 2023-12-16T07:40:50.321 INFO:tasks.workunit.client.1.smithi133.stdout:5/611: dwrite d1/de/d67/f2a [0,4194304] 0 2023-12-16T07:40:50.321 INFO:tasks.workunit.client.1.smithi133.stdout:1/905: rename d0/d12/d51/dac/d24/d5a/d68/lf1 to d0/d12/d51/dac/d24/d32/d56/d59/d66/l13a 0 2023-12-16T07:40:50.321 INFO:tasks.workunit.client.1.smithi133.stdout:1/906: chown d0/f29 3981838 1 2023-12-16T07:40:50.321 INFO:tasks.workunit.client.1.smithi133.stdout:0/788: dwrite d2/d9/d20/d5e/d92/fc0 [4194304,4194304] 0 2023-12-16T07:40:50.321 INFO:tasks.workunit.client.1.smithi133.stdout:0/789: write d2/d17/d2b/d31/d4d/fb1 [1274841,124532] 0 2023-12-16T07:40:50.323 INFO:tasks.workunit.client.1.smithi133.stdout:5/612: rmdir d1/de/d57/dc5 39 2023-12-16T07:40:50.324 INFO:tasks.workunit.client.1.smithi133.stdout:5/613: readlink d1/d54/l6e 0 2023-12-16T07:40:50.324 INFO:tasks.workunit.client.1.smithi133.stdout:5/614: fdatasync d1/d1c/f51 0 2023-12-16T07:40:50.324 INFO:tasks.workunit.client.1.smithi133.stdout:5/615: getdents d1/d54/ddb 0 2023-12-16T07:40:50.326 INFO:tasks.workunit.client.1.smithi133.stdout:4/896: read d3/d7/d1a/f27 [4040669,108251] 0 2023-12-16T07:40:50.330 INFO:tasks.workunit.client.1.smithi133.stdout:1/907: dread d0/d12/d51/dac/d24/d5a/d68/fa5 [0,4194304] 0 2023-12-16T07:40:50.330 INFO:tasks.workunit.client.1.smithi133.stdout:1/908: chown d0/d12/dda 1347171 1 2023-12-16T07:40:50.334 INFO:tasks.workunit.client.1.smithi133.stdout:8/650: dwrite d9/d10/d39/d48/d44/d6e/d78/fb1 [0,4194304] 0 2023-12-16T07:40:50.335 INFO:tasks.workunit.client.1.smithi133.stdout:1/909: dread d0/da/d3d/d41/f6a [0,4194304] 0 2023-12-16T07:40:50.341 INFO:tasks.workunit.client.1.smithi133.stdout:0/790: dwrite d2/d9/d12/d35/fb3 [0,4194304] 0 2023-12-16T07:40:50.341 INFO:tasks.workunit.client.1.smithi133.stdout:0/791: fsync d2/d9/d12/d76/fe4 0 2023-12-16T07:40:50.341 INFO:tasks.workunit.client.1.smithi133.stdout:0/792: chown d2/d9/d12/d35/d4f/d93 239 1 2023-12-16T07:40:50.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:49 smithi133 ceph-mon[120445]: pgmap v21: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 99 MiB/s rd, 193 MiB/s wr, 326 op/s 2023-12-16T07:40:50.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:49 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:50.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:49 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:40:50.371 INFO:tasks.workunit.client.1.smithi133.stdout:5/616: creat d1/de/d35/dc6/db4/d71/fdc x:0 0 0 2023-12-16T07:40:50.371 INFO:tasks.workunit.client.1.smithi133.stdout:5/617: read - d1/de/fa2 zero size 2023-12-16T07:40:50.371 INFO:tasks.workunit.client.1.smithi133.stdout:5/618: write d1/de/d35/dc6/db4/d71/f93 [1037522,90064] 0 2023-12-16T07:40:50.371 INFO:tasks.workunit.client.1.smithi133.stdout:5/619: read d1/de/f50 [1485674,41611] 0 2023-12-16T07:40:50.371 INFO:tasks.workunit.client.1.smithi133.stdout:5/620: fdatasync d1/de/d52/d95/fab 0 2023-12-16T07:40:50.371 INFO:tasks.workunit.client.1.smithi133.stdout:4/897: mknod d3/d7/d38/dd5/d63/c128 0 2023-12-16T07:40:50.374 INFO:tasks.workunit.client.1.smithi133.stdout:8/651: mknod d9/d2d/dc1/cd4 0 2023-12-16T07:40:50.374 INFO:tasks.workunit.client.1.smithi133.stdout:8/652: write d9/d10/d39/fd0 [360913,23093] 0 2023-12-16T07:40:50.375 INFO:tasks.workunit.client.1.smithi133.stdout:1/910: truncate d0/d12/d51/db6/ff4 1089084 0 2023-12-16T07:40:50.376 INFO:tasks.workunit.client.1.smithi133.stdout:8/653: fsync d9/d10/fd3 0 2023-12-16T07:40:50.376 INFO:tasks.workunit.client.1.smithi133.stdout:8/654: write d9/d10/f3a [5050721,38328] 0 2023-12-16T07:40:50.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/655: dread - d9/d10/d39/d48/fad zero size 2023-12-16T07:40:50.382 INFO:tasks.workunit.client.1.smithi133.stdout:4/898: mkdir d3/d7/d38/dd5/dac/dbc/d129 0 2023-12-16T07:40:50.386 INFO:tasks.workunit.client.1.smithi133.stdout:1/911: symlink d0/d12/d51/dac/d24/d5a/d68/dd5/l13b 0 2023-12-16T07:40:50.389 INFO:tasks.workunit.client.1.smithi133.stdout:8/656: symlink d9/dc/d27/ld5 0 2023-12-16T07:40:50.389 INFO:tasks.workunit.client.1.smithi133.stdout:8/657: readlink d9/d10/d39/d48/l75 0 2023-12-16T07:40:50.391 INFO:tasks.workunit.client.1.smithi133.stdout:1/912: mknod d0/da/d3d/dce/d12f/d122/c13c 0 2023-12-16T07:40:50.393 INFO:tasks.workunit.client.1.smithi133.stdout:8/658: mkdir d9/d85/dd6 0 2023-12-16T07:40:50.395 INFO:tasks.workunit.client.1.smithi133.stdout:3/588: sync 2023-12-16T07:40:50.396 INFO:tasks.workunit.client.1.smithi133.stdout:6/951: sync 2023-12-16T07:40:50.396 INFO:tasks.workunit.client.1.smithi133.stdout:9/823: sync 2023-12-16T07:40:50.396 INFO:tasks.workunit.client.1.smithi133.stdout:9/824: readlink d15/d18/l7d 0 2023-12-16T07:40:50.396 INFO:tasks.workunit.client.1.smithi133.stdout:1/913: symlink d0/d1c/d102/d70/l13d 0 2023-12-16T07:40:50.397 INFO:tasks.workunit.client.1.smithi133.stdout:5/621: dwrite d1/d4b/da5/f8b [0,4194304] 0 2023-12-16T07:40:50.399 INFO:tasks.workunit.client.1.smithi133.stdout:8/659: truncate d9/d10/d39/d48/d44/f89 986501 0 2023-12-16T07:40:50.401 INFO:tasks.workunit.client.1.smithi133.stdout:3/589: rmdir d7/d8/d1d/d2a/df2 0 2023-12-16T07:40:50.401 INFO:tasks.workunit.client.1.smithi133.stdout:3/590: chown d7/d8/d1c/d2b/l3f 97177536 1 2023-12-16T07:40:50.404 INFO:tasks.workunit.client.1.smithi133.stdout:6/952: mkdir d0/d5e/d75/dad/d138 0 2023-12-16T07:40:50.405 INFO:tasks.workunit.client.1.smithi133.stdout:1/914: mknod d0/d12/d11d/c13e 0 2023-12-16T07:40:50.405 INFO:tasks.workunit.client.1.smithi133.stdout:1/915: chown d0/d12/d51/dac/d24/d32/d56/d59/d66/fcd 44257 1 2023-12-16T07:40:50.406 INFO:tasks.workunit.client.1.smithi133.stdout:5/622: dread d1/de/f32 [0,4194304] 0 2023-12-16T07:40:50.406 INFO:tasks.workunit.client.1.smithi133.stdout:5/623: fsync d1/d1c/f3b 0 2023-12-16T07:40:50.406 INFO:tasks.workunit.client.1.smithi133.stdout:5/624: fdatasync d1/de/d35/dc6/db4/fbc 0 2023-12-16T07:40:50.407 INFO:tasks.workunit.client.1.smithi133.stdout:5/625: write d1/f1a [1663957,12265] 0 2023-12-16T07:40:50.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/660: creat d9/dc/de/fd7 x:0 0 0 2023-12-16T07:40:50.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/661: read d9/d2d/dc1/f66 [331735,72568] 0 2023-12-16T07:40:50.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/662: truncate d9/d10/d39/d48/d92/fbb 1024861 0 2023-12-16T07:40:50.412 INFO:tasks.workunit.client.1.smithi133.stdout:3/591: symlink d7/d8/d1d/dc9/lf6 0 2023-12-16T07:40:50.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/953: link d0/d5e/d8c/d107/d11f/f124 d0/d4/d21/d35/d7e/dac/f139 0 2023-12-16T07:40:50.417 INFO:tasks.workunit.client.1.smithi133.stdout:6/954: write d0/d4/d21/f4c [962620,2011] 0 2023-12-16T07:40:50.417 INFO:tasks.workunit.client.1.smithi133.stdout:1/916: creat d0/d12/d51/db6/f13f x:0 0 0 2023-12-16T07:40:50.418 INFO:tasks.workunit.client.1.smithi133.stdout:5/626: creat d1/d1c/d80/fdd x:0 0 0 2023-12-16T07:40:50.419 INFO:tasks.workunit.client.1.smithi133.stdout:5/627: readlink d1/ld 0 2023-12-16T07:40:50.422 INFO:tasks.workunit.client.1.smithi133.stdout:8/663: chown d9/dc/f3c 11 1 2023-12-16T07:40:50.422 INFO:tasks.workunit.client.1.smithi133.stdout:8/664: write d9/d10/f37 [5093393,48150] 0 2023-12-16T07:40:50.425 INFO:tasks.workunit.client.1.smithi133.stdout:6/955: creat d0/d5e/f13a x:0 0 0 2023-12-16T07:40:50.429 INFO:tasks.workunit.client.1.smithi133.stdout:5/628: creat d1/de/d57/dd6/fde x:0 0 0 2023-12-16T07:40:50.429 INFO:tasks.workunit.client.1.smithi133.stdout:1/917: dwrite d0/d12/d51/dac/d24/d32/f57 [0,4194304] 0 2023-12-16T07:40:50.429 INFO:tasks.workunit.client.1.smithi133.stdout:8/665: creat d9/d10/d39/d48/d44/d6e/d78/da6/fd8 x:0 0 0 2023-12-16T07:40:50.431 INFO:tasks.workunit.client.1.smithi133.stdout:1/918: dread d0/d12/d51/db6/dde/fdf [0,4194304] 0 2023-12-16T07:40:50.439 INFO:tasks.workunit.client.1.smithi133.stdout:8/666: unlink d9/d11/d33/faa 0 2023-12-16T07:40:50.441 INFO:tasks.workunit.client.1.smithi133.stdout:1/919: creat d0/da/d3d/d41/d9f/f140 x:0 0 0 2023-12-16T07:40:50.442 INFO:tasks.workunit.client.1.smithi133.stdout:8/667: rename d9/dc/d27/f76 to d9/d11/d42/fd9 0 2023-12-16T07:40:50.445 INFO:tasks.workunit.client.1.smithi133.stdout:1/920: creat d0/da/d3d/d41/df0/f141 x:0 0 0 2023-12-16T07:40:50.447 INFO:tasks.workunit.client.1.smithi133.stdout:8/668: mkdir d9/d11/d42/dda 0 2023-12-16T07:40:50.450 INFO:tasks.workunit.client.1.smithi133.stdout:1/921: unlink d0/da/d3d/dce/df5/c111 0 2023-12-16T07:40:50.450 INFO:tasks.workunit.client.1.smithi133.stdout:1/922: chown d0/d12/fb3 89797 1 2023-12-16T07:40:50.451 INFO:tasks.workunit.client.1.smithi133.stdout:8/669: truncate d9/d11/f16 940806 0 2023-12-16T07:40:50.452 INFO:tasks.workunit.client.1.smithi133.stdout:8/670: write d9/d10/f97 [1897817,61403] 0 2023-12-16T07:40:50.452 INFO:tasks.workunit.client.1.smithi133.stdout:8/671: write d9/d10/d39/d48/f86 [189096,40841] 0 2023-12-16T07:40:50.453 INFO:tasks.workunit.client.1.smithi133.stdout:1/923: truncate d0/da/d3d/d41/f83 105104 0 2023-12-16T07:40:50.453 INFO:tasks.workunit.client.1.smithi133.stdout:1/924: read - d0/d12/d51/dac/d24/d5a/d68/f76 zero size 2023-12-16T07:40:50.453 INFO:tasks.workunit.client.1.smithi133.stdout:1/925: write d0/da/d3d/d41/df0/d135/f109 [574995,80799] 0 2023-12-16T07:40:50.472 INFO:tasks.workunit.client.1.smithi133.stdout:1/926: dwrite d0/da/d3d/d41/df0/d135/f109 [0,4194304] 0 2023-12-16T07:40:50.486 INFO:tasks.workunit.client.1.smithi133.stdout:1/927: dwrite d0/d12/d51/db6/ff4 [0,4194304] 0 2023-12-16T07:40:50.581 INFO:tasks.workunit.client.1.smithi133.stdout:1/928: rename d0/da/d3d/f50 to d0/d12/d51/dac/d24/d5a/d68/dd5/f142 0 2023-12-16T07:40:50.581 INFO:tasks.workunit.client.1.smithi133.stdout:1/929: write d0/d12/d51/dac/d24/d5a/d68/dd5/f142 [750481,54880] 0 2023-12-16T07:40:50.582 INFO:tasks.workunit.client.1.smithi133.stdout:1/930: readlink d0/da/l63 0 2023-12-16T07:40:50.629 INFO:tasks.workunit.client.1.smithi133.stdout:1/931: creat d0/da/d3d/d41/d9f/f143 x:0 0 0 2023-12-16T07:40:50.629 INFO:tasks.workunit.client.1.smithi133.stdout:1/932: write d0/d12/dda/de0/fe9 [944593,49786] 0 2023-12-16T07:40:50.629 INFO:tasks.workunit.client.1.smithi133.stdout:1/933: write d0/d1c/d37/f43 [1391919,56935] 0 2023-12-16T07:40:50.630 INFO:tasks.workunit.client.1.smithi133.stdout:1/934: read d0/d12/f3f [3546458,13023] 0 2023-12-16T07:40:50.630 INFO:tasks.workunit.client.1.smithi133.stdout:1/935: getdents d0/da/d3d 0 2023-12-16T07:40:50.756 INFO:tasks.workunit.client.1.smithi133.stdout:6/956: sync 2023-12-16T07:40:50.756 INFO:tasks.workunit.client.1.smithi133.stdout:0/793: sync 2023-12-16T07:40:50.756 INFO:tasks.workunit.client.1.smithi133.stdout:4/899: sync 2023-12-16T07:40:50.756 INFO:tasks.workunit.client.1.smithi133.stdout:2/773: sync 2023-12-16T07:40:50.757 INFO:tasks.workunit.client.1.smithi133.stdout:0/794: chown d2/d17/d2b/f59 70814182 1 2023-12-16T07:40:50.757 INFO:tasks.workunit.client.1.smithi133.stdout:3/592: sync 2023-12-16T07:40:50.757 INFO:tasks.workunit.client.1.smithi133.stdout:9/825: sync 2023-12-16T07:40:50.758 INFO:tasks.workunit.client.1.smithi133.stdout:0/795: rmdir d2/d9/d20 39 2023-12-16T07:40:50.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/774: creat da/d1d/d60/d71/d2e/ff2 x:0 0 0 2023-12-16T07:40:50.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/775: fdatasync da/f11 0 2023-12-16T07:40:50.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/776: fsync da/d15/d1b/d43/fc5 0 2023-12-16T07:40:50.762 INFO:tasks.workunit.client.1.smithi133.stdout:4/900: symlink d3/d7/d38/d57/d75/de4/l12a 0 2023-12-16T07:40:50.764 INFO:tasks.workunit.client.1.smithi133.stdout:9/826: mknod d15/d18/d5b/dd6/c112 0 2023-12-16T07:40:50.764 INFO:tasks.workunit.client.1.smithi133.stdout:9/827: readlink l8 0 2023-12-16T07:40:50.766 INFO:tasks.workunit.client.1.smithi133.stdout:0/796: creat d2/d17/d2b/d31/d4d/df9/fff x:0 0 0 2023-12-16T07:40:50.766 INFO:tasks.workunit.client.1.smithi133.stdout:0/797: chown d2/d9/d20/d5e/d89/da2/la9 11108 1 2023-12-16T07:40:50.768 INFO:tasks.workunit.client.1.smithi133.stdout:4/901: mknod d3/d7/d38/dd5/dac/dcf/c12b 0 2023-12-16T07:40:50.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/828: link d15/d18/cd3 d15/d42/c113 0 2023-12-16T07:40:50.770 INFO:tasks.workunit.client.1.smithi133.stdout:6/957: dread d0/d4/d21/f40 [0,4194304] 0 2023-12-16T07:40:50.772 INFO:tasks.workunit.client.1.smithi133.stdout:0/798: symlink d2/d9/dc5/dd8/l100 0 2023-12-16T07:40:50.774 INFO:tasks.workunit.client.1.smithi133.stdout:4/902: mkdir d3/d7/db1/d12c 0 2023-12-16T07:40:50.776 INFO:tasks.workunit.client.1.smithi133.stdout:9/829: creat d15/d18/f114 x:0 0 0 2023-12-16T07:40:50.778 INFO:tasks.workunit.client.1.smithi133.stdout:6/958: symlink d0/d4/d21/d35/d4e/d84/d69/da1/l13b 0 2023-12-16T07:40:50.779 INFO:tasks.workunit.client.1.smithi133.stdout:0/799: mkdir d2/d17/d2b/d31/d4d/d101 0 2023-12-16T07:40:50.781 INFO:tasks.workunit.client.1.smithi133.stdout:4/903: truncate d3/d7/d1c/d2a/d91/dbe/dfa/d89/dbf/ff0 565783 0 2023-12-16T07:40:50.783 INFO:tasks.workunit.client.1.smithi133.stdout:9/830: mkdir d15/d18/d5b/d71/d78/dfa/d115 0 2023-12-16T07:40:50.783 INFO:tasks.workunit.client.1.smithi133.stdout:9/831: chown f0 2831598 1 2023-12-16T07:40:50.783 INFO:tasks.workunit.client.1.smithi133.stdout:9/832: write d15/d18/f5e [785994,37843] 0 2023-12-16T07:40:50.783 INFO:tasks.workunit.client.1.smithi133.stdout:9/833: write f14 [1253004,73161] 0 2023-12-16T07:40:50.784 INFO:tasks.workunit.client.1.smithi133.stdout:6/959: mkdir d0/d5e/d8c/d107/d13c 0 2023-12-16T07:40:50.786 INFO:tasks.workunit.client.1.smithi133.stdout:0/800: creat d2/d9/d20/d5e/f102 x:0 0 0 2023-12-16T07:40:50.789 INFO:tasks.workunit.client.1.smithi133.stdout:4/904: truncate d3/d7/d1c/d2a/f4c 381313 0 2023-12-16T07:40:50.789 INFO:tasks.workunit.client.1.smithi133.stdout:4/905: chown d3/d7/d1a/d111/l11a 1262 1 2023-12-16T07:40:50.789 INFO:tasks.workunit.client.1.smithi133.stdout:4/906: chown d3/d7/d1c 28305 1 2023-12-16T07:40:50.791 INFO:tasks.workunit.client.1.smithi133.stdout:6/960: getdents d0/d4/d21/d60 0 2023-12-16T07:40:50.791 INFO:tasks.workunit.client.1.smithi133.stdout:6/961: chown d0/d4/d21/d35/d36/c73 0 1 2023-12-16T07:40:50.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/962: chown d0/d4/d21/d35/d7e/ded 48 1 2023-12-16T07:40:50.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/963: chown d0/d5e/d75/dad 14 1 2023-12-16T07:40:50.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/964: fdatasync d0/d5e/d8c/f97 0 2023-12-16T07:40:50.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/965: write d0/d4/f1c [1964606,30278] 0 2023-12-16T07:40:50.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/966: symlink d0/d4/d21/d35/d4e/l13d 0 2023-12-16T07:40:50.792 INFO:tasks.workunit.client.1.smithi133.stdout:6/967: fsync d0/d5e/d75/dad/fbf 0 2023-12-16T07:40:50.793 INFO:tasks.workunit.client.1.smithi133.stdout:6/968: fdatasync d0/d4/d21/d8a/ff6 0 2023-12-16T07:40:50.793 INFO:tasks.workunit.client.1.smithi133.stdout:3/593: dwrite d7/d8/d1c/d2b/f9c [0,4194304] 0 2023-12-16T07:40:50.793 INFO:tasks.workunit.client.1.smithi133.stdout:2/777: dwrite da/d15/d17/d40/d98/fd9 [4194304,4194304] 0 2023-12-16T07:40:50.794 INFO:tasks.workunit.client.1.smithi133.stdout:2/778: fdatasync da/dc2/fd0 0 2023-12-16T07:40:50.794 INFO:tasks.workunit.client.1.smithi133.stdout:3/594: dread - d7/d8/d72/d86/ff5 zero size 2023-12-16T07:40:50.794 INFO:tasks.workunit.client.1.smithi133.stdout:3/595: write d7/d8/d1d/d2a/f3c [4767060,51890] 0 2023-12-16T07:40:50.794 INFO:tasks.workunit.client.1.smithi133.stdout:0/801: rename d2/d17/l85 to d2/d9/d12/d35/l103 0 2023-12-16T07:40:50.802 INFO:tasks.workunit.client.1.smithi133.stdout:3/596: creat d7/d8/d1c/d87/ff7 x:0 0 0 2023-12-16T07:40:50.802 INFO:tasks.workunit.client.1.smithi133.stdout:3/597: dread - d7/d8/d78/d43/fd8 zero size 2023-12-16T07:40:50.806 INFO:tasks.workunit.client.1.smithi133.stdout:0/802: rename d2/fce to d2/db2/f104 0 2023-12-16T07:40:50.809 INFO:tasks.workunit.client.1.smithi133.stdout:3/598: rmdir d7/d8/d78 39 2023-12-16T07:40:50.810 INFO:tasks.workunit.client.1.smithi133.stdout:3/599: dread - d7/d8/d1d/fef zero size 2023-12-16T07:40:50.810 INFO:tasks.workunit.client.1.smithi133.stdout:3/600: write d7/d8/d78/f69 [5427700,123055] 0 2023-12-16T07:40:50.811 INFO:tasks.workunit.client.1.smithi133.stdout:0/803: symlink d2/d17/d2b/d31/d4d/d54/l105 0 2023-12-16T07:40:50.817 INFO:tasks.workunit.client.1.smithi133.stdout:6/969: dwrite d0/d4/d21/d35/d4e/d84/d69/da1/f10c [0,4194304] 0 2023-12-16T07:40:50.817 INFO:tasks.workunit.client.1.smithi133.stdout:6/970: chown d0/d4/d21/d35/fc6 7488 1 2023-12-16T07:40:50.825 INFO:tasks.workunit.client.1.smithi133.stdout:4/907: dwrite d3/d7/d38/d57/d67/f92 [0,4194304] 0 2023-12-16T07:40:50.825 INFO:tasks.workunit.client.1.smithi133.stdout:4/908: read d3/d7/d38/dd5/d63/f93 [59951,5598] 0 2023-12-16T07:40:50.825 INFO:tasks.workunit.client.1.smithi133.stdout:6/971: symlink d0/d4/d21/d35/d4e/d84/l13e 0 2023-12-16T07:40:50.826 INFO:tasks.workunit.client.1.smithi133.stdout:0/804: mknod d2/d17/c106 0 2023-12-16T07:40:50.828 INFO:tasks.workunit.client.1.smithi133.stdout:6/972: write d0/d5e/d75/fd1 [875898,9407] 0 2023-12-16T07:40:50.829 INFO:tasks.workunit.client.1.smithi133.stdout:4/909: symlink d3/d7/d1c/d2a/l12d 0 2023-12-16T07:40:50.829 INFO:tasks.workunit.client.1.smithi133.stdout:4/910: chown d3/d7/d38/dd5/dac/dbc/feb 19 1 2023-12-16T07:40:50.831 INFO:tasks.workunit.client.1.smithi133.stdout:0/805: rename d2/d9/d20/d5e/d92/c97 to d2/d17/d2b/d31/d4d/da7/ded/c107 0 2023-12-16T07:40:50.832 INFO:tasks.workunit.client.1.smithi133.stdout:6/973: mknod d0/d5e/d75/dcf/c13f 0 2023-12-16T07:40:50.833 INFO:tasks.workunit.client.1.smithi133.stdout:4/911: mknod d3/d7/d38/dd5/da7/dbb/c12e 0 2023-12-16T07:40:50.833 INFO:tasks.workunit.client.1.smithi133.stdout:6/974: write d0/d4/f5c [2294971,52848] 0 2023-12-16T07:40:50.834 INFO:tasks.workunit.client.1.smithi133.stdout:0/806: mkdir d2/d17/dc2/d108 0 2023-12-16T07:40:50.834 INFO:tasks.workunit.client.1.smithi133.stdout:0/807: read d2/d9/d8f/f6e [2981525,34199] 0 2023-12-16T07:40:50.834 INFO:tasks.workunit.client.1.smithi133.stdout:0/808: getdents d2/d17/d2b/d31/d4d/d101 0 2023-12-16T07:40:50.835 INFO:tasks.workunit.client.1.smithi133.stdout:9/834: dwrite d15/d18/f77 [4194304,4194304] 0 2023-12-16T07:40:50.835 INFO:tasks.workunit.client.1.smithi133.stdout:2/779: dwrite da/dc2/fd0 [0,4194304] 0 2023-12-16T07:40:50.836 INFO:tasks.workunit.client.1.smithi133.stdout:3/601: dwrite d7/d8/d1c/fa5 [0,4194304] 0 2023-12-16T07:40:50.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/780: readlink da/d1d/d60/d71/d2e/d47/d52/lb4 0 2023-12-16T07:40:50.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/781: chown da/d15/d1b/d83/da3/dd4 265 1 2023-12-16T07:40:50.836 INFO:tasks.workunit.client.1.smithi133.stdout:2/782: write da/d1d/d60/d71/d2e/d47/fb9 [4394302,74173] 0 2023-12-16T07:40:50.837 INFO:tasks.workunit.client.1.smithi133.stdout:4/912: creat d3/d7/d1c/d2a/d91/dbe/f12f x:0 0 0 2023-12-16T07:40:50.838 INFO:tasks.workunit.client.1.smithi133.stdout:4/913: read - d3/d7/d38/dd5/dac/dbc/f10e zero size 2023-12-16T07:40:50.842 INFO:tasks.workunit.client.1.smithi133.stdout:6/975: unlink d0/d4/d21/d35/d4e/l7f 0 2023-12-16T07:40:50.846 INFO:tasks.workunit.client.1.smithi133.stdout:9/835: dread d15/d18/d2c/d68/da3/faf [0,4194304] 0 2023-12-16T07:40:50.847 INFO:tasks.workunit.client.1.smithi133.stdout:0/809: creat d2/d17/d2b/d31/d7f/f109 x:0 0 0 2023-12-16T07:40:50.868 INFO:tasks.workunit.client.1.smithi133.stdout:3/602: rename d7/d8/d78/f8b to d7/d8/d1d/d2a/d5f/ff8 0 2023-12-16T07:40:50.868 INFO:tasks.workunit.client.1.smithi133.stdout:3/603: chown d7/d8/d78/d43/d7f/d85/cba 58674383 1 2023-12-16T07:40:50.868 INFO:tasks.workunit.client.1.smithi133.stdout:3/604: chown d7/d8/d1c/ddb/le4 159666243 1 2023-12-16T07:40:50.870 INFO:tasks.workunit.client.1.smithi133.stdout:2/783: creat da/d50/db6/dc4/ff3 x:0 0 0 2023-12-16T07:40:50.870 INFO:tasks.workunit.client.1.smithi133.stdout:6/976: dwrite d0/d4/fae [0,4194304] 0 2023-12-16T07:40:50.870 INFO:tasks.workunit.client.1.smithi133.stdout:6/977: fdatasync d0/d5e/d8c/f134 0 2023-12-16T07:40:50.870 INFO:tasks.workunit.client.1.smithi133.stdout:0/810: dwrite d2/d9/dc5/fd3 [0,4194304] 0 2023-12-16T07:40:50.870 INFO:tasks.workunit.client.1.smithi133.stdout:0/811: write d2/d17/d2b/f4b [5824524,95275] 0 2023-12-16T07:40:50.872 INFO:tasks.workunit.client.1.smithi133.stdout:4/914: mknod d3/d7/d38/dd5/da7/dbb/dd8/c130 0 2023-12-16T07:40:50.874 INFO:tasks.workunit.client.1.smithi133.stdout:4/915: write d3/d7/d1c/d2a/fb3 [3838349,29449] 0 2023-12-16T07:40:50.880 INFO:tasks.workunit.client.1.smithi133.stdout:9/836: getdents d15/d18/d2c/d68/da6 0 2023-12-16T07:40:50.880 INFO:tasks.workunit.client.1.smithi133.stdout:9/837: chown d15/d18/d2c/d3a/f10b 1 1 2023-12-16T07:40:50.880 INFO:tasks.workunit.client.1.smithi133.stdout:9/838: write d15/d18/d2c/f3e [1065519,59221] 0 2023-12-16T07:40:50.880 INFO:tasks.workunit.client.1.smithi133.stdout:9/839: chown d15/d42/d8d 2670388 1 2023-12-16T07:40:50.882 INFO:tasks.workunit.client.1.smithi133.stdout:3/605: creat d7/d8/d78/d43/d7f/d85/d8f/ff9 x:0 0 0 2023-12-16T07:40:50.882 INFO:tasks.workunit.client.1.smithi133.stdout:4/916: dread d3/fa [0,4194304] 0 2023-12-16T07:40:50.883 INFO:tasks.workunit.client.1.smithi133.stdout:2/784: rmdir da/d15/d1b/d83 39 2023-12-16T07:40:50.883 INFO:tasks.workunit.client.1.smithi133.stdout:2/785: fsync da/d1d/d60/d71/f37 0 2023-12-16T07:40:50.883 INFO:tasks.workunit.client.1.smithi133.stdout:2/786: write da/d1d/faf [888816,98751] 0 2023-12-16T07:40:50.883 INFO:tasks.workunit.client.1.smithi133.stdout:2/787: write da/d15/d17/d40/d98/f9a [956296,39981] 0 2023-12-16T07:40:50.884 INFO:tasks.workunit.client.1.smithi133.stdout:2/788: read - da/d15/fd2 zero size 2023-12-16T07:40:50.885 INFO:tasks.workunit.client.1.smithi133.stdout:2/789: dread da/d1d/d60/d74/ddb/fe6 [0,4194304] 0 2023-12-16T07:40:50.885 INFO:tasks.workunit.client.1.smithi133.stdout:2/790: fsync da/d15/d1b/f44 0 2023-12-16T07:40:50.885 INFO:tasks.workunit.client.1.smithi133.stdout:2/791: read da/d15/d17/f84 [2215179,120766] 0 2023-12-16T07:40:50.890 INFO:tasks.workunit.client.1.smithi133.stdout:0/812: truncate d2/d17/d2b/d31/d4d/fb1 686731 0 2023-12-16T07:40:50.890 INFO:tasks.workunit.client.1.smithi133.stdout:0/813: fsync d2/d9/db/fe 0 2023-12-16T07:40:50.890 INFO:tasks.workunit.client.1.smithi133.stdout:0/814: fsync d2/d9/d12/f14 0 2023-12-16T07:40:50.891 INFO:tasks.workunit.client.1.smithi133.stdout:9/840: link d15/d18/d5b/l65 d15/d42/d8d/da9/l116 0 2023-12-16T07:40:50.892 INFO:tasks.workunit.client.1.smithi133.stdout:3/606: truncate d7/d8/d1c/f67 469158 0 2023-12-16T07:40:50.893 INFO:tasks.workunit.client.1.smithi133.stdout:0/815: dread d2/d9/d20/f29 [4194304,4194304] 0 2023-12-16T07:40:50.894 INFO:tasks.workunit.client.1.smithi133.stdout:4/917: unlink d3/d7/d1a/l81 0 2023-12-16T07:40:50.895 INFO:tasks.workunit.client.1.smithi133.stdout:9/841: write d15/d18/d2c/d3a/f49 [756755,96186] 0 2023-12-16T07:40:50.896 INFO:tasks.workunit.client.1.smithi133.stdout:9/842: write d15/d18/de8/f7b [2594346,37748] 0 2023-12-16T07:40:50.897 INFO:tasks.workunit.client.1.smithi133.stdout:3/607: mknod d7/d8/d1d/dc9/cfa 0 2023-12-16T07:40:50.901 INFO:tasks.workunit.client.1.smithi133.stdout:4/918: mknod d3/d7/d38/d57/d75/de4/c131 0 2023-12-16T07:40:50.902 INFO:tasks.workunit.client.1.smithi133.stdout:2/792: dwrite da/f5c [0,4194304] 0 2023-12-16T07:40:50.902 INFO:tasks.workunit.client.1.smithi133.stdout:2/793: truncate da/d1d/d60/d71/d3a/f7d 902818 0 2023-12-16T07:40:50.903 INFO:tasks.workunit.client.1.smithi133.stdout:2/794: write da/dc2/fd0 [1519637,52762] 0 2023-12-16T07:40:50.907 INFO:tasks.workunit.client.1.smithi133.stdout:3/608: mkdir d7/d8/d1c/ddb/dfb 0 2023-12-16T07:40:50.910 INFO:tasks.workunit.client.1.smithi133.stdout:9/843: dwrite d15/d18/d2c/d3a/f6f [0,4194304] 0 2023-12-16T07:40:50.910 INFO:tasks.workunit.client.1.smithi133.stdout:9/844: write d15/d18/d4d/d7e/fa8 [1081288,118746] 0 2023-12-16T07:40:50.910 INFO:tasks.workunit.client.1.smithi133.stdout:4/919: dread d3/d7/d1c/d2a/d91/dbe/d121/dc8/f65 [0,4194304] 0 2023-12-16T07:40:50.911 INFO:tasks.workunit.client.1.smithi133.stdout:4/920: read d3/d7/f86 [2307224,64428] 0 2023-12-16T07:40:50.911 INFO:tasks.workunit.client.1.smithi133.stdout:4/921: chown d3/d7/d1c/d2a/d91/dbe/dfa/d89/lab 2696 1 2023-12-16T07:40:50.911 INFO:tasks.workunit.client.1.smithi133.stdout:0/816: rename d2/d9/d4c to d2/d9/d10a 0 2023-12-16T07:40:50.919 INFO:tasks.workunit.client.1.smithi133.stdout:2/795: creat da/d1d/d60/d74/ff4 x:0 0 0 2023-12-16T07:40:50.919 INFO:tasks.workunit.client.1.smithi133.stdout:2/796: dread - da/d15/d1b/d43/fcd zero size 2023-12-16T07:40:50.919 INFO:tasks.workunit.client.1.smithi133.stdout:3/609: creat d7/d8/d1d/dc9/ffc x:0 0 0 2023-12-16T07:40:50.920 INFO:tasks.workunit.client.1.smithi133.stdout:2/797: write f4 [4188752,4667] 0 2023-12-16T07:40:50.922 INFO:tasks.workunit.client.1.smithi133.stdout:3/610: dread d7/d8/d78/f69 [4194304,4194304] 0 2023-12-16T07:40:50.923 INFO:tasks.workunit.client.1.smithi133.stdout:9/845: rename d15/d18/d2c/d3a/f74 to d15/d18/d5b/d71/f117 0 2023-12-16T07:40:50.924 INFO:tasks.workunit.client.1.smithi133.stdout:9/846: write d15/d18/d2c/d3a/d8a/ff0 [1170209,109240] 0 2023-12-16T07:40:50.925 INFO:tasks.workunit.client.1.smithi133.stdout:9/847: write f0 [6435732,37242] 0 2023-12-16T07:40:50.925 INFO:tasks.workunit.client.1.smithi133.stdout:9/848: fsync f9 0 2023-12-16T07:40:50.925 INFO:tasks.workunit.client.1.smithi133.stdout:9/849: truncate d15/d18/d2c/d68/f83 2724882 0 2023-12-16T07:40:50.925 INFO:tasks.workunit.client.1.smithi133.stdout:9/850: write d15/d18/d80/ff2 [125555,122232] 0 2023-12-16T07:40:50.925 INFO:tasks.workunit.client.1.smithi133.stdout:9/851: chown d15/l1e 134 1 2023-12-16T07:40:50.925 INFO:tasks.workunit.client.1.smithi133.stdout:4/922: truncate d3/d7/d1a/f24 6201239 0 2023-12-16T07:40:50.938 INFO:tasks.workunit.client.1.smithi133.stdout:2/798: mknod da/d1d/d60/d71/cf5 0 2023-12-16T07:40:50.940 INFO:tasks.workunit.client.1.smithi133.stdout:3/611: creat d7/d8/d72/d86/ffd x:0 0 0 2023-12-16T07:40:50.941 INFO:tasks.workunit.client.1.smithi133.stdout:5/629: sync 2023-12-16T07:40:50.942 INFO:tasks.workunit.client.1.smithi133.stdout:1/936: sync 2023-12-16T07:40:50.944 INFO:tasks.workunit.client.1.smithi133.stdout:8/672: sync 2023-12-16T07:40:50.945 INFO:tasks.workunit.client.1.smithi133.stdout:9/852: creat d15/d18/d2c/d68/da3/dcb/f118 x:0 0 0 2023-12-16T07:40:50.947 INFO:tasks.workunit.client.1.smithi133.stdout:4/923: dwrite d3/d7/d1c/d2a/fb3 [0,4194304] 0 2023-12-16T07:40:50.947 INFO:tasks.workunit.client.1.smithi133.stdout:4/924: write d3/d7/d1c/d2a/d91/dbe/dfa/fda [1068746,105032] 0 2023-12-16T07:40:50.949 INFO:tasks.workunit.client.1.smithi133.stdout:3/612: creat d7/d8/d78/de0/ffe x:0 0 0 2023-12-16T07:40:50.950 INFO:tasks.workunit.client.1.smithi133.stdout:4/925: write d3/d7/d38/d57/d75/f8a [2128163,13066] 0 2023-12-16T07:40:50.950 INFO:tasks.workunit.client.1.smithi133.stdout:4/926: chown d3/d7/d1a/c6f 43 1 2023-12-16T07:40:50.950 INFO:tasks.workunit.client.1.smithi133.stdout:5/630: mknod d1/de/d67/cdf 0 2023-12-16T07:40:50.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/937: dread d0/d12/f40 [0,4194304] 0 2023-12-16T07:40:50.954 INFO:tasks.workunit.client.1.smithi133.stdout:8/673: symlink d9/d2d/dc1/ldb 0 2023-12-16T07:40:50.954 INFO:tasks.workunit.client.1.smithi133.stdout:8/674: fsync d9/d10/f91 0 2023-12-16T07:40:50.956 INFO:tasks.workunit.client.1.smithi133.stdout:9/853: creat d15/d18/d4d/d94/dab/f119 x:0 0 0 2023-12-16T07:40:50.958 INFO:tasks.workunit.client.1.smithi133.stdout:3/613: mknod d7/d8/d1c/d2b/d2d/cff 0 2023-12-16T07:40:50.959 INFO:tasks.workunit.client.1.smithi133.stdout:2/799: dwrite da/d1d/d60/d71/d3a/d61/fb5 [0,4194304] 0 2023-12-16T07:40:50.962 INFO:tasks.workunit.client.1.smithi133.stdout:4/927: mkdir d3/d7/d38/dd5/dac/dbc/d129/d132 0 2023-12-16T07:40:50.962 INFO:tasks.workunit.client.1.smithi133.stdout:4/928: write d3/d7/d38/d57/f66 [4899676,92673] 0 2023-12-16T07:40:50.964 INFO:tasks.workunit.client.1.smithi133.stdout:1/938: truncate d0/d12/dda/de0/fe9 599901 0 2023-12-16T07:40:50.964 INFO:tasks.workunit.client.1.smithi133.stdout:1/939: dread - d0/d12/d51/dac/d24/d32/d56/d59/d66/f92 zero size 2023-12-16T07:40:50.964 INFO:tasks.workunit.client.1.smithi133.stdout:1/940: write d0/d12/d51/db6/f13f [521544,59618] 0 2023-12-16T07:40:50.967 INFO:tasks.workunit.client.1.smithi133.stdout:9/854: creat d15/d18/d80/dfc/f11a x:0 0 0 2023-12-16T07:40:50.968 INFO:tasks.workunit.client.1.smithi133.stdout:3/614: symlink d7/d8/d1d/d2a/d63/l100 0 2023-12-16T07:40:50.970 INFO:tasks.workunit.client.1.smithi133.stdout:2/800: creat da/d15/d17/d40/d98/ff6 x:0 0 0 2023-12-16T07:40:50.972 INFO:tasks.workunit.client.1.smithi133.stdout:4/929: creat d3/d7/d38/dd5/d63/d96/f133 x:0 0 0 2023-12-16T07:40:50.974 INFO:tasks.workunit.client.1.smithi133.stdout:1/941: mkdir d0/d12/d51/dac/d24/d32/d56/d59/d104/d144 0 2023-12-16T07:40:50.976 INFO:tasks.workunit.client.1.smithi133.stdout:8/675: rename d9/d10/d39/d48/d92/cbf to d9/d11/cdc 0 2023-12-16T07:40:50.977 INFO:tasks.workunit.client.1.smithi133.stdout:8/676: dread d9/d11/f7d [0,4194304] 0 2023-12-16T07:40:50.982 INFO:tasks.workunit.client.1.smithi133.stdout:1/942: read d0/d12/d51/dac/ff [2220924,101488] 0 2023-12-16T07:40:50.983 INFO:tasks.workunit.client.1.smithi133.stdout:1/943: write d0/da/d3d/dce/fd2 [4445420,111638] 0 2023-12-16T07:40:50.983 INFO:tasks.workunit.client.1.smithi133.stdout:9/855: creat d15/d18/d2c/d68/da6/f11b x:0 0 0 2023-12-16T07:40:50.983 INFO:tasks.workunit.client.1.smithi133.stdout:9/856: chown d15/d18/d2c/d68/fc4 140770 1 2023-12-16T07:40:50.983 INFO:tasks.workunit.client.1.smithi133.stdout:1/944: write d0/d1c/d102/d70/f112 [895987,126194] 0 2023-12-16T07:40:50.983 INFO:tasks.workunit.client.1.smithi133.stdout:3/615: rmdir d7/d8/d72/d77 39 2023-12-16T07:40:50.984 INFO:tasks.workunit.client.1.smithi133.stdout:5/631: dwrite d1/de/d35/dc6/db4/fbc [0,4194304] 0 2023-12-16T07:40:50.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/801: link da/d1d/d60/d71/d2e/f57 da/d1d/d60/d71/d2e/ff7 0 2023-12-16T07:40:50.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/802: fsync da/d15/f9f 0 2023-12-16T07:40:50.986 INFO:tasks.workunit.client.1.smithi133.stdout:4/930: mkdir d3/d7/db1/d12c/d134 0 2023-12-16T07:40:50.986 INFO:tasks.workunit.client.1.smithi133.stdout:4/931: chown d3/d7/d38/dd5/da7/ff7 132168717 1 2023-12-16T07:40:50.986 INFO:tasks.workunit.client.1.smithi133.stdout:4/932: stat d3/fd9 0 2023-12-16T07:40:50.986 INFO:tasks.workunit.client.1.smithi133.stdout:4/933: fdatasync d3/d7/d1a/d111/f127 0 2023-12-16T07:40:50.991 INFO:tasks.workunit.client.1.smithi133.stdout:9/857: getdents d15/d18/d5b/d71/d78/dfa/d101 0 2023-12-16T07:40:50.991 INFO:tasks.workunit.client.1.smithi133.stdout:9/858: readlink d15/lb9 0 2023-12-16T07:40:50.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/632: creat d1/de/d35/dc6/db4/d71/fe0 x:0 0 0 2023-12-16T07:40:50.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/633: chown d1/de/d35/dc6/c8a 357 1 2023-12-16T07:40:51.002 INFO:tasks.workunit.client.1.smithi133.stdout:2/803: symlink da/d1d/d60/d71/d2e/d47/lf8 0 2023-12-16T07:40:51.004 INFO:tasks.workunit.client.1.smithi133.stdout:9/859: dread d15/f35 [0,4194304] 0 2023-12-16T07:40:51.009 INFO:tasks.workunit.client.1.smithi133.stdout:4/934: symlink d3/d7/d1c/d2a/d91/dd1/l135 0 2023-12-16T07:40:51.009 INFO:tasks.workunit.client.1.smithi133.stdout:4/935: fdatasync d3/d7/d38/dd5/dac/dbc/feb 0 2023-12-16T07:40:51.010 INFO:tasks.workunit.client.1.smithi133.stdout:9/860: mknod d15/d18/d5b/d71/d78/d6e/c11c 0 2023-12-16T07:40:51.012 INFO:tasks.workunit.client.1.smithi133.stdout:4/936: link d3/d7/d38/dd5/da7/daa/dc6/fed d3/d7/d1c/d2a/d91/dbe/dd0/f136 0 2023-12-16T07:40:51.012 INFO:tasks.workunit.client.1.smithi133.stdout:4/937: dread - d3/fd9 zero size 2023-12-16T07:40:51.012 INFO:tasks.workunit.client.1.smithi133.stdout:4/938: truncate d3/d7/d38/d57/d75/f88 1063405 0 2023-12-16T07:40:51.014 INFO:tasks.workunit.client.1.smithi133.stdout:9/861: getdents d15/d42/d8d/db7 0 2023-12-16T07:40:51.015 INFO:tasks.workunit.client.1.smithi133.stdout:5/634: rmdir d1/d54/ddb 0 2023-12-16T07:40:51.017 INFO:tasks.workunit.client.1.smithi133.stdout:9/862: creat d15/d18/d2c/d3a/da4/f11d x:0 0 0 2023-12-16T07:40:51.018 INFO:tasks.workunit.client.1.smithi133.stdout:9/863: creat d15/d18/d5b/d71/d78/f11e x:0 0 0 2023-12-16T07:40:51.020 INFO:tasks.workunit.client.1.smithi133.stdout:9/864: rename d15/d18/d2c/d3a/f6f to d15/d18/d2c/d3a/da4/df3/f11f 0 2023-12-16T07:40:51.020 INFO:tasks.workunit.client.1.smithi133.stdout:2/804: dwrite da/d15/dbe/db2/fe1 [0,4194304] 0 2023-12-16T07:40:51.023 INFO:tasks.workunit.client.1.smithi133.stdout:9/865: symlink d15/l120 0 2023-12-16T07:40:51.025 INFO:tasks.workunit.client.1.smithi133.stdout:9/866: unlink d15/d18/f5e 0 2023-12-16T07:40:51.029 INFO:tasks.workunit.client.1.smithi133.stdout:4/939: dread d3/d7/d1c/d2a/d91/dbe/d121/dc8/fb9 [0,4194304] 0 2023-12-16T07:40:51.029 INFO:tasks.workunit.client.1.smithi133.stdout:1/945: dwrite d0/d12/d51/db6/f13f [0,4194304] 0 2023-12-16T07:40:51.029 INFO:tasks.workunit.client.1.smithi133.stdout:4/940: getdents d3/d7/d38/d57/d75/de4 0 2023-12-16T07:40:51.029 INFO:tasks.workunit.client.1.smithi133.stdout:3/616: dwrite d7/d8/d78/de0/ffe [0,4194304] 0 2023-12-16T07:40:51.029 INFO:tasks.workunit.client.1.smithi133.stdout:4/941: truncate d3/d7/d1c/d2a/d91/dbe/fce 145359 0 2023-12-16T07:40:51.030 INFO:tasks.workunit.client.1.smithi133.stdout:1/946: truncate d0/da/f3a 845700 0 2023-12-16T07:40:51.033 INFO:tasks.workunit.client.1.smithi133.stdout:3/617: unlink d7/d8/d1d/d2a/d63/f83 0 2023-12-16T07:40:51.034 INFO:tasks.workunit.client.1.smithi133.stdout:3/618: chown d7/d8/f84 53463226 1 2023-12-16T07:40:51.034 INFO:tasks.workunit.client.1.smithi133.stdout:3/619: write d7/d8/d1c/d87/ff7 [956218,72729] 0 2023-12-16T07:40:51.034 INFO:tasks.workunit.client.1.smithi133.stdout:4/942: creat d3/db6/f137 x:0 0 0 2023-12-16T07:40:51.036 INFO:tasks.workunit.client.1.smithi133.stdout:3/620: creat d7/d8/d1c/f101 x:0 0 0 2023-12-16T07:40:51.036 INFO:tasks.workunit.client.1.smithi133.stdout:3/621: fsync d7/d8/d1d/f40 0 2023-12-16T07:40:51.039 INFO:tasks.workunit.client.1.smithi133.stdout:4/943: mkdir d3/d7/d1a/d138 0 2023-12-16T07:40:51.039 INFO:tasks.workunit.client.1.smithi133.stdout:4/944: readlink d3/le1 0 2023-12-16T07:40:51.039 INFO:tasks.workunit.client.1.smithi133.stdout:1/947: dread d0/d1c/d37/f4a [0,4194304] 0 2023-12-16T07:40:51.041 INFO:tasks.workunit.client.1.smithi133.stdout:1/948: mknod d0/d1c/c145 0 2023-12-16T07:40:51.042 INFO:tasks.workunit.client.1.smithi133.stdout:3/622: write d7/d8/d1c/d2b/f15 [1487568,9945] 0 2023-12-16T07:40:51.044 INFO:tasks.workunit.client.1.smithi133.stdout:3/623: mknod d7/d8/d78/c102 0 2023-12-16T07:40:51.044 INFO:tasks.workunit.client.1.smithi133.stdout:3/624: write d7/d8/d78/d43/d7f/d85/d8f/ff9 [815352,52711] 0 2023-12-16T07:40:51.046 INFO:tasks.workunit.client.1.smithi133.stdout:3/625: getdents d7/d8/d1c/d2b/d2d 0 2023-12-16T07:40:51.055 INFO:tasks.workunit.client.1.smithi133.stdout:8/677: rmdir d9/d10/d39 39 2023-12-16T07:40:51.073 INFO:tasks.workunit.client.1.smithi133.stdout:5/635: rmdir d1/de/d35 39 2023-12-16T07:40:51.074 INFO:tasks.workunit.client.1.smithi133.stdout:5/636: chown d1/c6 228031756 1 2023-12-16T07:40:51.081 INFO:tasks.workunit.client.1.smithi133.stdout:9/867: rename d15/d18/d2c/d3a/da4/df3/f11f to d15/d18/f121 0 2023-12-16T07:40:51.082 INFO:tasks.workunit.client.1.smithi133.stdout:2/805: dwrite da/d1d/d60/d71/d2e/f57 [4194304,4194304] 0 2023-12-16T07:40:51.082 INFO:tasks.workunit.client.1.smithi133.stdout:2/806: write da/d15/d17/f36 [8856355,38930] 0 2023-12-16T07:40:51.083 INFO:tasks.workunit.client.1.smithi133.stdout:2/807: chown da/d1d/d60/d71/d3a/f7d 522469 1 2023-12-16T07:40:51.083 INFO:tasks.workunit.client.1.smithi133.stdout:2/808: chown da/d1d/faf 29340828 1 2023-12-16T07:40:51.084 INFO:tasks.workunit.client.1.smithi133.stdout:3/626: rename c1 to d7/d8/d1d/d2a/d5f/c103 0 2023-12-16T07:40:51.084 INFO:tasks.workunit.client.1.smithi133.stdout:3/627: write d7/d8/d1d/d2a/f94 [193225,18146] 0 2023-12-16T07:40:51.084 INFO:tasks.workunit.client.1.smithi133.stdout:4/945: dwrite d3/d7/d1c/d2a/d91/dbe/f12f [0,4194304] 0 2023-12-16T07:40:51.086 INFO:tasks.workunit.client.1.smithi133.stdout:8/678: dwrite d9/d10/f91 [0,4194304] 0 2023-12-16T07:40:51.086 INFO:tasks.workunit.client.1.smithi133.stdout:9/868: mknod d15/d18/d5b/d71/d78/dfa/dfb/c122 0 2023-12-16T07:40:51.086 INFO:tasks.workunit.client.1.smithi133.stdout:4/946: write d3/d7/d1c/d2a/d91/dbe/dd0/f11f [400328,63688] 0 2023-12-16T07:40:51.086 INFO:tasks.workunit.client.1.smithi133.stdout:9/869: fsync d15/f17 0 2023-12-16T07:40:51.086 INFO:tasks.workunit.client.1.smithi133.stdout:9/870: chown d15/d18/d2c/d68/db2/cbe 3 1 2023-12-16T07:40:51.089 INFO:tasks.workunit.client.1.smithi133.stdout:5/637: rename d1/de/d52/d95 to d1/d54/de1 0 2023-12-16T07:40:51.089 INFO:tasks.workunit.client.1.smithi133.stdout:8/679: rename d9/d10/d39/d48/d44/d69 to d9/d10/d39/d48/d44/d69/ddd 22 2023-12-16T07:40:51.089 INFO:tasks.workunit.client.1.smithi133.stdout:5/638: dread - d1/de/d57/dd6/fde zero size 2023-12-16T07:40:51.089 INFO:tasks.workunit.client.1.smithi133.stdout:5/639: chown d1/d1c/l28 5 1 2023-12-16T07:40:51.089 INFO:tasks.workunit.client.1.smithi133.stdout:5/640: chown d1/d1c/d80/d8d/lb5 1558250 1 2023-12-16T07:40:51.098 INFO:tasks.workunit.client.1.smithi133.stdout:4/947: write d3/d7/d1c/d2a/d91/dbe/d121/dc8/ff2 [2706614,51222] 0 2023-12-16T07:40:51.100 INFO:tasks.workunit.client.1.smithi133.stdout:5/641: creat d1/de/fe2 x:0 0 0 2023-12-16T07:40:51.102 INFO:tasks.workunit.client.1.smithi133.stdout:5/642: write d1/de/ff [3728258,79829] 0 2023-12-16T07:40:51.103 INFO:tasks.workunit.client.1.smithi133.stdout:5/643: write d1/de/d35/dc6/fb2 [659327,9548] 0 2023-12-16T07:40:51.108 INFO:tasks.workunit.client.1.smithi133.stdout:5/644: dread d1/de/d57/f8c [0,4194304] 0 2023-12-16T07:40:51.110 INFO:tasks.workunit.client.1.smithi133.stdout:5/645: rename d1/d18/l33 to d1/de/d35/le3 0 2023-12-16T07:40:51.110 INFO:tasks.workunit.client.1.smithi133.stdout:5/646: stat d1/de/d57/d74/la0 0 2023-12-16T07:40:51.120 INFO:tasks.workunit.client.1.smithi133.stdout:5/647: dread d1/f34 [0,4194304] 0 2023-12-16T07:40:51.120 INFO:tasks.workunit.client.1.smithi133.stdout:5/648: write d1/d4b/fc4 [794540,96601] 0 2023-12-16T07:40:51.121 INFO:tasks.workunit.client.1.smithi133.stdout:5/649: creat d1/de/dae/fe4 x:0 0 0 2023-12-16T07:40:51.122 INFO:tasks.workunit.client.1.smithi133.stdout:5/650: readlink d1/d54/de1/lce 0 2023-12-16T07:40:51.133 INFO:tasks.workunit.client.1.smithi133.stdout:3/628: dwrite d7/d8/d78/d43/d7f/fab [0,4194304] 0 2023-12-16T07:40:51.135 INFO:tasks.workunit.client.1.smithi133.stdout:2/809: dwrite da/d1d/d60/d71/d2e/ff7 [4194304,4194304] 0 2023-12-16T07:40:51.137 INFO:tasks.workunit.client.1.smithi133.stdout:3/629: symlink d7/d8/d1c/ddb/l104 0 2023-12-16T07:40:51.137 INFO:tasks.workunit.client.1.smithi133.stdout:9/871: dwrite d15/d18/f24 [4194304,4194304] 0 2023-12-16T07:40:51.142 INFO:tasks.workunit.client.1.smithi133.stdout:2/810: creat da/d15/ff9 x:0 0 0 2023-12-16T07:40:51.143 INFO:tasks.workunit.client.1.smithi133.stdout:3/630: mknod d7/c105 0 2023-12-16T07:40:51.146 INFO:tasks.workunit.client.1.smithi133.stdout:4/948: write d3/d7/d38/d57/f5f [656993,31052] 0 2023-12-16T07:40:51.155 INFO:tasks.workunit.client.1.smithi133.stdout:5/651: getdents d1/de/dae 0 2023-12-16T07:40:51.155 INFO:tasks.workunit.client.1.smithi133.stdout:5/652: stat d1/d54 0 2023-12-16T07:40:51.155 INFO:tasks.workunit.client.1.smithi133.stdout:5/653: stat d1/de/d35/dc6/db4/d71/f93 0 2023-12-16T07:40:51.157 INFO:tasks.workunit.client.1.smithi133.stdout:9/872: dread d15/d18/d2c/f46 [0,4194304] 0 2023-12-16T07:40:51.157 INFO:tasks.workunit.client.1.smithi133.stdout:9/873: fdatasync d15/d18/d2c/d68/da3/faf 0 2023-12-16T07:40:51.168 INFO:tasks.workunit.client.1.smithi133.stdout:2/811: creat da/dc2/ffa x:0 0 0 2023-12-16T07:40:51.168 INFO:tasks.workunit.client.1.smithi133.stdout:2/812: fdatasync da/d15/dbe/db2/fe1 0 2023-12-16T07:40:51.168 INFO:tasks.workunit.client.1.smithi133.stdout:2/813: write da/f10 [4834417,87332] 0 2023-12-16T07:40:51.170 INFO:tasks.workunit.client.1.smithi133.stdout:3/631: rmdir d7/d8/d72 39 2023-12-16T07:40:51.170 INFO:tasks.workunit.client.1.smithi133.stdout:3/632: chown d7/d8/d78/d43/d5b/f89 60791 1 2023-12-16T07:40:51.175 INFO:tasks.workunit.client.1.smithi133.stdout:9/874: dread d15/f26 [4194304,4194304] 0 2023-12-16T07:40:51.176 INFO:tasks.workunit.client.1.smithi133.stdout:4/949: mkdir d3/d7/d38/dd5/da7/dbb/dd8/d139 0 2023-12-16T07:40:51.176 INFO:tasks.workunit.client.1.smithi133.stdout:4/950: dread - d3/db6/fd6 zero size 2023-12-16T07:40:51.178 INFO:tasks.workunit.client.1.smithi133.stdout:2/814: mkdir da/d15/dbe/dfb 0 2023-12-16T07:40:51.181 INFO:tasks.workunit.client.1.smithi133.stdout:3/633: symlink d7/d8/d1d/dc9/l106 0 2023-12-16T07:40:51.183 INFO:tasks.workunit.client.1.smithi133.stdout:9/875: symlink d15/d18/d5b/d71/d78/d6e/l123 0 2023-12-16T07:40:51.183 INFO:tasks.workunit.client.1.smithi133.stdout:9/876: fsync f13 0 2023-12-16T07:40:51.186 INFO:tasks.workunit.client.1.smithi133.stdout:4/951: unlink d3/d7/d1c/c123 0 2023-12-16T07:40:51.190 INFO:tasks.workunit.client.1.smithi133.stdout:2/815: symlink da/d15/d1b/d43/d85/lfc 0 2023-12-16T07:40:51.191 INFO:tasks.workunit.client.1.smithi133.stdout:4/952: symlink d3/d7/d38/d57/d75/de4/l13a 0 2023-12-16T07:40:51.191 INFO:tasks.workunit.client.1.smithi133.stdout:2/816: fsync da/f11 0 2023-12-16T07:40:51.191 INFO:tasks.workunit.client.1.smithi133.stdout:2/817: chown da/d15/d17/f84 125277 1 2023-12-16T07:40:51.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/978: sync 2023-12-16T07:40:51.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/817: sync 2023-12-16T07:40:51.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/979: readlink d0/d5e/d75/dad/lc9 0 2023-12-16T07:40:51.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/980: read - d0/d5e/d75/d81/d99/f115 zero size 2023-12-16T07:40:51.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/981: fsync d0/d5e/d75/d81/d99/fd6 0 2023-12-16T07:40:51.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/818: write d2/d17/d2b/d31/d63/fb7 [1799802,103872] 0 2023-12-16T07:40:51.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/819: dread - d2/d17/d2b/d31/d4d/df9/fff zero size 2023-12-16T07:40:51.197 INFO:tasks.workunit.client.1.smithi133.stdout:2/818: creat da/d50/db6/ffd x:0 0 0 2023-12-16T07:40:51.199 INFO:tasks.workunit.client.1.smithi133.stdout:9/877: dread d15/d18/d80/f98 [0,4194304] 0 2023-12-16T07:40:51.199 INFO:tasks.workunit.client.1.smithi133.stdout:2/819: read da/d1d/d60/d71/d3a/fa1 [1488303,13611] 0 2023-12-16T07:40:51.199 INFO:tasks.workunit.client.1.smithi133.stdout:0/820: write d2/d9/d20/d5e/d92/fc0 [7407491,1114] 0 2023-12-16T07:40:51.204 INFO:tasks.workunit.client.1.smithi133.stdout:9/878: getdents d15/d18/d5b/d71/d78 0 2023-12-16T07:40:51.204 INFO:tasks.workunit.client.1.smithi133.stdout:0/821: mknod d2/d17/d2b/d31/d63/d98/c10b 0 2023-12-16T07:40:51.204 INFO:tasks.workunit.client.1.smithi133.stdout:0/822: truncate d2/d9/d12/f3f 4555446 0 2023-12-16T07:40:51.205 INFO:tasks.workunit.client.1.smithi133.stdout:2/820: symlink da/d15/d17/d40/lfe 0 2023-12-16T07:40:51.207 INFO:tasks.workunit.client.1.smithi133.stdout:0/823: write d2/d9/d8f/f6e [1699226,98514] 0 2023-12-16T07:40:51.208 INFO:tasks.workunit.client.1.smithi133.stdout:0/824: chown d2/d9/d12/d35/fb3 20953 1 2023-12-16T07:40:51.208 INFO:tasks.workunit.client.1.smithi133.stdout:9/879: creat d15/d18/d2c/d68/da6/f124 x:0 0 0 2023-12-16T07:40:51.208 INFO:tasks.workunit.client.1.smithi133.stdout:9/880: rmdir d15/d18/d5b/d71/d78/dfa 39 2023-12-16T07:40:51.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:50 smithi049 ceph-mon[111939]: Reconfiguring grafana.smithi049 (dependencies changed)... 2023-12-16T07:40:51.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:50 smithi049 ceph-mon[111939]: Reconfiguring daemon grafana.smithi049 on smithi049 2023-12-16T07:40:51.209 INFO:tasks.workunit.client.1.smithi133.stdout:0/825: dread d2/d9/d12/d45/d9e/da0/fae [0,4194304] 0 2023-12-16T07:40:51.210 INFO:tasks.workunit.client.1.smithi133.stdout:0/826: truncate d2/d17/f26 3869368 0 2023-12-16T07:40:51.213 INFO:tasks.workunit.client.1.smithi133.stdout:0/827: creat d2/d9/d12/d45/d9e/f10c x:0 0 0 2023-12-16T07:40:51.218 INFO:tasks.workunit.client.1.smithi133.stdout:5/654: dwrite d1/d4b/fc8 [0,4194304] 0 2023-12-16T07:40:51.218 INFO:tasks.workunit.client.1.smithi133.stdout:5/655: dread - d1/de/d35/dc6/db4/d71/fe0 zero size 2023-12-16T07:40:51.221 INFO:tasks.workunit.client.1.smithi133.stdout:5/656: creat d1/de/d35/dc6/db4/fe5 x:0 0 0 2023-12-16T07:40:51.222 INFO:tasks.workunit.client.1.smithi133.stdout:5/657: truncate d1/d1c/d80/d64/dc1/dca/fcb 382620 0 2023-12-16T07:40:51.222 INFO:tasks.workunit.client.1.smithi133.stdout:2/821: dread da/d1d/d60/d71/f37 [0,4194304] 0 2023-12-16T07:40:51.224 INFO:tasks.workunit.client.1.smithi133.stdout:2/822: mknod da/d15/dbe/db2/cff 0 2023-12-16T07:40:51.224 INFO:tasks.workunit.client.1.smithi133.stdout:2/823: chown da/d15/dbe/db2/fe1 16849 1 2023-12-16T07:40:51.225 INFO:tasks.workunit.client.1.smithi133.stdout:2/824: mkdir da/d15/d1b/d83/da3/dd4/dda/d100 0 2023-12-16T07:40:51.225 INFO:tasks.workunit.client.1.smithi133.stdout:2/825: fsync da/d15/f8a 0 2023-12-16T07:40:51.225 INFO:tasks.workunit.client.1.smithi133.stdout:3/634: dwrite d7/d8/d1c/f41 [0,4194304] 0 2023-12-16T07:40:51.226 INFO:tasks.workunit.client.1.smithi133.stdout:2/826: rmdir da/d50/db6/dc4 39 2023-12-16T07:40:51.229 INFO:tasks.workunit.client.1.smithi133.stdout:3/635: creat d7/d8/d78/d43/f107 x:0 0 0 2023-12-16T07:40:51.232 INFO:tasks.workunit.client.1.smithi133.stdout:3/636: creat d7/d8/d1c/d87/f108 x:0 0 0 2023-12-16T07:40:51.264 INFO:tasks.workunit.client.1.smithi133.stdout:4/953: dwrite d3/d7/d38/d57/d67/f6a [0,4194304] 0 2023-12-16T07:40:51.264 INFO:tasks.workunit.client.1.smithi133.stdout:4/954: chown d3/d7/d38/dd5/d63/d96 5093714 1 2023-12-16T07:40:51.264 INFO:tasks.workunit.client.1.smithi133.stdout:9/881: dwrite d15/f17 [0,4194304] 0 2023-12-16T07:40:51.265 INFO:tasks.workunit.client.1.smithi133.stdout:5/658: dwrite d1/f3d [0,4194304] 0 2023-12-16T07:40:51.265 INFO:tasks.workunit.client.1.smithi133.stdout:2/827: dwrite da/d1d/d60/d71/d2e/d47/f5e [0,4194304] 0 2023-12-16T07:40:51.265 INFO:tasks.workunit.client.1.smithi133.stdout:6/982: dwrite d0/d4/d21/d8a/d93/fa5 [0,4194304] 0 2023-12-16T07:40:51.268 INFO:tasks.workunit.client.1.smithi133.stdout:4/955: creat d3/d7/d38/dd5/da7/f13b x:0 0 0 2023-12-16T07:40:51.268 INFO:tasks.workunit.client.1.smithi133.stdout:4/956: fdatasync d3/d7/d38/dd5/da7/daa/dc6/d113/f122 0 2023-12-16T07:40:51.275 INFO:tasks.workunit.client.1.smithi133.stdout:5/659: rename d1/f75 to d1/d1c/fe6 0 2023-12-16T07:40:51.283 INFO:tasks.workunit.client.1.smithi133.stdout:2/828: truncate da/d15/d17/fa0 1591866 0 2023-12-16T07:40:51.283 INFO:tasks.workunit.client.1.smithi133.stdout:2/829: fdatasync da/d1d/f29 0 2023-12-16T07:40:51.283 INFO:tasks.workunit.client.1.smithi133.stdout:2/830: readlink da/d1d/d60/d71/d2e/d47/le4 0 2023-12-16T07:40:51.286 INFO:tasks.workunit.client.1.smithi133.stdout:6/983: rename d0/d5e/d8c/dc5 to d0/d5e/d8c/d107/d13c/d140 0 2023-12-16T07:40:51.286 INFO:tasks.workunit.client.1.smithi133.stdout:6/984: dread - d0/d5e/d75/d81/d99/f115 zero size 2023-12-16T07:40:51.289 INFO:tasks.workunit.client.1.smithi133.stdout:5/660: mkdir d1/d54/de1/de7 0 2023-12-16T07:40:51.290 INFO:tasks.workunit.client.1.smithi133.stdout:2/831: mkdir da/d1d/d60/d71/d2e/d47/d52/d80/d101 0 2023-12-16T07:40:51.291 INFO:tasks.workunit.client.1.smithi133.stdout:2/832: read da/d1d/f96 [160328,70479] 0 2023-12-16T07:40:51.294 INFO:tasks.workunit.client.1.smithi133.stdout:6/985: symlink d0/d5e/d75/dad/l141 0 2023-12-16T07:40:51.296 INFO:tasks.workunit.client.1.smithi133.stdout:5/661: truncate d1/de/f32 1986989 0 2023-12-16T07:40:51.296 INFO:tasks.workunit.client.1.smithi133.stdout:5/662: write d1/de/d57/dd6/fde [575180,54635] 0 2023-12-16T07:40:51.300 INFO:tasks.workunit.client.1.smithi133.stdout:6/986: creat d0/d4/d21/d35/d7e/f142 x:0 0 0 2023-12-16T07:40:51.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/663: creat d1/de/d52/da3/fe8 x:0 0 0 2023-12-16T07:40:51.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/664: write d1/d1c/f40 [1037793,105149] 0 2023-12-16T07:40:51.301 INFO:tasks.workunit.client.1.smithi133.stdout:6/987: creat d0/d5e/d75/d81/d120/f143 x:0 0 0 2023-12-16T07:40:51.302 INFO:tasks.workunit.client.1.smithi133.stdout:5/665: symlink d1/d1c/d80/d64/dc1/le9 0 2023-12-16T07:40:51.306 INFO:tasks.workunit.client.1.smithi133.stdout:5/666: symlink d1/lea 0 2023-12-16T07:40:51.311 INFO:tasks.workunit.client.1.smithi133.stdout:9/882: dwrite d15/d42/d8d/ff9 [0,4194304] 0 2023-12-16T07:40:51.312 INFO:tasks.workunit.client.1.smithi133.stdout:9/883: write d15/d18/d2c/f31 [1977872,23280] 0 2023-12-16T07:40:51.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/957: dwrite d3/d7/fb [0,4194304] 0 2023-12-16T07:40:51.331 INFO:tasks.workunit.client.1.smithi133.stdout:2/833: dwrite da/d1d/d60/d71/d2e/d59/f7e [0,4194304] 0 2023-12-16T07:40:51.331 INFO:tasks.workunit.client.1.smithi133.stdout:6/988: dwrite d0/d4/d21/d35/d4e/d84/f58 [4194304,4194304] 0 2023-12-16T07:40:51.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/667: dwrite d1/de/d52/da3/fe8 [0,4194304] 0 2023-12-16T07:40:51.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/668: read - d1/de/d35/dc6/db4/fe5 zero size 2023-12-16T07:40:51.335 INFO:tasks.workunit.client.1.smithi133.stdout:2/834: symlink da/d1d/d60/d71/l102 0 2023-12-16T07:40:51.335 INFO:tasks.workunit.client.1.smithi133.stdout:2/835: chown da/d1d/d60/d71/l53 425 1 2023-12-16T07:40:51.335 INFO:tasks.workunit.client.1.smithi133.stdout:2/836: write da/f9c [4304177,53202] 0 2023-12-16T07:40:51.336 INFO:tasks.workunit.client.1.smithi133.stdout:6/989: rename d0/d4/d21/d35/d4e/l96 to d0/d4/d21/d35/d4e/d84/d69/l144 0 2023-12-16T07:40:51.336 INFO:tasks.workunit.client.1.smithi133.stdout:5/669: rename d1/d1c/d80 to d1/d1c/d80/da7/deb 22 2023-12-16T07:40:51.337 INFO:tasks.workunit.client.1.smithi133.stdout:6/990: chown d0/d4/d21/d35/d4e/d84/f58 64558 1 2023-12-16T07:40:51.337 INFO:tasks.workunit.client.1.smithi133.stdout:6/991: read - d0/d4/d21/d35/d4e/d84/d69/dbd/dcb/f118 zero size 2023-12-16T07:40:51.338 INFO:tasks.workunit.client.1.smithi133.stdout:5/670: write d1/de/ff [3160823,62025] 0 2023-12-16T07:40:51.344 INFO:tasks.workunit.client.1.smithi133.stdout:2/837: symlink da/d1d/d60/d74/l103 0 2023-12-16T07:40:51.346 INFO:tasks.workunit.client.1.smithi133.stdout:6/992: mknod d0/d4/d21/d35/d7e/dac/c145 0 2023-12-16T07:40:51.346 INFO:tasks.workunit.client.1.smithi133.stdout:6/993: fdatasync d0/d4/d21/d8a/da4/f10a 0 2023-12-16T07:40:51.348 INFO:tasks.workunit.client.1.smithi133.stdout:2/838: creat da/d15/d17/d40/f104 x:0 0 0 2023-12-16T07:40:51.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/994: truncate d0/d5e/f6f 2474856 0 2023-12-16T07:40:51.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/995: chown d0/d4/d21/d8a/da4/cc0 679 1 2023-12-16T07:40:51.351 INFO:tasks.workunit.client.1.smithi133.stdout:2/839: rmdir da/d15/d1b/d83/da3 39 2023-12-16T07:40:51.352 INFO:tasks.workunit.client.1.smithi133.stdout:9/884: write d15/d18/d2c/f46 [1611537,115483] 0 2023-12-16T07:40:51.352 INFO:tasks.workunit.client.1.smithi133.stdout:9/885: stat d15/d18 0 2023-12-16T07:40:51.352 INFO:tasks.workunit.client.1.smithi133.stdout:9/886: truncate d15/d18/d2c/d68/da6/f11b 488878 0 2023-12-16T07:40:51.354 INFO:tasks.workunit.client.1.smithi133.stdout:4/958: dwrite d3/d7/d1a/f24 [0,4194304] 0 2023-12-16T07:40:51.354 INFO:tasks.workunit.client.1.smithi133.stdout:6/996: symlink d0/d5e/d8c/d107/d11f/l146 0 2023-12-16T07:40:51.355 INFO:tasks.workunit.client.1.smithi133.stdout:6/997: read d0/f3a [125352,43219] 0 2023-12-16T07:40:51.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/887: mknod d15/d42/c125 0 2023-12-16T07:40:51.359 INFO:tasks.workunit.client.1.smithi133.stdout:9/888: fdatasync d15/d18/d2c/d68/da6/f124 0 2023-12-16T07:40:51.360 INFO:tasks.workunit.client.1.smithi133.stdout:6/998: symlink d0/d5e/d8c/d107/d13c/l147 0 2023-12-16T07:40:51.365 INFO:tasks.workunit.client.1.smithi133.stdout:6/999: creat d0/d4/d21/d35/d4e/d127/f148 x:0 0 0 2023-12-16T07:40:51.366 INFO:tasks.workunit.client.1.smithi133.stdout:9/889: dread d15/d18/d80/f96 [0,4194304] 0 2023-12-16T07:40:51.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:50 smithi133 ceph-mon[120445]: Reconfiguring grafana.smithi049 (dependencies changed)... 2023-12-16T07:40:51.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:50 smithi133 ceph-mon[120445]: Reconfiguring daemon grafana.smithi049 on smithi049 2023-12-16T07:40:51.367 INFO:tasks.workunit.client.1.smithi133.stdout:4/959: dread d3/d7/d38/dd5/da7/ff7 [0,4194304] 0 2023-12-16T07:40:51.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/960: chown d3/d7/d1a/d111/d118 2715 1 2023-12-16T07:40:51.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/961: write d3/d7/d38/dd5/dac/dbc/feb [795369,26291] 0 2023-12-16T07:40:51.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/962: read d3/d7/d38/d57/d67/f92 [3593006,109291] 0 2023-12-16T07:40:51.368 INFO:tasks.workunit.client.1.smithi133.stdout:9/890: symlink d15/d18/de8/l126 0 2023-12-16T07:40:51.370 INFO:tasks.workunit.client.1.smithi133.stdout:9/891: mkdir d15/d18/d2c/d3a/da4/d127 0 2023-12-16T07:40:51.372 INFO:tasks.workunit.client.1.smithi133.stdout:9/892: write d15/d18/f36 [3850578,6733] 0 2023-12-16T07:40:51.374 INFO:tasks.workunit.client.1.smithi133.stdout:9/893: mknod d15/d18/d80/d97/dba/c128 0 2023-12-16T07:40:51.374 INFO:tasks.workunit.client.1.smithi133.stdout:9/894: getdents d15/d18/d5b/d71/d78/dfa/d101/d111 0 2023-12-16T07:40:51.375 INFO:tasks.workunit.client.1.smithi133.stdout:9/895: unlink d15/d18/d5b/d71/d78/dfa/d101/c110 0 2023-12-16T07:40:51.376 INFO:tasks.workunit.client.1.smithi133.stdout:2/840: getdents da/d15/d17/d40 0 2023-12-16T07:40:51.378 INFO:tasks.workunit.client.1.smithi133.stdout:2/841: write da/d15/fa8 [1008322,17292] 0 2023-12-16T07:40:51.378 INFO:tasks.workunit.client.1.smithi133.stdout:2/842: fdatasync da/d1d/f6a 0 2023-12-16T07:40:51.379 INFO:tasks.workunit.client.1.smithi133.stdout:5/671: dwrite d1/de/d57/dd6/fde [0,4194304] 0 2023-12-16T07:40:51.379 INFO:tasks.workunit.client.1.smithi133.stdout:1/949: sync 2023-12-16T07:40:51.379 INFO:tasks.workunit.client.1.smithi133.stdout:1/950: write d0/d12/d51/dac/d24/d32/fb2 [216421,126997] 0 2023-12-16T07:40:51.379 INFO:tasks.workunit.client.1.smithi133.stdout:9/896: mkdir d15/d18/d2c/d3a/da4/d129 0 2023-12-16T07:40:51.388 INFO:tasks.workunit.client.1.smithi133.stdout:4/963: dwrite d3/d7/f86 [4194304,4194304] 0 2023-12-16T07:40:51.389 INFO:tasks.workunit.client.1.smithi133.stdout:5/672: rename d1/f1f to d1/de/d35/dc6/fec 0 2023-12-16T07:40:51.391 INFO:tasks.workunit.client.1.smithi133.stdout:1/951: getdents d0/d1c/d9b 0 2023-12-16T07:40:51.395 INFO:tasks.workunit.client.1.smithi133.stdout:2/843: dwrite da/d1d/f72 [0,4194304] 0 2023-12-16T07:40:51.395 INFO:tasks.workunit.client.1.smithi133.stdout:2/844: write da/d1d/d60/d71/d2e/ff2 [996968,16943] 0 2023-12-16T07:40:51.397 INFO:tasks.workunit.client.1.smithi133.stdout:4/964: mknod d3/d7/d1a/d138/c13c 0 2023-12-16T07:40:51.397 INFO:tasks.workunit.client.1.smithi133.stdout:4/965: readlink d3/l80 0 2023-12-16T07:40:51.401 INFO:tasks.workunit.client.1.smithi133.stdout:5/673: getdents d1/de/d57/dc5 0 2023-12-16T07:40:51.401 INFO:tasks.workunit.client.1.smithi133.stdout:5/674: truncate d1/d1c/d80/d8d/fb8 1039564 0 2023-12-16T07:40:51.402 INFO:tasks.workunit.client.1.smithi133.stdout:9/897: rename d15/d18/d5b/d71/d78/dfa to d15/d18/d80/dfc/d12a 0 2023-12-16T07:40:51.404 INFO:tasks.workunit.client.1.smithi133.stdout:1/952: creat d0/d12/f146 x:0 0 0 2023-12-16T07:40:51.408 INFO:tasks.workunit.client.1.smithi133.stdout:2/845: mknod da/dc2/c105 0 2023-12-16T07:40:51.410 INFO:tasks.workunit.client.1.smithi133.stdout:4/966: creat d3/d7/d38/d57/f13d x:0 0 0 2023-12-16T07:40:51.411 INFO:tasks.workunit.client.1.smithi133.stdout:5/675: symlink d1/de/d57/dd6/led 0 2023-12-16T07:40:51.413 INFO:tasks.workunit.client.1.smithi133.stdout:9/898: rename d15/d18/d80/dfc/d12a/d115 to d15/d18/d5b/d71/d78/d6e/d12b 0 2023-12-16T07:40:51.413 INFO:tasks.workunit.client.1.smithi133.stdout:8/680: sync 2023-12-16T07:40:51.414 INFO:tasks.workunit.client.1.smithi133.stdout:1/953: dread d0/da/d3d/d41/df0/d135/f109 [0,4194304] 0 2023-12-16T07:40:51.414 INFO:tasks.workunit.client.1.smithi133.stdout:1/954: fdatasync d0/f17 0 2023-12-16T07:40:51.414 INFO:tasks.workunit.client.1.smithi133.stdout:2/846: truncate da/f5c 3425944 0 2023-12-16T07:40:51.414 INFO:tasks.workunit.client.1.smithi133.stdout:2/847: chown da/d1d/fd3 188602 1 2023-12-16T07:40:51.415 INFO:tasks.workunit.client.1.smithi133.stdout:4/967: unlink d3/d7/d38/c56 0 2023-12-16T07:40:51.416 INFO:tasks.workunit.client.1.smithi133.stdout:5/676: mknod d1/de/d67/cee 0 2023-12-16T07:40:51.418 INFO:tasks.workunit.client.1.smithi133.stdout:9/899: symlink d15/d42/d8d/l12c 0 2023-12-16T07:40:51.418 INFO:tasks.workunit.client.1.smithi133.stdout:5/677: dread d1/f17 [0,4194304] 0 2023-12-16T07:40:51.418 INFO:tasks.workunit.client.1.smithi133.stdout:3/637: sync 2023-12-16T07:40:51.418 INFO:tasks.workunit.client.1.smithi133.stdout:0/828: sync 2023-12-16T07:40:51.420 INFO:tasks.workunit.client.1.smithi133.stdout:5/678: write d1/d18/d2c/f9a [751207,101462] 0 2023-12-16T07:40:51.422 INFO:tasks.workunit.client.1.smithi133.stdout:1/955: truncate d0/d1c/d37/f9e 2352200 0 2023-12-16T07:40:51.424 INFO:tasks.workunit.client.1.smithi133.stdout:2/848: symlink da/d15/d1b/d83/da3/dd4/l106 0 2023-12-16T07:40:51.449 INFO:tasks.workunit.client.1.smithi133.stdout:4/968: creat d3/d7/d38/dd5/dac/df1/f13e x:0 0 0 2023-12-16T07:40:51.464 INFO:tasks.workunit.client.1.smithi133.stdout:3/638: symlink d7/d8/d1d/d2a/d62/de3/l109 0 2023-12-16T07:40:51.498 INFO:tasks.workunit.client.1.smithi133.stdout:5/679: rmdir d1/d4b/da5 39 2023-12-16T07:40:51.541 INFO:tasks.workunit.client.1.smithi133.stdout:1/956: creat d0/d1c/d102/d70/d105/f147 x:0 0 0 2023-12-16T07:40:51.550 INFO:tasks.workunit.client.1.smithi133.stdout:4/969: creat d3/d7/d38/dd5/f13f x:0 0 0 2023-12-16T07:40:51.550 INFO:tasks.workunit.client.1.smithi133.stdout:4/970: write d3/d7/d1c/d2a/d91/dbe/fd2 [425192,248] 0 2023-12-16T07:40:51.551 INFO:tasks.workunit.client.1.smithi133.stdout:4/971: stat d3/d7/d38/dd5/dac/df1 0 2023-12-16T07:40:51.553 INFO:tasks.workunit.client.1.smithi133.stdout:9/900: dread d15/d18/d2c/fdb [0,4194304] 0 2023-12-16T07:40:51.557 INFO:tasks.workunit.client.1.smithi133.stdout:3/639: link d7/d8/d78/d43/d7f/d85/d8f/fae d7/d8/d78/de0/f10a 0 2023-12-16T07:40:51.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/640: write d7/d8/d1d/f90 [1186003,66431] 0 2023-12-16T07:40:51.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/641: chown d7/d8/d78/l65 1429 1 2023-12-16T07:40:51.560 INFO:tasks.workunit.client.1.smithi133.stdout:3/642: write f3 [3515553,5435] 0 2023-12-16T07:40:51.568 INFO:tasks.workunit.client.1.smithi133.stdout:1/957: creat d0/d12/d51/db6/dde/f148 x:0 0 0 2023-12-16T07:40:51.571 INFO:tasks.workunit.client.1.smithi133.stdout:9/901: mkdir d15/d18/d4d/d94/dcc/d12d 0 2023-12-16T07:40:51.574 INFO:tasks.workunit.client.1.smithi133.stdout:3/643: creat d7/d8/d78/de0/f10b x:0 0 0 2023-12-16T07:40:51.574 INFO:tasks.workunit.client.1.smithi133.stdout:3/644: write d7/d8/d78/d43/d7f/d85/d8f/fa1 [100590,5094] 0 2023-12-16T07:40:51.576 INFO:tasks.workunit.client.1.smithi133.stdout:1/958: truncate d0/d12/f3f 2600724 0 2023-12-16T07:40:51.577 INFO:tasks.workunit.client.1.smithi133.stdout:9/902: mknod d15/d18/d2c/d3a/d8a/c12e 0 2023-12-16T07:40:51.578 INFO:tasks.workunit.client.1.smithi133.stdout:3/645: symlink d7/d8/d1d/dc9/l10c 0 2023-12-16T07:40:51.578 INFO:tasks.workunit.client.1.smithi133.stdout:3/646: truncate d7/d8/d1d/dc9/ffc 885611 0 2023-12-16T07:40:51.578 INFO:tasks.workunit.client.1.smithi133.stdout:3/647: chown d7/d8/d1d/dc9/ffc 15821 1 2023-12-16T07:40:51.580 INFO:tasks.workunit.client.1.smithi133.stdout:1/959: mkdir d0/d12/d51/dac/d24/d32/d56/d59/d149 0 2023-12-16T07:40:51.583 INFO:tasks.workunit.client.1.smithi133.stdout:1/960: write d0/f46 [254396,125831] 0 2023-12-16T07:40:51.597 INFO:tasks.workunit.client.1.smithi133.stdout:1/961: dwrite d0/d12/d51/dac/f21 [0,4194304] 0 2023-12-16T07:40:51.622 INFO:tasks.workunit.client.1.smithi133.stdout:8/681: rename d9/d11/d33/f7e to d9/dc/fde 0 2023-12-16T07:40:51.624 INFO:tasks.workunit.client.1.smithi133.stdout:8/682: creat d9/d10/d39/d48/d44/d6e/d78/da6/fdf x:0 0 0 2023-12-16T07:40:51.625 INFO:tasks.workunit.client.1.smithi133.stdout:4/972: mknod d3/d7/d38/dd5/da7/dbb/c140 0 2023-12-16T07:40:51.625 INFO:tasks.workunit.client.1.smithi133.stdout:4/973: write d3/db6/dee/ff8 [263966,109319] 0 2023-12-16T07:40:51.634 INFO:tasks.workunit.client.1.smithi133.stdout:9/903: creat d15/d42/d8d/f12f x:0 0 0 2023-12-16T07:40:51.635 INFO:tasks.workunit.client.1.smithi133.stdout:9/904: write d15/d18/d4d/d7e/fc5 [3255322,21804] 0 2023-12-16T07:40:51.636 INFO:tasks.workunit.client.1.smithi133.stdout:9/905: write f9 [2565107,104780] 0 2023-12-16T07:40:51.638 INFO:tasks.workunit.client.1.smithi133.stdout:9/906: write d15/d18/f2f [2960054,5716] 0 2023-12-16T07:40:51.643 INFO:tasks.workunit.client.1.smithi133.stdout:9/907: dread d15/d18/d4d/d7e/f95 [0,4194304] 0 2023-12-16T07:40:51.645 INFO:tasks.workunit.client.1.smithi133.stdout:4/974: dwrite d3/d7/f5c [4194304,4194304] 0 2023-12-16T07:40:51.645 INFO:tasks.workunit.client.1.smithi133.stdout:4/975: stat d3/d7/d1a/l3c 0 2023-12-16T07:40:51.645 INFO:tasks.workunit.client.1.smithi133.stdout:4/976: fdatasync d3/d7/d38/d57/fc0 0 2023-12-16T07:40:51.647 INFO:tasks.workunit.client.1.smithi133.stdout:4/977: creat d3/d7/d38/dd5/da7/dbb/f141 x:0 0 0 2023-12-16T07:40:51.647 INFO:tasks.workunit.client.1.smithi133.stdout:4/978: fsync d3/d7/d38/dd5/f8f 0 2023-12-16T07:40:51.647 INFO:tasks.workunit.client.1.smithi133.stdout:4/979: fsync d3/d7/d1c/d2a/d91/dbe/d121/dc8/f65 0 2023-12-16T07:40:51.647 INFO:tasks.workunit.client.1.smithi133.stdout:4/980: write d3/d7/d1c/f73 [1390043,24353] 0 2023-12-16T07:40:51.678 INFO:tasks.workunit.client.1.smithi133.stdout:5/680: symlink d1/lef 0 2023-12-16T07:40:51.678 INFO:tasks.workunit.client.1.smithi133.stdout:5/681: write d1/de/d35/fbb [1501249,40527] 0 2023-12-16T07:40:51.679 INFO:tasks.workunit.client.1.smithi133.stdout:5/682: getdents d1/de/d57/dd6 0 2023-12-16T07:40:51.687 INFO:tasks.workunit.client.1.smithi133.stdout:9/908: mkdir d15/d18/d4d/d130 0 2023-12-16T07:40:51.688 INFO:tasks.workunit.client.1.smithi133.stdout:9/909: creat d15/d18/d80/dfc/f131 x:0 0 0 2023-12-16T07:40:51.688 INFO:tasks.workunit.client.1.smithi133.stdout:9/910: fsync d15/d42/d8d/da9/fc3 0 2023-12-16T07:40:51.693 INFO:tasks.workunit.client.1.smithi133.stdout:9/911: creat d15/d42/d8d/f132 x:0 0 0 2023-12-16T07:40:51.693 INFO:tasks.workunit.client.1.smithi133.stdout:9/912: chown d15/d18/d5b 519948 1 2023-12-16T07:40:51.693 INFO:tasks.workunit.client.1.smithi133.stdout:9/913: write d15/f29 [1986904,87818] 0 2023-12-16T07:40:51.695 INFO:tasks.workunit.client.1.smithi133.stdout:9/914: creat d15/d18/d2c/d68/f133 x:0 0 0 2023-12-16T07:40:51.695 INFO:tasks.workunit.client.1.smithi133.stdout:5/683: dwrite d1/d54/de1/fa6 [0,4194304] 0 2023-12-16T07:40:51.702 INFO:tasks.workunit.client.1.smithi133.stdout:5/684: unlink d1/de/d35/dc6/db4/fe5 0 2023-12-16T07:40:51.705 INFO:tasks.workunit.client.1.smithi133.stdout:5/685: truncate d1/f1a 992975 0 2023-12-16T07:40:51.705 INFO:tasks.workunit.client.1.smithi133.stdout:5/686: fsync d1/de/d35/dc6/fec 0 2023-12-16T07:40:51.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/962: rename d0/da/l63 to d0/da/d3d/dce/d12f/d122/l14a 0 2023-12-16T07:40:51.709 INFO:tasks.workunit.client.1.smithi133.stdout:5/687: getdents d1/de/d57/d74 0 2023-12-16T07:40:51.712 INFO:tasks.workunit.client.1.smithi133.stdout:4/981: rename d3/d7/d38/dd5/da7/dbb/c12e to d3/d7/d1c/d2a/d91/dbe/dfa/d89/c142 0 2023-12-16T07:40:51.712 INFO:tasks.workunit.client.1.smithi133.stdout:4/982: chown d3/d7/d38/d57/d75/de4/c131 152 1 2023-12-16T07:40:51.713 INFO:tasks.workunit.client.1.smithi133.stdout:3/648: unlink d7/d8/l1a 0 2023-12-16T07:40:51.713 INFO:tasks.workunit.client.1.smithi133.stdout:1/963: creat d0/d12/d51/db6/dde/f14b x:0 0 0 2023-12-16T07:40:51.713 INFO:tasks.workunit.client.1.smithi133.stdout:1/964: write d0/d1c/d37/d103/f131 [602289,62822] 0 2023-12-16T07:40:51.715 INFO:tasks.workunit.client.1.smithi133.stdout:5/688: mknod d1/d54/cf0 0 2023-12-16T07:40:51.717 INFO:tasks.workunit.client.1.smithi133.stdout:1/965: dread d0/d12/d51/dac/d24/f6b [0,4194304] 0 2023-12-16T07:40:51.717 INFO:tasks.workunit.client.1.smithi133.stdout:1/966: write d0/d12/d51/dac/d24/d32/ffc [120055,81804] 0 2023-12-16T07:40:51.718 INFO:tasks.workunit.client.1.smithi133.stdout:9/915: rename d15/lb9 to d15/d18/d5b/d71/d78/d6e/d9b/l134 0 2023-12-16T07:40:51.718 INFO:tasks.workunit.client.1.smithi133.stdout:1/967: write d0/d12/d51/dac/fd [1342511,112868] 0 2023-12-16T07:40:51.719 INFO:tasks.workunit.client.1.smithi133.stdout:1/968: fdatasync d0/da/d3d/dce/df5/f11f 0 2023-12-16T07:40:51.722 INFO:tasks.workunit.client.1.smithi133.stdout:4/983: dread d3/d7/d38/d57/d67/f92 [0,4194304] 0 2023-12-16T07:40:51.724 INFO:tasks.workunit.client.1.smithi133.stdout:9/916: mknod d15/d18/d2c/d3a/da4/d127/c135 0 2023-12-16T07:40:51.724 INFO:tasks.workunit.client.1.smithi133.stdout:5/689: truncate d1/d18/f4e 6258400 0 2023-12-16T07:40:51.724 INFO:tasks.workunit.client.1.smithi133.stdout:4/984: read d3/d7/d1c/d2a/d91/f117 [663134,37313] 0 2023-12-16T07:40:51.725 INFO:tasks.workunit.client.1.smithi133.stdout:4/985: stat d3/d7/d1c/d2a/d91/dbe/fce 0 2023-12-16T07:40:51.727 INFO:tasks.workunit.client.1.smithi133.stdout:3/649: dread d7/f23 [0,4194304] 0 2023-12-16T07:40:51.727 INFO:tasks.workunit.client.1.smithi133.stdout:3/650: truncate d7/d8/d1c/f31 1266854 0 2023-12-16T07:40:51.727 INFO:tasks.workunit.client.1.smithi133.stdout:3/651: write d7/d8/d1d/f52 [4354423,91907] 0 2023-12-16T07:40:51.727 INFO:tasks.workunit.client.1.smithi133.stdout:3/652: fsync d7/f47 0 2023-12-16T07:40:51.727 INFO:tasks.workunit.client.1.smithi133.stdout:3/653: write d7/d8/d1d/d2a/fca [1465121,35819] 0 2023-12-16T07:40:51.727 INFO:tasks.workunit.client.1.smithi133.stdout:3/654: chown c0 653639 1 2023-12-16T07:40:51.728 INFO:tasks.workunit.client.1.smithi133.stdout:3/655: write d7/d8/d1c/ddb/d95/f9f [2969298,89348] 0 2023-12-16T07:40:51.733 INFO:tasks.workunit.client.1.smithi133.stdout:9/917: dread f13 [0,4194304] 0 2023-12-16T07:40:51.752 INFO:tasks.workunit.client.1.smithi133.stdout:3/656: dwrite d7/d8/d1d/d2a/f94 [0,4194304] 0 2023-12-16T07:40:51.767 INFO:tasks.workunit.client.1.smithi133.stdout:3/657: dwrite d7/d8/fa [0,4194304] 0 2023-12-16T07:40:51.784 INFO:tasks.workunit.client.1.smithi133.stdout:3/658: dwrite d7/f23 [0,4194304] 0 2023-12-16T07:40:51.798 INFO:tasks.workunit.client.1.smithi133.stdout:4/986: creat d3/d7/d38/dd5/da7/dbb/f143 x:0 0 0 2023-12-16T07:40:51.800 INFO:tasks.workunit.client.1.smithi133.stdout:8/683: write d9/d10/d39/d48/d44/d6e/f94 [1137731,27584] 0 2023-12-16T07:40:51.804 INFO:tasks.workunit.client.1.smithi133.stdout:2/849: rmdir da/dc2 39 2023-12-16T07:40:51.804 INFO:tasks.workunit.client.1.smithi133.stdout:2/850: stat da/d15/lb0 0 2023-12-16T07:40:51.805 INFO:tasks.workunit.client.1.smithi133.stdout:2/851: write da/f10 [2920074,32383] 0 2023-12-16T07:40:51.813 INFO:tasks.workunit.client.1.smithi133.stdout:8/684: dwrite d9/d10/d39/d48/d44/d6e/f7c [0,4194304] 0 2023-12-16T07:40:51.813 INFO:tasks.workunit.client.1.smithi133.stdout:8/685: write d9/d11/f38 [330945,93475] 0 2023-12-16T07:40:51.813 INFO:tasks.workunit.client.1.smithi133.stdout:8/686: stat d9/d2d/dc1/l47 0 2023-12-16T07:40:51.816 INFO:tasks.workunit.client.1.smithi133.stdout:9/918: mkdir d15/d18/d2c/d3a/d8a/d136 0 2023-12-16T07:40:51.816 INFO:tasks.workunit.client.1.smithi133.stdout:9/919: fdatasync d15/d18/d4d/d7e/fc5 0 2023-12-16T07:40:51.823 INFO:tasks.workunit.client.1.smithi133.stdout:3/659: creat d7/d8/d1d/dc9/f10d x:0 0 0 2023-12-16T07:40:51.824 INFO:tasks.workunit.client.1.smithi133.stdout:2/852: creat da/d1d/d60/d71/d2e/d59/f107 x:0 0 0 2023-12-16T07:40:51.824 INFO:tasks.workunit.client.1.smithi133.stdout:2/853: chown da/dc2/fd0 90 1 2023-12-16T07:40:51.828 INFO:tasks.workunit.client.1.smithi133.stdout:8/687: link d9/d10/c19 d9/dc/de/ce0 0 2023-12-16T07:40:51.829 INFO:tasks.workunit.client.1.smithi133.stdout:9/920: truncate d15/d18/d80/ff2 186025 0 2023-12-16T07:40:51.830 INFO:tasks.workunit.client.1.smithi133.stdout:9/921: write d15/f39 [919102,102392] 0 2023-12-16T07:40:51.830 INFO:tasks.workunit.client.1.smithi133.stdout:9/922: chown d15/d42/d8d/l12c 124396710 1 2023-12-16T07:40:51.830 INFO:tasks.workunit.client.1.smithi133.stdout:3/660: mkdir d7/d8/d1c/ddb/dfb/d10e 0 2023-12-16T07:40:51.832 INFO:tasks.workunit.client.1.smithi133.stdout:0/829: sync 2023-12-16T07:40:51.833 INFO:tasks.workunit.client.1.smithi133.stdout:8/688: creat d9/d10/d39/d48/d44/d6e/d78/fe1 x:0 0 0 2023-12-16T07:40:51.833 INFO:tasks.workunit.client.1.smithi133.stdout:8/689: write d9/d10/d39/d48/d44/d6e/d78/da6/fd8 [636863,91886] 0 2023-12-16T07:40:51.834 INFO:tasks.workunit.client.1.smithi133.stdout:9/923: dread d15/f29 [0,4194304] 0 2023-12-16T07:40:51.834 INFO:tasks.workunit.client.1.smithi133.stdout:9/924: write d15/d18/d2c/d68/da3/fb5 [1137373,25345] 0 2023-12-16T07:40:51.835 INFO:tasks.workunit.client.1.smithi133.stdout:3/661: mkdir d7/d8/d1c/ddb/dfb/d10e/d10f 0 2023-12-16T07:40:51.837 INFO:tasks.workunit.client.1.smithi133.stdout:0/830: creat d2/d9/d12/d35/d4f/f10d x:0 0 0 2023-12-16T07:40:51.837 INFO:tasks.workunit.client.1.smithi133.stdout:0/831: stat d2/d17/d2b/d31/d63/d98 0 2023-12-16T07:40:51.837 INFO:tasks.workunit.client.1.smithi133.stdout:0/832: chown d2/d9/d12/f14 43 1 2023-12-16T07:40:51.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/690: rmdir d9/d11/d52 39 2023-12-16T07:40:51.839 INFO:tasks.workunit.client.1.smithi133.stdout:3/662: mknod d7/d8/d78/d43/d7f/c110 0 2023-12-16T07:40:51.846 INFO:tasks.workunit.client.1.smithi133.stdout:8/691: dread d9/d11/d42/f80 [0,4194304] 0 2023-12-16T07:40:51.854 INFO:tasks.workunit.client.1.smithi133.stdout:3/663: dwrite d7/d8/d72/d86/fcd [4194304,4194304] 0 2023-12-16T07:40:51.855 INFO:tasks.workunit.client.1.smithi133.stdout:5/690: link d1/d1c/f3b d1/de/d57/dc5/ff1 0 2023-12-16T07:40:51.858 INFO:tasks.workunit.client.1.smithi133.stdout:3/664: rename d7/d8/d1c/f26 to d7/d8/d1d/d2a/da2/f111 0 2023-12-16T07:40:51.877 INFO:tasks.workunit.client.1.smithi133.stdout:5/691: creat d1/de/dba/ff2 x:0 0 0 2023-12-16T07:40:51.879 INFO:tasks.workunit.client.1.smithi133.stdout:3/665: rename d7/d8/d1c/d2b/d2d/l91 to d7/d8/d1c/l112 0 2023-12-16T07:40:51.889 INFO:tasks.workunit.client.1.smithi133.stdout:5/692: creat d1/d18/d26/ff3 x:0 0 0 2023-12-16T07:40:51.892 INFO:tasks.workunit.client.1.smithi133.stdout:3/666: mknod d7/d8/d1d/dc9/c113 0 2023-12-16T07:40:51.892 INFO:tasks.workunit.client.1.smithi133.stdout:5/693: symlink d1/de/d57/lf4 0 2023-12-16T07:40:51.893 INFO:tasks.workunit.client.1.smithi133.stdout:5/694: truncate d1/de/d52/f78 1341643 0 2023-12-16T07:40:51.893 INFO:tasks.workunit.client.1.smithi133.stdout:3/667: dread d7/d8/f75 [0,4194304] 0 2023-12-16T07:40:51.894 INFO:tasks.workunit.client.1.smithi133.stdout:3/668: write d7/d8/d1d/f1e [101137,63801] 0 2023-12-16T07:40:51.895 INFO:tasks.workunit.client.1.smithi133.stdout:5/695: creat d1/d1c/d80/d64/dc1/dca/ff5 x:0 0 0 2023-12-16T07:40:51.898 INFO:tasks.workunit.client.1.smithi133.stdout:2/854: getdents da/d1d/d60/d71/d2e/d59 0 2023-12-16T07:40:51.898 INFO:tasks.workunit.client.1.smithi133.stdout:2/855: fdatasync da/d15/fa8 0 2023-12-16T07:40:51.899 INFO:tasks.workunit.client.1.smithi133.stdout:2/856: creat da/d15/dbe/dfb/f108 x:0 0 0 2023-12-16T07:40:51.901 INFO:tasks.workunit.client.1.smithi133.stdout:2/857: unlink da/d1d/f25 0 2023-12-16T07:40:51.911 INFO:tasks.workunit.client.1.smithi133.stdout:2/858: dread da/d1d/d60/d71/d2e/d59/f7e [0,4194304] 0 2023-12-16T07:40:51.913 INFO:tasks.workunit.client.1.smithi133.stdout:3/669: dwrite d7/d8/d1d/d2a/fd3 [0,4194304] 0 2023-12-16T07:40:51.913 INFO:tasks.workunit.client.1.smithi133.stdout:3/670: truncate d7/d8/d78/d43/d5b/f89 579043 0 2023-12-16T07:40:51.921 INFO:tasks.workunit.client.1.smithi133.stdout:3/671: dread d7/d8/d1c/fa0 [0,4194304] 0 2023-12-16T07:40:51.923 INFO:tasks.workunit.client.1.smithi133.stdout:3/672: symlink d7/d8/d72/d77/db5/l114 0 2023-12-16T07:40:51.923 INFO:tasks.workunit.client.1.smithi133.stdout:3/673: dread - d7/d8/d1c/ddb/fa3 zero size 2023-12-16T07:40:51.924 INFO:tasks.workunit.client.1.smithi133.stdout:5/696: dwrite d1/d1c/f77 [0,4194304] 0 2023-12-16T07:40:51.930 INFO:tasks.workunit.client.1.smithi133.stdout:5/697: getdents d1/d1c/d80/da7 0 2023-12-16T07:40:51.931 INFO:tasks.workunit.client.1.smithi133.stdout:5/698: fsync d1/de/f3c 0 2023-12-16T07:40:51.931 INFO:tasks.workunit.client.1.smithi133.stdout:2/859: dwrite da/d1d/d60/d71/f37 [0,4194304] 0 2023-12-16T07:40:51.932 INFO:tasks.workunit.client.1.smithi133.stdout:3/674: dread d7/d8/d1d/d2a/da2/f111 [0,4194304] 0 2023-12-16T07:40:51.936 INFO:tasks.workunit.client.1.smithi133.stdout:5/699: mknod d1/cf6 0 2023-12-16T07:40:51.937 INFO:tasks.workunit.client.1.smithi133.stdout:2/860: creat da/d1d/d60/d74/f109 x:0 0 0 2023-12-16T07:40:51.939 INFO:tasks.workunit.client.1.smithi133.stdout:2/861: write da/d1d/f87 [1992560,35668] 0 2023-12-16T07:40:51.960 INFO:tasks.workunit.client.1.smithi133.stdout:3/675: dwrite d7/d8/d78/de0/f10a [0,4194304] 0 2023-12-16T07:40:51.967 INFO:tasks.workunit.client.1.smithi133.stdout:5/700: dwrite d1/d4b/fc4 [0,4194304] 0 2023-12-16T07:40:51.968 INFO:tasks.workunit.client.1.smithi133.stdout:5/701: read d1/d1c/f38 [3946407,102090] 0 2023-12-16T07:40:51.968 INFO:tasks.workunit.client.1.smithi133.stdout:5/702: write d1/d18/d26/ff3 [661879,87385] 0 2023-12-16T07:40:51.968 INFO:tasks.workunit.client.1.smithi133.stdout:5/703: chown d1/d18/d2c 111 1 2023-12-16T07:40:51.971 INFO:tasks.workunit.client.1.smithi133.stdout:3/676: dread d7/d8/d78/de0/f10a [0,4194304] 0 2023-12-16T07:40:51.973 INFO:tasks.workunit.client.1.smithi133.stdout:3/677: rename d7/d8/d1d/le2 to d7/d8/d1c/d2b/l115 0 2023-12-16T07:40:51.973 INFO:tasks.workunit.client.1.smithi133.stdout:3/678: fsync d7/d8/d78/d43/f79 0 2023-12-16T07:40:51.976 INFO:tasks.workunit.client.1.smithi133.stdout:3/679: creat d7/d8/d72/f116 x:0 0 0 2023-12-16T07:40:51.979 INFO:tasks.workunit.client.1.smithi133.stdout:3/680: creat d7/d8/d78/de0/f117 x:0 0 0 2023-12-16T07:40:51.981 INFO:tasks.workunit.client.1.smithi133.stdout:3/681: mkdir d7/d8/d1c/ddb/dfb/d10e/d118 0 2023-12-16T07:40:51.984 INFO:tasks.workunit.client.1.smithi133.stdout:5/704: dwrite d1/d1c/d80/d64/dc1/dca/ff5 [0,4194304] 0 2023-12-16T07:40:51.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/705: write d1/de/d57/dd6/fde [238490,19856] 0 2023-12-16T07:40:51.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/706: write d1/d1c/d80/fdd [917463,68400] 0 2023-12-16T07:40:51.986 INFO:tasks.workunit.client.1.smithi133.stdout:5/707: write d1/d54/de1/fa6 [1653765,102985] 0 2023-12-16T07:40:51.991 INFO:tasks.workunit.client.1.smithi133.stdout:5/708: rename d1/de/dae to d1/d1c/df7 0 2023-12-16T07:40:51.991 INFO:tasks.workunit.client.1.smithi133.stdout:5/709: write d1/de/d35/dc6/db4/faa [107980,109013] 0 2023-12-16T07:40:51.993 INFO:tasks.workunit.client.1.smithi133.stdout:5/710: mkdir d1/d1c/d80/dd7/df8 0 2023-12-16T07:40:51.993 INFO:tasks.workunit.client.1.smithi133.stdout:5/711: chown d1/d1c/d80/d64/l90 147 1 2023-12-16T07:40:51.993 INFO:tasks.workunit.client.1.smithi133.stdout:5/712: write d1/d1c/d80/fd4 [952507,10349] 0 2023-12-16T07:40:51.993 INFO:tasks.workunit.client.1.smithi133.stdout:5/713: truncate d1/de/d52/f78 1960903 0 2023-12-16T07:40:51.996 INFO:tasks.workunit.client.1.smithi133.stdout:5/714: mkdir d1/d1c/d80/d64/dc1/df9 0 2023-12-16T07:40:51.997 INFO:tasks.workunit.client.1.smithi133.stdout:5/715: write d1/d18/d26/f9c [1754627,94997] 0 2023-12-16T07:40:52.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/969: sync 2023-12-16T07:40:52.018 INFO:tasks.workunit.client.1.smithi133.stdout:1/970: dwrite d0/d1c/d37/f137 [0,4194304] 0 2023-12-16T07:40:52.018 INFO:tasks.workunit.client.1.smithi133.stdout:1/971: readlink d0/lc 0 2023-12-16T07:40:52.019 INFO:tasks.workunit.client.1.smithi133.stdout:1/972: read d0/d12/d51/dac/d24/d32/d56/d59/f12e [1782142,101977] 0 2023-12-16T07:40:52.019 INFO:tasks.workunit.client.1.smithi133.stdout:1/973: truncate d0/da/d3d/d41/f83 546708 0 2023-12-16T07:40:52.021 INFO:tasks.workunit.client.1.smithi133.stdout:1/974: mkdir d0/d12/d51/dac/d24/d14c 0 2023-12-16T07:40:52.022 INFO:tasks.workunit.client.1.smithi133.stdout:1/975: write d0/d12/d51/dac/f38 [1042352,31698] 0 2023-12-16T07:40:52.034 INFO:tasks.workunit.client.1.smithi133.stdout:1/976: dwrite d0/d1c/f5c [0,4194304] 0 2023-12-16T07:40:52.040 INFO:tasks.workunit.client.1.smithi133.stdout:1/977: truncate d0/d12/dda/de0/fe9 66197 0 2023-12-16T07:40:52.064 INFO:tasks.workunit.client.1.smithi133.stdout:1/978: dwrite d0/da/f3a [0,4194304] 0 2023-12-16T07:40:52.065 INFO:tasks.workunit.client.1.smithi133.stdout:1/979: truncate d0/dd4/f115 1809656 0 2023-12-16T07:40:52.066 INFO:tasks.workunit.client.1.smithi133.stdout:1/980: mknod d0/d12/d11d/c14d 0 2023-12-16T07:40:52.070 INFO:tasks.workunit.client.1.smithi133.stdout:1/981: dread d0/d12/d51/dac/d24/fae [0,4194304] 0 2023-12-16T07:40:52.070 INFO:tasks.workunit.client.1.smithi133.stdout:1/982: write d0/da/d3d/dce/df5/f11f [396191,5741] 0 2023-12-16T07:40:52.086 INFO:tasks.workunit.client.1.smithi133.stdout:1/983: dwrite d0/d12/d51/dac/d24/d32/f86 [0,4194304] 0 2023-12-16T07:40:52.087 INFO:tasks.workunit.client.1.smithi133.stdout:1/984: rmdir d0/da/d3d/dce/df5/d123 39 2023-12-16T07:40:52.110 INFO:tasks.workunit.client.1.smithi133.stdout:4/987: sync 2023-12-16T07:40:52.112 INFO:tasks.workunit.client.1.smithi133.stdout:4/988: rename d3/d7/d1c/d2a/d91/f117 to d3/d7/d38/dd5/da7/daa/dc6/d10b/f144 0 2023-12-16T07:40:52.112 INFO:tasks.workunit.client.1.smithi133.stdout:4/989: readlink d3/d7/d38/dd5/da7/daa/l110 0 2023-12-16T07:40:52.112 INFO:tasks.workunit.client.1.smithi133.stdout:4/990: fsync d3/d7/d38/d57/d67/f92 0 2023-12-16T07:40:52.113 INFO:tasks.workunit.client.1.smithi133.stdout:4/991: symlink d3/d7/d1c/d2a/d91/dbe/d121/dc8/l145 0 2023-12-16T07:40:52.116 INFO:tasks.workunit.client.1.smithi133.stdout:4/992: getdents d3/d7/d38/dd5/da7/daa/dc6/d10b/d100 0 2023-12-16T07:40:52.117 INFO:tasks.workunit.client.1.smithi133.stdout:4/993: unlink d3/d7/d38/dd5/da7/daa/dc6/fe3 0 2023-12-16T07:40:52.120 INFO:tasks.workunit.client.1.smithi133.stdout:4/994: rename d3/d7/d1a/f9c to d3/d7/d1c/d2a/d91/dbe/dfa/d89/f146 0 2023-12-16T07:40:52.121 INFO:tasks.workunit.client.1.smithi133.stdout:4/995: symlink d3/d7/d38/dd5/da7/daa/dc6/d113/l147 0 2023-12-16T07:40:52.122 INFO:tasks.workunit.client.1.smithi133.stdout:4/996: creat d3/d7/d38/dd5/dac/dcf/f148 x:0 0 0 2023-12-16T07:40:52.137 INFO:tasks.workunit.client.1.smithi133.stdout:4/997: dwrite d3/d7/d1c/d2a/d91/dbe/fce [0,4194304] 0 2023-12-16T07:40:52.137 INFO:tasks.workunit.client.1.smithi133.stdout:4/998: dread - d3/d7/db1/f104 zero size 2023-12-16T07:40:52.142 INFO:tasks.workunit.client.1.smithi133.stdout:4/999: creat d3/d7/d1c/d2a/d91/dbe/dfa/f149 x:0 0 0 2023-12-16T07:40:52.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:51 smithi049 ceph-mon[111939]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 110 MiB/s rd, 221 MiB/s wr, 392 op/s 2023-12-16T07:40:52.238 INFO:tasks.workunit.client.1.smithi133.stdout:9/925: sync 2023-12-16T07:40:52.238 INFO:tasks.workunit.client.1.smithi133.stdout:8/692: sync 2023-12-16T07:40:52.238 INFO:tasks.workunit.client.1.smithi133.stdout:0/833: sync 2023-12-16T07:40:52.239 INFO:tasks.workunit.client.1.smithi133.stdout:0/834: truncate d2/d9/d12/d35/d4f/d93/fbc 2373967 0 2023-12-16T07:40:52.248 INFO:tasks.workunit.client.1.smithi133.stdout:8/693: dread d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:52.249 INFO:tasks.workunit.client.1.smithi133.stdout:0/835: read d2/d9/d12/d35/fb3 [2343509,25290] 0 2023-12-16T07:40:52.249 INFO:tasks.workunit.client.1.smithi133.stdout:9/926: dread d15/d18/d4d/d7e/ffe [0,4194304] 0 2023-12-16T07:40:52.249 INFO:tasks.workunit.client.1.smithi133.stdout:9/927: read d15/d18/d2c/fad [3283739,38611] 0 2023-12-16T07:40:52.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/694: mknod d9/d85/dd6/ce2 0 2023-12-16T07:40:52.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/695: write d9/d10/d39/fa1 [387152,35476] 0 2023-12-16T07:40:52.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/696: chown d9/dc/d27/l90 80197 1 2023-12-16T07:40:52.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/697: read d9/d11/d42/f62 [2793423,99480] 0 2023-12-16T07:40:52.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/698: readlink d9/dc/de/l5b 0 2023-12-16T07:40:52.255 INFO:tasks.workunit.client.1.smithi133.stdout:0/836: link d2/d17/d2b/d67/f73 d2/d17/dc2/f10e 0 2023-12-16T07:40:52.259 INFO:tasks.workunit.client.1.smithi133.stdout:9/928: getdents d15/d42/d8d 0 2023-12-16T07:40:52.262 INFO:tasks.workunit.client.1.smithi133.stdout:8/699: unlink d9/d11/f16 0 2023-12-16T07:40:52.262 INFO:tasks.workunit.client.1.smithi133.stdout:8/700: dread - d9/dc/de/fd7 zero size 2023-12-16T07:40:52.268 INFO:tasks.workunit.client.1.smithi133.stdout:9/929: dread d15/d18/d2c/fad [0,4194304] 0 2023-12-16T07:40:52.270 INFO:tasks.workunit.client.1.smithi133.stdout:0/837: dwrite d2/d17/d2b/f59 [0,4194304] 0 2023-12-16T07:40:52.271 INFO:tasks.workunit.client.1.smithi133.stdout:9/930: link d15/d18/d2c/d68/da3/dcb/cdd d15/d18/de8/c137 0 2023-12-16T07:40:52.272 INFO:tasks.workunit.client.1.smithi133.stdout:0/838: rmdir d2/d9/d12/d45 39 2023-12-16T07:40:52.275 INFO:tasks.workunit.client.1.smithi133.stdout:9/931: mkdir d15/d18/d5b/d71/d138 0 2023-12-16T07:40:52.275 INFO:tasks.workunit.client.1.smithi133.stdout:9/932: stat ca 0 2023-12-16T07:40:52.277 INFO:tasks.workunit.client.1.smithi133.stdout:0/839: creat d2/d17/d2b/d31/d4d/d101/f10f x:0 0 0 2023-12-16T07:40:52.277 INFO:tasks.workunit.client.1.smithi133.stdout:0/840: chown d2/d9/d20/fb0 849637 1 2023-12-16T07:40:52.277 INFO:tasks.workunit.client.1.smithi133.stdout:8/701: dwrite d9/d10/d39/d48/d44/d6e/d78/fc5 [0,4194304] 0 2023-12-16T07:40:52.277 INFO:tasks.workunit.client.1.smithi133.stdout:8/702: fdatasync d9/d11/d42/f62 0 2023-12-16T07:40:52.278 INFO:tasks.workunit.client.1.smithi133.stdout:9/933: mknod d15/d18/d80/dfc/d12a/dfb/d103/c139 0 2023-12-16T07:40:52.279 INFO:tasks.workunit.client.1.smithi133.stdout:9/934: read d15/d18/d5b/d71/f117 [274730,22352] 0 2023-12-16T07:40:52.279 INFO:tasks.workunit.client.1.smithi133.stdout:9/935: dread - d15/d18/d2c/d3a/f10b zero size 2023-12-16T07:40:52.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/936: dread d15/d18/d80/ff2 [0,4194304] 0 2023-12-16T07:40:52.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/937: write d15/fd2 [5836275,59453] 0 2023-12-16T07:40:52.285 INFO:tasks.workunit.client.1.smithi133.stdout:8/703: dread d9/d10/d39/d48/d44/d6e/f7c [0,4194304] 0 2023-12-16T07:40:52.285 INFO:tasks.workunit.client.1.smithi133.stdout:8/704: truncate d9/d11/d42/fd9 4896920 0 2023-12-16T07:40:52.285 INFO:tasks.workunit.client.1.smithi133.stdout:8/705: stat d9/d10/d39/fd0 0 2023-12-16T07:40:52.286 INFO:tasks.workunit.client.1.smithi133.stdout:0/841: dread d2/d9/d12/d35/fb3 [0,4194304] 0 2023-12-16T07:40:52.286 INFO:tasks.workunit.client.1.smithi133.stdout:0/842: read - d2/d17/fc8 zero size 2023-12-16T07:40:52.287 INFO:tasks.workunit.client.1.smithi133.stdout:8/706: write d9/dc/de/fa4 [57129,10908] 0 2023-12-16T07:40:52.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/938: dread d15/d18/d2c/d68/f83 [0,4194304] 0 2023-12-16T07:40:52.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/939: write d15/d18/d80/fd0 [4362546,89258] 0 2023-12-16T07:40:52.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/940: fsync fc 0 2023-12-16T07:40:52.291 INFO:tasks.workunit.client.1.smithi133.stdout:8/707: mkdir d9/d2d/dc1/de3 0 2023-12-16T07:40:52.291 INFO:tasks.workunit.client.1.smithi133.stdout:8/708: read d9/d10/d39/d48/d92/fce [320727,82009] 0 2023-12-16T07:40:52.292 INFO:tasks.workunit.client.1.smithi133.stdout:0/843: dread d2/d9/d20/d5e/fb9 [0,4194304] 0 2023-12-16T07:40:52.292 INFO:tasks.workunit.client.1.smithi133.stdout:0/844: write d2/d17/d2b/d31/d7f/f109 [580994,114771] 0 2023-12-16T07:40:52.298 INFO:tasks.workunit.client.1.smithi133.stdout:8/709: mkdir d9/dc/de/de4 0 2023-12-16T07:40:52.299 INFO:tasks.workunit.client.1.smithi133.stdout:8/710: mkdir d9/d85/de5 0 2023-12-16T07:40:52.299 INFO:tasks.workunit.client.1.smithi133.stdout:1/985: sync 2023-12-16T07:40:52.299 INFO:tasks.workunit.client.1.smithi133.stdout:3/682: sync 2023-12-16T07:40:52.299 INFO:tasks.workunit.client.1.smithi133.stdout:5/716: sync 2023-12-16T07:40:52.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/717: unlink d1/ca 0 2023-12-16T07:40:52.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/718: fdatasync d1/d18/f47 0 2023-12-16T07:40:52.301 INFO:tasks.workunit.client.1.smithi133.stdout:5/719: fsync d1/de/d35/dc6/f8f 0 2023-12-16T07:40:52.301 INFO:tasks.workunit.client.1.smithi133.stdout:3/683: rmdir d7/d8/d1c/ddb 39 2023-12-16T07:40:52.301 INFO:tasks.workunit.client.1.smithi133.stdout:3/684: read - d7/d8/d1d/fef zero size 2023-12-16T07:40:52.302 INFO:tasks.workunit.client.1.smithi133.stdout:2/862: sync 2023-12-16T07:40:52.302 INFO:tasks.workunit.client.1.smithi133.stdout:2/863: readlink da/d15/d1b/d43/d85/lfc 0 2023-12-16T07:40:52.302 INFO:tasks.workunit.client.1.smithi133.stdout:2/864: write da/d15/d1b/f34 [4881309,59603] 0 2023-12-16T07:40:52.303 INFO:tasks.workunit.client.1.smithi133.stdout:8/711: dread d9/d10/d39/d48/f7f [0,4194304] 0 2023-12-16T07:40:52.303 INFO:tasks.workunit.client.1.smithi133.stdout:1/986: rmdir d0/d12/d51/dac/d24/d5a/d68 39 2023-12-16T07:40:52.303 INFO:tasks.workunit.client.1.smithi133.stdout:1/987: dread - d0/d12/dda/de0/fe7 zero size 2023-12-16T07:40:52.303 INFO:tasks.workunit.client.1.smithi133.stdout:1/988: stat d0/d12/d51/dac/fd 0 2023-12-16T07:40:52.303 INFO:tasks.workunit.client.1.smithi133.stdout:1/989: write d0/d12/d51/dac/d24/d32/d56/fb1 [543653,91198] 0 2023-12-16T07:40:52.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/685: truncate d7/d8/f54 1135136 0 2023-12-16T07:40:52.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/686: write d7/d8/d1c/d2b/f7a [893751,35187] 0 2023-12-16T07:40:52.306 INFO:tasks.workunit.client.1.smithi133.stdout:2/865: truncate da/d1d/d60/d71/d2e/d47/fdd 1651051 0 2023-12-16T07:40:52.307 INFO:tasks.workunit.client.1.smithi133.stdout:8/712: rmdir d9/d10/d39 39 2023-12-16T07:40:52.307 INFO:tasks.workunit.client.1.smithi133.stdout:8/713: readlink d9/d10/dc7/la8 0 2023-12-16T07:40:52.307 INFO:tasks.workunit.client.1.smithi133.stdout:1/990: write d0/d12/d51/dac/d24/d32/d56/d59/d66/fa9 [2777340,64879] 0 2023-12-16T07:40:52.308 INFO:tasks.workunit.client.1.smithi133.stdout:3/687: mkdir d7/d8/d1c/ddb/dfb/d119 0 2023-12-16T07:40:52.308 INFO:tasks.workunit.client.1.smithi133.stdout:9/941: dwrite d15/d18/d4d/d94/dab/fcd [0,4194304] 0 2023-12-16T07:40:52.311 INFO:tasks.workunit.client.1.smithi133.stdout:2/866: mknod da/d1d/d60/d71/d3a/d61/c10a 0 2023-12-16T07:40:52.312 INFO:tasks.workunit.client.1.smithi133.stdout:8/714: stat d9/dc/de/l73 0 2023-12-16T07:40:52.313 INFO:tasks.workunit.client.1.smithi133.stdout:5/720: dread d1/d18/d2c/f39 [0,4194304] 0 2023-12-16T07:40:52.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/845: dwrite d2/d17/d2b/d31/d63/d98/fbd [0,4194304] 0 2023-12-16T07:40:52.314 INFO:tasks.workunit.client.1.smithi133.stdout:8/715: fsync d9/dc/de/fa4 0 2023-12-16T07:40:52.314 INFO:tasks.workunit.client.1.smithi133.stdout:8/716: fsync d9/d10/d39/d48/f7f 0 2023-12-16T07:40:52.315 INFO:tasks.workunit.client.1.smithi133.stdout:9/942: dread d15/f37 [0,4194304] 0 2023-12-16T07:40:52.315 INFO:tasks.workunit.client.1.smithi133.stdout:1/991: getdents d0/da/d3d/d41/df0/d135 0 2023-12-16T07:40:52.315 INFO:tasks.workunit.client.1.smithi133.stdout:1/992: write d0/d12/d51/db6/dde/fdf [1635482,58123] 0 2023-12-16T07:40:52.318 INFO:tasks.workunit.client.1.smithi133.stdout:3/688: rename d7/d8/d1c/fa0 to d7/d8/d1c/ddb/d95/db4/f11a 0 2023-12-16T07:40:52.318 INFO:tasks.workunit.client.1.smithi133.stdout:3/689: chown d7/d8/d1c/c36 60112 1 2023-12-16T07:40:52.318 INFO:tasks.workunit.client.1.smithi133.stdout:9/943: write d15/d18/d2c/d68/f8e [3588185,72190] 0 2023-12-16T07:40:52.318 INFO:tasks.workunit.client.1.smithi133.stdout:9/944: fsync d15/d18/f114 0 2023-12-16T07:40:52.325 INFO:tasks.workunit.client.1.smithi133.stdout:2/867: symlink da/d1d/d60/d71/d3a/d5a/l10b 0 2023-12-16T07:40:52.327 INFO:tasks.workunit.client.1.smithi133.stdout:3/690: dread d7/d8/d1d/d2a/f94 [0,4194304] 0 2023-12-16T07:40:52.327 INFO:tasks.workunit.client.1.smithi133.stdout:5/721: symlink d1/de/d35/dc6/db4/lfa 0 2023-12-16T07:40:52.333 INFO:tasks.workunit.client.1.smithi133.stdout:0/846: creat d2/d9/d12/d35/d4f/d93/f110 x:0 0 0 2023-12-16T07:40:52.335 INFO:tasks.workunit.client.1.smithi133.stdout:8/717: getdents d9/d10 0 2023-12-16T07:40:52.338 INFO:tasks.workunit.client.1.smithi133.stdout:1/993: truncate d0/da/fb5 939447 0 2023-12-16T07:40:52.339 INFO:tasks.workunit.client.1.smithi133.stdout:5/722: dread d1/d18/f4e [0,4194304] 0 2023-12-16T07:40:52.341 INFO:tasks.workunit.client.1.smithi133.stdout:9/945: mkdir d15/d18/d80/dfc/d13a 0 2023-12-16T07:40:52.341 INFO:tasks.workunit.client.1.smithi133.stdout:9/946: getdents d15/d18/d80 0 2023-12-16T07:40:52.342 INFO:tasks.workunit.client.1.smithi133.stdout:2/868: dwrite da/d15/ff9 [0,4194304] 0 2023-12-16T07:40:52.342 INFO:tasks.workunit.client.1.smithi133.stdout:2/869: chown da/d1d/d60/d71/l2a 1240691 1 2023-12-16T07:40:52.342 INFO:tasks.workunit.client.1.smithi133.stdout:2/870: chown da/d15/d17/d40/lb7 1 1 2023-12-16T07:40:52.342 INFO:tasks.workunit.client.1.smithi133.stdout:2/871: stat da/d15/d1b/c4e 0 2023-12-16T07:40:52.342 INFO:tasks.workunit.client.1.smithi133.stdout:2/872: write da/d15/d1b/d43/fcd [354229,7581] 0 2023-12-16T07:40:52.343 INFO:tasks.workunit.client.1.smithi133.stdout:3/691: symlink d7/d8/d1c/ddb/dfb/d119/l11b 0 2023-12-16T07:40:52.343 INFO:tasks.workunit.client.1.smithi133.stdout:3/692: fsync d7/d8/d1c/d2b/f15 0 2023-12-16T07:40:52.345 INFO:tasks.workunit.client.1.smithi133.stdout:0/847: unlink d2/f38 0 2023-12-16T07:40:52.348 INFO:tasks.workunit.client.1.smithi133.stdout:8/718: symlink d9/d10/d39/d48/le6 0 2023-12-16T07:40:52.348 INFO:tasks.workunit.client.1.smithi133.stdout:8/719: chown d9/d11 168484 1 2023-12-16T07:40:52.350 INFO:tasks.workunit.client.1.smithi133.stdout:1/994: symlink d0/da/d3d/d41/df0/l14e 0 2023-12-16T07:40:52.350 INFO:tasks.workunit.client.1.smithi133.stdout:1/995: rename d0/d12/d51/dac/d24 to d0/d12/d51/dac/d24/d5a/d139/d14f 22 2023-12-16T07:40:52.351 INFO:tasks.workunit.client.1.smithi133.stdout:5/723: truncate d1/de/d57/dc5/ff1 4709552 0 2023-12-16T07:40:52.352 INFO:tasks.workunit.client.1.smithi133.stdout:5/724: write d1/d1c/d80/d64/dc1/dca/ff5 [4441116,78085] 0 2023-12-16T07:40:52.352 INFO:tasks.workunit.client.1.smithi133.stdout:9/947: mkdir d15/d18/d5b/d13b 0 2023-12-16T07:40:52.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/693: dwrite d7/d8/d78/d43/d5b/ff1 [0,4194304] 0 2023-12-16T07:40:52.358 INFO:tasks.workunit.client.1.smithi133.stdout:0/848: rmdir d2/d17 39 2023-12-16T07:40:52.358 INFO:tasks.workunit.client.1.smithi133.stdout:8/720: mknod d9/d10/ce7 0 2023-12-16T07:40:52.361 INFO:tasks.workunit.client.1.smithi133.stdout:5/725: mkdir d1/d1c/d80/dd7/df8/dfb 0 2023-12-16T07:40:52.367 INFO:tasks.workunit.client.1.smithi133.stdout:2/873: mknod da/d1d/c10c 0 2023-12-16T07:40:52.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:51 smithi133 ceph-mon[120445]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 110 MiB/s rd, 221 MiB/s wr, 392 op/s 2023-12-16T07:40:52.371 INFO:tasks.workunit.client.1.smithi133.stdout:3/694: truncate d7/d8/d1c/faa 3907833 0 2023-12-16T07:40:52.374 INFO:tasks.workunit.client.1.smithi133.stdout:0/849: getdents d2/d17/d2b 0 2023-12-16T07:40:52.376 INFO:tasks.workunit.client.1.smithi133.stdout:8/721: unlink d9/d11/d42/f62 0 2023-12-16T07:40:52.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/722: write d9/d10/d39/d48/f51 [1513951,70472] 0 2023-12-16T07:40:52.378 INFO:tasks.workunit.client.1.smithi133.stdout:1/996: rename d0/da/d3d/dce/df5/d123/f12d to d0/d1c/f150 0 2023-12-16T07:40:52.382 INFO:tasks.workunit.client.1.smithi133.stdout:0/850: dread d2/d9/db/f5d [0,4194304] 0 2023-12-16T07:40:52.382 INFO:tasks.workunit.client.1.smithi133.stdout:0/851: chown d2/d9/d20/d5e/d89/da2 74 1 2023-12-16T07:40:52.382 INFO:tasks.workunit.client.1.smithi133.stdout:5/726: rmdir d1/d1c/d80/dd7/df8 39 2023-12-16T07:40:52.382 INFO:tasks.workunit.client.1.smithi133.stdout:5/727: stat d1/d1c/d80/d8d/lb5 0 2023-12-16T07:40:52.387 INFO:tasks.workunit.client.1.smithi133.stdout:2/874: link da/d15/d1b/f75 da/f10d 0 2023-12-16T07:40:52.387 INFO:tasks.workunit.client.1.smithi133.stdout:2/875: read da/d1d/d60/d71/d3a/f7d [545729,3839] 0 2023-12-16T07:40:52.387 INFO:tasks.workunit.client.1.smithi133.stdout:2/876: stat da/d1d/d60/d71/d3a/d61/f79 0 2023-12-16T07:40:52.390 INFO:tasks.workunit.client.1.smithi133.stdout:8/723: creat d9/d10/d39/d48/fe8 x:0 0 0 2023-12-16T07:40:52.390 INFO:tasks.workunit.client.1.smithi133.stdout:3/695: rename d7/d8/d1c/l112 to d7/d8/d72/d86/dbf/l11c 0 2023-12-16T07:40:52.391 INFO:tasks.workunit.client.1.smithi133.stdout:5/728: creat d1/ffc x:0 0 0 2023-12-16T07:40:52.391 INFO:tasks.workunit.client.1.smithi133.stdout:5/729: chown d1/d18/c7e 2004227814 1 2023-12-16T07:40:52.392 INFO:tasks.workunit.client.1.smithi133.stdout:5/730: chown d1/l49 641 1 2023-12-16T07:40:52.394 INFO:tasks.workunit.client.1.smithi133.stdout:3/696: creat d7/d8/d1d/d2a/da2/f11d x:0 0 0 2023-12-16T07:40:52.395 INFO:tasks.workunit.client.1.smithi133.stdout:5/731: creat d1/d1c/d80/da7/ffd x:0 0 0 2023-12-16T07:40:52.397 INFO:tasks.workunit.client.1.smithi133.stdout:8/724: read d9/dc/d27/f29 [3805582,53584] 0 2023-12-16T07:40:52.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/725: chown d9/d11/d42/fd9 129636531 1 2023-12-16T07:40:52.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/726: chown d9/c93 1100 1 2023-12-16T07:40:52.398 INFO:tasks.workunit.client.1.smithi133.stdout:9/948: truncate d15/d18/d2c/d68/f8e 384844 0 2023-12-16T07:40:52.407 INFO:tasks.workunit.client.1.smithi133.stdout:3/697: dread d7/d8/d78/d43/d5b/ff1 [0,4194304] 0 2023-12-16T07:40:52.408 INFO:tasks.workunit.client.1.smithi133.stdout:1/997: dwrite d0/da/d3d/d41/fa4 [0,4194304] 0 2023-12-16T07:40:52.409 INFO:tasks.workunit.client.1.smithi133.stdout:8/727: creat d9/d11/d42/fe9 x:0 0 0 2023-12-16T07:40:52.410 INFO:tasks.workunit.client.1.smithi133.stdout:9/949: creat d15/d18/d2c/d3a/f13c x:0 0 0 2023-12-16T07:40:52.410 INFO:tasks.workunit.client.1.smithi133.stdout:1/998: write d0/d12/d51/dac/d24/d32/d56/d59/d66/f74 [3417267,75840] 0 2023-12-16T07:40:52.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/698: mknod d7/d8/d1c/d2b/d2d/c11e 0 2023-12-16T07:40:52.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/699: write d7/d8/d78/d43/d7f/d85/d8f/fa1 [237556,84891] 0 2023-12-16T07:40:52.415 INFO:tasks.workunit.client.1.smithi133.stdout:2/877: dwrite da/d15/d17/d40/fa5 [4194304,4194304] 0 2023-12-16T07:40:52.416 INFO:tasks.workunit.client.1.smithi133.stdout:8/728: creat d9/d11/fea x:0 0 0 2023-12-16T07:40:52.416 INFO:tasks.workunit.client.1.smithi133.stdout:5/732: dwrite d1/de/d35/dc6/f8f [0,4194304] 0 2023-12-16T07:40:52.416 INFO:tasks.workunit.client.1.smithi133.stdout:5/733: stat d1/f1a 0 2023-12-16T07:40:52.417 INFO:tasks.workunit.client.1.smithi133.stdout:9/950: rename d15/d18/d2c/d3a/da4/df3/f104 to d15/d42/d8d/da9/f13d 0 2023-12-16T07:40:52.417 INFO:tasks.workunit.client.1.smithi133.stdout:9/951: fdatasync d15/d18/d2c/d68/da6/f11b 0 2023-12-16T07:40:52.418 INFO:tasks.workunit.client.1.smithi133.stdout:1/999: symlink d0/d60/l151 0 2023-12-16T07:40:52.420 INFO:tasks.workunit.client.1.smithi133.stdout:3/700: mkdir d7/d8/d1d/d11f 0 2023-12-16T07:40:52.423 INFO:tasks.workunit.client.1.smithi133.stdout:2/878: unlink da/d1d/d60/d71/l6c 0 2023-12-16T07:40:52.424 INFO:tasks.workunit.client.1.smithi133.stdout:8/729: creat d9/d2d/feb x:0 0 0 2023-12-16T07:40:52.424 INFO:tasks.workunit.client.1.smithi133.stdout:8/730: read - d9/f6a zero size 2023-12-16T07:40:52.427 INFO:tasks.workunit.client.1.smithi133.stdout:9/952: creat d15/d42/d8d/db7/dd4/f13e x:0 0 0 2023-12-16T07:40:52.427 INFO:tasks.workunit.client.1.smithi133.stdout:9/953: chown d15/d18/d80/dfc 925 1 2023-12-16T07:40:52.432 INFO:tasks.workunit.client.1.smithi133.stdout:2/879: mkdir da/d15/dea/d10e 0 2023-12-16T07:40:52.432 INFO:tasks.workunit.client.1.smithi133.stdout:2/880: readlink da/d15/d1b/l30 0 2023-12-16T07:40:52.435 INFO:tasks.workunit.client.1.smithi133.stdout:9/954: dread d15/d42/d8d/f9e [0,4194304] 0 2023-12-16T07:40:52.435 INFO:tasks.workunit.client.1.smithi133.stdout:9/955: read - d15/d18/d2c/d68/da6/f124 zero size 2023-12-16T07:40:52.437 INFO:tasks.workunit.client.1.smithi133.stdout:2/881: link da/d1d/d60/d71/d2e/d47/fdd da/d15/dbe/f10f 0 2023-12-16T07:40:52.439 INFO:tasks.workunit.client.1.smithi133.stdout:3/701: dwrite d7/d8/d72/d77/f97 [0,4194304] 0 2023-12-16T07:40:52.439 INFO:tasks.workunit.client.1.smithi133.stdout:3/702: read d7/d8/d1d/f90 [3656535,63883] 0 2023-12-16T07:40:52.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/956: truncate d15/f17 3181921 0 2023-12-16T07:40:52.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/957: chown d15/c3b 10319268 1 2023-12-16T07:40:52.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/958: fdatasync d15/d18/f41 0 2023-12-16T07:40:52.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/959: truncate d15/d42/fc0 4717605 0 2023-12-16T07:40:52.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/960: write d15/d18/d5b/d71/d78/f11e [605984,22404] 0 2023-12-16T07:40:52.441 INFO:tasks.workunit.client.1.smithi133.stdout:2/882: creat da/d50/db6/f110 x:0 0 0 2023-12-16T07:40:52.444 INFO:tasks.workunit.client.1.smithi133.stdout:8/731: dread d9/d10/d39/d48/d92/fbb [0,4194304] 0 2023-12-16T07:40:52.448 INFO:tasks.workunit.client.1.smithi133.stdout:9/961: dread d15/d42/d8d/da9/ff5 [0,4194304] 0 2023-12-16T07:40:52.452 INFO:tasks.workunit.client.1.smithi133.stdout:9/962: dread fd [0,4194304] 0 2023-12-16T07:40:52.454 INFO:tasks.workunit.client.1.smithi133.stdout:3/703: rename d7/d8/d1d/la8 to d7/d8/d1c/d87/dad/l120 0 2023-12-16T07:40:52.454 INFO:tasks.workunit.client.1.smithi133.stdout:3/704: fdatasync d7/d8/d1c/f4b 0 2023-12-16T07:40:52.454 INFO:tasks.workunit.client.1.smithi133.stdout:8/732: symlink d9/d10/dc7/lec 0 2023-12-16T07:40:52.456 INFO:tasks.workunit.client.1.smithi133.stdout:2/883: dwrite da/d1d/d60/d71/d2e/d47/d52/d80/f8b [0,4194304] 0 2023-12-16T07:40:52.457 INFO:tasks.workunit.client.1.smithi133.stdout:9/963: write d15/d18/d5b/d71/d78/d6e/f75 [1230043,13074] 0 2023-12-16T07:40:52.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/733: truncate d9/f5e 2074672 0 2023-12-16T07:40:52.458 INFO:tasks.workunit.client.1.smithi133.stdout:3/705: dread d7/d8/d1c/d87/ff7 [0,4194304] 0 2023-12-16T07:40:52.463 INFO:tasks.workunit.client.1.smithi133.stdout:2/884: mknod da/d15/d17/d40/d98/c111 0 2023-12-16T07:40:52.469 INFO:tasks.workunit.client.1.smithi133.stdout:8/734: mkdir d9/d11/d33/ded 0 2023-12-16T07:40:52.470 INFO:tasks.workunit.client.1.smithi133.stdout:9/964: creat d15/d18/d5b/d71/d78/d6e/f13f x:0 0 0 2023-12-16T07:40:52.471 INFO:tasks.workunit.client.1.smithi133.stdout:9/965: write d15/d18/d2c/d68/fc1 [4750656,125621] 0 2023-12-16T07:40:52.473 INFO:tasks.workunit.client.1.smithi133.stdout:3/706: symlink d7/d8/d72/d86/dbf/l121 0 2023-12-16T07:40:52.478 INFO:tasks.workunit.client.1.smithi133.stdout:3/707: dread d7/d8/d1c/f38 [0,4194304] 0 2023-12-16T07:40:52.478 INFO:tasks.workunit.client.1.smithi133.stdout:3/708: write d7/d8/d1c/f66 [977678,63227] 0 2023-12-16T07:40:52.478 INFO:tasks.workunit.client.1.smithi133.stdout:3/709: readlink d7/d8/d1c/l3a 0 2023-12-16T07:40:52.479 INFO:tasks.workunit.client.1.smithi133.stdout:8/735: mknod d9/d85/dd6/cee 0 2023-12-16T07:40:52.481 INFO:tasks.workunit.client.1.smithi133.stdout:9/966: truncate d15/d18/d2c/d3a/d8a/ff0 2378946 0 2023-12-16T07:40:52.482 INFO:tasks.workunit.client.1.smithi133.stdout:9/967: dread - d15/d18/d2c/d68/da6/f124 zero size 2023-12-16T07:40:52.483 INFO:tasks.workunit.client.1.smithi133.stdout:3/710: dread d7/d8/f5c [0,4194304] 0 2023-12-16T07:40:52.483 INFO:tasks.workunit.client.1.smithi133.stdout:3/711: dread - d7/d8/d72/f116 zero size 2023-12-16T07:40:52.484 INFO:tasks.workunit.client.1.smithi133.stdout:8/736: mkdir d9/d11/d42/dda/def 0 2023-12-16T07:40:52.487 INFO:tasks.workunit.client.1.smithi133.stdout:9/968: symlink d15/d18/d2c/d68/l140 0 2023-12-16T07:40:52.490 INFO:tasks.workunit.client.1.smithi133.stdout:3/712: dread d7/d8/d1c/ddb/fc1 [0,4194304] 0 2023-12-16T07:40:52.491 INFO:tasks.workunit.client.1.smithi133.stdout:3/713: write d7/f25 [1092999,21617] 0 2023-12-16T07:40:52.491 INFO:tasks.workunit.client.1.smithi133.stdout:3/714: stat d7/d8/d1c/d87/dad 0 2023-12-16T07:40:52.491 INFO:tasks.workunit.client.1.smithi133.stdout:8/737: symlink d9/d11/d33/ded/lf0 0 2023-12-16T07:40:52.496 INFO:tasks.workunit.client.1.smithi133.stdout:9/969: rmdir d15/d18/d80/dfc/d13a 0 2023-12-16T07:40:52.498 INFO:tasks.workunit.client.1.smithi133.stdout:3/715: mknod d7/d8/d1d/d11f/c122 0 2023-12-16T07:40:52.498 INFO:tasks.workunit.client.1.smithi133.stdout:3/716: readlink d7/d8/d72/d86/dbf/l11c 0 2023-12-16T07:40:52.502 INFO:tasks.workunit.client.1.smithi133.stdout:8/738: rmdir d9/d10/d39/d48 39 2023-12-16T07:40:52.502 INFO:tasks.workunit.client.1.smithi133.stdout:8/739: read - d9/f6a zero size 2023-12-16T07:40:52.504 INFO:tasks.workunit.client.1.smithi133.stdout:9/970: rename d15/d18/de8/l126 to d15/d42/d8d/de7/d108/l141 0 2023-12-16T07:40:52.506 INFO:tasks.workunit.client.1.smithi133.stdout:9/971: read d15/d18/d4d/d7e/f9d [2585290,46262] 0 2023-12-16T07:40:52.507 INFO:tasks.workunit.client.1.smithi133.stdout:3/717: dread d7/f8e [4194304,4194304] 0 2023-12-16T07:40:52.517 INFO:tasks.workunit.client.1.smithi133.stdout:8/740: dwrite d9/d10/f8e [0,4194304] 0 2023-12-16T07:40:52.538 INFO:tasks.workunit.client.1.smithi133.stdout:8/741: dwrite d9/f2e [0,4194304] 0 2023-12-16T07:40:52.538 INFO:tasks.workunit.client.1.smithi133.stdout:8/742: truncate d9/d11/d52/f9b 932815 0 2023-12-16T07:40:52.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/718: mknod d7/d8/d1c/d87/dad/c123 0 2023-12-16T07:40:52.538 INFO:tasks.workunit.client.1.smithi133.stdout:3/719: write d7/f1b [3010267,21848] 0 2023-12-16T07:40:52.549 INFO:tasks.workunit.client.1.smithi133.stdout:8/743: truncate d9/dc/d27/f28 3339986 0 2023-12-16T07:40:52.551 INFO:tasks.workunit.client.1.smithi133.stdout:3/720: link d7/d8/d1d/d2a/d5f/fe1 d7/d8/d78/d43/d7f/d85/f124 0 2023-12-16T07:40:52.551 INFO:tasks.workunit.client.1.smithi133.stdout:3/721: fdatasync d7/d8/d78/d43/d5b/fd2 0 2023-12-16T07:40:52.552 INFO:tasks.workunit.client.1.smithi133.stdout:8/744: symlink d9/d10/d39/d48/d44/d6e/lf1 0 2023-12-16T07:40:52.553 INFO:tasks.workunit.client.1.smithi133.stdout:3/722: truncate d7/d8/d1d/d2a/fd3 1462770 0 2023-12-16T07:40:52.555 INFO:tasks.workunit.client.1.smithi133.stdout:8/745: write d9/d10/f37 [5524279,102695] 0 2023-12-16T07:40:52.555 INFO:tasks.workunit.client.1.smithi133.stdout:8/746: fdatasync d9/d10/d39/fa1 0 2023-12-16T07:40:52.555 INFO:tasks.workunit.client.1.smithi133.stdout:8/747: chown d9/d10/c36 14273540 1 2023-12-16T07:40:52.555 INFO:tasks.workunit.client.1.smithi133.stdout:8/748: getdents d9/d2d/dc1/de3 0 2023-12-16T07:40:52.558 INFO:tasks.workunit.client.1.smithi133.stdout:8/749: creat d9/d11/d42/ff2 x:0 0 0 2023-12-16T07:40:52.564 INFO:tasks.workunit.client.1.smithi133.stdout:8/750: truncate d9/d10/d39/d48/f68 6926198 0 2023-12-16T07:40:52.572 INFO:tasks.workunit.client.1.smithi133.stdout:3/723: dwrite f3 [0,4194304] 0 2023-12-16T07:40:52.572 INFO:tasks.workunit.client.1.smithi133.stdout:3/724: truncate d7/d8/d1d/d2a/f3c 4915272 0 2023-12-16T07:40:52.574 INFO:tasks.workunit.client.1.smithi133.stdout:3/725: creat d7/d8/d72/d77/f125 x:0 0 0 2023-12-16T07:40:52.575 INFO:tasks.workunit.client.1.smithi133.stdout:3/726: mkdir d7/d8/d72/d77/d126 0 2023-12-16T07:40:52.585 INFO:tasks.workunit.client.1.smithi133.stdout:8/751: dwrite d9/dc/d27/fcb [0,4194304] 0 2023-12-16T07:40:52.588 INFO:tasks.workunit.client.1.smithi133.stdout:8/752: mkdir d9/dc/de/df3 0 2023-12-16T07:40:52.590 INFO:tasks.workunit.client.1.smithi133.stdout:3/727: dwrite d7/d8/f84 [0,4194304] 0 2023-12-16T07:40:52.590 INFO:tasks.workunit.client.1.smithi133.stdout:3/728: readlink d7/d8/d1c/d2b/l3f 0 2023-12-16T07:40:52.590 INFO:tasks.workunit.client.1.smithi133.stdout:3/729: write f6 [2238278,117112] 0 2023-12-16T07:40:52.591 INFO:tasks.workunit.client.1.smithi133.stdout:3/730: write d7/d8/d78/de0/f10a [1965329,38587] 0 2023-12-16T07:40:52.591 INFO:tasks.workunit.client.1.smithi133.stdout:3/731: fsync d7/d8/d1d/d2a/da2/f111 0 2023-12-16T07:40:52.591 INFO:tasks.workunit.client.1.smithi133.stdout:8/753: unlink d9/d10/d39/ccc 0 2023-12-16T07:40:52.591 INFO:tasks.workunit.client.1.smithi133.stdout:8/754: fsync d9/d11/d42/fa5 0 2023-12-16T07:40:52.595 INFO:tasks.workunit.client.1.smithi133.stdout:3/732: symlink d7/d8/d78/d43/d7f/l127 0 2023-12-16T07:40:52.596 INFO:tasks.workunit.client.1.smithi133.stdout:3/733: write d7/d8/d78/d43/f79 [2379082,7392] 0 2023-12-16T07:40:52.596 INFO:tasks.workunit.client.1.smithi133.stdout:3/734: dread - d7/d8/d1d/dc9/f10d zero size 2023-12-16T07:40:52.596 INFO:tasks.workunit.client.1.smithi133.stdout:3/735: write d7/d8/d78/de0/f10b [238004,25907] 0 2023-12-16T07:40:52.596 INFO:tasks.workunit.client.1.smithi133.stdout:8/755: rename d9/dc/d27/f28 to d9/d85/ff4 0 2023-12-16T07:40:52.598 INFO:tasks.workunit.client.1.smithi133.stdout:3/736: mkdir d7/d128 0 2023-12-16T07:40:52.612 INFO:tasks.workunit.client.1.smithi133.stdout:8/756: dwrite d9/d10/d39/fd0 [0,4194304] 0 2023-12-16T07:40:52.633 INFO:tasks.workunit.client.1.smithi133.stdout:3/737: dwrite d7/d8/d72/d86/fe6 [0,4194304] 0 2023-12-16T07:40:52.633 INFO:tasks.workunit.client.1.smithi133.stdout:3/738: chown d7/d8/d78/d43/ccc 6 1 2023-12-16T07:40:52.633 INFO:tasks.workunit.client.1.smithi133.stdout:3/739: write d7/d8/d1c/d2b/d2d/f82 [777018,104415] 0 2023-12-16T07:40:52.633 INFO:tasks.workunit.client.1.smithi133.stdout:3/740: dread - d7/d8/d1c/d2b/d2d/fc2 zero size 2023-12-16T07:40:52.633 INFO:tasks.workunit.client.1.smithi133.stdout:8/757: dwrite d9/d10/d39/d48/f7f [0,4194304] 0 2023-12-16T07:40:52.639 INFO:tasks.workunit.client.1.smithi133.stdout:3/741: dread d7/d8/d1d/d2a/f94 [0,4194304] 0 2023-12-16T07:40:52.640 INFO:tasks.workunit.client.1.smithi133.stdout:3/742: write d7/d8/d1d/dc9/ff0 [896005,49088] 0 2023-12-16T07:40:52.648 INFO:tasks.workunit.client.1.smithi133.stdout:3/743: dread d7/d8/fa [0,4194304] 0 2023-12-16T07:40:52.655 INFO:tasks.workunit.client.1.smithi133.stdout:3/744: getdents d7/d8/d1c/ddb/dfb 0 2023-12-16T07:40:52.656 INFO:tasks.workunit.client.1.smithi133.stdout:3/745: chown d7/d8/d1c/f31 223509079 1 2023-12-16T07:40:52.656 INFO:tasks.workunit.client.1.smithi133.stdout:3/746: dread - d7/d8/d1d/dc9/f10d zero size 2023-12-16T07:40:52.656 INFO:tasks.workunit.client.1.smithi133.stdout:3/747: fdatasync d7/d8/fe 0 2023-12-16T07:40:52.657 INFO:tasks.workunit.client.1.smithi133.stdout:3/748: symlink d7/d8/d1c/d2b/d2d/l129 0 2023-12-16T07:40:52.659 INFO:tasks.workunit.client.1.smithi133.stdout:3/749: symlink d7/d8/l12a 0 2023-12-16T07:40:52.660 INFO:tasks.workunit.client.1.smithi133.stdout:3/750: write d7/d8/f75 [408548,39409] 0 2023-12-16T07:40:52.675 INFO:tasks.workunit.client.1.smithi133.stdout:2/885: sync 2023-12-16T07:40:52.676 INFO:tasks.workunit.client.1.smithi133.stdout:0/852: sync 2023-12-16T07:40:52.676 INFO:tasks.workunit.client.1.smithi133.stdout:5/734: sync 2023-12-16T07:40:52.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/972: sync 2023-12-16T07:40:52.676 INFO:tasks.workunit.client.1.smithi133.stdout:0/853: getdents d2/d17/dc2/d108 0 2023-12-16T07:40:52.676 INFO:tasks.workunit.client.1.smithi133.stdout:2/886: write da/d1d/d60/d74/f109 [534877,6595] 0 2023-12-16T07:40:52.677 INFO:tasks.workunit.client.1.smithi133.stdout:8/758: dwrite d9/f5e [0,4194304] 0 2023-12-16T07:40:52.677 INFO:tasks.workunit.client.1.smithi133.stdout:8/759: write d9/d10/d39/d48/fe8 [921404,116223] 0 2023-12-16T07:40:52.677 INFO:tasks.workunit.client.1.smithi133.stdout:5/735: mknod d1/de/d57/d74/cfe 0 2023-12-16T07:40:52.679 INFO:tasks.workunit.client.1.smithi133.stdout:8/760: dread d9/d10/d39/d48/d92/fce [0,4194304] 0 2023-12-16T07:40:52.680 INFO:tasks.workunit.client.1.smithi133.stdout:0/854: truncate d2/d9/db/f6c 1139941 0 2023-12-16T07:40:52.680 INFO:tasks.workunit.client.1.smithi133.stdout:0/855: write d2/db2/f104 [4696313,88556] 0 2023-12-16T07:40:52.681 INFO:tasks.workunit.client.1.smithi133.stdout:2/887: rmdir da/d1d/d60/d71/d3a/d61/d73 0 2023-12-16T07:40:52.685 INFO:tasks.workunit.client.1.smithi133.stdout:8/761: mknod d9/d10/d39/d48/d92/cf5 0 2023-12-16T07:40:52.687 INFO:tasks.workunit.client.1.smithi133.stdout:5/736: dread d1/f10 [4194304,4194304] 0 2023-12-16T07:40:52.688 INFO:tasks.workunit.client.1.smithi133.stdout:0/856: mknod d2/d17/d2b/d31/d4d/da7/c111 0 2023-12-16T07:40:52.689 INFO:tasks.workunit.client.1.smithi133.stdout:8/762: mknod d9/d10/d39/d48/d44/d6e/cf6 0 2023-12-16T07:40:52.690 INFO:tasks.workunit.client.1.smithi133.stdout:2/888: dread da/d15/d17/f84 [0,4194304] 0 2023-12-16T07:40:52.690 INFO:tasks.workunit.client.1.smithi133.stdout:0/857: creat d2/d9/d10a/f112 x:0 0 0 2023-12-16T07:40:52.692 INFO:tasks.workunit.client.1.smithi133.stdout:8/763: unlink d9/d10/d39/d48/d44/d6e/d78/fc5 0 2023-12-16T07:40:52.693 INFO:tasks.workunit.client.1.smithi133.stdout:2/889: creat da/f112 x:0 0 0 2023-12-16T07:40:52.695 INFO:tasks.workunit.client.1.smithi133.stdout:2/890: rename da/f10 to da/d15/d1b/d83/da3/dd4/dda/f113 0 2023-12-16T07:40:52.697 INFO:tasks.workunit.client.1.smithi133.stdout:2/891: truncate da/d1d/d60/d71/d3a/d61/f68 4033921 0 2023-12-16T07:40:52.697 INFO:tasks.workunit.client.1.smithi133.stdout:2/892: write da/d1d/d60/d71/d3a/fa1 [2108925,22268] 0 2023-12-16T07:40:52.700 INFO:tasks.workunit.client.1.smithi133.stdout:2/893: mkdir da/d15/d17/d114 0 2023-12-16T07:40:52.700 INFO:tasks.workunit.client.1.smithi133.stdout:2/894: readlink da/d1d/d60/d74/l7a 0 2023-12-16T07:40:52.700 INFO:tasks.workunit.client.1.smithi133.stdout:2/895: write da/d15/d1b/d83/da3/fed [276279,51384] 0 2023-12-16T07:40:52.701 INFO:tasks.workunit.client.1.smithi133.stdout:2/896: creat da/d15/d1b/d83/da3/f115 x:0 0 0 2023-12-16T07:40:52.705 INFO:tasks.workunit.client.1.smithi133.stdout:9/973: dwrite d15/d18/d2c/d68/fc4 [0,4194304] 0 2023-12-16T07:40:52.705 INFO:tasks.workunit.client.1.smithi133.stdout:2/897: creat da/d15/d17/f116 x:0 0 0 2023-12-16T07:40:52.706 INFO:tasks.workunit.client.1.smithi133.stdout:8/764: dread d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:52.711 INFO:tasks.workunit.client.1.smithi133.stdout:2/898: mkdir da/d15/d1b/d83/da3/dd4/dda/d100/d117 0 2023-12-16T07:40:52.711 INFO:tasks.workunit.client.1.smithi133.stdout:5/737: dwrite d1/de/dba/ff2 [0,4194304] 0 2023-12-16T07:40:52.711 INFO:tasks.workunit.client.1.smithi133.stdout:5/738: stat d1/ld 0 2023-12-16T07:40:52.712 INFO:tasks.workunit.client.1.smithi133.stdout:8/765: truncate d9/dc/d27/fcb 1882983 0 2023-12-16T07:40:52.714 INFO:tasks.workunit.client.1.smithi133.stdout:9/974: rename d15/d42/d8d/f12f to d15/d18/d2c/d3a/f142 0 2023-12-16T07:40:52.718 INFO:tasks.workunit.client.1.smithi133.stdout:2/899: symlink da/d50/db6/l118 0 2023-12-16T07:40:52.729 INFO:tasks.workunit.client.1.smithi133.stdout:9/975: link d15/d18/d5b/d71/f89 d15/d18/d2c/d68/da3/f143 0 2023-12-16T07:40:52.730 INFO:tasks.workunit.client.1.smithi133.stdout:2/900: symlink da/d50/db6/l119 0 2023-12-16T07:40:52.733 INFO:tasks.workunit.client.1.smithi133.stdout:8/766: mknod d9/d11/cf7 0 2023-12-16T07:40:52.736 INFO:tasks.workunit.client.1.smithi133.stdout:9/976: mkdir d15/d18/d2c/d68/db2/d144 0 2023-12-16T07:40:52.738 INFO:tasks.workunit.client.1.smithi133.stdout:5/739: dwrite d1/d18/f4e [0,4194304] 0 2023-12-16T07:40:52.745 INFO:tasks.workunit.client.1.smithi133.stdout:8/767: dread d9/dc/f3c [0,4194304] 0 2023-12-16T07:40:52.764 INFO:tasks.workunit.client.1.smithi133.stdout:9/977: dwrite d15/d18/d4d/d7e/fc5 [0,4194304] 0 2023-12-16T07:40:52.764 INFO:tasks.workunit.client.1.smithi133.stdout:9/978: fdatasync d15/d42/d8d/da9/ff5 0 2023-12-16T07:40:52.765 INFO:tasks.workunit.client.1.smithi133.stdout:9/979: mkdir d15/d18/d5b/d71/d78/d6e/d145 0 2023-12-16T07:40:52.765 INFO:tasks.workunit.client.1.smithi133.stdout:9/980: write fc [4490511,65260] 0 2023-12-16T07:40:52.765 INFO:tasks.workunit.client.1.smithi133.stdout:9/981: fsync d15/f26 0 2023-12-16T07:40:52.767 INFO:tasks.workunit.client.1.smithi133.stdout:9/982: mkdir d15/d18/d2c/d68/da3/dcb/d146 0 2023-12-16T07:40:52.767 INFO:tasks.workunit.client.1.smithi133.stdout:9/983: dread - d15/d18/d2c/d68/da3/dcb/f118 zero size 2023-12-16T07:40:52.767 INFO:tasks.workunit.client.1.smithi133.stdout:9/984: chown d15/d18/f4e 1795669 1 2023-12-16T07:40:52.768 INFO:tasks.workunit.client.1.smithi133.stdout:9/985: mkdir d15/d18/d80/d97/d147 0 2023-12-16T07:40:52.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/986: unlink d15/d18/fa5 0 2023-12-16T07:40:52.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/987: chown d15/f26 27711003 1 2023-12-16T07:40:52.770 INFO:tasks.workunit.client.1.smithi133.stdout:9/988: read d15/d18/d2c/f31 [1562876,119114] 0 2023-12-16T07:40:52.771 INFO:tasks.workunit.client.1.smithi133.stdout:9/989: symlink d15/d18/d5b/d13b/l148 0 2023-12-16T07:40:52.773 INFO:tasks.workunit.client.1.smithi133.stdout:2/901: dwrite da/d15/d1b/f75 [8388608,4194304] 0 2023-12-16T07:40:52.773 INFO:tasks.workunit.client.1.smithi133.stdout:8/768: dwrite d9/dc/de/fa4 [0,4194304] 0 2023-12-16T07:40:52.774 INFO:tasks.workunit.client.1.smithi133.stdout:5/740: dwrite d1/de/d35/dc6/db4/d71/fe0 [0,4194304] 0 2023-12-16T07:40:52.774 INFO:tasks.workunit.client.1.smithi133.stdout:9/990: rename d15/d18/d4d/d7e/f95 to d15/d18/d2c/d3a/da4/df3/f149 0 2023-12-16T07:40:52.778 INFO:tasks.workunit.client.1.smithi133.stdout:8/769: write d9/dc/f65 [120206,92069] 0 2023-12-16T07:40:52.781 INFO:tasks.workunit.client.1.smithi133.stdout:5/741: mknod d1/de/d57/cff 0 2023-12-16T07:40:52.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/991: creat d15/d18/d2c/d68/f14a x:0 0 0 2023-12-16T07:40:52.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/992: truncate d15/d18/d2c/d68/da6/f11b 1390083 0 2023-12-16T07:40:52.783 INFO:tasks.workunit.client.1.smithi133.stdout:8/770: rename d9/d2d/dc1/fb6 to d9/dc/de/de4/ff8 0 2023-12-16T07:40:52.784 INFO:tasks.workunit.client.1.smithi133.stdout:5/742: mknod d1/d18/c100 0 2023-12-16T07:40:52.785 INFO:tasks.workunit.client.1.smithi133.stdout:8/771: mknod d9/d11/d52/cf9 0 2023-12-16T07:40:52.786 INFO:tasks.workunit.client.1.smithi133.stdout:5/743: truncate d1/d4b/f5f 1862020 0 2023-12-16T07:40:52.789 INFO:tasks.workunit.client.1.smithi133.stdout:9/993: write f0 [3132205,123916] 0 2023-12-16T07:40:52.790 INFO:tasks.workunit.client.1.smithi133.stdout:8/772: rename d9/d11/d33 to d9/d10/d39/d48/d92/dfa 0 2023-12-16T07:40:52.791 INFO:tasks.workunit.client.1.smithi133.stdout:2/902: dwrite da/d15/d17/fa0 [0,4194304] 0 2023-12-16T07:40:52.797 INFO:tasks.workunit.client.1.smithi133.stdout:8/773: dread d9/d2d/fcf [0,4194304] 0 2023-12-16T07:40:52.798 INFO:tasks.workunit.client.1.smithi133.stdout:8/774: readlink d9/dc/d27/ld5 0 2023-12-16T07:40:52.800 INFO:tasks.workunit.client.1.smithi133.stdout:2/903: unlink da/d1d/f87 0 2023-12-16T07:40:52.800 INFO:tasks.workunit.client.1.smithi133.stdout:2/904: stat da/d1d/c91 0 2023-12-16T07:40:52.800 INFO:tasks.workunit.client.1.smithi133.stdout:2/905: truncate da/d1d/d60/d74/fc0 7652 0 2023-12-16T07:40:52.801 INFO:tasks.workunit.client.1.smithi133.stdout:8/775: mknod d9/d10/d39/d48/d92/cfb 0 2023-12-16T07:40:52.809 INFO:tasks.workunit.client.1.smithi133.stdout:9/994: dwrite d15/d18/d4d/d7e/ffe [0,4194304] 0 2023-12-16T07:40:52.811 INFO:tasks.workunit.client.1.smithi133.stdout:8/776: dread d9/dc/fde [0,4194304] 0 2023-12-16T07:40:52.811 INFO:tasks.workunit.client.1.smithi133.stdout:8/777: read - d9/d10/fd3 zero size 2023-12-16T07:40:52.813 INFO:tasks.workunit.client.1.smithi133.stdout:9/995: mknod d15/d18/d5b/d71/d78/d6e/d145/c14b 0 2023-12-16T07:40:52.813 INFO:tasks.workunit.client.1.smithi133.stdout:9/996: chown d15/d18/d80/dfc/d12a/dfb/c122 408754 1 2023-12-16T07:40:52.815 INFO:tasks.workunit.client.1.smithi133.stdout:8/778: read d9/d85/ff4 [966717,89751] 0 2023-12-16T07:40:52.815 INFO:tasks.workunit.client.1.smithi133.stdout:8/779: fdatasync d9/f2e 0 2023-12-16T07:40:52.816 INFO:tasks.workunit.client.1.smithi133.stdout:8/780: write d9/f3e [5005312,95240] 0 2023-12-16T07:40:52.816 INFO:tasks.workunit.client.1.smithi133.stdout:9/997: unlink d15/d18/d5b/d71/d78/d6e/d9b/l100 0 2023-12-16T07:40:52.817 INFO:tasks.workunit.client.1.smithi133.stdout:8/781: mkdir d9/d10/d39/d48/d44/d6e/d78/da6/dfc 0 2023-12-16T07:40:52.818 INFO:tasks.workunit.client.1.smithi133.stdout:9/998: symlink d15/d18/d80/dfc/d12a/dfb/l14c 0 2023-12-16T07:40:52.818 INFO:tasks.workunit.client.1.smithi133.stdout:9/999: truncate d15/d18/d5b/d71/d78/d6e/d9b/fbb 4693175 0 2023-12-16T07:40:52.818 INFO:tasks.workunit.client.1.smithi133.stdout:8/782: write d9/d2d/f8a [2082603,95608] 0 2023-12-16T07:40:52.819 INFO:tasks.workunit.client.1.smithi133.stdout:8/783: symlink d9/d10/d39/d48/d44/d69/lfd 0 2023-12-16T07:40:52.819 INFO:tasks.workunit.client.1.smithi133.stdout:8/784: chown d9/d11/c9a 17362 1 2023-12-16T07:40:52.820 INFO:tasks.workunit.client.1.smithi133.stdout:8/785: getdents d9/d2d 0 2023-12-16T07:40:52.821 INFO:tasks.workunit.client.1.smithi133.stdout:8/786: symlink d9/d2d/dc1/de3/lfe 0 2023-12-16T07:40:52.821 INFO:tasks.workunit.client.1.smithi133.stdout:8/787: chown d9/d10/d39/d48/d44/d69 40 1 2023-12-16T07:40:52.836 INFO:tasks.workunit.client.1.smithi133.stdout:8/788: dwrite d9/d11/fea [0,4194304] 0 2023-12-16T07:40:52.843 INFO:tasks.workunit.client.1.smithi133.stdout:8/789: dread d9/d10/f81 [0,4194304] 0 2023-12-16T07:40:52.843 INFO:tasks.workunit.client.1.smithi133.stdout:8/790: read d9/d10/f3a [2491031,100430] 0 2023-12-16T07:40:52.845 INFO:tasks.workunit.client.1.smithi133.stdout:8/791: unlink d9/d10/d39/f5c 0 2023-12-16T07:40:52.861 INFO:tasks.workunit.client.1.smithi133.stdout:8/792: dwrite d9/d10/d39/d48/fe8 [0,4194304] 0 2023-12-16T07:40:52.862 INFO:tasks.workunit.client.1.smithi133.stdout:8/793: readlink d9/d10/l57 0 2023-12-16T07:40:52.864 INFO:tasks.workunit.client.1.smithi133.stdout:8/794: creat d9/d10/d39/d48/d44/fff x:0 0 0 2023-12-16T07:40:52.869 INFO:tasks.workunit.client.1.smithi133.stdout:8/795: creat d9/d10/d39/d48/d44/d69/f100 x:0 0 0 2023-12-16T07:40:52.869 INFO:tasks.workunit.client.1.smithi133.stdout:8/796: fsync d9/d10/d39/d48/d44/d6e/d78/fb1 0 2023-12-16T07:40:52.876 INFO:tasks.workunit.client.1.smithi133.stdout:8/797: dread d9/d10/d39/fd0 [0,4194304] 0 2023-12-16T07:40:52.876 INFO:tasks.workunit.client.1.smithi133.stdout:8/798: chown d9/d10/d39/d48/f68 400387 1 2023-12-16T07:40:52.877 INFO:tasks.workunit.client.1.smithi133.stdout:8/799: write d9/d85/fae [164262,104336] 0 2023-12-16T07:40:52.879 INFO:tasks.workunit.client.1.smithi133.stdout:8/800: symlink d9/d10/d39/d48/d44/d69/l101 0 2023-12-16T07:40:52.879 INFO:tasks.workunit.client.1.smithi133.stdout:8/801: read d9/d10/d39/d48/d92/fce [485772,36492] 0 2023-12-16T07:40:53.014 INFO:tasks.workunit.client.1.smithi133.stdout:0/858: sync 2023-12-16T07:40:53.014 INFO:tasks.workunit.client.1.smithi133.stdout:3/751: sync 2023-12-16T07:40:53.017 INFO:tasks.workunit.client.1.smithi133.stdout:3/752: rename d7/d8/d1c/d2b/d2d/c32 to d7/d8/d78/d43/d7f/d85/c12b 0 2023-12-16T07:40:53.018 INFO:tasks.workunit.client.1.smithi133.stdout:3/753: read d7/d8/d72/d86/fa7 [4104002,91678] 0 2023-12-16T07:40:53.018 INFO:tasks.workunit.client.1.smithi133.stdout:0/859: symlink d2/d9/d20/d5e/d92/ddd/l113 0 2023-12-16T07:40:53.019 INFO:tasks.workunit.client.1.smithi133.stdout:0/860: write d2/d17/d2b/d31/d4d/d54/fde [1405590,54068] 0 2023-12-16T07:40:53.020 INFO:tasks.workunit.client.1.smithi133.stdout:3/754: rmdir d7/d8/d1c/d2b/d2d 39 2023-12-16T07:40:53.022 INFO:tasks.workunit.client.1.smithi133.stdout:0/861: unlink d2/d9/d12/d35/d4f/leb 0 2023-12-16T07:40:53.022 INFO:tasks.workunit.client.1.smithi133.stdout:3/755: mkdir d7/d128/d12c 0 2023-12-16T07:40:53.023 INFO:tasks.workunit.client.1.smithi133.stdout:0/862: getdents d2/d9/d8f 0 2023-12-16T07:40:53.026 INFO:tasks.workunit.client.1.smithi133.stdout:3/756: link d7/d8/d1d/d2a/d62/ccb d7/d128/c12d 0 2023-12-16T07:40:53.028 INFO:tasks.workunit.client.1.smithi133.stdout:0/863: creat d2/d9/dc5/dd8/f114 x:0 0 0 2023-12-16T07:40:53.030 INFO:tasks.workunit.client.1.smithi133.stdout:3/757: getdents d7/d8/d1c/ddb 0 2023-12-16T07:40:53.031 INFO:tasks.workunit.client.1.smithi133.stdout:3/758: creat d7/d8/d72/d77/d126/f12e x:0 0 0 2023-12-16T07:40:53.033 INFO:tasks.workunit.client.1.smithi133.stdout:3/759: dread d7/d8/d1c/f66 [0,4194304] 0 2023-12-16T07:40:53.035 INFO:tasks.workunit.client.1.smithi133.stdout:3/760: rename d7/d8/d72/d86/fa7 to d7/d8/d1c/ddb/d95/db4/f12f 0 2023-12-16T07:40:53.036 INFO:tasks.workunit.client.1.smithi133.stdout:0/864: dread d2/d17/f1b [0,4194304] 0 2023-12-16T07:40:53.038 INFO:tasks.workunit.client.1.smithi133.stdout:0/865: mkdir d2/d9/d10a/d115 0 2023-12-16T07:40:53.053 INFO:tasks.workunit.client.1.smithi133.stdout:3/761: dwrite d7/d8/d1d/d2a/d5f/fb0 [0,4194304] 0 2023-12-16T07:40:53.105 INFO:tasks.workunit.client.1.smithi133.stdout:3/762: link d7/d8/d78/d43/d7f/cc7 d7/d8/d78/d43/d5b/c130 0 2023-12-16T07:40:53.141 INFO:tasks.workunit.client.1.smithi133.stdout:3/763: symlink d7/d8/d1c/ddb/dfb/d119/l131 0 2023-12-16T07:40:53.142 INFO:tasks.workunit.client.1.smithi133.stdout:3/764: write d7/d8/d1d/d2a/f94 [646133,17455] 0 2023-12-16T07:40:53.150 INFO:tasks.workunit.client.1.smithi133.stdout:5/744: sync 2023-12-16T07:40:53.150 INFO:tasks.workunit.client.1.smithi133.stdout:2/906: sync 2023-12-16T07:40:53.150 INFO:tasks.workunit.client.1.smithi133.stdout:8/802: sync 2023-12-16T07:40:53.152 INFO:tasks.workunit.client.1.smithi133.stdout:5/745: unlink d1/de/f3c 0 2023-12-16T07:40:53.152 INFO:tasks.workunit.client.1.smithi133.stdout:5/746: fdatasync d1/d1c/f40 0 2023-12-16T07:40:53.154 INFO:tasks.workunit.client.1.smithi133.stdout:8/803: symlink d9/d10/d39/d48/d44/d6e/d78/da6/dfc/l102 0 2023-12-16T07:40:53.155 INFO:tasks.workunit.client.1.smithi133.stdout:5/747: truncate d1/de/f50 1772164 0 2023-12-16T07:40:53.159 INFO:tasks.workunit.client.1.smithi133.stdout:8/804: mknod d9/d10/d39/d48/d44/c103 0 2023-12-16T07:40:53.161 INFO:tasks.workunit.client.1.smithi133.stdout:5/748: unlink d1/d4b/f5f 0 2023-12-16T07:40:53.163 INFO:tasks.workunit.client.1.smithi133.stdout:5/749: symlink d1/de/d52/da3/l101 0 2023-12-16T07:40:53.163 INFO:tasks.workunit.client.1.smithi133.stdout:8/805: read d9/dc/d27/fcb [1639011,76055] 0 2023-12-16T07:40:53.163 INFO:tasks.workunit.client.1.smithi133.stdout:8/806: chown d9/dc/de/l5b 37 1 2023-12-16T07:40:53.165 INFO:tasks.workunit.client.1.smithi133.stdout:5/750: dread d1/d18/d2c/f53 [0,4194304] 0 2023-12-16T07:40:53.166 INFO:tasks.workunit.client.1.smithi133.stdout:8/807: mkdir d9/d10/d39/d48/d92/dfa/ded/d104 0 2023-12-16T07:40:53.167 INFO:tasks.workunit.client.1.smithi133.stdout:2/907: dwrite da/fe [0,4194304] 0 2023-12-16T07:40:53.168 INFO:tasks.workunit.client.1.smithi133.stdout:2/908: fsync da/d15/d1b/f34 0 2023-12-16T07:40:53.168 INFO:tasks.workunit.client.1.smithi133.stdout:2/909: truncate da/d1d/d60/d74/ff4 508507 0 2023-12-16T07:40:53.169 INFO:tasks.workunit.client.1.smithi133.stdout:3/765: dwrite d7/d8/d1d/f33 [0,4194304] 0 2023-12-16T07:40:53.169 INFO:tasks.workunit.client.1.smithi133.stdout:3/766: chown d7/d8/d1c/d2b/d2d/fc2 125 1 2023-12-16T07:40:53.169 INFO:tasks.workunit.client.1.smithi133.stdout:5/751: creat d1/de/d57/d74/f102 x:0 0 0 2023-12-16T07:40:53.175 INFO:tasks.workunit.client.1.smithi133.stdout:8/808: dread d9/d11/d42/f4d [0,4194304] 0 2023-12-16T07:40:53.176 INFO:tasks.workunit.client.1.smithi133.stdout:8/809: read d9/d10/dc7/fba [3675742,90088] 0 2023-12-16T07:40:53.177 INFO:tasks.workunit.client.1.smithi133.stdout:5/752: rename d1/de/d35/f9f to d1/d4b/f103 0 2023-12-16T07:40:53.177 INFO:tasks.workunit.client.1.smithi133.stdout:5/753: write d1/d1c/f3b [5228230,26141] 0 2023-12-16T07:40:53.179 INFO:tasks.workunit.client.1.smithi133.stdout:2/910: dread da/d1d/d60/d71/d2e/d59/f9b [0,4194304] 0 2023-12-16T07:40:53.180 INFO:tasks.workunit.client.1.smithi133.stdout:8/810: unlink d9/f6a 0 2023-12-16T07:40:53.181 INFO:tasks.workunit.client.1.smithi133.stdout:5/754: creat d1/de/d35/f104 x:0 0 0 2023-12-16T07:40:53.182 INFO:tasks.workunit.client.1.smithi133.stdout:5/755: write d1/de/f13 [3581634,110612] 0 2023-12-16T07:40:53.183 INFO:tasks.workunit.client.1.smithi133.stdout:5/756: truncate d1/de/d35/dc6/fec 4357407 0 2023-12-16T07:40:53.183 INFO:tasks.workunit.client.1.smithi133.stdout:5/757: write d1/f24 [6926347,99211] 0 2023-12-16T07:40:53.184 INFO:tasks.workunit.client.1.smithi133.stdout:2/911: creat da/d15/d1b/d43/d85/dec/f11a x:0 0 0 2023-12-16T07:40:53.185 INFO:tasks.workunit.client.1.smithi133.stdout:8/811: mkdir d9/d10/d39/d48/d92/dfa/ded/d105 0 2023-12-16T07:40:53.190 INFO:tasks.workunit.client.1.smithi133.stdout:5/758: rename d1/d54/de1/f96 to d1/de/d57/dd6/f105 0 2023-12-16T07:40:53.192 INFO:tasks.workunit.client.1.smithi133.stdout:8/812: symlink d9/dc/d27/l106 0 2023-12-16T07:40:53.192 INFO:tasks.workunit.client.1.smithi133.stdout:5/759: write d1/de/d57/f8c [1045281,75566] 0 2023-12-16T07:40:53.193 INFO:tasks.workunit.client.1.smithi133.stdout:8/813: write d9/d10/d39/d48/d44/d6e/f94 [110409,57029] 0 2023-12-16T07:40:53.206 INFO:tasks.workunit.client.1.smithi133.stdout:5/760: rename d1/de/d57/dd6 to d1/d1c/d80/da7/d106 0 2023-12-16T07:40:53.206 INFO:tasks.workunit.client.1.smithi133.stdout:5/761: fsync d1/d18/d26/fad 0 2023-12-16T07:40:53.206 INFO:tasks.workunit.client.1.smithi133.stdout:5/762: write d1/d1c/f40 [888236,125681] 0 2023-12-16T07:40:53.210 INFO:tasks.workunit.client.1.smithi133.stdout:8/814: dwrite d9/dc/f4c [4194304,4194304] 0 2023-12-16T07:40:53.215 INFO:tasks.workunit.client.1.smithi133.stdout:8/815: truncate d9/d10/f91 3170679 0 2023-12-16T07:40:53.215 INFO:tasks.workunit.client.1.smithi133.stdout:8/816: dread - d9/d10/d39/d48/d44/fff zero size 2023-12-16T07:40:53.215 INFO:tasks.workunit.client.1.smithi133.stdout:5/763: dread d1/de/d35/dc6/fec [0,4194304] 0 2023-12-16T07:40:53.218 INFO:tasks.workunit.client.1.smithi133.stdout:5/764: truncate d1/de/d35/dc6/fb2 688671 0 2023-12-16T07:40:53.224 INFO:tasks.workunit.client.1.smithi133.stdout:5/765: creat d1/d1c/d80/dd7/df8/dfb/f107 x:0 0 0 2023-12-16T07:40:53.229 INFO:tasks.workunit.client.1.smithi133.stdout:5/766: rename d1/d1c/d80/fdd to d1/d1c/d80/dd7/f108 0 2023-12-16T07:40:53.229 INFO:tasks.workunit.client.1.smithi133.stdout:5/767: readlink d1/d1c/d80/d64/l7b 0 2023-12-16T07:40:53.229 INFO:tasks.workunit.client.1.smithi133.stdout:5/768: chown d1/d1c/l6a 186550 1 2023-12-16T07:40:53.232 INFO:tasks.workunit.client.1.smithi133.stdout:5/769: creat d1/d1c/d80/dd7/f109 x:0 0 0 2023-12-16T07:40:53.235 INFO:tasks.workunit.client.1.smithi133.stdout:5/770: creat d1/de/d57/f10a x:0 0 0 2023-12-16T07:40:53.251 INFO:tasks.workunit.client.1.smithi133.stdout:5/771: dwrite d1/de/d35/dc6/db4/faa [0,4194304] 0 2023-12-16T07:40:53.256 INFO:tasks.workunit.client.1.smithi133.stdout:5/772: creat d1/d1c/d80/dd7/f10b x:0 0 0 2023-12-16T07:40:53.257 INFO:tasks.workunit.client.1.smithi133.stdout:5/773: dread - d1/d18/d26/fad zero size 2023-12-16T07:40:53.257 INFO:tasks.workunit.client.1.smithi133.stdout:5/774: symlink d1/d18/l10c 0 2023-12-16T07:40:53.269 INFO:tasks.workunit.client.1.smithi133.stdout:0/866: sync 2023-12-16T07:40:53.269 INFO:tasks.workunit.client.1.smithi133.stdout:0/867: chown d2/d9/d20/c22 52224 1 2023-12-16T07:40:53.271 INFO:tasks.workunit.client.1.smithi133.stdout:0/868: creat d2/d9/d12/d35/d4f/f116 x:0 0 0 2023-12-16T07:40:53.277 INFO:tasks.workunit.client.1.smithi133.stdout:0/869: creat d2/d9/f117 x:0 0 0 2023-12-16T07:40:53.280 INFO:tasks.workunit.client.1.smithi133.stdout:5/775: dwrite d1/de/ff [0,4194304] 0 2023-12-16T07:40:53.281 INFO:tasks.workunit.client.1.smithi133.stdout:5/776: getdents d1/d1c/d80/da7 0 2023-12-16T07:40:53.282 INFO:tasks.workunit.client.1.smithi133.stdout:5/777: creat d1/d1c/d80/da7/f10d x:0 0 0 2023-12-16T07:40:53.283 INFO:tasks.workunit.client.1.smithi133.stdout:5/778: creat d1/d4b/f10e x:0 0 0 2023-12-16T07:40:53.285 INFO:tasks.workunit.client.1.smithi133.stdout:5/779: mknod d1/de/d52/da3/c10f 0 2023-12-16T07:40:53.285 INFO:tasks.workunit.client.1.smithi133.stdout:0/870: dread d2/d9/d12/f3f [0,4194304] 0 2023-12-16T07:40:53.286 INFO:tasks.workunit.client.1.smithi133.stdout:0/871: creat d2/d9/d8f/dcc/f118 x:0 0 0 2023-12-16T07:40:53.287 INFO:tasks.workunit.client.1.smithi133.stdout:0/872: chown d2/db2/cf5 2 1 2023-12-16T07:40:53.289 INFO:tasks.workunit.client.1.smithi133.stdout:0/873: symlink d2/d17/d2b/d31/d4d/da7/l119 0 2023-12-16T07:40:53.289 INFO:tasks.workunit.client.1.smithi133.stdout:0/874: chown d2/d9/d12/d35/d4f/f116 30380 1 2023-12-16T07:40:53.289 INFO:tasks.workunit.client.1.smithi133.stdout:0/875: write d2/d9/d20/fd6 [1025607,47119] 0 2023-12-16T07:40:53.290 INFO:tasks.workunit.client.1.smithi133.stdout:0/876: creat d2/f11a x:0 0 0 2023-12-16T07:40:53.292 INFO:tasks.workunit.client.1.smithi133.stdout:0/877: mknod d2/d17/dc2/c11b 0 2023-12-16T07:40:53.293 INFO:tasks.workunit.client.1.smithi133.stdout:0/878: unlink d2/d9/d12/d35/d4f/f116 0 2023-12-16T07:40:53.294 INFO:tasks.workunit.client.1.smithi133.stdout:0/879: truncate d2/d17/d2b/f88 985850 0 2023-12-16T07:40:53.294 INFO:tasks.workunit.client.1.smithi133.stdout:0/880: read d2/d17/d2b/d67/fad [2400300,55033] 0 2023-12-16T07:40:53.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/780: dwrite d1/de/dc7/fda [0,4194304] 0 2023-12-16T07:40:53.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/781: chown d1/d18/d26/l48 20027 1 2023-12-16T07:40:53.303 INFO:tasks.workunit.client.1.smithi133.stdout:5/782: creat d1/de/d35/f110 x:0 0 0 2023-12-16T07:40:53.304 INFO:tasks.workunit.client.1.smithi133.stdout:0/881: dread d2/d9/d20/d5e/d92/fc0 [0,4194304] 0 2023-12-16T07:40:53.305 INFO:tasks.workunit.client.1.smithi133.stdout:5/783: mkdir d1/d54/de1/d111 0 2023-12-16T07:40:53.307 INFO:tasks.workunit.client.1.smithi133.stdout:0/882: symlink d2/d9/d12/d45/d9e/de6/l11c 0 2023-12-16T07:40:53.308 INFO:tasks.workunit.client.1.smithi133.stdout:5/784: creat d1/d1c/d80/dd7/df8/f112 x:0 0 0 2023-12-16T07:40:53.308 INFO:tasks.workunit.client.1.smithi133.stdout:5/785: write d1/de/d52/f78 [2276734,61517] 0 2023-12-16T07:40:53.310 INFO:tasks.workunit.client.1.smithi133.stdout:0/883: creat d2/d9/f11d x:0 0 0 2023-12-16T07:40:53.312 INFO:tasks.workunit.client.1.smithi133.stdout:5/786: mkdir d1/de/d52/da3/d113 0 2023-12-16T07:40:53.312 INFO:tasks.workunit.client.1.smithi133.stdout:5/787: getdents d1/d54/de1/d111 0 2023-12-16T07:40:53.312 INFO:tasks.workunit.client.1.smithi133.stdout:5/788: fdatasync d1/d18/f47 0 2023-12-16T07:40:53.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/884: link d2/d17/d2b/f4b d2/d9/d20/d5e/d92/ddd/f11e 0 2023-12-16T07:40:53.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/885: read - d2/d17/fc8 zero size 2023-12-16T07:40:53.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/886: fsync d2/d9/d20/d5e/d89/fcd 0 2023-12-16T07:40:53.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/887: write d2/d9/db/fe [5822686,29395] 0 2023-12-16T07:40:53.315 INFO:tasks.workunit.client.1.smithi133.stdout:0/888: symlink d2/d9/d12/l11f 0 2023-12-16T07:40:53.320 INFO:tasks.workunit.client.1.smithi133.stdout:5/789: dread d1/de/d57/dc5/ff1 [0,4194304] 0 2023-12-16T07:40:53.331 INFO:tasks.workunit.client.1.smithi133.stdout:0/889: dwrite d2/d9/d20/d5e/d89/fcd [0,4194304] 0 2023-12-16T07:40:53.334 INFO:tasks.workunit.client.1.smithi133.stdout:0/890: truncate d2/d9/dc5/fd3 434910 0 2023-12-16T07:40:53.334 INFO:tasks.workunit.client.1.smithi133.stdout:0/891: fsync d2/d9/db/f5d 0 2023-12-16T07:40:53.334 INFO:tasks.workunit.client.1.smithi133.stdout:5/790: dwrite d1/d1c/d80/d8d/fb8 [0,4194304] 0 2023-12-16T07:40:53.334 INFO:tasks.workunit.client.1.smithi133.stdout:0/892: readlink d2/d17/lee 0 2023-12-16T07:40:53.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/791: chown d1/de/d52/da3/c10f 37 1 2023-12-16T07:40:53.337 INFO:tasks.workunit.client.1.smithi133.stdout:0/893: truncate d2/d9/d12/f14 1474229 0 2023-12-16T07:40:53.348 INFO:tasks.workunit.client.1.smithi133.stdout:0/894: link d2/d9/d20/d5e/d92/l5a d2/d17/d2b/d31/d4d/df9/l120 0 2023-12-16T07:40:53.352 INFO:tasks.workunit.client.1.smithi133.stdout:5/792: dwrite d1/ffc [0,4194304] 0 2023-12-16T07:40:53.352 INFO:tasks.workunit.client.1.smithi133.stdout:0/895: rename d2/d17/fbf to d2/d9/d20/f121 0 2023-12-16T07:40:53.352 INFO:tasks.workunit.client.1.smithi133.stdout:0/896: dread - d2/d9/d12/d45/d9e/f10c zero size 2023-12-16T07:40:53.352 INFO:tasks.workunit.client.1.smithi133.stdout:5/793: write d1/de/ff [672432,40862] 0 2023-12-16T07:40:53.354 INFO:tasks.workunit.client.1.smithi133.stdout:5/794: write d1/f10 [7910663,4406] 0 2023-12-16T07:40:53.356 INFO:tasks.workunit.client.1.smithi133.stdout:5/795: mknod d1/de/d35/dc6/db4/c114 0 2023-12-16T07:40:53.357 INFO:tasks.workunit.client.1.smithi133.stdout:0/897: mknod d2/d17/c122 0 2023-12-16T07:40:53.358 INFO:tasks.workunit.client.1.smithi133.stdout:5/796: mknod d1/d1c/c115 0 2023-12-16T07:40:53.359 INFO:tasks.workunit.client.1.smithi133.stdout:0/898: write d2/d17/d2b/d31/d4d/fa1 [3483419,56784] 0 2023-12-16T07:40:53.360 INFO:tasks.workunit.client.1.smithi133.stdout:5/797: link d1/d18/f42 d1/d1c/f116 0 2023-12-16T07:40:53.363 INFO:tasks.workunit.client.1.smithi133.stdout:5/798: mknod d1/de/d52/da3/d113/c117 0 2023-12-16T07:40:53.365 INFO:tasks.workunit.client.1.smithi133.stdout:5/799: creat d1/de/d35/dc6/db4/f118 x:0 0 0 2023-12-16T07:40:53.367 INFO:tasks.workunit.client.1.smithi133.stdout:5/800: rename d1/d1c/d80/d64/l7b to d1/d1c/d80/d64/dc1/dca/l119 0 2023-12-16T07:40:53.367 INFO:tasks.workunit.client.1.smithi133.stdout:5/801: chown d1/de/d57/d74/la1 796745656 1 2023-12-16T07:40:53.368 INFO:tasks.workunit.client.1.smithi133.stdout:5/802: rename d1/d18/d2c/f39 to d1/d54/de1/f11a 0 2023-12-16T07:40:53.372 INFO:tasks.workunit.client.1.smithi133.stdout:0/899: dwrite d2/d9/dc5/dd8/fec [0,4194304] 0 2023-12-16T07:40:53.396 INFO:tasks.workunit.client.1.smithi133.stdout:5/803: dwrite d1/de/f50 [0,4194304] 0 2023-12-16T07:40:53.396 INFO:tasks.workunit.client.1.smithi133.stdout:0/900: dwrite d2/f6 [4194304,4194304] 0 2023-12-16T07:40:53.399 INFO:tasks.workunit.client.1.smithi133.stdout:5/804: creat d1/de/d57/dc5/f11b x:0 0 0 2023-12-16T07:40:53.399 INFO:tasks.workunit.client.1.smithi133.stdout:5/805: readlink d1/d54/de1/lce 0 2023-12-16T07:40:53.402 INFO:tasks.workunit.client.1.smithi133.stdout:0/901: rename d2/d9/d8f/dcc/fd1 to d2/d9/d12/d76/f123 0 2023-12-16T07:40:53.408 INFO:tasks.workunit.client.1.smithi133.stdout:3/767: sync 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/768: rename d7/d8/d1c/ddb/fc1 to d7/d8/d72/f132 0 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/769: write d7/d8/d78/d43/f107 [110864,24293] 0 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:2/912: sync 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/817: sync 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/770: chown d7/d8/d1c/ddb/d95/le9 25805644 1 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/771: chown d7/d8/d1d/d2a/lbe 1953290167 1 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/772: chown d7/d8/d72/d86/dbf 20 1 2023-12-16T07:40:53.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/773: chown d7/d8/d1c/faa 75 1 2023-12-16T07:40:53.413 INFO:tasks.workunit.client.1.smithi133.stdout:8/818: chown d9/dc/f30 12884 1 2023-12-16T07:40:53.417 INFO:tasks.workunit.client.1.smithi133.stdout:2/913: rename da/d1d/d60/d71/d2e/d47/fdd to da/d1d/d60/f11b 0 2023-12-16T07:40:53.419 INFO:tasks.workunit.client.1.smithi133.stdout:3/774: symlink d7/d128/d12c/l133 0 2023-12-16T07:40:53.421 INFO:tasks.workunit.client.1.smithi133.stdout:2/914: creat da/d15/d1b/d43/f11c x:0 0 0 2023-12-16T07:40:53.425 INFO:tasks.workunit.client.1.smithi133.stdout:2/915: creat da/d1d/d60/d71/d2e/d47/d52/f11d x:0 0 0 2023-12-16T07:40:53.427 INFO:tasks.workunit.client.1.smithi133.stdout:2/916: creat da/d15/d1b/d83/da3/dd4/dda/d100/f11e x:0 0 0 2023-12-16T07:40:53.441 INFO:tasks.workunit.client.1.smithi133.stdout:0/902: dwrite d2/d9/f47 [0,4194304] 0 2023-12-16T07:40:53.441 INFO:tasks.workunit.client.1.smithi133.stdout:5/806: dwrite d1/f17 [0,4194304] 0 2023-12-16T07:40:53.443 INFO:tasks.workunit.client.1.smithi133.stdout:8/819: dwrite d9/dc/f30 [0,4194304] 0 2023-12-16T07:40:53.443 INFO:tasks.workunit.client.1.smithi133.stdout:3/775: dwrite d7/d8/d1c/ddb/fa3 [0,4194304] 0 2023-12-16T07:40:53.444 INFO:tasks.workunit.client.1.smithi133.stdout:2/917: dwrite da/d1d/d60/d71/d3a/d61/f68 [4194304,4194304] 0 2023-12-16T07:40:53.445 INFO:tasks.workunit.client.1.smithi133.stdout:8/820: creat d9/dc/d27/f107 x:0 0 0 2023-12-16T07:40:53.445 INFO:tasks.workunit.client.1.smithi133.stdout:2/918: read - da/d50/d8e/fce zero size 2023-12-16T07:40:53.445 INFO:tasks.workunit.client.1.smithi133.stdout:2/919: readlink da/d15/d1b/d83/da3/dd4/dda/ld7 0 2023-12-16T07:40:53.445 INFO:tasks.workunit.client.1.smithi133.stdout:2/920: write da/d1d/d60/d71/d2e/d47/f9e [818284,44390] 0 2023-12-16T07:40:53.445 INFO:tasks.workunit.client.1.smithi133.stdout:2/921: chown da/d1d/d60/d71/d2e/d47/d52/d80/ca9 0 1 2023-12-16T07:40:53.447 INFO:tasks.workunit.client.1.smithi133.stdout:3/776: read d7/d8/d1c/ddb/fa3 [265402,106783] 0 2023-12-16T07:40:53.448 INFO:tasks.workunit.client.1.smithi133.stdout:8/821: truncate d9/d10/d39/d48/d92/fbb 1816001 0 2023-12-16T07:40:53.448 INFO:tasks.workunit.client.1.smithi133.stdout:8/822: fdatasync d9/d10/f74 0 2023-12-16T07:40:53.448 INFO:tasks.workunit.client.1.smithi133.stdout:8/823: chown d9/dc/d27/c83 75122 1 2023-12-16T07:40:53.448 INFO:tasks.workunit.client.1.smithi133.stdout:8/824: getdents d9/dc/de/df3 0 2023-12-16T07:40:53.448 INFO:tasks.workunit.client.1.smithi133.stdout:3/777: creat d7/d8/d72/d86/dbf/f134 x:0 0 0 2023-12-16T07:40:53.449 INFO:tasks.workunit.client.1.smithi133.stdout:0/903: dread d2/d9/d12/d76/f123 [0,4194304] 0 2023-12-16T07:40:53.450 INFO:tasks.workunit.client.1.smithi133.stdout:8/825: write d9/dc/d27/fb0 [3077576,114323] 0 2023-12-16T07:40:53.453 INFO:tasks.workunit.client.1.smithi133.stdout:3/778: creat d7/d8/d78/f135 x:0 0 0 2023-12-16T07:40:53.453 INFO:tasks.workunit.client.1.smithi133.stdout:0/904: mkdir d2/d9/d12/d35/d124 0 2023-12-16T07:40:53.454 INFO:tasks.workunit.client.1.smithi133.stdout:2/922: dread da/d1d/d60/d71/d3a/d61/f68 [0,4194304] 0 2023-12-16T07:40:53.454 INFO:tasks.workunit.client.1.smithi133.stdout:2/923: fdatasync da/d15/d1b/d83/da3/fed 0 2023-12-16T07:40:53.455 INFO:tasks.workunit.client.1.smithi133.stdout:3/779: mknod d7/d8/d1c/d2b/c136 0 2023-12-16T07:40:53.455 INFO:tasks.workunit.client.1.smithi133.stdout:2/924: write da/d15/d1b/f70 [899090,15531] 0 2023-12-16T07:40:53.458 INFO:tasks.workunit.client.1.smithi133.stdout:3/780: creat d7/f137 x:0 0 0 2023-12-16T07:40:53.459 INFO:tasks.workunit.client.1.smithi133.stdout:8/826: dread d9/d11/d42/fa5 [0,4194304] 0 2023-12-16T07:40:53.459 INFO:tasks.workunit.client.1.smithi133.stdout:8/827: fdatasync d9/d10/d39/d48/d92/f95 0 2023-12-16T07:40:53.460 INFO:tasks.workunit.client.1.smithi133.stdout:8/828: dread d9/d10/f45 [0,4194304] 0 2023-12-16T07:40:53.460 INFO:tasks.workunit.client.1.smithi133.stdout:8/829: write d9/d10/f45 [449203,58986] 0 2023-12-16T07:40:53.460 INFO:tasks.workunit.client.1.smithi133.stdout:2/925: creat da/d1d/d60/d71/d2e/d47/d52/d80/f11f x:0 0 0 2023-12-16T07:40:53.463 INFO:tasks.workunit.client.1.smithi133.stdout:3/781: creat d7/d8/d1d/d11f/f138 x:0 0 0 2023-12-16T07:40:53.464 INFO:tasks.workunit.client.1.smithi133.stdout:3/782: chown d7/d8/d78/d43/d5b/cdc 311030 1 2023-12-16T07:40:53.464 INFO:tasks.workunit.client.1.smithi133.stdout:3/783: write d7/d8/d72/d86/ff5 [855019,81478] 0 2023-12-16T07:40:53.464 INFO:tasks.workunit.client.1.smithi133.stdout:3/784: write d7/d8/d78/d43/fd8 [919878,9131] 0 2023-12-16T07:40:53.464 INFO:tasks.workunit.client.1.smithi133.stdout:3/785: write d7/d8/d1c/ddb/d95/faf [4841427,42503] 0 2023-12-16T07:40:53.465 INFO:tasks.workunit.client.1.smithi133.stdout:3/786: rename d7/d8/d1d/d2a/d5f/cd5 to d7/d8/d78/d43/d7f/d85/c139 0 2023-12-16T07:40:53.468 INFO:tasks.workunit.client.1.smithi133.stdout:8/830: mknod d9/dc/c108 0 2023-12-16T07:40:53.468 INFO:tasks.workunit.client.1.smithi133.stdout:8/831: fdatasync d9/d10/d39/d48/d44/fff 0 2023-12-16T07:40:53.476 INFO:tasks.workunit.client.1.smithi133.stdout:0/905: write d2/d9/d12/f3f [2164014,31891] 0 2023-12-16T07:40:53.482 INFO:tasks.workunit.client.1.smithi133.stdout:2/926: dwrite da/d1d/d60/d71/d2e/d47/fb9 [0,4194304] 0 2023-12-16T07:40:53.482 INFO:tasks.workunit.client.1.smithi133.stdout:0/906: symlink d2/d9/d12/d35/l125 0 2023-12-16T07:40:53.483 INFO:tasks.workunit.client.1.smithi133.stdout:0/907: fdatasync d2/d9/d10a/f112 0 2023-12-16T07:40:53.483 INFO:tasks.workunit.client.1.smithi133.stdout:0/908: fdatasync d2/d9/d20/d5e/d89/de0/fe5 0 2023-12-16T07:40:53.483 INFO:tasks.workunit.client.1.smithi133.stdout:2/927: rename da/d15/lb0 to da/d1d/d60/d74/l120 0 2023-12-16T07:40:53.483 INFO:tasks.workunit.client.1.smithi133.stdout:2/928: read da/d1d/f72 [1011842,118061] 0 2023-12-16T07:40:53.484 INFO:tasks.workunit.client.1.smithi133.stdout:2/929: write da/d15/d17/d40/d98/fc6 [2183351,3362] 0 2023-12-16T07:40:53.484 INFO:tasks.workunit.client.1.smithi133.stdout:0/909: rename d2/d9/d8f/dcc/f118 to d2/d17/d2b/d31/d7f/f126 0 2023-12-16T07:40:53.484 INFO:tasks.workunit.client.1.smithi133.stdout:0/910: chown d2/d9/d20/d5e/d92/c87 18 1 2023-12-16T07:40:53.484 INFO:tasks.workunit.client.1.smithi133.stdout:3/787: dwrite d7/d8/d1d/f40 [4194304,4194304] 0 2023-12-16T07:40:53.486 INFO:tasks.workunit.client.1.smithi133.stdout:2/930: rename da/d15/d1b/l31 to da/d15/d1b/d43/l121 0 2023-12-16T07:40:53.488 INFO:tasks.workunit.client.1.smithi133.stdout:8/832: write d9/d10/d39/d48/d92/fbb [1432255,78138] 0 2023-12-16T07:40:53.488 INFO:tasks.workunit.client.1.smithi133.stdout:8/833: chown d9/d10/d39/d48/d44/c4e 11909396 1 2023-12-16T07:40:53.489 INFO:tasks.workunit.client.1.smithi133.stdout:0/911: creat d2/db2/f127 x:0 0 0 2023-12-16T07:40:53.490 INFO:tasks.workunit.client.1.smithi133.stdout:3/788: rename d7/d8/d1c/d2b/f9c to d7/d8/d78/d43/d7f/d85/f13a 0 2023-12-16T07:40:53.492 INFO:tasks.workunit.client.1.smithi133.stdout:8/834: mknod d9/d10/d39/c109 0 2023-12-16T07:40:53.495 INFO:tasks.workunit.client.1.smithi133.stdout:3/789: mknod d7/d8/d1d/d2a/d63/c13b 0 2023-12-16T07:40:53.495 INFO:tasks.workunit.client.1.smithi133.stdout:8/835: dread d9/d10/f37 [4194304,4194304] 0 2023-12-16T07:40:53.497 INFO:tasks.workunit.client.1.smithi133.stdout:2/931: mknod da/d1d/c122 0 2023-12-16T07:40:53.497 INFO:tasks.workunit.client.1.smithi133.stdout:3/790: dread d7/d8/f75 [0,4194304] 0 2023-12-16T07:40:53.497 INFO:tasks.workunit.client.1.smithi133.stdout:3/791: chown l4 28 1 2023-12-16T07:40:53.499 INFO:tasks.workunit.client.1.smithi133.stdout:8/836: rename d9/d10/d39/fd0 to d9/d10/d39/d48/d44/d69/f10a 0 2023-12-16T07:40:53.501 INFO:tasks.workunit.client.1.smithi133.stdout:2/932: mkdir da/d15/d1b/d83/da7/d123 0 2023-12-16T07:40:53.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/792: mkdir d7/d8/d1c/ddb/d95/db4/d13c 0 2023-12-16T07:40:53.508 INFO:tasks.workunit.client.1.smithi133.stdout:3/793: link d7/d8/d78/d43/d7f/d85/cba d7/d8/d1c/d87/c13d 0 2023-12-16T07:40:53.511 INFO:tasks.workunit.client.1.smithi133.stdout:8/837: mkdir d9/d2d/dc1/d10b 0 2023-12-16T07:40:53.512 INFO:tasks.workunit.client.1.smithi133.stdout:3/794: mknod d7/d8/d1c/d87/dad/c13e 0 2023-12-16T07:40:53.513 INFO:tasks.workunit.client.1.smithi133.stdout:3/795: fdatasync d7/d8/d72/d77/d126/f12e 0 2023-12-16T07:40:53.513 INFO:tasks.workunit.client.1.smithi133.stdout:3/796: fdatasync d7/d8/d1c/d2b/d2d/fd7 0 2023-12-16T07:40:53.514 INFO:tasks.workunit.client.1.smithi133.stdout:8/838: creat d9/d10/d39/d48/d92/f10c x:0 0 0 2023-12-16T07:40:53.515 INFO:tasks.workunit.client.1.smithi133.stdout:0/912: write d2/d9/db/f6c [748059,93131] 0 2023-12-16T07:40:53.517 INFO:tasks.workunit.client.1.smithi133.stdout:3/797: rename d7/d8/d1c/ddb/d95/fe5 to d7/d8/d78/f13f 0 2023-12-16T07:40:53.517 INFO:tasks.workunit.client.1.smithi133.stdout:3/798: fdatasync f3 0 2023-12-16T07:40:53.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/839: mkdir d9/d10/d39/d48/d44/d10d 0 2023-12-16T07:40:53.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/840: write d9/dc/fde [4536605,9152] 0 2023-12-16T07:40:53.519 INFO:tasks.workunit.client.1.smithi133.stdout:2/933: dwrite da/d15/d1b/d43/fc5 [0,4194304] 0 2023-12-16T07:40:53.519 INFO:tasks.workunit.client.1.smithi133.stdout:2/934: chown da/d50/db6/dc4/fc7 0 1 2023-12-16T07:40:53.520 INFO:tasks.workunit.client.1.smithi133.stdout:0/913: symlink d2/d9/d20/d5e/d89/l128 0 2023-12-16T07:40:53.522 INFO:tasks.workunit.client.1.smithi133.stdout:2/935: dread da/d15/d17/d40/f7c [0,4194304] 0 2023-12-16T07:40:53.522 INFO:tasks.workunit.client.1.smithi133.stdout:8/841: write d9/d2d/fcf [2281685,14522] 0 2023-12-16T07:40:53.522 INFO:tasks.workunit.client.1.smithi133.stdout:2/936: read - da/d15/d1b/d83/da3/dd4/fee zero size 2023-12-16T07:40:53.522 INFO:tasks.workunit.client.1.smithi133.stdout:2/937: readlink da/d1d/d60/d71/d2e/d47/lf8 0 2023-12-16T07:40:53.527 INFO:tasks.workunit.client.1.smithi133.stdout:8/842: mkdir d9/d10/d39/d48/d92/dfa/ded/d104/d10e 0 2023-12-16T07:40:53.528 INFO:tasks.workunit.client.1.smithi133.stdout:3/799: dread d7/d8/d78/d43/d7f/d85/f98 [0,4194304] 0 2023-12-16T07:40:53.529 INFO:tasks.workunit.client.1.smithi133.stdout:3/800: chown d7/d8/d72/f116 49317250 1 2023-12-16T07:40:53.529 INFO:tasks.workunit.client.1.smithi133.stdout:3/801: chown d7/d128 55190 1 2023-12-16T07:40:53.531 INFO:tasks.workunit.client.1.smithi133.stdout:3/802: write d7/d8/d72/d86/fe6 [2816760,47410] 0 2023-12-16T07:40:53.536 INFO:tasks.workunit.client.1.smithi133.stdout:3/803: rename d7/d8/d1c/d87/dad/c13e to d7/d8/d72/d77/db5/c140 0 2023-12-16T07:40:53.537 INFO:tasks.workunit.client.1.smithi133.stdout:8/843: dread d9/d10/d39/d48/f51 [4194304,4194304] 0 2023-12-16T07:40:53.537 INFO:tasks.workunit.client.1.smithi133.stdout:8/844: stat d9/d10/f3a 0 2023-12-16T07:40:53.537 INFO:tasks.workunit.client.1.smithi133.stdout:8/845: write d9/d10/d39/d48/d44/d69/f100 [652213,30353] 0 2023-12-16T07:40:53.538 INFO:tasks.workunit.client.1.smithi133.stdout:0/914: dwrite d2/d9/d20/d5e/fb9 [0,4194304] 0 2023-12-16T07:40:53.544 INFO:tasks.workunit.client.1.smithi133.stdout:3/804: creat d7/d8/d72/d86/dbf/f141 x:0 0 0 2023-12-16T07:40:53.552 INFO:tasks.workunit.client.1.smithi133.stdout:0/915: mknod d2/d17/d2b/d31/d4d/da7/c129 0 2023-12-16T07:40:53.552 INFO:tasks.workunit.client.1.smithi133.stdout:8/846: dwrite d9/d10/d39/d48/d44/d6e/d78/da6/fd8 [0,4194304] 0 2023-12-16T07:40:53.552 INFO:tasks.workunit.client.1.smithi133.stdout:8/847: chown d9/d10/d39/d48/d92/dfa/c61 156387619 1 2023-12-16T07:40:53.556 INFO:tasks.workunit.client.1.smithi133.stdout:3/805: rmdir d7/d8/d72/d77/d126 39 2023-12-16T07:40:53.556 INFO:tasks.workunit.client.1.smithi133.stdout:8/848: dread d9/d11/d42/f63 [0,4194304] 0 2023-12-16T07:40:53.556 INFO:tasks.workunit.client.1.smithi133.stdout:0/916: dread d2/d9/dc5/fd3 [0,4194304] 0 2023-12-16T07:40:53.561 INFO:tasks.workunit.client.1.smithi133.stdout:0/917: creat d2/d9/d20/d5e/d89/de0/f12a x:0 0 0 2023-12-16T07:40:53.563 INFO:tasks.workunit.client.1.smithi133.stdout:0/918: mkdir d2/d9/d12/d45/d9e/d12b 0 2023-12-16T07:40:53.566 INFO:tasks.workunit.client.1.smithi133.stdout:0/919: creat d2/d9/d12/d35/d4f/f12c x:0 0 0 2023-12-16T07:40:53.568 INFO:tasks.workunit.client.1.smithi133.stdout:0/920: mknod d2/d9/d20/d5e/c12d 0 2023-12-16T07:40:53.569 INFO:tasks.workunit.client.1.smithi133.stdout:0/921: readlink d2/d9/d20/d5e/d92/l5a 0 2023-12-16T07:40:53.579 INFO:tasks.workunit.client.1.smithi133.stdout:3/806: dwrite f6 [0,4194304] 0 2023-12-16T07:40:53.580 INFO:tasks.workunit.client.1.smithi133.stdout:3/807: chown d7/d8/d1c/fb7 312 1 2023-12-16T07:40:53.580 INFO:tasks.workunit.client.1.smithi133.stdout:8/849: dwrite d9/d11/d42/f63 [0,4194304] 0 2023-12-16T07:40:53.580 INFO:tasks.workunit.client.1.smithi133.stdout:0/922: dread d2/d17/d2b/f59 [0,4194304] 0 2023-12-16T07:40:53.580 INFO:tasks.workunit.client.1.smithi133.stdout:0/923: dread - d2/d9/d12/d35/d4f/f12c zero size 2023-12-16T07:40:53.586 INFO:tasks.workunit.client.1.smithi133.stdout:8/850: link d9/d10/d39/d48/d92/f10c d9/d10/d39/f10f 0 2023-12-16T07:40:53.602 INFO:tasks.workunit.client.1.smithi133.stdout:8/851: dwrite d9/f3e [4194304,4194304] 0 2023-12-16T07:40:53.603 INFO:tasks.workunit.client.1.smithi133.stdout:0/924: dwrite d2/d17/d2b/d67/fad [0,4194304] 0 2023-12-16T07:40:53.603 INFO:tasks.workunit.client.1.smithi133.stdout:0/925: write d2/d17/d2b/d31/d4d/df9/ddf/ff4 [751446,25584] 0 2023-12-16T07:40:53.603 INFO:tasks.workunit.client.1.smithi133.stdout:0/926: chown d2/d9/d20/d5e/d92/ddd/f11e 3 1 2023-12-16T07:40:53.603 INFO:tasks.workunit.client.1.smithi133.stdout:8/852: truncate d9/dc/fc3 97693 0 2023-12-16T07:40:53.605 INFO:tasks.workunit.client.1.smithi133.stdout:0/927: creat d2/d9/d8f/dcc/f12e x:0 0 0 2023-12-16T07:40:53.605 INFO:tasks.workunit.client.1.smithi133.stdout:0/928: truncate d2/f11a 73571 0 2023-12-16T07:40:53.607 INFO:tasks.workunit.client.1.smithi133.stdout:0/929: rename d2/d9/d12/f65 to d2/d9/d12/d76/f12f 0 2023-12-16T07:40:53.608 INFO:tasks.workunit.client.1.smithi133.stdout:0/930: creat d2/d9/d8f/dcc/f130 x:0 0 0 2023-12-16T07:40:53.624 INFO:tasks.workunit.client.1.smithi133.stdout:8/853: dwrite d9/d10/f8e [0,4194304] 0 2023-12-16T07:40:53.624 INFO:tasks.workunit.client.1.smithi133.stdout:8/854: chown d9/d10/dc7/la8 1391412 1 2023-12-16T07:40:53.624 INFO:tasks.workunit.client.1.smithi133.stdout:0/931: dwrite d2/d9/d12/d35/d4f/f10d [0,4194304] 0 2023-12-16T07:40:53.625 INFO:tasks.workunit.client.1.smithi133.stdout:0/932: dread - d2/d9/d12/d35/d4f/d93/f110 zero size 2023-12-16T07:40:53.631 INFO:tasks.workunit.client.1.smithi133.stdout:0/933: creat d2/db2/f131 x:0 0 0 2023-12-16T07:40:53.633 INFO:tasks.workunit.client.1.smithi133.stdout:0/934: rmdir d2/d9/d12/d45 39 2023-12-16T07:40:53.634 INFO:tasks.workunit.client.1.smithi133.stdout:0/935: mkdir d2/d9/dc5/d132 0 2023-12-16T07:40:53.634 INFO:tasks.workunit.client.1.smithi133.stdout:0/936: chown d2/d17/d2b/d31/d4d/df9/fff 1 1 2023-12-16T07:40:53.636 INFO:tasks.workunit.client.1.smithi133.stdout:0/937: rename d2/d9/d20/d5e/d89/fcd to d2/d9/d12/d76/f133 0 2023-12-16T07:40:53.636 INFO:tasks.workunit.client.1.smithi133.stdout:0/938: truncate d2/d9/d12/d35/d4f/fbe 1493234 0 2023-12-16T07:40:53.636 INFO:tasks.workunit.client.1.smithi133.stdout:0/939: chown d2/d9/l2f 251664668 1 2023-12-16T07:40:53.636 INFO:tasks.workunit.client.1.smithi133.stdout:0/940: chown d2/d9/d8f/l8c 899679543 1 2023-12-16T07:40:53.636 INFO:tasks.workunit.client.1.smithi133.stdout:8/855: dwrite d9/d10/d39/d48/d44/f53 [0,4194304] 0 2023-12-16T07:40:53.638 INFO:tasks.workunit.client.1.smithi133.stdout:0/941: fdatasync d2/d17/d2b/d31/d4d/df9/ddf/ff4 0 2023-12-16T07:40:53.640 INFO:tasks.workunit.client.1.smithi133.stdout:8/856: creat d9/d10/d39/d48/d44/d10d/f110 x:0 0 0 2023-12-16T07:40:53.640 INFO:tasks.workunit.client.1.smithi133.stdout:8/857: fdatasync d9/d11/fea 0 2023-12-16T07:40:53.641 INFO:tasks.workunit.client.1.smithi133.stdout:8/858: write d9/d10/d39/d48/f51 [7085466,29173] 0 2023-12-16T07:40:53.641 INFO:tasks.workunit.client.1.smithi133.stdout:8/859: chown d9/d85/ca0 3982847 1 2023-12-16T07:40:53.643 INFO:tasks.workunit.client.1.smithi133.stdout:0/942: dread d2/d17/d2b/d31/d63/fb7 [0,4194304] 0 2023-12-16T07:40:53.643 INFO:tasks.workunit.client.1.smithi133.stdout:0/943: mknod d2/d9/dc5/d132/c134 0 2023-12-16T07:40:53.647 INFO:tasks.workunit.client.1.smithi133.stdout:8/860: dread d9/d10/f91 [0,4194304] 0 2023-12-16T07:40:53.649 INFO:tasks.workunit.client.1.smithi133.stdout:8/861: creat d9/d10/d39/d48/d44/d6e/f111 x:0 0 0 2023-12-16T07:40:53.650 INFO:tasks.workunit.client.1.smithi133.stdout:8/862: truncate d9/d2d/fc9 1224239 0 2023-12-16T07:40:53.650 INFO:tasks.workunit.client.1.smithi133.stdout:8/863: chown d9/d11/cf7 0 1 2023-12-16T07:40:53.650 INFO:tasks.workunit.client.1.smithi133.stdout:8/864: chown d9/d10/d39/d48/d92/dfa 139106660 1 2023-12-16T07:40:53.652 INFO:tasks.workunit.client.1.smithi133.stdout:8/865: rename d9/d10/d39/d48/d92/dfa/ded/d104 to d9/d2d/dc1/d112 0 2023-12-16T07:40:53.653 INFO:tasks.workunit.client.1.smithi133.stdout:8/866: read d9/d85/ff4 [774589,127429] 0 2023-12-16T07:40:53.653 INFO:tasks.workunit.client.1.smithi133.stdout:8/867: chown d9/dc/d27/c83 3323843 1 2023-12-16T07:40:53.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/944: dwrite d2/d9/d20/d5e/f102 [0,4194304] 0 2023-12-16T07:40:53.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/945: write d2/d17/d2b/d31/d4d/f53 [4333791,30876] 0 2023-12-16T07:40:53.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/946: dread - d2/db2/f127 zero size 2023-12-16T07:40:53.665 INFO:tasks.workunit.client.1.smithi133.stdout:8/868: dread d9/d10/f74 [0,4194304] 0 2023-12-16T07:40:53.674 INFO:tasks.workunit.client.1.smithi133.stdout:0/947: dwrite d2/d9/dc5/dd8/fec [0,4194304] 0 2023-12-16T07:40:53.675 INFO:tasks.workunit.client.1.smithi133.stdout:0/948: mknod d2/d9/d12/d35/d124/c135 0 2023-12-16T07:40:53.678 INFO:tasks.workunit.client.1.smithi133.stdout:0/949: dread d2/d17/d2b/fa5 [0,4194304] 0 2023-12-16T07:40:53.678 INFO:tasks.workunit.client.1.smithi133.stdout:0/950: chown d2/d9/d20/d5e/d89/de0/fe5 15407 1 2023-12-16T07:40:53.679 INFO:tasks.workunit.client.1.smithi133.stdout:0/951: fdatasync d2/d17/fac 0 2023-12-16T07:40:53.680 INFO:tasks.workunit.client.1.smithi133.stdout:0/952: rmdir d2/d9/d12/d35 39 2023-12-16T07:40:53.680 INFO:tasks.workunit.client.1.smithi133.stdout:0/953: read d2/d9/d12/d76/f123 [1370121,41743] 0 2023-12-16T07:40:53.681 INFO:tasks.workunit.client.1.smithi133.stdout:0/954: mknod d2/d17/d2b/d31/d4d/da7/ded/c136 0 2023-12-16T07:40:53.684 INFO:tasks.workunit.client.1.smithi133.stdout:0/955: unlink d2/d9/dc5/d132/c134 0 2023-12-16T07:40:53.685 INFO:tasks.workunit.client.1.smithi133.stdout:0/956: read d2/d9/d20/d5e/d92/fc0 [4554179,9366] 0 2023-12-16T07:40:53.686 INFO:tasks.workunit.client.1.smithi133.stdout:0/957: rename d2/d17/d2b/d31/d4d/f53 to d2/d9/dc5/f137 0 2023-12-16T07:40:53.687 INFO:tasks.workunit.client.1.smithi133.stdout:0/958: chown d2/db2/f127 1020377 1 2023-12-16T07:40:53.687 INFO:tasks.workunit.client.1.smithi133.stdout:0/959: dread - d2/d9/d12/d45/d9e/f10c zero size 2023-12-16T07:40:53.688 INFO:tasks.workunit.client.1.smithi133.stdout:5/807: sync 2023-12-16T07:40:53.690 INFO:tasks.workunit.client.1.smithi133.stdout:2/938: sync 2023-12-16T07:40:53.693 INFO:tasks.workunit.client.1.smithi133.stdout:2/939: link da/dc2/c105 da/d15/dbe/dfb/c124 0 2023-12-16T07:40:53.697 INFO:tasks.workunit.client.1.smithi133.stdout:2/940: rename da/d1d/d60/d74/fc0 to da/d50/db6/dc4/f125 0 2023-12-16T07:40:53.707 INFO:tasks.workunit.client.1.smithi133.stdout:0/960: dwrite d2/d9/d12/d45/d9e/f10c [0,4194304] 0 2023-12-16T07:40:53.707 INFO:tasks.workunit.client.1.smithi133.stdout:0/961: dread - d2/d9/d20/d5e/d92/ff6 zero size 2023-12-16T07:40:53.707 INFO:tasks.workunit.client.1.smithi133.stdout:5/808: dwrite d1/f10 [4194304,4194304] 0 2023-12-16T07:40:53.707 INFO:tasks.workunit.client.1.smithi133.stdout:5/809: fsync d1/de/f32 0 2023-12-16T07:40:53.710 INFO:tasks.workunit.client.1.smithi133.stdout:0/962: unlink d2/d9/d12/d45/cb6 0 2023-12-16T07:40:53.719 INFO:tasks.workunit.client.1.smithi133.stdout:5/810: dwrite d1/de/fa2 [0,4194304] 0 2023-12-16T07:40:53.722 INFO:tasks.workunit.client.1.smithi133.stdout:2/941: rename da/d50/db6 to da/d15/dbe/db2/d126 0 2023-12-16T07:40:53.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/811: creat d1/de/dba/f11c x:0 0 0 2023-12-16T07:40:53.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/812: fsync d1/d4b/f10e 0 2023-12-16T07:40:53.735 INFO:tasks.workunit.client.1.smithi133.stdout:0/963: rename d2/d17/d2b/f77 to d2/d9/d10a/f138 0 2023-12-16T07:40:53.735 INFO:tasks.workunit.client.1.smithi133.stdout:2/942: creat da/d15/d1b/f127 x:0 0 0 2023-12-16T07:40:53.736 INFO:tasks.workunit.client.1.smithi133.stdout:2/943: chown da/d15/d17/d40/lad 0 1 2023-12-16T07:40:53.736 INFO:tasks.workunit.client.1.smithi133.stdout:0/964: write d2/db2/f104 [761115,55378] 0 2023-12-16T07:40:53.736 INFO:tasks.workunit.client.1.smithi133.stdout:0/965: readlink d2/d9/l9d 0 2023-12-16T07:40:53.736 INFO:tasks.workunit.client.1.smithi133.stdout:0/966: creat d2/d9/d20/d5e/d89/f139 x:0 0 0 2023-12-16T07:40:53.738 INFO:tasks.workunit.client.1.smithi133.stdout:5/813: dread d1/d18/f47 [0,4194304] 0 2023-12-16T07:40:53.739 INFO:tasks.workunit.client.1.smithi133.stdout:5/814: chown d1/ld 3410129 1 2023-12-16T07:40:53.739 INFO:tasks.workunit.client.1.smithi133.stdout:5/815: write d1/d1c/f51 [3534529,54717] 0 2023-12-16T07:40:53.745 INFO:tasks.workunit.client.1.smithi133.stdout:5/816: mkdir d1/d1c/d80/d64/dc1/dca/d11d 0 2023-12-16T07:40:53.749 INFO:tasks.workunit.client.1.smithi133.stdout:0/967: dwrite d2/d9/d20/d5e/ff8 [0,4194304] 0 2023-12-16T07:40:53.749 INFO:tasks.workunit.client.1.smithi133.stdout:0/968: rmdir d2/d9/d20 39 2023-12-16T07:40:53.750 INFO:tasks.workunit.client.1.smithi133.stdout:0/969: creat d2/d9/d12/d35/f13a x:0 0 0 2023-12-16T07:40:53.752 INFO:tasks.workunit.client.1.smithi133.stdout:0/970: write d2/d17/d2b/d31/d63/d98/fbd [3377606,6369] 0 2023-12-16T07:40:53.752 INFO:tasks.workunit.client.1.smithi133.stdout:0/971: creat d2/d9/d12/d35/f13b x:0 0 0 2023-12-16T07:40:53.753 INFO:tasks.workunit.client.1.smithi133.stdout:0/972: dread - d2/d17/d2b/d67/fe7 zero size 2023-12-16T07:40:53.753 INFO:tasks.workunit.client.1.smithi133.stdout:0/973: mkdir d2/d9/d20/d5e/d89/de0/d13c 0 2023-12-16T07:40:53.753 INFO:tasks.workunit.client.1.smithi133.stdout:0/974: truncate d2/d9/d12/d76/ffd 219037 0 2023-12-16T07:40:53.754 INFO:tasks.workunit.client.1.smithi133.stdout:0/975: creat d2/d9/dc5/d132/f13d x:0 0 0 2023-12-16T07:40:53.760 INFO:tasks.workunit.client.1.smithi133.stdout:5/817: dwrite d1/d54/de1/fa6 [0,4194304] 0 2023-12-16T07:40:53.761 INFO:tasks.workunit.client.1.smithi133.stdout:5/818: rmdir d1/de/d35/dc6/db4 39 2023-12-16T07:40:53.766 INFO:tasks.workunit.client.1.smithi133.stdout:5/819: mknod d1/d4b/c11e 0 2023-12-16T07:40:53.766 INFO:tasks.workunit.client.1.smithi133.stdout:5/820: dread - d1/de/d35/dc6/f8e zero size 2023-12-16T07:40:53.766 INFO:tasks.workunit.client.1.smithi133.stdout:5/821: chown d1/de/d67/c3f 1102341 1 2023-12-16T07:40:53.766 INFO:tasks.workunit.client.1.smithi133.stdout:0/976: dread d2/d17/d2b/d31/d4d/df9/f9f [0,4194304] 0 2023-12-16T07:40:53.767 INFO:tasks.workunit.client.1.smithi133.stdout:0/977: write d2/d9/d20/d5e/d92/ddd/f11e [4503187,70679] 0 2023-12-16T07:40:53.767 INFO:tasks.workunit.client.1.smithi133.stdout:5/822: creat d1/d1c/d80/dd7/f11f x:0 0 0 2023-12-16T07:40:53.769 INFO:tasks.workunit.client.1.smithi133.stdout:0/978: symlink d2/d17/d2b/d31/d4d/d101/l13e 0 2023-12-16T07:40:53.769 INFO:tasks.workunit.client.1.smithi133.stdout:0/979: dread - d2/d9/dc5/dd8/f114 zero size 2023-12-16T07:40:53.769 INFO:tasks.workunit.client.1.smithi133.stdout:0/980: write d2/d17/d2b/d31/d4d/d54/fde [4663334,37409] 0 2023-12-16T07:40:53.769 INFO:tasks.workunit.client.1.smithi133.stdout:0/981: write d2/d17/d2b/d31/d7f/f126 [857998,64873] 0 2023-12-16T07:40:53.770 INFO:tasks.workunit.client.1.smithi133.stdout:5/823: symlink d1/d1c/d80/d8d/l120 0 2023-12-16T07:40:53.771 INFO:tasks.workunit.client.1.smithi133.stdout:0/982: truncate d2/d9/db/f6c 544452 0 2023-12-16T07:40:53.772 INFO:tasks.workunit.client.1.smithi133.stdout:0/983: dread - d2/d9/d10a/f112 zero size 2023-12-16T07:40:53.772 INFO:tasks.workunit.client.1.smithi133.stdout:0/984: chown d2/d17/d2b/d31/d4d/df9/f49 1353848022 1 2023-12-16T07:40:53.774 INFO:tasks.workunit.client.1.smithi133.stdout:5/824: symlink d1/de/dc7/l121 0 2023-12-16T07:40:53.775 INFO:tasks.workunit.client.1.smithi133.stdout:0/985: mknod d2/d9/d20/d5e/c13f 0 2023-12-16T07:40:53.775 INFO:tasks.workunit.client.1.smithi133.stdout:5/825: read d1/de/d67/f2a [2253078,14296] 0 2023-12-16T07:40:53.779 INFO:tasks.workunit.client.1.smithi133.stdout:0/986: unlink d2/d9/d20/d5e/d92/f3d 0 2023-12-16T07:40:53.779 INFO:tasks.workunit.client.1.smithi133.stdout:0/987: stat d2/d9/d12/d76/f133 0 2023-12-16T07:40:53.779 INFO:tasks.workunit.client.1.smithi133.stdout:0/988: fdatasync d2/d9/d20/d5e/fb9 0 2023-12-16T07:40:53.789 INFO:tasks.workunit.client.1.smithi133.stdout:0/989: mkdir d2/d140 0 2023-12-16T07:40:53.792 INFO:tasks.workunit.client.1.smithi133.stdout:5/826: link d1/d1c/d80/da7/d106/f105 d1/de/d52/f122 0 2023-12-16T07:40:53.806 INFO:tasks.workunit.client.1.smithi133.stdout:0/990: dwrite d2/d9/d20/d5e/f102 [0,4194304] 0 2023-12-16T07:40:53.882 INFO:tasks.workunit.client.1.smithi133.stdout:0/991: symlink d2/d9/d12/d45/l141 0 2023-12-16T07:40:53.882 INFO:tasks.workunit.client.1.smithi133.stdout:0/992: chown d2/d9/dc5/dd8/l100 0 1 2023-12-16T07:40:53.887 INFO:tasks.workunit.client.1.smithi133.stdout:0/993: symlink d2/d9/d12/d45/l142 0 2023-12-16T07:40:53.888 INFO:tasks.workunit.client.1.smithi133.stdout:0/994: write d2/d9/d20/d5e/ff0 [301301,93433] 0 2023-12-16T07:40:53.899 INFO:tasks.workunit.client.1.smithi133.stdout:0/995: rename d2/d9/d12/f3f to d2/d9/d12/d76/f143 0 2023-12-16T07:40:53.901 INFO:tasks.workunit.client.1.smithi133.stdout:0/996: dread d2/d17/d2b/fa5 [0,4194304] 0 2023-12-16T07:40:53.904 INFO:tasks.workunit.client.1.smithi133.stdout:0/997: creat d2/d9/d12/d45/d9e/de6/dea/f144 x:0 0 0 2023-12-16T07:40:53.904 INFO:tasks.workunit.client.1.smithi133.stdout:0/998: write d2/d17/d2b/f59 [460913,85916] 0 2023-12-16T07:40:53.904 INFO:tasks.workunit.client.1.smithi133.stdout:0/999: write d2/d9/d20/d5e/ff0 [560117,70789] 0 2023-12-16T07:40:53.957 INFO:tasks.workunit.client.1.smithi133.stdout:8/869: sync 2023-12-16T07:40:53.958 INFO:tasks.workunit.client.1.smithi133.stdout:2/944: sync 2023-12-16T07:40:53.958 INFO:tasks.workunit.client.1.smithi133.stdout:3/808: sync 2023-12-16T07:40:53.958 INFO:tasks.workunit.client.1.smithi133.stdout:5/827: sync 2023-12-16T07:40:53.962 INFO:tasks.workunit.client.1.smithi133.stdout:3/809: getdents d7/d8/d78/de0 0 2023-12-16T07:40:53.962 INFO:tasks.workunit.client.1.smithi133.stdout:3/810: truncate d7/d8/d1d/fef 161249 0 2023-12-16T07:40:53.962 INFO:tasks.workunit.client.1.smithi133.stdout:8/870: dread d9/d10/d39/d48/f86 [0,4194304] 0 2023-12-16T07:40:53.962 INFO:tasks.workunit.client.1.smithi133.stdout:8/871: chown d9/dc/de/fa4 688110689 1 2023-12-16T07:40:53.963 INFO:tasks.workunit.client.1.smithi133.stdout:8/872: truncate d9/d10/d39/f10f 964861 0 2023-12-16T07:40:53.979 INFO:tasks.workunit.client.1.smithi133.stdout:5/828: truncate d1/d1c/d80/d64/f7a 3948910 0 2023-12-16T07:40:53.981 INFO:tasks.workunit.client.1.smithi133.stdout:8/873: creat d9/d10/d39/d48/d92/dfa/ded/f113 x:0 0 0 2023-12-16T07:40:53.981 INFO:tasks.workunit.client.1.smithi133.stdout:3/811: dread d7/d8/d1c/f4b [0,4194304] 0 2023-12-16T07:40:53.981 INFO:tasks.workunit.client.1.smithi133.stdout:3/812: stat d7/d8/d78/d43/d7f/d85/d8f 0 2023-12-16T07:40:53.981 INFO:tasks.workunit.client.1.smithi133.stdout:3/813: write d7/d8/d1d/fef [522804,121965] 0 2023-12-16T07:40:53.984 INFO:tasks.workunit.client.1.smithi133.stdout:8/874: truncate d9/f5e 3615113 0 2023-12-16T07:40:53.984 INFO:tasks.workunit.client.1.smithi133.stdout:8/875: chown d9/d2d/dc1/de3/lfe 1000 0 2023-12-16T07:40:53.984 INFO:tasks.workunit.client.1.smithi133.stdout:3/814: read d7/d8/d1d/dc9/ffc [109864,118808] 0 2023-12-16T07:40:53.984 INFO:tasks.workunit.client.1.smithi133.stdout:3/815: write d7/ff4 [276426,83213] 0 2023-12-16T07:40:53.984 INFO:tasks.workunit.client.1.smithi133.stdout:5/829: mkdir d1/d1c/d80/da7/d123 0 2023-12-16T07:40:53.984 INFO:tasks.workunit.client.1.smithi133.stdout:2/945: dread da/d15/d17/f36 [0,4194304] 0 2023-12-16T07:40:53.984 INFO:tasks.workunit.client.1.smithi133.stdout:3/816: mkdir d7/d128/d142 0 2023-12-16T07:40:53.985 INFO:tasks.workunit.client.1.smithi133.stdout:3/817: chown d7/d8/d1d/dc9/l10c 3168466 1 2023-12-16T07:40:53.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/946: mkdir da/d15/dea/d10e/d128 0 2023-12-16T07:40:53.985 INFO:tasks.workunit.client.1.smithi133.stdout:3/818: creat d7/d8/d1c/d2b/f143 x:0 0 0 2023-12-16T07:40:53.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/830: link d1/d4b/da5/cb9 d1/de/d57/dc5/c124 0 2023-12-16T07:40:53.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/947: link da/d15/d1b/d43/l121 da/d15/dbe/db2/d126/dc4/l129 0 2023-12-16T07:40:53.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/948: truncate da/d1d/d60/d71/d2e/fef 918827 0 2023-12-16T07:40:53.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/949: mkdir da/d15/d1b/d12a 0 2023-12-16T07:40:53.987 INFO:tasks.workunit.client.1.smithi133.stdout:5/831: dread d1/f34 [0,4194304] 0 2023-12-16T07:40:53.987 INFO:tasks.workunit.client.1.smithi133.stdout:5/832: write d1/d18/d26/f5e [885614,22901] 0 2023-12-16T07:40:53.991 INFO:tasks.workunit.client.1.smithi133.stdout:3/819: dwrite d7/d8/d78/f5d [4194304,4194304] 0 2023-12-16T07:40:53.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/833: dwrite d1/d1c/d80/dd7/df8/dfb/f107 [0,4194304] 0 2023-12-16T07:40:53.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/834: getdents d1/d54/de1/dd5 0 2023-12-16T07:40:53.999 INFO:tasks.workunit.client.1.smithi133.stdout:5/835: readlink d1/d1c/d80/d64/dc1/le9 0 2023-12-16T07:40:54.000 INFO:tasks.workunit.client.1.smithi133.stdout:5/836: rename d1/d1c/df7/fe4 to d1/d1c/d80/d64/dc1/dca/d11d/f125 0 2023-12-16T07:40:54.013 INFO:tasks.workunit.client.1.smithi133.stdout:5/837: dread d1/fb [0,4194304] 0 2023-12-16T07:40:54.014 INFO:tasks.workunit.client.1.smithi133.stdout:5/838: mknod d1/d1c/d80/d64/dc1/dca/c126 0 2023-12-16T07:40:54.014 INFO:tasks.workunit.client.1.smithi133.stdout:3/820: dwrite d7/d8/d1c/d87/f108 [0,4194304] 0 2023-12-16T07:40:54.016 INFO:tasks.workunit.client.1.smithi133.stdout:3/821: rename d7/d8/d1c/d87/dad/c123 to d7/d8/d1c/ddb/d95/db4/d13c/c144 0 2023-12-16T07:40:54.022 INFO:tasks.workunit.client.1.smithi133.stdout:5/839: dread d1/d4b/f4c [0,4194304] 0 2023-12-16T07:40:54.022 INFO:tasks.workunit.client.1.smithi133.stdout:5/840: truncate d1/de/d35/f104 558964 0 2023-12-16T07:40:54.025 INFO:tasks.workunit.client.1.smithi133.stdout:3/822: dread d7/d8/d1d/d2a/d5f/fb0 [0,4194304] 0 2023-12-16T07:40:54.027 INFO:tasks.workunit.client.1.smithi133.stdout:5/841: creat d1/d1c/d80/d64/dc1/dca/f127 x:0 0 0 2023-12-16T07:40:54.029 INFO:tasks.workunit.client.1.smithi133.stdout:5/842: dread d1/de/d35/dc6/db4/d71/f93 [0,4194304] 0 2023-12-16T07:40:54.033 INFO:tasks.workunit.client.1.smithi133.stdout:5/843: mkdir d1/de/d128 0 2023-12-16T07:40:54.033 INFO:tasks.workunit.client.1.smithi133.stdout:5/844: fsync d1/de/d35/dc6/db4/d71/f93 0 2023-12-16T07:40:54.037 INFO:tasks.workunit.client.1.smithi133.stdout:5/845: mknod d1/de/d35/dc6/db4/d71/c129 0 2023-12-16T07:40:54.037 INFO:tasks.workunit.client.1.smithi133.stdout:5/846: write d1/d4b/f10e [178772,20261] 0 2023-12-16T07:40:54.037 INFO:tasks.workunit.client.1.smithi133.stdout:5/847: dread - d1/de/d35/dc6/f8e zero size 2023-12-16T07:40:54.039 INFO:tasks.workunit.client.1.smithi133.stdout:5/848: symlink d1/de/d35/dc6/db4/l12a 0 2023-12-16T07:40:54.082 INFO:tasks.workunit.client.1.smithi133.stdout:5/849: truncate d1/de/d35/f104 358829 0 2023-12-16T07:40:54.083 INFO:tasks.workunit.client.1.smithi133.stdout:5/850: write d1/de/fe2 [667353,16875] 0 2023-12-16T07:40:54.084 INFO:tasks.workunit.client.1.smithi133.stdout:3/823: write d7/d8/f54 [951758,100722] 0 2023-12-16T07:40:54.085 INFO:tasks.workunit.client.1.smithi133.stdout:5/851: creat d1/d1c/d80/d64/f12b x:0 0 0 2023-12-16T07:40:54.112 INFO:tasks.workunit.client.1.smithi133.stdout:3/824: dwrite d7/d8/d1c/f101 [0,4194304] 0 2023-12-16T07:40:54.114 INFO:tasks.workunit.client.1.smithi133.stdout:3/825: creat d7/d8/d78/d43/d5b/f145 x:0 0 0 2023-12-16T07:40:54.115 INFO:tasks.workunit.client.1.smithi133.stdout:3/826: creat d7/d8/d72/d86/dbf/f146 x:0 0 0 2023-12-16T07:40:54.117 INFO:tasks.workunit.client.1.smithi133.stdout:3/827: unlink d7/d8/d1d/d2a/d62/lee 0 2023-12-16T07:40:54.119 INFO:tasks.workunit.client.1.smithi133.stdout:5/852: dwrite d1/de/d35/f104 [0,4194304] 0 2023-12-16T07:40:54.142 INFO:tasks.workunit.client.1.smithi133.stdout:2/950: sync 2023-12-16T07:40:54.145 INFO:tasks.workunit.client.1.smithi133.stdout:2/951: write da/d15/f8a [2267505,99224] 0 2023-12-16T07:40:54.145 INFO:tasks.workunit.client.1.smithi133.stdout:2/952: stat da/d15/d17/d40/d98/lae 0 2023-12-16T07:40:54.147 INFO:tasks.workunit.client.1.smithi133.stdout:2/953: getdents da/d15/d17 0 2023-12-16T07:40:54.147 INFO:tasks.workunit.client.1.smithi133.stdout:2/954: write da/dc2/ffa [727369,24258] 0 2023-12-16T07:40:54.147 INFO:tasks.workunit.client.1.smithi133.stdout:2/955: dread - da/d15/dbe/db2/d126/ffd zero size 2023-12-16T07:40:54.147 INFO:tasks.workunit.client.1.smithi133.stdout:2/956: dread - da/d15/dbe/db2/d126/ffd zero size 2023-12-16T07:40:54.147 INFO:tasks.workunit.client.1.smithi133.stdout:2/957: chown da/d15/d17/d40/d98/c111 2865166 1 2023-12-16T07:40:54.147 INFO:tasks.workunit.client.1.smithi133.stdout:2/958: chown da/d15/d1b/f75 36563788 1 2023-12-16T07:40:54.148 INFO:tasks.workunit.client.1.smithi133.stdout:2/959: link da/d15/d17/f116 da/d1d/d60/d71/d2e/d47/d52/d80/f12b 0 2023-12-16T07:40:54.149 INFO:tasks.workunit.client.1.smithi133.stdout:3/828: dwrite d7/d8/d72/d86/ffd [0,4194304] 0 2023-12-16T07:40:54.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/853: dwrite d1/d1c/f99 [0,4194304] 0 2023-12-16T07:40:54.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/854: dread - d1/de/d35/dc6/db4/d71/fc0 zero size 2023-12-16T07:40:54.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/855: stat d1/de/d52/l82 0 2023-12-16T07:40:54.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/856: read - d1/de/d57/dc5/f11b zero size 2023-12-16T07:40:54.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/857: read - d1/d1c/d80/d64/f12b zero size 2023-12-16T07:40:54.149 INFO:tasks.workunit.client.1.smithi133.stdout:8/876: sync 2023-12-16T07:40:54.155 INFO:tasks.workunit.client.1.smithi133.stdout:3/829: unlink d7/c13 0 2023-12-16T07:40:54.158 INFO:tasks.workunit.client.1.smithi133.stdout:2/960: dread da/d15/d1b/d43/f45 [0,4194304] 0 2023-12-16T07:40:54.160 INFO:tasks.workunit.client.1.smithi133.stdout:5/858: getdents d1/d1c/d80/dd7/df8 0 2023-12-16T07:40:54.161 INFO:tasks.workunit.client.1.smithi133.stdout:5/859: read - d1/d54/de1/fab zero size 2023-12-16T07:40:54.161 INFO:tasks.workunit.client.1.smithi133.stdout:8/877: mknod d9/d11/d42/dda/c114 0 2023-12-16T07:40:54.165 INFO:tasks.workunit.client.1.smithi133.stdout:2/961: link da/d1d/d60/f11b da/d15/d1b/d43/d85/dec/f12c 0 2023-12-16T07:40:54.167 INFO:tasks.workunit.client.1.smithi133.stdout:5/860: mkdir d1/d1c/d80/dd7/d12c 0 2023-12-16T07:40:54.170 INFO:tasks.workunit.client.1.smithi133.stdout:8/878: mknod d9/d10/d39/d48/d92/dfa/ded/c115 0 2023-12-16T07:40:54.171 INFO:tasks.workunit.client.1.smithi133.stdout:8/879: write d9/d11/d42/f63 [1759869,104811] 0 2023-12-16T07:40:54.172 INFO:tasks.workunit.client.1.smithi133.stdout:8/880: stat d9/dc/d27/f2b 0 2023-12-16T07:40:54.172 INFO:tasks.workunit.client.1.smithi133.stdout:8/881: chown d9/d10/d39/d48/d44/d6e/d78/da6/dfc 863 1 2023-12-16T07:40:54.172 INFO:tasks.workunit.client.1.smithi133.stdout:8/882: chown d9/f5e 185764 1 2023-12-16T07:40:54.172 INFO:tasks.workunit.client.1.smithi133.stdout:8/883: chown d9/d11/d42/c5d 10689804 1 2023-12-16T07:40:54.173 INFO:tasks.workunit.client.1.smithi133.stdout:3/830: dwrite d7/d8/d72/d86/f7b [0,4194304] 0 2023-12-16T07:40:54.174 INFO:tasks.workunit.client.1.smithi133.stdout:2/962: rename da/d15/d17/d40/fa5 to da/d15/d1b/d83/da3/dd4/dda/d100/f12d 0 2023-12-16T07:40:54.178 INFO:tasks.workunit.client.1.smithi133.stdout:5/861: mknod d1/d18/d2c/c12d 0 2023-12-16T07:40:54.184 INFO:tasks.workunit.client.1.smithi133.stdout:8/884: symlink d9/d11/d42/dda/l116 0 2023-12-16T07:40:54.187 INFO:tasks.workunit.client.1.smithi133.stdout:5/862: rename d1/de/d52/c88 to d1/de/d57/d74/c12e 0 2023-12-16T07:40:54.189 INFO:tasks.workunit.client.1.smithi133.stdout:8/885: symlink d9/l117 0 2023-12-16T07:40:54.189 INFO:tasks.workunit.client.1.smithi133.stdout:2/963: dwrite da/d15/d17/d40/f104 [0,4194304] 0 2023-12-16T07:40:54.190 INFO:tasks.workunit.client.1.smithi133.stdout:2/964: write da/d1d/d60/d71/d2e/f57 [2152149,31138] 0 2023-12-16T07:40:54.190 INFO:tasks.workunit.client.1.smithi133.stdout:2/965: chown da/d15/ff9 94675704 1 2023-12-16T07:40:54.190 INFO:tasks.workunit.client.1.smithi133.stdout:3/831: link d7/d8/d1c/d2b/l3f d7/d8/d1c/ddb/dfb/l147 0 2023-12-16T07:40:54.191 INFO:tasks.workunit.client.1.smithi133.stdout:2/966: write da/d1d/d60/f11b [1369401,52369] 0 2023-12-16T07:40:54.191 INFO:tasks.workunit.client.1.smithi133.stdout:2/967: read da/d15/ff9 [507651,112330] 0 2023-12-16T07:40:54.192 INFO:tasks.workunit.client.1.smithi133.stdout:2/968: read da/d15/d1b/d83/da3/dd4/dda/f113 [4727257,94027] 0 2023-12-16T07:40:54.192 INFO:tasks.workunit.client.1.smithi133.stdout:2/969: truncate da/d15/d17/f116 916363 0 2023-12-16T07:40:54.196 INFO:tasks.workunit.client.1.smithi133.stdout:5/863: symlink d1/d54/de1/dd5/l12f 0 2023-12-16T07:40:54.197 INFO:tasks.workunit.client.1.smithi133.stdout:5/864: write d1/f10 [6301919,65557] 0 2023-12-16T07:40:54.197 INFO:tasks.workunit.client.1.smithi133.stdout:8/886: mknod d9/c118 0 2023-12-16T07:40:54.200 INFO:tasks.workunit.client.1.smithi133.stdout:8/887: dread d9/dc/d27/fcb [0,4194304] 0 2023-12-16T07:40:54.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:53 smithi049 ceph-mon[111939]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 85 MiB/s rd, 167 MiB/s wr, 323 op/s 2023-12-16T07:40:54.211 INFO:tasks.workunit.client.1.smithi133.stdout:5/865: creat d1/d1c/d80/da7/d123/f130 x:0 0 0 2023-12-16T07:40:54.211 INFO:tasks.workunit.client.1.smithi133.stdout:8/888: truncate d9/f3e 5067079 0 2023-12-16T07:40:54.214 INFO:tasks.workunit.client.1.smithi133.stdout:5/866: mknod d1/d1c/d80/dd7/c131 0 2023-12-16T07:40:54.214 INFO:tasks.workunit.client.1.smithi133.stdout:5/867: chown d1/de/d57/la4 24 1 2023-12-16T07:40:54.214 INFO:tasks.workunit.client.1.smithi133.stdout:8/889: unlink d9/dc/f65 0 2023-12-16T07:40:54.215 INFO:tasks.workunit.client.1.smithi133.stdout:5/868: write d1/d18/f42 [2739144,51952] 0 2023-12-16T07:40:54.216 INFO:tasks.workunit.client.1.smithi133.stdout:2/970: dwrite da/d1d/d60/d71/d2e/d59/fdc [0,4194304] 0 2023-12-16T07:40:54.216 INFO:tasks.workunit.client.1.smithi133.stdout:2/971: fdatasync da/d15/d17/f116 0 2023-12-16T07:40:54.216 INFO:tasks.workunit.client.1.smithi133.stdout:8/890: unlink d9/dc/d27/fcb 0 2023-12-16T07:40:54.217 INFO:tasks.workunit.client.1.smithi133.stdout:8/891: write d9/d10/d39/d48/f51 [2613137,16354] 0 2023-12-16T07:40:54.217 INFO:tasks.workunit.client.1.smithi133.stdout:8/892: dread - d9/d10/d39/d48/d44/d6e/f111 zero size 2023-12-16T07:40:54.218 INFO:tasks.workunit.client.1.smithi133.stdout:8/893: chown d9/d11/d42/fa5 5 1 2023-12-16T07:40:54.218 INFO:tasks.workunit.client.1.smithi133.stdout:8/894: chown l7 12611 1 2023-12-16T07:40:54.218 INFO:tasks.workunit.client.1.smithi133.stdout:5/869: mkdir d1/d1c/d80/d8d/d132 0 2023-12-16T07:40:54.222 INFO:tasks.workunit.client.1.smithi133.stdout:2/972: mknod da/d1d/d60/d71/d3a/c12e 0 2023-12-16T07:40:54.225 INFO:tasks.workunit.client.1.smithi133.stdout:8/895: symlink d9/d85/l119 0 2023-12-16T07:40:54.225 INFO:tasks.workunit.client.1.smithi133.stdout:2/973: write da/f11 [3592150,27791] 0 2023-12-16T07:40:54.226 INFO:tasks.workunit.client.1.smithi133.stdout:5/870: unlink d1/de/d35/f104 0 2023-12-16T07:40:54.230 INFO:tasks.workunit.client.1.smithi133.stdout:8/896: rename d9/d11/cdc to d9/d10/d39/d48/d44/c11a 0 2023-12-16T07:40:54.232 INFO:tasks.workunit.client.1.smithi133.stdout:2/974: mknod da/d1d/d60/d71/d2e/d47/c12f 0 2023-12-16T07:40:54.235 INFO:tasks.workunit.client.1.smithi133.stdout:8/897: dread - d9/d2d/f40 zero size 2023-12-16T07:40:54.238 INFO:tasks.workunit.client.1.smithi133.stdout:8/898: mkdir d9/d10/d39/d48/d44/d6e/d78/d11b 0 2023-12-16T07:40:54.238 INFO:tasks.workunit.client.1.smithi133.stdout:8/899: stat d9/d10/d39/d48/d92/dfa/ded 0 2023-12-16T07:40:54.238 INFO:tasks.workunit.client.1.smithi133.stdout:3/832: dwrite d7/d8/d78/d43/d5b/f89 [0,4194304] 0 2023-12-16T07:40:54.239 INFO:tasks.workunit.client.1.smithi133.stdout:2/975: mkdir da/d1d/d130 0 2023-12-16T07:40:54.239 INFO:tasks.workunit.client.1.smithi133.stdout:2/976: chown da/d15/d1b/d43/d85/dec 19 1 2023-12-16T07:40:54.239 INFO:tasks.workunit.client.1.smithi133.stdout:8/900: mknod d9/d10/d39/d48/d44/d6e/d78/da6/c11c 0 2023-12-16T07:40:54.240 INFO:tasks.workunit.client.1.smithi133.stdout:8/901: write d9/f41 [5492377,76840] 0 2023-12-16T07:40:54.240 INFO:tasks.workunit.client.1.smithi133.stdout:8/902: chown d9/d11/d42 983166357 1 2023-12-16T07:40:54.241 INFO:tasks.workunit.client.1.smithi133.stdout:3/833: creat d7/d8/d1c/d2b/f148 x:0 0 0 2023-12-16T07:40:54.241 INFO:tasks.workunit.client.1.smithi133.stdout:3/834: chown d7/d8/d1d/d2a/d5f 0 1 2023-12-16T07:40:54.242 INFO:tasks.workunit.client.1.smithi133.stdout:8/903: link d9/dc/f30 d9/d11/d42/dda/def/f11d 0 2023-12-16T07:40:54.243 INFO:tasks.workunit.client.1.smithi133.stdout:5/871: dwrite d1/d18/d26/f9c [0,4194304] 0 2023-12-16T07:40:54.243 INFO:tasks.workunit.client.1.smithi133.stdout:3/835: truncate d7/d8/d78/de0/ffe 3885900 0 2023-12-16T07:40:54.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/872: mknod d1/de/d57/dc5/c133 0 2023-12-16T07:40:54.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/873: chown d1/d1c/d80/dd7/f11f 0 1 2023-12-16T07:40:54.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/874: stat d1/d1c/fe6 0 2023-12-16T07:40:54.245 INFO:tasks.workunit.client.1.smithi133.stdout:3/836: mknod d7/d8/d1d/dc9/c149 0 2023-12-16T07:40:54.247 INFO:tasks.workunit.client.1.smithi133.stdout:3/837: creat d7/d8/d1d/d2a/f14a x:0 0 0 2023-12-16T07:40:54.249 INFO:tasks.workunit.client.1.smithi133.stdout:3/838: creat d7/d8/d78/d43/d7f/f14b x:0 0 0 2023-12-16T07:40:54.258 INFO:tasks.workunit.client.1.smithi133.stdout:2/977: dwrite da/d1d/d60/d74/f109 [0,4194304] 0 2023-12-16T07:40:54.258 INFO:tasks.workunit.client.1.smithi133.stdout:2/978: fsync da/d15/d17/d40/fa2 0 2023-12-16T07:40:54.263 INFO:tasks.workunit.client.1.smithi133.stdout:8/904: write d9/d85/ff4 [3565730,112816] 0 2023-12-16T07:40:54.271 INFO:tasks.workunit.client.1.smithi133.stdout:3/839: dwrite d7/d8/d1c/faa [0,4194304] 0 2023-12-16T07:40:54.273 INFO:tasks.workunit.client.1.smithi133.stdout:3/840: mknod d7/d8/d1c/d87/c14c 0 2023-12-16T07:40:54.275 INFO:tasks.workunit.client.1.smithi133.stdout:2/979: dwrite da/d15/dbe/feb [0,4194304] 0 2023-12-16T07:40:54.278 INFO:tasks.workunit.client.1.smithi133.stdout:2/980: creat da/d1d/d130/f131 x:0 0 0 2023-12-16T07:40:54.279 INFO:tasks.workunit.client.1.smithi133.stdout:3/841: dread d7/d8/d1c/f31 [0,4194304] 0 2023-12-16T07:40:54.280 INFO:tasks.workunit.client.1.smithi133.stdout:3/842: write d7/d8/d72/d77/f97 [609438,33409] 0 2023-12-16T07:40:54.280 INFO:tasks.workunit.client.1.smithi133.stdout:2/981: dread da/d15/d1b/d43/fcd [0,4194304] 0 2023-12-16T07:40:54.283 INFO:tasks.workunit.client.1.smithi133.stdout:3/843: rename d7/d8/d78/d43/d5b/c130 to d7/d8/d1d/d2a/c14d 0 2023-12-16T07:40:54.283 INFO:tasks.workunit.client.1.smithi133.stdout:5/875: dwrite d1/d1c/f38 [0,4194304] 0 2023-12-16T07:40:54.283 INFO:tasks.workunit.client.1.smithi133.stdout:5/876: stat d1/de/d67/c29 0 2023-12-16T07:40:54.283 INFO:tasks.workunit.client.1.smithi133.stdout:5/877: write d1/de/d35/dc6/db4/d71/fdc [433645,54352] 0 2023-12-16T07:40:54.286 INFO:tasks.workunit.client.1.smithi133.stdout:8/905: dwrite d9/dc/d27/f29 [0,4194304] 0 2023-12-16T07:40:54.288 INFO:tasks.workunit.client.1.smithi133.stdout:8/906: write d9/dc/de/fa4 [2597222,24978] 0 2023-12-16T07:40:54.288 INFO:tasks.workunit.client.1.smithi133.stdout:3/844: mkdir d7/d8/d1d/d2a/d62/de3/d14e 0 2023-12-16T07:40:54.288 INFO:tasks.workunit.client.1.smithi133.stdout:3/845: truncate d7/d8/d1c/ddb/d95/db4/f11a 4489914 0 2023-12-16T07:40:54.293 INFO:tasks.workunit.client.1.smithi133.stdout:8/907: link c4 d9/d85/dd6/c11e 0 2023-12-16T07:40:54.295 INFO:tasks.workunit.client.1.smithi133.stdout:3/846: mknod d7/d8/d78/d43/c14f 0 2023-12-16T07:40:54.295 INFO:tasks.workunit.client.1.smithi133.stdout:3/847: read d7/d8/d78/d43/d7f/d85/d8f/ff9 [466811,95979] 0 2023-12-16T07:40:54.298 INFO:tasks.workunit.client.1.smithi133.stdout:8/908: getdents d9/d10/d39/d48/d44/d6e/d78/da6/dfc 0 2023-12-16T07:40:54.313 INFO:tasks.workunit.client.1.smithi133.stdout:5/878: dwrite d1/fb [0,4194304] 0 2023-12-16T07:40:54.318 INFO:tasks.workunit.client.1.smithi133.stdout:2/982: dwrite da/d1d/f96 [0,4194304] 0 2023-12-16T07:40:54.319 INFO:tasks.workunit.client.1.smithi133.stdout:5/879: fsync d1/d18/f42 0 2023-12-16T07:40:54.319 INFO:tasks.workunit.client.1.smithi133.stdout:5/880: fsync d1/de/d35/f37 0 2023-12-16T07:40:54.319 INFO:tasks.workunit.client.1.smithi133.stdout:8/909: dwrite d9/d10/f37 [0,4194304] 0 2023-12-16T07:40:54.334 INFO:tasks.workunit.client.1.smithi133.stdout:2/983: dwrite da/d15/d17/fdf [0,4194304] 0 2023-12-16T07:40:54.334 INFO:tasks.workunit.client.1.smithi133.stdout:2/984: truncate da/d1d/d130/f131 165981 0 2023-12-16T07:40:54.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:53 smithi133 ceph-mon[120445]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 85 MiB/s rd, 167 MiB/s wr, 323 op/s 2023-12-16T07:40:54.382 INFO:tasks.workunit.client.1.smithi133.stdout:5/881: creat d1/d1c/f134 x:0 0 0 2023-12-16T07:40:54.382 INFO:tasks.workunit.client.1.smithi133.stdout:5/882: chown d1/d1c/df7 1956270 1 2023-12-16T07:40:54.387 INFO:tasks.workunit.client.1.smithi133.stdout:8/910: rmdir d9/d11/d42/dda 39 2023-12-16T07:40:54.392 INFO:tasks.workunit.client.1.smithi133.stdout:2/985: creat da/d15/dbe/db2/d126/f132 x:0 0 0 2023-12-16T07:40:54.395 INFO:tasks.workunit.client.1.smithi133.stdout:2/986: mknod da/d15/d1b/d83/da7/c133 0 2023-12-16T07:40:54.395 INFO:tasks.workunit.client.1.smithi133.stdout:2/987: chown da/d15/dbe/dfb/c124 1237650 1 2023-12-16T07:40:54.396 INFO:tasks.workunit.client.1.smithi133.stdout:8/911: dread d9/d85/fae [0,4194304] 0 2023-12-16T07:40:54.397 INFO:tasks.workunit.client.1.smithi133.stdout:2/988: creat da/d50/d8e/f134 x:0 0 0 2023-12-16T07:40:54.398 INFO:tasks.workunit.client.1.smithi133.stdout:5/883: dwrite d1/de/fe2 [0,4194304] 0 2023-12-16T07:40:54.399 INFO:tasks.workunit.client.1.smithi133.stdout:2/989: rmdir da/d15/d1b/d83 39 2023-12-16T07:40:54.405 INFO:tasks.workunit.client.1.smithi133.stdout:5/884: getdents d1/de/d35/dc6/db4/d71 0 2023-12-16T07:40:54.405 INFO:tasks.workunit.client.1.smithi133.stdout:5/885: stat d1/f10 0 2023-12-16T07:40:54.405 INFO:tasks.workunit.client.1.smithi133.stdout:5/886: truncate d1/d1c/d80/dd7/df8/f112 999527 0 2023-12-16T07:40:54.409 INFO:tasks.workunit.client.1.smithi133.stdout:2/990: dread f4 [0,4194304] 0 2023-12-16T07:40:54.409 INFO:tasks.workunit.client.1.smithi133.stdout:2/991: write da/d15/d1b/f127 [367078,12907] 0 2023-12-16T07:40:54.410 INFO:tasks.workunit.client.1.smithi133.stdout:5/887: read d1/d1c/fe6 [1895244,94622] 0 2023-12-16T07:40:54.410 INFO:tasks.workunit.client.1.smithi133.stdout:2/992: rename da/d1d/d60/d71/l53 to da/d1d/d60/d74/l135 0 2023-12-16T07:40:54.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/912: dwrite d9/d11/d42/f7a [0,4194304] 0 2023-12-16T07:40:54.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/913: getdents d9/d2d/dc1/d10b 0 2023-12-16T07:40:54.411 INFO:tasks.workunit.client.1.smithi133.stdout:2/993: write da/fd [659531,39617] 0 2023-12-16T07:40:54.413 INFO:tasks.workunit.client.1.smithi133.stdout:5/888: creat d1/de/d52/f135 x:0 0 0 2023-12-16T07:40:54.417 INFO:tasks.workunit.client.1.smithi133.stdout:8/914: write d9/d2d/f8a [461659,130254] 0 2023-12-16T07:40:54.422 INFO:tasks.workunit.client.1.smithi133.stdout:5/889: creat d1/d1c/d80/d8d/d132/f136 x:0 0 0 2023-12-16T07:40:54.422 INFO:tasks.workunit.client.1.smithi133.stdout:5/890: fdatasync d1/d1c/d80/dd7/df8/dfb/f107 0 2023-12-16T07:40:54.422 INFO:tasks.workunit.client.1.smithi133.stdout:5/891: fdatasync d1/de/d35/dc6/fb2 0 2023-12-16T07:40:54.423 INFO:tasks.workunit.client.1.smithi133.stdout:5/892: read d1/f17 [970833,71616] 0 2023-12-16T07:40:54.423 INFO:tasks.workunit.client.1.smithi133.stdout:5/893: fdatasync d1/de/d52/f122 0 2023-12-16T07:40:54.423 INFO:tasks.workunit.client.1.smithi133.stdout:5/894: readlink d1/d1c/l28 0 2023-12-16T07:40:54.423 INFO:tasks.workunit.client.1.smithi133.stdout:5/895: dread - d1/d1c/d80/da7/f10d zero size 2023-12-16T07:40:54.424 INFO:tasks.workunit.client.1.smithi133.stdout:5/896: write d1/de/fe2 [1331806,73516] 0 2023-12-16T07:40:54.424 INFO:tasks.workunit.client.1.smithi133.stdout:5/897: chown d1/d54/de1/d111 698 1 2023-12-16T07:40:54.427 INFO:tasks.workunit.client.1.smithi133.stdout:2/994: rmdir da/d1d/d60/d71 39 2023-12-16T07:40:54.429 INFO:tasks.workunit.client.1.smithi133.stdout:2/995: rename da/d1d/fe7 to da/d1d/d130/f136 0 2023-12-16T07:40:54.429 INFO:tasks.workunit.client.1.smithi133.stdout:2/996: stat da/d1d/c91 0 2023-12-16T07:40:54.429 INFO:tasks.workunit.client.1.smithi133.stdout:2/997: chown da/d1d/d60/d71/d2e/d59/cd5 23 1 2023-12-16T07:40:54.435 INFO:tasks.workunit.client.1.smithi133.stdout:2/998: rename da/d1d/d130 to da/d1d/d60/d71/d2e/d47/d52/d137 0 2023-12-16T07:40:54.437 INFO:tasks.workunit.client.1.smithi133.stdout:2/999: truncate da/f5c 1672949 0 2023-12-16T07:40:54.444 INFO:tasks.workunit.client.1.smithi133.stdout:5/898: dwrite d1/de/dba/f11c [0,4194304] 0 2023-12-16T07:40:54.444 INFO:tasks.workunit.client.1.smithi133.stdout:5/899: write d1/de/d35/dc6/db4/d71/fdc [1107636,98053] 0 2023-12-16T07:40:54.444 INFO:tasks.workunit.client.1.smithi133.stdout:8/915: dwrite d9/f41 [0,4194304] 0 2023-12-16T07:40:54.451 INFO:tasks.workunit.client.1.smithi133.stdout:8/916: symlink d9/d10/d39/d48/d44/d10d/l11f 0 2023-12-16T07:40:54.452 INFO:tasks.workunit.client.1.smithi133.stdout:8/917: creat d9/d2d/dc1/d112/d10e/f120 x:0 0 0 2023-12-16T07:40:54.452 INFO:tasks.workunit.client.1.smithi133.stdout:8/918: truncate d9/d10/d39/d48/f86 624005 0 2023-12-16T07:40:54.473 INFO:tasks.workunit.client.1.smithi133.stdout:5/900: dwrite d1/de/d57/d74/f102 [0,4194304] 0 2023-12-16T07:40:54.473 INFO:tasks.workunit.client.1.smithi133.stdout:5/901: readlink d1/de/lb6 0 2023-12-16T07:40:54.474 INFO:tasks.workunit.client.1.smithi133.stdout:5/902: read d1/d1c/f38 [42081,88073] 0 2023-12-16T07:40:54.474 INFO:tasks.workunit.client.1.smithi133.stdout:8/919: dwrite d9/dc/d27/fb0 [4194304,4194304] 0 2023-12-16T07:40:54.484 INFO:tasks.workunit.client.1.smithi133.stdout:5/903: rename d1/d18/lbf to d1/d1c/d80/da7/d123/l137 0 2023-12-16T07:40:54.486 INFO:tasks.workunit.client.1.smithi133.stdout:8/920: unlink d9/d10/lcd 0 2023-12-16T07:40:54.486 INFO:tasks.workunit.client.1.smithi133.stdout:8/921: write d9/d10/d39/d48/d92/fce [1112329,108684] 0 2023-12-16T07:40:54.489 INFO:tasks.workunit.client.1.smithi133.stdout:5/904: creat d1/d18/f138 x:0 0 0 2023-12-16T07:40:54.489 INFO:tasks.workunit.client.1.smithi133.stdout:8/922: write d9/d2d/feb [179420,5004] 0 2023-12-16T07:40:54.491 INFO:tasks.workunit.client.1.smithi133.stdout:8/923: rmdir d9/d10/d39/d48/d92/dfa 39 2023-12-16T07:40:54.494 INFO:tasks.workunit.client.1.smithi133.stdout:8/924: rename d9/d10/d39/d48/lc6 to d9/d85/de5/l121 0 2023-12-16T07:40:54.496 INFO:tasks.workunit.client.1.smithi133.stdout:8/925: creat d9/d2d/dc1/f122 x:0 0 0 2023-12-16T07:40:54.496 INFO:tasks.workunit.client.1.smithi133.stdout:8/926: write d9/d11/d42/dda/def/f11d [4663099,76357] 0 2023-12-16T07:40:54.496 INFO:tasks.workunit.client.1.smithi133.stdout:8/927: fsync d9/d10/d39/d48/d92/f10c 0 2023-12-16T07:40:54.498 INFO:tasks.workunit.client.1.smithi133.stdout:8/928: rename d9/d10/d39/d48/f51 to d9/d10/f123 0 2023-12-16T07:40:54.499 INFO:tasks.workunit.client.1.smithi133.stdout:8/929: creat d9/d2d/dc1/de3/f124 x:0 0 0 2023-12-16T07:40:54.500 INFO:tasks.workunit.client.1.smithi133.stdout:8/930: read d9/d10/d39/f10f [245091,81142] 0 2023-12-16T07:40:54.508 INFO:tasks.workunit.client.1.smithi133.stdout:5/905: dwrite d1/d1c/d80/d64/dc1/dca/ff5 [0,4194304] 0 2023-12-16T07:40:54.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/931: dwrite d9/d10/d39/d48/f7f [4194304,4194304] 0 2023-12-16T07:40:54.530 INFO:tasks.workunit.client.1.smithi133.stdout:8/932: dwrite d9/d10/d39/d48/d92/f95 [0,4194304] 0 2023-12-16T07:40:54.530 INFO:tasks.workunit.client.1.smithi133.stdout:8/933: stat d9/d11/d52/f9b 0 2023-12-16T07:40:54.544 INFO:tasks.workunit.client.1.smithi133.stdout:8/934: dwrite d9/dc/f30 [0,4194304] 0 2023-12-16T07:40:54.633 INFO:tasks.workunit.client.1.smithi133.stdout:3/848: sync 2023-12-16T07:40:54.652 INFO:tasks.workunit.client.1.smithi133.stdout:3/849: dwrite d7/f8e [0,4194304] 0 2023-12-16T07:40:54.653 INFO:tasks.workunit.client.1.smithi133.stdout:3/850: getdents d7/d8/d1d/dc9 0 2023-12-16T07:40:54.654 INFO:tasks.workunit.client.1.smithi133.stdout:3/851: chown d7/d8/d1c/ddb/c93 0 1 2023-12-16T07:40:54.668 INFO:tasks.workunit.client.1.smithi133.stdout:3/852: dwrite d7/d8/f84 [0,4194304] 0 2023-12-16T07:40:54.670 INFO:tasks.workunit.client.1.smithi133.stdout:3/853: mknod d7/d8/d1d/d2a/d62/de3/c150 0 2023-12-16T07:40:54.679 INFO:tasks.workunit.client.1.smithi133.stdout:3/854: dread d7/d8/d1c/ddb/d95/db4/f11a [0,4194304] 0 2023-12-16T07:40:54.679 INFO:tasks.workunit.client.1.smithi133.stdout:3/855: chown d7/d8/d1c/d2b/f143 3255 1 2023-12-16T07:40:54.681 INFO:tasks.workunit.client.1.smithi133.stdout:3/856: creat d7/d8/d1d/d2a/d62/f151 x:0 0 0 2023-12-16T07:40:54.690 INFO:tasks.workunit.client.1.smithi133.stdout:5/906: sync 2023-12-16T07:40:54.690 INFO:tasks.workunit.client.1.smithi133.stdout:8/935: sync 2023-12-16T07:40:54.691 INFO:tasks.workunit.client.1.smithi133.stdout:8/936: mknod d9/d11/d42/c125 0 2023-12-16T07:40:54.691 INFO:tasks.workunit.client.1.smithi133.stdout:8/937: readlink d9/d10/d39/d48/d92/lb4 0 2023-12-16T07:40:54.692 INFO:tasks.workunit.client.1.smithi133.stdout:5/907: rename d1/de/d57/d74/c12e to d1/d1c/d80/dd7/df8/dfb/c139 0 2023-12-16T07:40:54.693 INFO:tasks.workunit.client.1.smithi133.stdout:8/938: rmdir d9/d10/d39/d48/d44/d6e/d78/da6 39 2023-12-16T07:40:54.695 INFO:tasks.workunit.client.1.smithi133.stdout:3/857: dwrite d7/d8/d1c/fb7 [0,4194304] 0 2023-12-16T07:40:54.695 INFO:tasks.workunit.client.1.smithi133.stdout:3/858: getdents d7/d8/d78/de0 0 2023-12-16T07:40:54.695 INFO:tasks.workunit.client.1.smithi133.stdout:5/908: rmdir d1/d1c/d80/da7 39 2023-12-16T07:40:54.696 INFO:tasks.workunit.client.1.smithi133.stdout:8/939: symlink d9/d10/d39/d48/d44/d6e/l126 0 2023-12-16T07:40:54.704 INFO:tasks.workunit.client.1.smithi133.stdout:8/940: rmdir d9/d11/d42/dda 39 2023-12-16T07:40:54.712 INFO:tasks.workunit.client.1.smithi133.stdout:3/859: dwrite d7/d8/d1c/d2b/f7a [0,4194304] 0 2023-12-16T07:40:54.719 INFO:tasks.workunit.client.1.smithi133.stdout:3/860: creat d7/d8/d1c/ddb/d95/db4/f152 x:0 0 0 2023-12-16T07:40:54.725 INFO:tasks.workunit.client.1.smithi133.stdout:5/909: dwrite d1/d1c/d80/dd7/f108 [0,4194304] 0 2023-12-16T07:40:54.725 INFO:tasks.workunit.client.1.smithi133.stdout:5/910: chown d1/d1c/d80/d64/f12b 1685983080 1 2023-12-16T07:40:54.728 INFO:tasks.workunit.client.1.smithi133.stdout:5/911: rename d1/f3d to d1/de/d35/dc6/db4/d71/f13a 0 2023-12-16T07:40:54.728 INFO:tasks.workunit.client.1.smithi133.stdout:5/912: mkdir d1/de/dba/d13b 0 2023-12-16T07:40:54.730 INFO:tasks.workunit.client.1.smithi133.stdout:5/913: rename d1/de/d35/dc6/f8f to d1/de/d52/da3/d113/f13c 0 2023-12-16T07:40:54.732 INFO:tasks.workunit.client.1.smithi133.stdout:5/914: link d1/de/d57/dc5/ld1 d1/d18/d2c/l13d 0 2023-12-16T07:40:54.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/915: write d1/de/d52/f78 [695848,53255] 0 2023-12-16T07:40:54.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/916: readlink d1/de/dba/lbd 0 2023-12-16T07:40:54.738 INFO:tasks.workunit.client.1.smithi133.stdout:8/941: dwrite d9/d11/d52/f9b [0,4194304] 0 2023-12-16T07:40:54.738 INFO:tasks.workunit.client.1.smithi133.stdout:3/861: dwrite d7/d8/d1d/dc9/ff0 [0,4194304] 0 2023-12-16T07:40:54.742 INFO:tasks.workunit.client.1.smithi133.stdout:8/942: rename d9/d10/f3a to d9/d2d/dc1/f127 0 2023-12-16T07:40:54.745 INFO:tasks.workunit.client.1.smithi133.stdout:3/862: link d7/d8/d1d/dc9/l106 d7/d8/d1c/d87/dad/l153 0 2023-12-16T07:40:54.746 INFO:tasks.workunit.client.1.smithi133.stdout:8/943: getdents d9/d11/d42 0 2023-12-16T07:40:54.746 INFO:tasks.workunit.client.1.smithi133.stdout:5/917: dwrite d1/d1c/d80/fd4 [0,4194304] 0 2023-12-16T07:40:54.749 INFO:tasks.workunit.client.1.smithi133.stdout:3/863: getdents d7/d128/d142 0 2023-12-16T07:40:54.749 INFO:tasks.workunit.client.1.smithi133.stdout:3/864: fdatasync d7/d8/d1c/ddb/d95/f9f 0 2023-12-16T07:40:54.752 INFO:tasks.workunit.client.1.smithi133.stdout:5/918: rmdir d1/de/d52/da3/d113 39 2023-12-16T07:40:54.754 INFO:tasks.workunit.client.1.smithi133.stdout:3/865: creat d7/d8/d1c/d2b/f154 x:0 0 0 2023-12-16T07:40:54.754 INFO:tasks.workunit.client.1.smithi133.stdout:3/866: chown d7/d8/d78/d43/d5b/fd2 7258 1 2023-12-16T07:40:54.754 INFO:tasks.workunit.client.1.smithi133.stdout:3/867: fdatasync d7/d8/d72/d86/ffd 0 2023-12-16T07:40:54.757 INFO:tasks.workunit.client.1.smithi133.stdout:3/868: mknod d7/d8/d1d/d2a/da2/c155 0 2023-12-16T07:40:54.758 INFO:tasks.workunit.client.1.smithi133.stdout:3/869: write d7/d8/d1d/f90 [3905167,22348] 0 2023-12-16T07:40:54.758 INFO:tasks.workunit.client.1.smithi133.stdout:5/919: rename d1/d1c/f40 to d1/d4b/da5/f13e 0 2023-12-16T07:40:54.761 INFO:tasks.workunit.client.1.smithi133.stdout:3/870: mknod d7/d8/d1c/d87/dad/c156 0 2023-12-16T07:40:54.762 INFO:tasks.workunit.client.1.smithi133.stdout:5/920: symlink d1/de/d57/d74/l13f 0 2023-12-16T07:40:54.762 INFO:tasks.workunit.client.1.smithi133.stdout:5/921: fsync d1/de/f13 0 2023-12-16T07:40:54.762 INFO:tasks.workunit.client.1.smithi133.stdout:5/922: readlink d1/d1c/d80/d8d/l120 0 2023-12-16T07:40:54.763 INFO:tasks.workunit.client.1.smithi133.stdout:3/871: mknod d7/d8/d1c/d87/dad/c157 0 2023-12-16T07:40:54.763 INFO:tasks.workunit.client.1.smithi133.stdout:3/872: truncate d7/d8/d78/d43/d7f/d85/d8f/fa1 1008189 0 2023-12-16T07:40:54.767 INFO:tasks.workunit.client.1.smithi133.stdout:8/944: dwrite d9/d10/d39/d48/f7f [4194304,4194304] 0 2023-12-16T07:40:54.767 INFO:tasks.workunit.client.1.smithi133.stdout:8/945: readlink d9/d10/l57 0 2023-12-16T07:40:54.768 INFO:tasks.workunit.client.1.smithi133.stdout:8/946: mkdir d9/d2d/dc1/d128 0 2023-12-16T07:40:54.769 INFO:tasks.workunit.client.1.smithi133.stdout:8/947: mknod d9/d85/c129 0 2023-12-16T07:40:54.769 INFO:tasks.workunit.client.1.smithi133.stdout:8/948: fsync d9/dc/f3c 0 2023-12-16T07:40:54.769 INFO:tasks.workunit.client.1.smithi133.stdout:3/873: dread d7/d8/d78/d43/d5b/f8c [0,4194304] 0 2023-12-16T07:40:54.769 INFO:tasks.workunit.client.1.smithi133.stdout:3/874: fdatasync d7/d8/d1d/d2a/da2/f111 0 2023-12-16T07:40:54.772 INFO:tasks.workunit.client.1.smithi133.stdout:3/875: write d7/d8/d1c/ddb/d95/f9f [3463958,68217] 0 2023-12-16T07:40:54.772 INFO:tasks.workunit.client.1.smithi133.stdout:8/949: dread d9/d10/d39/d48/d44/d69/f100 [0,4194304] 0 2023-12-16T07:40:54.772 INFO:tasks.workunit.client.1.smithi133.stdout:3/876: write d7/d8/d1d/d2a/d5f/fe1 [964957,107677] 0 2023-12-16T07:40:54.774 INFO:tasks.workunit.client.1.smithi133.stdout:8/950: unlink d9/d2d/dc1/d112/d10e/f120 0 2023-12-16T07:40:54.775 INFO:tasks.workunit.client.1.smithi133.stdout:3/877: mkdir d7/d8/d1d/d11f/d158 0 2023-12-16T07:40:54.776 INFO:tasks.workunit.client.1.smithi133.stdout:8/951: mkdir d9/d10/d39/d48/d92/dfa/ded/d12a 0 2023-12-16T07:40:54.778 INFO:tasks.workunit.client.1.smithi133.stdout:5/923: dwrite d1/d18/d2c/f45 [0,4194304] 0 2023-12-16T07:40:54.778 INFO:tasks.workunit.client.1.smithi133.stdout:8/952: creat d9/dc/de/de4/f12b x:0 0 0 2023-12-16T07:40:54.779 INFO:tasks.workunit.client.1.smithi133.stdout:3/878: write d7/f8e [2443241,112542] 0 2023-12-16T07:40:54.782 INFO:tasks.workunit.client.1.smithi133.stdout:5/924: creat d1/d1c/d80/d64/dc1/df9/f140 x:0 0 0 2023-12-16T07:40:54.784 INFO:tasks.workunit.client.1.smithi133.stdout:8/953: truncate d9/d10/d39/d48/d44/d6e/d78/fb1 1602368 0 2023-12-16T07:40:54.786 INFO:tasks.workunit.client.1.smithi133.stdout:3/879: mkdir d7/d8/d78/d43/d7f/d159 0 2023-12-16T07:40:54.786 INFO:tasks.workunit.client.1.smithi133.stdout:3/880: stat d7/d8/d72/f132 0 2023-12-16T07:40:54.788 INFO:tasks.workunit.client.1.smithi133.stdout:5/925: creat d1/de/d35/dc6/db4/f141 x:0 0 0 2023-12-16T07:40:54.788 INFO:tasks.workunit.client.1.smithi133.stdout:5/926: chown d1/de/d52/da3/fe8 125347528 1 2023-12-16T07:40:54.789 INFO:tasks.workunit.client.1.smithi133.stdout:8/954: dread d9/d10/d39/d48/d92/f10c [0,4194304] 0 2023-12-16T07:40:54.789 INFO:tasks.workunit.client.1.smithi133.stdout:8/955: chown d9/d10/d39/d48/d44/f53 26773 1 2023-12-16T07:40:54.789 INFO:tasks.workunit.client.1.smithi133.stdout:8/956: write d9/dc/de/de4/f12b [933687,19444] 0 2023-12-16T07:40:54.789 INFO:tasks.workunit.client.1.smithi133.stdout:8/957: write d9/d10/d39/d48/d44/fff [477091,74563] 0 2023-12-16T07:40:54.791 INFO:tasks.workunit.client.1.smithi133.stdout:3/881: rename d7/d8/d1c/c2c to d7/d8/d1c/d87/c15a 0 2023-12-16T07:40:54.792 INFO:tasks.workunit.client.1.smithi133.stdout:3/882: write d7/d8/d1c/f41 [2273836,87700] 0 2023-12-16T07:40:54.792 INFO:tasks.workunit.client.1.smithi133.stdout:3/883: fdatasync d7/d8/d1c/f66 0 2023-12-16T07:40:54.793 INFO:tasks.workunit.client.1.smithi133.stdout:8/958: mknod d9/d10/d39/d48/d44/d6e/d78/d11b/c12c 0 2023-12-16T07:40:54.796 INFO:tasks.workunit.client.1.smithi133.stdout:5/927: rename d1/de/d35/dc6/db4/d71/f93 to d1/de/d35/f142 0 2023-12-16T07:40:54.798 INFO:tasks.workunit.client.1.smithi133.stdout:8/959: creat d9/dc/de/de4/f12d x:0 0 0 2023-12-16T07:40:54.837 INFO:tasks.workunit.client.1.smithi133.stdout:5/928: mkdir d1/d143 0 2023-12-16T07:40:54.839 INFO:tasks.workunit.client.1.smithi133.stdout:5/929: write d1/d4b/fc4 [1159686,66188] 0 2023-12-16T07:40:54.851 INFO:tasks.workunit.client.1.smithi133.stdout:5/930: dwrite d1/de/d35/dc6/db4/f141 [0,4194304] 0 2023-12-16T07:40:54.870 INFO:tasks.workunit.client.1.smithi133.stdout:8/960: creat d9/d2d/dc1/de3/f12e x:0 0 0 2023-12-16T07:40:54.874 INFO:tasks.workunit.client.1.smithi133.stdout:5/931: mkdir d1/d1c/d80/d8d/d132/d144 0 2023-12-16T07:40:54.874 INFO:tasks.workunit.client.1.smithi133.stdout:5/932: truncate d1/d1c/f134 935932 0 2023-12-16T07:40:54.875 INFO:tasks.workunit.client.1.smithi133.stdout:5/933: read d1/d1c/fe6 [3919023,34856] 0 2023-12-16T07:40:55.075 INFO:tasks.workunit.client.1.smithi133.stdout:3/884: sync 2023-12-16T07:40:55.075 INFO:tasks.workunit.client.1.smithi133.stdout:8/961: sync 2023-12-16T07:40:55.075 INFO:tasks.workunit.client.1.smithi133.stdout:8/962: truncate d9/d10/d39/d48/d92/f10c 1262386 0 2023-12-16T07:40:55.076 INFO:tasks.workunit.client.1.smithi133.stdout:3/885: rmdir d7/d8/d72/d86/dbf 39 2023-12-16T07:40:55.077 INFO:tasks.workunit.client.1.smithi133.stdout:3/886: chown d7/d8/d78/c102 24325358 1 2023-12-16T07:40:55.077 INFO:tasks.workunit.client.1.smithi133.stdout:8/963: creat d9/d10/d39/f12f x:0 0 0 2023-12-16T07:40:55.080 INFO:tasks.workunit.client.1.smithi133.stdout:3/887: symlink d7/d8/d72/d86/l15b 0 2023-12-16T07:40:55.080 INFO:tasks.workunit.client.1.smithi133.stdout:3/888: read - d7/d8/d78/f135 zero size 2023-12-16T07:40:55.081 INFO:tasks.workunit.client.1.smithi133.stdout:8/964: creat d9/d10/dc7/f130 x:0 0 0 2023-12-16T07:40:55.082 INFO:tasks.workunit.client.1.smithi133.stdout:8/965: getdents d9/d10 0 2023-12-16T07:40:55.084 INFO:tasks.workunit.client.1.smithi133.stdout:8/966: symlink d9/d11/d52/l131 0 2023-12-16T07:40:55.084 INFO:tasks.workunit.client.1.smithi133.stdout:8/967: fsync d9/f2e 0 2023-12-16T07:40:55.086 INFO:tasks.workunit.client.1.smithi133.stdout:8/968: rmdir d9/d2d/dc1/d128 0 2023-12-16T07:40:55.089 INFO:tasks.workunit.client.1.smithi133.stdout:3/889: dread d7/d8/d78/f5e [0,4194304] 0 2023-12-16T07:40:55.089 INFO:tasks.workunit.client.1.smithi133.stdout:3/890: fsync d7/d8/d1d/d2a/f14a 0 2023-12-16T07:40:55.089 INFO:tasks.workunit.client.1.smithi133.stdout:8/969: mknod d9/d10/d39/d48/c132 0 2023-12-16T07:40:55.090 INFO:tasks.workunit.client.1.smithi133.stdout:3/891: mkdir d7/d8/d1c/ddb/d95/db4/d15c 0 2023-12-16T07:40:55.090 INFO:tasks.workunit.client.1.smithi133.stdout:8/970: mkdir d9/d10/d39/d133 0 2023-12-16T07:40:55.093 INFO:tasks.workunit.client.1.smithi133.stdout:3/892: rmdir d7/d8/d78/d43 39 2023-12-16T07:40:55.093 INFO:tasks.workunit.client.1.smithi133.stdout:8/971: creat d9/d2d/dc1/d112/d10e/f134 x:0 0 0 2023-12-16T07:40:55.094 INFO:tasks.workunit.client.1.smithi133.stdout:3/893: rmdir d7/d8/d1d/dc9 39 2023-12-16T07:40:55.094 INFO:tasks.workunit.client.1.smithi133.stdout:3/894: read - d7/d8/d78/f13f zero size 2023-12-16T07:40:55.096 INFO:tasks.workunit.client.1.smithi133.stdout:8/972: rename d9/d11/d42/f63 to d9/d10/d39/d48/f135 0 2023-12-16T07:40:55.096 INFO:tasks.workunit.client.1.smithi133.stdout:8/973: readlink d9/d11/d52/l131 0 2023-12-16T07:40:55.099 INFO:tasks.workunit.client.1.smithi133.stdout:3/895: creat d7/d8/d1c/ddb/dfb/d10e/d118/f15d x:0 0 0 2023-12-16T07:40:55.099 INFO:tasks.workunit.client.1.smithi133.stdout:3/896: chown d7/d8/d72/d86/dbf/f134 139353982 1 2023-12-16T07:40:55.101 INFO:tasks.workunit.client.1.smithi133.stdout:8/974: mkdir d9/d11/d42/dda/d136 0 2023-12-16T07:40:55.106 INFO:tasks.workunit.client.1.smithi133.stdout:8/975: symlink d9/d10/l137 0 2023-12-16T07:40:55.109 INFO:tasks.workunit.client.1.smithi133.stdout:8/976: rename d9/d10/d39/cc4 to d9/d2d/dc1/d112/c138 0 2023-12-16T07:40:55.112 INFO:tasks.workunit.client.1.smithi133.stdout:8/977: mkdir d9/d10/d39/d48/d139 0 2023-12-16T07:40:55.113 INFO:tasks.workunit.client.1.smithi133.stdout:8/978: write d9/d10/d39/d48/d44/d6e/d78/da6/fd8 [1318154,7854] 0 2023-12-16T07:40:55.117 INFO:tasks.workunit.client.1.smithi133.stdout:8/979: creat d9/d11/d42/f13a x:0 0 0 2023-12-16T07:40:55.117 INFO:tasks.workunit.client.1.smithi133.stdout:8/980: creat d9/d10/d39/d48/d44/d10d/f13b x:0 0 0 2023-12-16T07:40:55.117 INFO:tasks.workunit.client.1.smithi133.stdout:3/897: dwrite d7/d8/d78/d43/d5b/f89 [0,4194304] 0 2023-12-16T07:40:55.117 INFO:tasks.workunit.client.1.smithi133.stdout:8/981: mkdir d9/d2d/dc1/d10b/d13c 0 2023-12-16T07:40:55.117 INFO:tasks.workunit.client.1.smithi133.stdout:8/982: fdatasync d9/d85/fae 0 2023-12-16T07:40:55.119 INFO:tasks.workunit.client.1.smithi133.stdout:3/898: mkdir d7/d8/d1c/ddb/d15e 0 2023-12-16T07:40:55.120 INFO:tasks.workunit.client.1.smithi133.stdout:8/983: mknod d9/d10/d39/d133/c13d 0 2023-12-16T07:40:55.121 INFO:tasks.workunit.client.1.smithi133.stdout:3/899: mkdir d7/d8/d1c/ddb/d95/db4/d13c/d15f 0 2023-12-16T07:40:55.123 INFO:tasks.workunit.client.1.smithi133.stdout:5/934: sync 2023-12-16T07:40:55.124 INFO:tasks.workunit.client.1.smithi133.stdout:8/984: creat d9/d2d/dc1/d10b/d13c/f13e x:0 0 0 2023-12-16T07:40:55.126 INFO:tasks.workunit.client.1.smithi133.stdout:3/900: unlink d7/d8/d1c/d2b/f15 0 2023-12-16T07:40:55.127 INFO:tasks.workunit.client.1.smithi133.stdout:5/935: creat d1/de/d57/f145 x:0 0 0 2023-12-16T07:40:55.129 INFO:tasks.workunit.client.1.smithi133.stdout:8/985: creat d9/d10/d39/d133/f13f x:0 0 0 2023-12-16T07:40:55.131 INFO:tasks.workunit.client.1.smithi133.stdout:3/901: creat d7/d8/d72/d77/db5/f160 x:0 0 0 2023-12-16T07:40:55.133 INFO:tasks.workunit.client.1.smithi133.stdout:5/936: rename d1/d54/de1/c9d to d1/de/d35/dc6/db4/d71/c146 0 2023-12-16T07:40:55.134 INFO:tasks.workunit.client.1.smithi133.stdout:8/986: mknod d9/d10/d39/d48/d92/dfa/ded/d12a/c140 0 2023-12-16T07:40:55.134 INFO:tasks.workunit.client.1.smithi133.stdout:8/987: dread - d9/d11/d42/fe9 zero size 2023-12-16T07:40:55.135 INFO:tasks.workunit.client.1.smithi133.stdout:3/902: mkdir d7/d8/d1c/ddb/d95/db4/d13c/d15f/d161 0 2023-12-16T07:40:55.136 INFO:tasks.workunit.client.1.smithi133.stdout:5/937: mkdir d1/d18/d147 0 2023-12-16T07:40:55.136 INFO:tasks.workunit.client.1.smithi133.stdout:5/938: getdents d1/d54/de1/d111 0 2023-12-16T07:40:55.136 INFO:tasks.workunit.client.1.smithi133.stdout:5/939: truncate d1/d18/f1b 4626542 0 2023-12-16T07:40:55.138 INFO:tasks.workunit.client.1.smithi133.stdout:8/988: creat d9/d2d/f141 x:0 0 0 2023-12-16T07:40:55.140 INFO:tasks.workunit.client.1.smithi133.stdout:3/903: link d7/d8/d78/d43/l5a d7/d8/d1d/d2a/d62/l162 0 2023-12-16T07:40:55.143 INFO:tasks.workunit.client.1.smithi133.stdout:5/940: symlink d1/de/d67/l148 0 2023-12-16T07:40:55.145 INFO:tasks.workunit.client.1.smithi133.stdout:5/941: symlink d1/d4b/l149 0 2023-12-16T07:40:55.148 INFO:tasks.workunit.client.1.smithi133.stdout:8/989: dread d9/d10/d39/d48/d44/d69/fa9 [0,4194304] 0 2023-12-16T07:40:55.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/942: creat d1/de/d35/dc6/db4/f14a x:0 0 0 2023-12-16T07:40:55.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/943: readlink d1/de/d67/l62 0 2023-12-16T07:40:55.152 INFO:tasks.workunit.client.1.smithi133.stdout:5/944: write d1/de/d35/dc6/fec [1721448,29564] 0 2023-12-16T07:40:55.153 INFO:tasks.workunit.client.1.smithi133.stdout:5/945: creat d1/de/d52/da3/d113/f14b x:0 0 0 2023-12-16T07:40:55.154 INFO:tasks.workunit.client.1.smithi133.stdout:5/946: fdatasync d1/d18/d26/f70 0 2023-12-16T07:40:55.155 INFO:tasks.workunit.client.1.smithi133.stdout:5/947: unlink d1/d1c/d80/d8d/fb8 0 2023-12-16T07:40:55.156 INFO:tasks.workunit.client.1.smithi133.stdout:3/904: dwrite d7/d8/d72/d86/dbf/f141 [0,4194304] 0 2023-12-16T07:40:55.157 INFO:tasks.workunit.client.1.smithi133.stdout:3/905: write d7/d8/f35 [3215772,59665] 0 2023-12-16T07:40:55.157 INFO:tasks.workunit.client.1.smithi133.stdout:5/948: rename d1/d54/de1/fab to d1/d1c/d80/d8d/f14c 0 2023-12-16T07:40:55.158 INFO:tasks.workunit.client.1.smithi133.stdout:3/906: write f3 [3659444,27675] 0 2023-12-16T07:40:55.164 INFO:tasks.workunit.client.1.smithi133.stdout:3/907: creat d7/d8/d1d/d11f/d158/f163 x:0 0 0 2023-12-16T07:40:55.167 INFO:tasks.workunit.client.1.smithi133.stdout:3/908: unlink d7/d8/d1d/d11f/c122 0 2023-12-16T07:40:55.167 INFO:tasks.workunit.client.1.smithi133.stdout:3/909: readlink d7/d8/d1d/d2a/lbe 0 2023-12-16T07:40:55.168 INFO:tasks.workunit.client.1.smithi133.stdout:3/910: link d7/d8/d78/de0/f10a d7/d8/d78/d43/d7f/d85/f164 0 2023-12-16T07:40:55.169 INFO:tasks.workunit.client.1.smithi133.stdout:3/911: mknod d7/d8/d1d/d2a/d63/c165 0 2023-12-16T07:40:55.171 INFO:tasks.workunit.client.1.smithi133.stdout:5/949: dwrite d1/de/d35/fbb [0,4194304] 0 2023-12-16T07:40:55.174 INFO:tasks.workunit.client.1.smithi133.stdout:5/950: truncate d1/d18/d26/f9c 2197068 0 2023-12-16T07:40:55.176 INFO:tasks.workunit.client.1.smithi133.stdout:5/951: rename d1/d4b/f103 to d1/d4b/f14d 0 2023-12-16T07:40:55.178 INFO:tasks.workunit.client.1.smithi133.stdout:5/952: rmdir d1/d18/d147 0 2023-12-16T07:40:55.190 INFO:tasks.workunit.client.1.smithi133.stdout:3/912: dwrite d7/d8/d1d/dc9/f10d [0,4194304] 0 2023-12-16T07:40:55.196 INFO:tasks.workunit.client.1.smithi133.stdout:5/953: dwrite d1/d1c/d80/d8d/d132/f136 [0,4194304] 0 2023-12-16T07:40:55.197 INFO:tasks.workunit.client.1.smithi133.stdout:3/913: link d7/d8/l3b d7/d8/d1d/d2a/l166 0 2023-12-16T07:40:55.198 INFO:tasks.workunit.client.1.smithi133.stdout:3/914: write d7/d8/f84 [948392,38873] 0 2023-12-16T07:40:55.204 INFO:tasks.workunit.client.1.smithi133.stdout:5/954: link d1/de/l73 d1/de/d57/d74/l14e 0 2023-12-16T07:40:55.206 INFO:tasks.workunit.client.1.smithi133.stdout:3/915: mknod d7/d8/d78/d43/c167 0 2023-12-16T07:40:55.210 INFO:tasks.workunit.client.1.smithi133.stdout:3/916: rename d7/d8/d78/d43/cda to d7/d8/d1c/d2b/d2d/c168 0 2023-12-16T07:40:55.211 INFO:tasks.workunit.client.1.smithi133.stdout:5/955: dread d1/de/d67/f2a [0,4194304] 0 2023-12-16T07:40:55.212 INFO:tasks.workunit.client.1.smithi133.stdout:5/956: write d1/de/d35/dc6/db4/f141 [477761,86728] 0 2023-12-16T07:40:55.213 INFO:tasks.workunit.client.1.smithi133.stdout:3/917: rename d7/d8/d1d/dc9 to d7/d8/d1c/ddb/dfb/d10e/d118/d169 0 2023-12-16T07:40:55.215 INFO:tasks.workunit.client.1.smithi133.stdout:5/957: symlink d1/d1c/d80/da7/d106/l14f 0 2023-12-16T07:40:55.227 INFO:tasks.workunit.client.1.smithi133.stdout:3/918: dread d7/d8/d1c/d87/f108 [0,4194304] 0 2023-12-16T07:40:55.228 INFO:tasks.workunit.client.1.smithi133.stdout:3/919: mknod d7/d8/d1c/ddb/dfb/d10e/d10f/c16a 0 2023-12-16T07:40:55.228 INFO:tasks.workunit.client.1.smithi133.stdout:3/920: dread - d7/d8/d78/f135 zero size 2023-12-16T07:40:55.228 INFO:tasks.workunit.client.1.smithi133.stdout:3/921: mkdir d7/d8/d72/d77/d126/d16b 0 2023-12-16T07:40:55.230 INFO:tasks.workunit.client.1.smithi133.stdout:3/922: readlink d7/l19 0 2023-12-16T07:40:55.230 INFO:tasks.workunit.client.1.smithi133.stdout:3/923: fdatasync d7/d8/d72/d86/ff5 0 2023-12-16T07:40:55.230 INFO:tasks.workunit.client.1.smithi133.stdout:3/924: write d7/d8/d1c/f4b [1306917,52139] 0 2023-12-16T07:40:55.237 INFO:tasks.workunit.client.1.smithi133.stdout:3/925: write d7/f1b [2729421,87860] 0 2023-12-16T07:40:55.237 INFO:tasks.workunit.client.1.smithi133.stdout:3/926: chown d7/d8/d78/l44 0 1 2023-12-16T07:40:55.240 INFO:tasks.workunit.client.1.smithi133.stdout:3/927: creat d7/d8/d1c/ddb/d95/db4/f16c x:0 0 0 2023-12-16T07:40:55.242 INFO:tasks.workunit.client.1.smithi133.stdout:5/958: dwrite d1/de/d57/d74/f102 [0,4194304] 0 2023-12-16T07:40:55.243 INFO:tasks.workunit.client.1.smithi133.stdout:3/928: rename d7/d128/d142 to d7/d8/d72/d77/db5/d16d 0 2023-12-16T07:40:55.246 INFO:tasks.workunit.client.1.smithi133.stdout:3/929: dread d7/d8/d1c/f66 [0,4194304] 0 2023-12-16T07:40:55.247 INFO:tasks.workunit.client.1.smithi133.stdout:5/959: link d1/de/d52/l82 d1/d54/de1/dd5/l150 0 2023-12-16T07:40:55.247 INFO:tasks.workunit.client.1.smithi133.stdout:5/960: write d1/d18/f41 [1306483,36062] 0 2023-12-16T07:40:55.253 INFO:tasks.workunit.client.1.smithi133.stdout:5/961: creat d1/de/d57/dc5/f151 x:0 0 0 2023-12-16T07:40:55.253 INFO:tasks.workunit.client.1.smithi133.stdout:5/962: readlink d1/d1c/d80/d8d/l120 0 2023-12-16T07:40:55.256 INFO:tasks.workunit.client.1.smithi133.stdout:3/930: rename d7/d8/d1c/d2b to d7/d8/d78/d16e 0 2023-12-16T07:40:55.277 INFO:tasks.workunit.client.1.smithi133.stdout:5/963: dwrite d1/d1c/d80/da7/d123/f130 [0,4194304] 0 2023-12-16T07:40:55.277 INFO:tasks.workunit.client.1.smithi133.stdout:3/931: dwrite d7/d8/d1c/f38 [0,4194304] 0 2023-12-16T07:40:55.281 INFO:tasks.workunit.client.1.smithi133.stdout:5/964: mkdir d1/de/d35/dc6/db4/d71/d152 0 2023-12-16T07:40:55.287 INFO:tasks.workunit.client.1.smithi133.stdout:3/932: mkdir d7/d8/d1c/ddb/d95/db4/d13c/d16f 0 2023-12-16T07:40:55.287 INFO:tasks.workunit.client.1.smithi133.stdout:3/933: write d7/d8/d1c/d87/ff7 [1032912,96421] 0 2023-12-16T07:40:55.288 INFO:tasks.workunit.client.1.smithi133.stdout:3/934: symlink d7/d128/d12c/l170 0 2023-12-16T07:40:55.290 INFO:tasks.workunit.client.1.smithi133.stdout:3/935: rename d7/d8/d1c/ddb/d95/db4/d15c to d7/d8/d1c/d87/d171 0 2023-12-16T07:40:55.291 INFO:tasks.workunit.client.1.smithi133.stdout:5/965: dread d1/de/f50 [0,4194304] 0 2023-12-16T07:40:55.291 INFO:tasks.workunit.client.1.smithi133.stdout:5/966: dread - d1/d1c/d80/da7/d106/f105 zero size 2023-12-16T07:40:55.291 INFO:tasks.workunit.client.1.smithi133.stdout:5/967: write d1/de/d35/f110 [1042382,18311] 0 2023-12-16T07:40:55.291 INFO:tasks.workunit.client.1.smithi133.stdout:3/936: symlink d7/d8/d78/d43/d7f/d85/l172 0 2023-12-16T07:40:55.292 INFO:tasks.workunit.client.1.smithi133.stdout:5/968: mknod d1/d4b/c153 0 2023-12-16T07:40:55.295 INFO:tasks.workunit.client.1.smithi133.stdout:3/937: rename d7/d8/d1d/d11f to d7/d8/d78/d16e/d2d/d173 0 2023-12-16T07:40:55.295 INFO:tasks.workunit.client.1.smithi133.stdout:3/938: write d7/d8/d1c/ddb/fde [915263,131069] 0 2023-12-16T07:40:55.295 INFO:tasks.workunit.client.1.smithi133.stdout:3/939: write d7/d8/d78/d43/fd8 [1344243,6185] 0 2023-12-16T07:40:55.297 INFO:tasks.workunit.client.1.smithi133.stdout:3/940: rmdir d7/d8/d78/d43/d7f/d85/d8f 39 2023-12-16T07:40:55.298 INFO:tasks.workunit.client.1.smithi133.stdout:3/941: rmdir d7/d8/d78/d43 39 2023-12-16T07:40:55.298 INFO:tasks.workunit.client.1.smithi133.stdout:3/942: fsync d7/d8/d78/d43/f79 0 2023-12-16T07:40:55.302 INFO:tasks.workunit.client.1.smithi133.stdout:5/969: dread d1/de/d35/dc6/db4/d71/fe0 [0,4194304] 0 2023-12-16T07:40:55.302 INFO:tasks.workunit.client.1.smithi133.stdout:3/943: dread d7/d8/d1c/f4b [0,4194304] 0 2023-12-16T07:40:55.304 INFO:tasks.workunit.client.1.smithi133.stdout:3/944: unlink d7/d8/d78/d43/d7f/d85/f164 0 2023-12-16T07:40:55.304 INFO:tasks.workunit.client.1.smithi133.stdout:3/945: chown d7/d8/d78/d16e/d2d/d173/d158/f163 52570 1 2023-12-16T07:40:55.304 INFO:tasks.workunit.client.1.smithi133.stdout:3/946: write d7/d8/d78/d43/d7f/d85/f124 [654619,69110] 0 2023-12-16T07:40:55.313 INFO:tasks.workunit.client.1.smithi133.stdout:5/970: dread d1/de/d35/dc6/db4/d71/f13a [0,4194304] 0 2023-12-16T07:40:55.314 INFO:tasks.workunit.client.1.smithi133.stdout:5/971: readlink d1/d54/de1/lce 0 2023-12-16T07:40:55.314 INFO:tasks.workunit.client.1.smithi133.stdout:5/972: creat d1/de/d52/da3/d113/f154 x:0 0 0 2023-12-16T07:40:55.317 INFO:tasks.workunit.client.1.smithi133.stdout:3/947: dwrite d7/d8/d72/d86/dbf/f134 [0,4194304] 0 2023-12-16T07:40:55.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/948: link d7/d8/d72/d77/f97 d7/d8/d1c/d87/d171/f174 0 2023-12-16T07:40:55.325 INFO:tasks.workunit.client.1.smithi133.stdout:5/973: dread d1/d4b/fc8 [0,4194304] 0 2023-12-16T07:40:55.335 INFO:tasks.workunit.client.1.smithi133.stdout:3/949: dwrite d7/d8/f84 [0,4194304] 0 2023-12-16T07:40:55.337 INFO:tasks.workunit.client.1.smithi133.stdout:3/950: read d7/d8/d1c/ddb/d95/faf [3498284,24545] 0 2023-12-16T07:40:55.339 INFO:tasks.workunit.client.1.smithi133.stdout:3/951: dread d7/d8/f75 [0,4194304] 0 2023-12-16T07:40:55.344 INFO:tasks.workunit.client.1.smithi133.stdout:5/974: dwrite d1/de/d35/dc6/db4/faa [0,4194304] 0 2023-12-16T07:40:55.349 INFO:tasks.workunit.client.1.smithi133.stdout:5/975: unlink d1/de/d35/dc6/db4/d71/fdc 0 2023-12-16T07:40:55.349 INFO:tasks.workunit.client.1.smithi133.stdout:5/976: write d1/f24 [9120734,72494] 0 2023-12-16T07:40:55.354 INFO:tasks.workunit.client.1.smithi133.stdout:5/977: unlink d1/de/d52/da3/l101 0 2023-12-16T07:40:55.355 INFO:tasks.workunit.client.1.smithi133.stdout:5/978: link d1/de/dba/f11c d1/de/dba/f155 0 2023-12-16T07:40:55.356 INFO:tasks.workunit.client.1.smithi133.stdout:5/979: stat d1/de/d35/f37 0 2023-12-16T07:40:55.357 INFO:tasks.workunit.client.1.smithi133.stdout:5/980: symlink d1/de/d57/dc5/l156 0 2023-12-16T07:40:55.358 INFO:tasks.workunit.client.1.smithi133.stdout:5/981: creat d1/de/d35/dc6/f157 x:0 0 0 2023-12-16T07:40:55.359 INFO:tasks.workunit.client.1.smithi133.stdout:5/982: truncate d1/d1c/d80/d64/f65 1240655 0 2023-12-16T07:40:55.360 INFO:tasks.workunit.client.1.smithi133.stdout:5/983: truncate d1/f10 3090841 0 2023-12-16T07:40:55.375 INFO:tasks.workunit.client.1.smithi133.stdout:5/984: write d1/f10 [1817494,51364] 0 2023-12-16T07:40:55.376 INFO:tasks.workunit.client.1.smithi133.stdout:5/985: read d1/f17 [1734868,107149] 0 2023-12-16T07:40:55.378 INFO:tasks.workunit.client.1.smithi133.stdout:5/986: symlink d1/de/dc7/l158 0 2023-12-16T07:40:55.378 INFO:tasks.workunit.client.1.smithi133.stdout:5/987: dread - d1/d1c/d80/dd7/f109 zero size 2023-12-16T07:40:55.381 INFO:tasks.workunit.client.1.smithi133.stdout:5/988: mknod d1/d4b/c159 0 2023-12-16T07:40:55.385 INFO:tasks.workunit.client.1.smithi133.stdout:5/989: dread d1/d18/d26/f9c [0,4194304] 0 2023-12-16T07:40:55.387 INFO:tasks.workunit.client.1.smithi133.stdout:5/990: symlink d1/d54/de1/de7/l15a 0 2023-12-16T07:40:55.395 INFO:tasks.workunit.client.1.smithi133.stdout:5/991: dread d1/f34 [0,4194304] 0 2023-12-16T07:40:55.396 INFO:tasks.workunit.client.1.smithi133.stdout:5/992: mknod d1/d143/c15b 0 2023-12-16T07:40:55.398 INFO:tasks.workunit.client.1.smithi133.stdout:5/993: symlink d1/d54/de1/l15c 0 2023-12-16T07:40:55.401 INFO:tasks.workunit.client.1.smithi133.stdout:5/994: link d1/d54/de1/dd5/l150 d1/d4b/da5/l15d 0 2023-12-16T07:40:55.402 INFO:tasks.workunit.client.1.smithi133.stdout:5/995: write d1/de/d52/da3/fd8 [776640,72361] 0 2023-12-16T07:40:55.406 INFO:tasks.workunit.client.1.smithi133.stdout:5/996: dread d1/d1c/d80/d64/f65 [0,4194304] 0 2023-12-16T07:40:55.408 INFO:tasks.workunit.client.1.smithi133.stdout:5/997: rename d1/de/d67/c3f to d1/de/d57/dc5/c15e 0 2023-12-16T07:40:55.423 INFO:tasks.workunit.client.1.smithi133.stdout:5/998: dwrite d1/d1c/d80/dd7/df8/dfb/f107 [0,4194304] 0 2023-12-16T07:40:55.425 INFO:tasks.workunit.client.1.smithi133.stdout:5/999: getdents d1/d18 0 2023-12-16T07:40:55.466 INFO:tasks.workunit.client.1.smithi133.stdout:8/990: sync 2023-12-16T07:40:55.478 INFO:tasks.workunit.client.1.smithi133.stdout:8/991: dwrite d9/dc/de/f7b [0,4194304] 0 2023-12-16T07:40:55.494 INFO:tasks.workunit.client.1.smithi133.stdout:8/992: dwrite d9/d10/d39/d48/d44/d69/fc8 [4194304,4194304] 0 2023-12-16T07:40:55.500 INFO:tasks.workunit.client.1.smithi133.stdout:3/952: sync 2023-12-16T07:40:55.502 INFO:tasks.workunit.client.1.smithi133.stdout:3/953: symlink d7/d8/d1d/d2a/d5f/l175 0 2023-12-16T07:40:55.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/954: mknod d7/d8/d78/d16e/d2d/d173/c176 0 2023-12-16T07:40:55.512 INFO:tasks.workunit.client.1.smithi133.stdout:8/993: dwrite d9/dc/de/fa4 [0,4194304] 0 2023-12-16T07:40:55.514 INFO:tasks.workunit.client.1.smithi133.stdout:8/994: write d9/d11/d52/f9b [1696458,49591] 0 2023-12-16T07:40:55.514 INFO:tasks.workunit.client.1.smithi133.stdout:8/995: dread - d9/d11/d42/ff2 zero size 2023-12-16T07:40:55.515 INFO:tasks.workunit.client.1.smithi133.stdout:8/996: dread d9/dc/de/fb3 [0,4194304] 0 2023-12-16T07:40:55.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/997: write d9/d10/d39/d48/d44/d6e/f94 [1330035,4399] 0 2023-12-16T07:40:55.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/998: write d9/d10/fbc [4366767,49597] 0 2023-12-16T07:40:55.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/999: fsync d9/d10/f37 0 2023-12-16T07:40:55.521 INFO:tasks.workunit.client.1.smithi133.stdout:3/955: dwrite d7/d8/d1c/ddb/dfb/d10e/d118/d169/f10d [0,4194304] 0 2023-12-16T07:40:55.521 INFO:tasks.workunit.client.1.smithi133.stdout:3/956: chown d7/d8/d78/l70 40230249 1 2023-12-16T07:40:55.523 INFO:tasks.workunit.client.1.smithi133.stdout:3/957: unlink d7/d8/d78/d16e/c24 0 2023-12-16T07:40:55.525 INFO:tasks.workunit.client.1.smithi133.stdout:3/958: write d7/f23 [513540,101117] 0 2023-12-16T07:40:55.525 INFO:tasks.workunit.client.1.smithi133.stdout:3/959: write d7/d8/d78/f13f [961462,92848] 0 2023-12-16T07:40:55.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/960: creat d7/d8/d72/d86/f177 x:0 0 0 2023-12-16T07:40:55.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/961: write d7/d8/f75 [1164983,36603] 0 2023-12-16T07:40:55.528 INFO:tasks.workunit.client.1.smithi133.stdout:3/962: dread d7/d8/f35 [4194304,4194304] 0 2023-12-16T07:40:55.531 INFO:tasks.workunit.client.1.smithi133.stdout:3/963: creat d7/d8/d1c/ddb/dfb/d10e/d10f/f178 x:0 0 0 2023-12-16T07:40:55.532 INFO:tasks.workunit.client.1.smithi133.stdout:3/964: chown d7/d8/d1c/ddb/dfb/d10e/d118/d169/l106 172 1 2023-12-16T07:40:55.537 INFO:tasks.workunit.client.1.smithi133.stdout:3/965: rename d7/d8/d1d/d2a/d63 to d7/d8/d78/d179 0 2023-12-16T07:40:55.549 INFO:tasks.workunit.client.1.smithi133.stdout:3/966: dwrite d7/d8/d78/d43/d5b/fd2 [0,4194304] 0 2023-12-16T07:40:55.552 INFO:tasks.workunit.client.1.smithi133.stdout:3/967: dread d7/d8/d78/d43/fd8 [0,4194304] 0 2023-12-16T07:40:55.552 INFO:tasks.workunit.client.1.smithi133.stdout:3/968: readlink d7/d8/l27 0 2023-12-16T07:40:55.553 INFO:tasks.workunit.client.1.smithi133.stdout:3/969: getdents d7/d8/d78/d16e 0 2023-12-16T07:40:55.553 INFO:tasks.workunit.client.1.smithi133.stdout:3/970: stat d7/d8/d1d/d2a/l6a 0 2023-12-16T07:40:55.554 INFO:tasks.workunit.client.1.smithi133.stdout:3/971: getdents d7/d8/d72/d77/d126 0 2023-12-16T07:40:55.555 INFO:tasks.workunit.client.1.smithi133.stdout:3/972: write d7/d8/d1c/f48 [964373,89882] 0 2023-12-16T07:40:55.555 INFO:tasks.workunit.client.1.smithi133.stdout:3/973: fdatasync d7/d8/fe 0 2023-12-16T07:40:55.556 INFO:tasks.workunit.client.1.smithi133.stdout:3/974: rename d7/d8/d72/f132 to d7/d8/d1c/ddb/d95/db4/d13c/d16f/f17a 0 2023-12-16T07:40:55.557 INFO:tasks.workunit.client.1.smithi133.stdout:3/975: creat d7/d8/d1d/f17b x:0 0 0 2023-12-16T07:40:55.558 INFO:tasks.workunit.client.1.smithi133.stdout:3/976: mkdir d7/d8/d1d/d17c 0 2023-12-16T07:40:55.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/977: readlink d7/d8/d1d/d2a/d62/de3/le8 0 2023-12-16T07:40:55.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/978: chown d7/d8/d78/d43/l5a 10324670 1 2023-12-16T07:40:55.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/979: dread d7/d8/f5c [0,4194304] 0 2023-12-16T07:40:55.578 INFO:tasks.workunit.client.1.smithi133.stdout:3/980: dwrite d7/d8/d1c/ddb/d95/faf [0,4194304] 0 2023-12-16T07:40:55.579 INFO:tasks.workunit.client.1.smithi133.stdout:3/981: creat d7/d8/d1c/ddb/f17d x:0 0 0 2023-12-16T07:40:55.581 INFO:tasks.workunit.client.1.smithi133.stdout:3/982: rename d7/d8/d1c/l3a to d7/d8/d1c/d87/d171/l17e 0 2023-12-16T07:40:55.581 INFO:tasks.workunit.client.1.smithi133.stdout:3/983: fdatasync d7/d8/d78/d43/d5b/ff1 0 2023-12-16T07:40:55.583 INFO:tasks.workunit.client.1.smithi133.stdout:3/984: rename d7/d8/d1d/fef to d7/d8/d78/d43/f17f 0 2023-12-16T07:40:55.589 INFO:tasks.workunit.client.1.smithi133.stdout:3/985: rename d7/f137 to d7/d8/d1c/ddb/dfb/d10e/f180 0 2023-12-16T07:40:55.591 INFO:tasks.workunit.client.1.smithi133.stdout:3/986: creat d7/d8/d1c/d87/d171/f181 x:0 0 0 2023-12-16T07:40:55.592 INFO:tasks.workunit.client.1.smithi133.stdout:3/987: write d7/d8/d72/d86/f7b [2167806,24732] 0 2023-12-16T07:40:55.593 INFO:tasks.workunit.client.1.smithi133.stdout:3/988: getdents d7/d8/d1c/d87/dad 0 2023-12-16T07:40:55.595 INFO:tasks.workunit.client.1.smithi133.stdout:3/989: stat d7/d8/d1c/ddb/dfb/d10e/d118/d169/l106 0 2023-12-16T07:40:55.595 INFO:tasks.workunit.client.1.smithi133.stdout:3/990: write d7/d8/d1d/d2a/d5f/fe1 [228808,24397] 0 2023-12-16T07:40:55.598 INFO:tasks.workunit.client.1.smithi133.stdout:3/991: rmdir d7/d8/d72/d86 39 2023-12-16T07:40:55.598 INFO:tasks.workunit.client.1.smithi133.stdout:3/992: chown d7/d8/d78/d43/l59 25306971 1 2023-12-16T07:40:55.599 INFO:tasks.workunit.client.1.smithi133.stdout:3/993: write d7/d8/d1c/ddb/dfb/d10e/d118/d169/ff0 [2439420,29255] 0 2023-12-16T07:40:55.599 INFO:tasks.workunit.client.1.smithi133.stdout:3/994: write d7/d8/d78/d16e/d2d/d173/f138 [17906,46961] 0 2023-12-16T07:40:55.600 INFO:tasks.workunit.client.1.smithi133.stdout:3/995: getdents d7/d128 0 2023-12-16T07:40:55.603 INFO:tasks.workunit.client.1.smithi133.stdout:3/996: mknod d7/d8/d78/d16e/d2d/d173/d158/c182 0 2023-12-16T07:40:55.605 INFO:tasks.workunit.client.1.smithi133.stdout:3/997: unlink d7/d8/d78/d43/d7f/d85/c139 0 2023-12-16T07:40:55.606 INFO:tasks.workunit.client.1.smithi133.stdout:3/998: read d7/d8/d1d/d2a/f3c [2577928,115224] 0 2023-12-16T07:40:55.607 INFO:tasks.workunit.client.1.smithi133.stdout:3/999: write d7/d8/d72/d77/f125 [470485,90706] 0 2023-12-16T07:40:55.610 INFO:tasks.workunit.client.1.smithi133.stderr:+ rm -rf -- ./tmp.vWudvF2W3T 2023-12-16T07:40:56.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:55 smithi049 ceph-mon[111939]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 118 MiB/s rd, 228 MiB/s wr, 513 op/s 2023-12-16T07:40:56.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:55 smithi133 ceph-mon[120445]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 118 MiB/s rd, 228 MiB/s wr, 513 op/s 2023-12-16T07:40:58.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:57 smithi049 ceph-mon[111939]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 72 MiB/s rd, 136 MiB/s wr, 351 op/s 2023-12-16T07:40:58.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:57 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:40:58.284 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:57 smithi133 ceph-mon[120445]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 72 MiB/s rd, 136 MiB/s wr, 351 op/s 2023-12-16T07:40:58.284 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:57 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:00.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:40:59 smithi133 ceph-mon[120445]: pgmap v26: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 77 MiB/s rd, 145 MiB/s wr, 398 op/s 2023-12-16T07:41:00.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:40:59 smithi049 ceph-mon[111939]: pgmap v26: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 77 MiB/s rd, 145 MiB/s wr, 398 op/s 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.052+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2310488517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fcbf0 msgr2=0x7f4c640fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.052+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2310488517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fcbf0 0x7f4c640fd000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c60004940 tx=0x7f4c60009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.052+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2310488517 shutdown_connections 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.052+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2310488517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c640fde00 0x7f4c640fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.052+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2310488517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fcbf0 0x7f4c640fd000 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.052+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2310488517 >> 172.21.15.49:0/2310488517 conn(0x7f4c640f82d0 msgr2=0x7f4c640fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2310488517 shutdown_connections 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2310488517 wait complete. 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 Processor -- start 2023-12-16T07:41:02.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 -- start start 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c640fcbf0 0x7f4c64071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fde00 0x7f4c6406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64070590 con 0x7f4c640fde00 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c6b85d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64070700 con 0x7f4c640fcbf0 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c68df8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fde00 0x7f4c6406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c695f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c640fcbf0 0x7f4c64071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c68df8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fde00 0x7f4c6406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42258/0 (socket says 172.21.15.49:42258) 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.053+0000 7f4c68df8700 1 -- 172.21.15.49:0/2156183024 learned_addr learned my addr 172.21.15.49:0/2156183024 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c68df8700 1 -- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c640fcbf0 msgr2=0x7f4c64071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c68df8700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c640fcbf0 0x7f4c64071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c68df8700 1 -- 172.21.15.49:0/2156183024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60005040 con 0x7f4c640fde00 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c68df8700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fde00 0x7f4c6406ff90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400eb40 tx=0x7f4c5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c59ffb700 1 -- 172.21.15.49:0/2156183024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c54007cc0 con 0x7f4c640fde00 2023-12-16T07:41:02.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c59ffb700 1 -- 172.21.15.49:0/2156183024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c5400f040 con 0x7f4c640fde00 2023-12-16T07:41:02.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c64070980 con 0x7f4c640fde00 2023-12-16T07:41:02.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c59ffb700 1 -- 172.21.15.49:0/2156183024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c5400c990 con 0x7f4c640fde00 2023-12-16T07:41:02.057 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.054+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c64115500 con 0x7f4c640fde00 2023-12-16T07:41:02.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.056+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6404bb80 con 0x7f4c640fde00 2023-12-16T07:41:02.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.056+0000 7f4c59ffb700 1 -- 172.21.15.49:0/2156183024 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f4c5400caf0 con 0x7f4c640fde00 2023-12-16T07:41:02.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.056+0000 7f4c59ffb700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f4c5006ae40 0x7f4c5006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.056+0000 7f4c59ffb700 1 -- 172.21.15.49:0/2156183024 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4c54089370 con 0x7f4c640fde00 2023-12-16T07:41:02.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.056+0000 7f4c695f9700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f4c5006ae40 0x7f4c5006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.057+0000 7f4c695f9700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f4c5006ae40 0x7f4c5006d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009fd0 tx=0x7f4c60009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:02.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.061+0000 7f4c59ffb700 1 -- 172.21.15.49:0/2156183024 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4c5404ece0 con 0x7f4c640fde00 2023-12-16T07:41:02.322 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:41:02.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.289+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c64102750 con 0x7f4c5006ae40 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.290+0000 7f4c59ffb700 1 -- 172.21.15.49:0/2156183024 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4c64102750 con 0x7f4c5006ae40 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f4c5006ae40 msgr2=0x7f4c5006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f4c5006ae40 0x7f4c5006d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009fd0 tx=0x7f4c60009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fde00 msgr2=0x7f4c6406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fde00 0x7f4c6406ff90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400eb40 tx=0x7f4c5400b040 comp rx=0 tx=0).stop 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 shutdown_connections 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f4c5006ae40 0x7f4c5006d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c640fcbf0 0x7f4c64071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 --2- 172.21.15.49:0/2156183024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c640fde00 0x7f4c6406ff90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 >> 172.21.15.49:0/2156183024 conn(0x7f4c640f82d0 msgr2=0x7f4c64101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 shutdown_connections 2023-12-16T07:41:02.323 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.293+0000 7f4c6b85d700 1 -- 172.21.15.49:0/2156183024 wait complete. 2023-12-16T07:41:02.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:01 smithi133 ceph-mon[120445]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 146 MiB/s wr, 472 op/s 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.448+0000 7faa57a74700 1 -- 172.21.15.49:0/3296181993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 msgr2=0x7faa500fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.448+0000 7faa57a74700 1 --2- 172.21.15.49:0/3296181993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa500fc390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faa48009ce0 tx=0x7faa48004d10 comp rx=0 tx=0).stop 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.448+0000 7faa57a74700 1 -- 172.21.15.49:0/3296181993 shutdown_connections 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.448+0000 7faa57a74700 1 --2- 172.21.15.49:0/3296181993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500fac40 0x7faa500fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.448+0000 7faa57a74700 1 --2- 172.21.15.49:0/3296181993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa500fc390 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.448+0000 7faa57a74700 1 -- 172.21.15.49:0/3296181993 >> 172.21.15.49:0/3296181993 conn(0x7faa500f6950 msgr2=0x7faa500f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.449+0000 7faa57a74700 1 -- 172.21.15.49:0/3296181993 shutdown_connections 2023-12-16T07:41:02.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.449+0000 7faa57a74700 1 -- 172.21.15.49:0/3296181993 wait complete. 2023-12-16T07:41:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.450+0000 7faa57a74700 1 Processor -- start 2023-12-16T07:41:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.450+0000 7faa57a74700 1 -- start start 2023-12-16T07:41:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.450+0000 7faa57a74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500fac40 0x7faa50113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.450+0000 7faa57a74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa50114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.450+0000 7faa57a74700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa50114730 con 0x7faa500fbf80 2023-12-16T07:41:02.453 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.450+0000 7faa57a74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa50114fd0 con 0x7faa500fac40 2023-12-16T07:41:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.453+0000 7faa5500f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa50114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.453+0000 7faa5500f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa50114130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42276/0 (socket says 172.21.15.49:42276) 2023-12-16T07:41:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.453+0000 7faa5500f700 1 -- 172.21.15.49:0/1479567805 learned_addr learned my addr 172.21.15.49:0/1479567805 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.453+0000 7faa5500f700 1 -- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500fac40 msgr2=0x7faa50113bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T07:41:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.453+0000 7faa5500f700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500fac40 0x7faa50113bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.453+0000 7faa5500f700 1 -- 172.21.15.49:0/1479567805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009940 con 0x7faa500fbf80 2023-12-16T07:41:02.454 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.454+0000 7faa5500f700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa50114130 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00eb40 tx=0x7faa4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.454+0000 7faa467fc700 1 -- 172.21.15.49:0/1479567805 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4c007cc0 con 0x7faa500fbf80 2023-12-16T07:41:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.454+0000 7faa467fc700 1 -- 172.21.15.49:0/1479567805 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa4c00f040 con 0x7faa500fbf80 2023-12-16T07:41:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.454+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa501151d0 con 0x7faa500fbf80 2023-12-16T07:41:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.454+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa50115710 con 0x7faa500fbf80 2023-12-16T07:41:02.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.454+0000 7faa467fc700 1 -- 172.21.15.49:0/1479567805 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4c009570 con 0x7faa500fbf80 2023-12-16T07:41:02.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.455+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa340052e0 con 0x7faa500fbf80 2023-12-16T07:41:02.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.459+0000 7faa467fc700 1 -- 172.21.15.49:0/1479567805 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7faa4c0096d0 con 0x7faa500fbf80 2023-12-16T07:41:02.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.459+0000 7faa467fc700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7faa3c06b020 0x7faa3c06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.459+0000 7faa467fc700 1 -- 172.21.15.49:0/1479567805 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7faa4c089390 con 0x7faa500fbf80 2023-12-16T07:41:02.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.459+0000 7faa55810700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7faa3c06b020 0x7faa3c06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:01 smithi049 ceph-mon[111939]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 146 MiB/s wr, 472 op/s 2023-12-16T07:41:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.461+0000 7faa55810700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7faa3c06b020 0x7faa3c06d4d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa48003400 tx=0x7faa48004d10 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:02.465 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.464+0000 7faa467fc700 1 -- 172.21.15.49:0/1479567805 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7faa4c04ece0 con 0x7faa500fbf80 2023-12-16T07:41:02.742 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.742+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa34000bf0 con 0x7faa3c06b020 2023-12-16T07:41:02.743 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.743+0000 7faa467fc700 1 -- 172.21.15.49:0/1479567805 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7faa34000bf0 con 0x7faa3c06b020 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7faa3c06b020 msgr2=0x7faa3c06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7faa3c06b020 0x7faa3c06d4d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa48003400 tx=0x7faa48004d10 comp rx=0 tx=0).stop 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 msgr2=0x7faa50114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa50114130 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00eb40 tx=0x7faa4c00b040 comp rx=0 tx=0).stop 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 shutdown_connections 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7faa3c06b020 0x7faa3c06d4d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500fac40 0x7faa50113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 --2- 172.21.15.49:0/1479567805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa500fbf80 0x7faa50114130 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.746 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 >> 172.21.15.49:0/1479567805 conn(0x7faa500f6950 msgr2=0x7faa500f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:02.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.745+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 shutdown_connections 2023-12-16T07:41:02.747 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.746+0000 7faa57a74700 1 -- 172.21.15.49:0/1479567805 wait complete. 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.849+0000 7fc28f8e9700 1 -- 172.21.15.49:0/43255187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 msgr2=0x7fc2880fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.849+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/43255187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880fbf00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc284004940 tx=0x7fc284009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 -- 172.21.15.49:0/43255187 shutdown_connections 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/43255187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2880fcd00 0x7fc2880fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/43255187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880fbf00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 -- 172.21.15.49:0/43255187 >> 172.21.15.49:0/43255187 conn(0x7fc2880f7190 msgr2=0x7fc2880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 -- 172.21.15.49:0/43255187 shutdown_connections 2023-12-16T07:41:02.850 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 -- 172.21.15.49:0/43255187 wait complete. 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 Processor -- start 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 -- start start 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2880fcd00 0x7fc2880fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880fe640 con 0x7fc2880fbaf0 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28f8e9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880fe7b0 con 0x7fc2880fcd00 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28d685700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.852 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.850+0000 7fc28d685700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42300/0 (socket says 172.21.15.49:42300) 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28d685700 1 -- 172.21.15.49:0/3622530518 learned_addr learned my addr 172.21.15.49:0/3622530518 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28ce84700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2880fcd00 0x7fc2880fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28d685700 1 -- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2880fcd00 msgr2=0x7fc2880fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28d685700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2880fcd00 0x7fc2880fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28d685700 1 -- 172.21.15.49:0/3622530518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284005040 con 0x7fc2880fbaf0 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28d685700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880ffbc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc284008f90 tx=0x7fc284009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc27dffb700 1 -- 172.21.15.49:0/3622530518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc284021070 con 0x7fc2880fbaf0 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2880fea30 con 0x7fc2880fbaf0 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc27dffb700 1 -- 172.21.15.49:0/3622530518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc28401c400 con 0x7fc2880fbaf0 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc27dffb700 1 -- 172.21.15.49:0/3622530518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc28400e030 con 0x7fc2880fbaf0 2023-12-16T07:41:02.853 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.851+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc288115520 con 0x7fc2880fbaf0 2023-12-16T07:41:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.852+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28804bb80 con 0x7fc2880fbaf0 2023-12-16T07:41:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.853+0000 7fc27dffb700 1 -- 172.21.15.49:0/3622530518 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7fc28401c9e0 con 0x7fc2880fbaf0 2023-12-16T07:41:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.853+0000 7fc27dffb700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fc27406ae40 0x7fc27406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.853+0000 7fc27dffb700 1 -- 172.21.15.49:0/3622530518 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc28408a990 con 0x7fc2880fbaf0 2023-12-16T07:41:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.853+0000 7fc28ce84700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fc27406ae40 0x7fc27406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:02.854 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.854+0000 7fc28ce84700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fc27406ae40 0x7fc27406d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc278009b80 tx=0x7fc27800b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:02.858 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:02.858+0000 7fc27dffb700 1 -- 172.21.15.49:0/3622530518 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc284058860 con 0x7fc2880fbaf0 2023-12-16T07:41:03.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.079+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc288065a80 con 0x7fc27406ae40 2023-12-16T07:41:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.096+0000 7fc27dffb700 1 -- 172.21.15.49:0/3622530518 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fc288065a80 con 0x7fc27406ae40 2023-12-16T07:41:03.096 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 starting - - - - 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 37s ago 6m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (5m) 29s ago 5m 7495k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 37s ago 6m 91.1M - 9.4.7 954c08fa6188 f8fc00abbcaf 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (2m) 37s ago 2m 13.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (2m) 37s ago 2m 14.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (2m) 29s ago 2m 3192M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (2m) 29s ago 2m 16.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:9283 running (7m) 37s ago 7m 425M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ecfbb356bee1 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283 running (63s) 29s ago 5m 494M - 19.0.0-191-g6d933094 a29c258b5d6f eb57616ccaf3 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (7m) 37s ago 7m 77.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (5m) 29s ago 5m 56.6M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:41:03.097 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 starting - - - - 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (5m) 29s ago 5m 19.3M - 1.5.0 0da6a335fe13 ecd5d6b45738 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 37s ago 5m 383M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 37s ago 4m 415M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 37s ago 4m 319M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (4m) 29s ago 4m 451M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (3m) 29s ago 3m 387M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (3m) 29s ago 3m 436M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:41:03.098 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (5m) 37s ago 6m 58.6M - 2.43.0 a07b618ecd1d d2e8b8e4a383 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fc27406ae40 msgr2=0x7fc27406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fc27406ae40 0x7fc27406d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc278009b80 tx=0x7fc27800b040 comp rx=0 tx=0).stop 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 msgr2=0x7fc2880ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880ffbc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc284008f90 tx=0x7fc284009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 shutdown_connections 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7fc27406ae40 0x7fc27406d2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2880fbaf0 0x7fc2880ffbc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 --2- 172.21.15.49:0/3622530518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2880fcd00 0x7fc2880fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 >> 172.21.15.49:0/3622530518 conn(0x7fc2880f7190 msgr2=0x7fc288065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 shutdown_connections 2023-12-16T07:41:03.099 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.098+0000 7fc28f8e9700 1 -- 172.21.15.49:0/3622530518 wait complete. 2023-12-16T07:41:03.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 -- 172.21.15.49:0/2996277083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fcbf0 msgr2=0x7f7ebc0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 --2- 172.21.15.49:0/2996277083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fcbf0 0x7f7ebc0fd000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7eac004940 tx=0x7f7eac009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 -- 172.21.15.49:0/2996277083 shutdown_connections 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 --2- 172.21.15.49:0/2996277083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ebc0fde00 0x7f7ebc0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 --2- 172.21.15.49:0/2996277083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fcbf0 0x7f7ebc0fd000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 -- 172.21.15.49:0/2996277083 >> 172.21.15.49:0/2996277083 conn(0x7f7ebc0f82d0 msgr2=0x7f7ebc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 -- 172.21.15.49:0/2996277083 shutdown_connections 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 -- 172.21.15.49:0/2996277083 wait complete. 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.243+0000 7f7ec2956700 1 Processor -- start 2023-12-16T07:41:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ec2956700 1 -- start start 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ec2956700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ebc0fcbf0 0x7f7ebc10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ec2956700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fde00 0x7f7ebc10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ec2956700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc10e010 con 0x7f7ebc0fde00 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ec2956700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc10e8b0 con 0x7f7ebc0fcbf0 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fde00 0x7f7ebc10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fde00 0x7f7ebc10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42322/0 (socket says 172.21.15.49:42322) 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebb7fe700 1 -- 172.21.15.49:0/755333313 learned_addr learned my addr 172.21.15.49:0/755333313 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebbfff700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ebc0fcbf0 0x7f7ebc10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebb7fe700 1 -- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ebc0fcbf0 msgr2=0x7f7ebc10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebb7fe700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ebc0fcbf0 0x7f7ebc10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebb7fe700 1 -- 172.21.15.49:0/755333313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac005040 con 0x7f7ebc0fde00 2023-12-16T07:41:03.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7ebb7fe700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fde00 0x7f7ebc10da10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000eb40 tx=0x7f7eb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:03.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.244+0000 7f7eb8ff9700 1 -- 172.21.15.49:0/755333313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb0007cc0 con 0x7f7ebc0fde00 2023-12-16T07:41:03.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.245+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc10eb30 con 0x7f7ebc0fde00 2023-12-16T07:41:03.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.245+0000 7f7eb8ff9700 1 -- 172.21.15.49:0/755333313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7eb000f040 con 0x7f7ebc0fde00 2023-12-16T07:41:03.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.245+0000 7f7eb8ff9700 1 -- 172.21.15.49:0/755333313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb000c990 con 0x7f7ebc0fde00 2023-12-16T07:41:03.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.245+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc10f070 con 0x7f7ebc0fde00 2023-12-16T07:41:03.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.246+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc04bb80 con 0x7f7ebc0fde00 2023-12-16T07:41:03.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.247+0000 7f7eb8ff9700 1 -- 172.21.15.49:0/755333313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f7eb000cc00 con 0x7f7ebc0fde00 2023-12-16T07:41:03.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.247+0000 7f7eb8ff9700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f7ea406ae40 0x7f7ea406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:03.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.247+0000 7f7eb8ff9700 1 -- 172.21.15.49:0/755333313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7eb0089670 con 0x7f7ebc0fde00 2023-12-16T07:41:03.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.247+0000 7f7ebbfff700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f7ea406ae40 0x7f7ea406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:03.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.248+0000 7f7ebbfff700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f7ea406ae40 0x7f7ea406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7eac013680 tx=0x7f7eac009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:03.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.251+0000 7f7eb8ff9700 1 -- 172.21.15.49:0/755333313 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7eb00574d0 con 0x7f7ebc0fde00 2023-12-16T07:41:03.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.554+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7ebc105590 con 0x7f7ebc0fde00 2023-12-16T07:41:03.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.555+0000 7f7eb8ff9700 1 -- 172.21.15.49:0/755333313 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f7eb0057060 con 0x7f7ebc0fde00 2023-12-16T07:41:03.555 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:41:03.555 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:41:03.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:41:03.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:03.555 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:41:03.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:41:03.556 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f7ea406ae40 msgr2=0x7f7ea406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f7ea406ae40 0x7f7ea406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7eac013680 tx=0x7f7eac009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fde00 msgr2=0x7f7ebc10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fde00 0x7f7ebc10da10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000eb40 tx=0x7f7eb000b040 comp rx=0 tx=0).stop 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 shutdown_connections 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f7ea406ae40 0x7f7ea406d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ebc0fcbf0 0x7f7ebc10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 --2- 172.21.15.49:0/755333313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ebc0fde00 0x7f7ebc10da10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 >> 172.21.15.49:0/755333313 conn(0x7f7ebc0f82d0 msgr2=0x7f7ebc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:03.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 shutdown_connections 2023-12-16T07:41:03.558 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.557+0000 7f7ec2956700 1 -- 172.21.15.49:0/755333313 wait complete. 2023-12-16T07:41:03.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 -- 172.21.15.49:0/1729942584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 msgr2=0x7f18e00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 --2- 172.21.15.49:0/1729942584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e00fd150 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f18d0004940 tx=0x7f18d0009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:03.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 -- 172.21.15.49:0/1729942584 shutdown_connections 2023-12-16T07:41:03.663 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 --2- 172.21.15.49:0/1729942584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e00fd150 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 --2- 172.21.15.49:0/1729942584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00fbaf0 0x7f18e00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 -- 172.21.15.49:0/1729942584 >> 172.21.15.49:0/1729942584 conn(0x7f18e00f7190 msgr2=0x7f18e00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:03.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 -- 172.21.15.49:0/1729942584 shutdown_connections 2023-12-16T07:41:03.664 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 -- 172.21.15.49:0/1729942584 wait complete. 2023-12-16T07:41:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.663+0000 7f18e7467700 1 Processor -- start 2023-12-16T07:41:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e7467700 1 -- start start 2023-12-16T07:41:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e7467700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00fbaf0 0x7f18e010f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e7467700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e7467700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0110210 con 0x7f18e00fcd00 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e7467700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0110ab0 con 0x7f18e00fbaf0 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e4a02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e4a02700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e010fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42340/0 (socket says 172.21.15.49:42340) 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e4a02700 1 -- 172.21.15.49:0/2778446600 learned_addr learned my addr 172.21.15.49:0/2778446600 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e5203700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00fbaf0 0x7f18e010f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e4a02700 1 -- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00fbaf0 msgr2=0x7f18e010f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e4a02700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00fbaf0 0x7f18e010f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e4a02700 1 -- 172.21.15.49:0/2778446600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0005040 con 0x7f18e00fcd00 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18e4a02700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e010fc10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18d0000c00 tx=0x7f18d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.664+0000 7f18d5ffb700 1 -- 172.21.15.49:0/2778446600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d0021070 con 0x7f18e00fcd00 2023-12-16T07:41:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.665+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e0110d30 con 0x7f18e00fcd00 2023-12-16T07:41:03.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.665+0000 7f18d5ffb700 1 -- 172.21.15.49:0/2778446600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18d001c400 con 0x7f18e00fcd00 2023-12-16T07:41:03.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.665+0000 7f18d5ffb700 1 -- 172.21.15.49:0/2778446600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d000e070 con 0x7f18e00fcd00 2023-12-16T07:41:03.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.665+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0111210 con 0x7f18e00fcd00 2023-12-16T07:41:03.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.666+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e004bb80 con 0x7f18e00fcd00 2023-12-16T07:41:03.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.666+0000 7f18d5ffb700 1 -- 172.21.15.49:0/2778446600 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 88727+0+0 (secure 0 0 0) 0x7f18d001c9c0 con 0x7f18e00fcd00 2023-12-16T07:41:03.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.667+0000 7f18d5ffb700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f18cc06ae40 0x7f18cc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:03.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.667+0000 7f18d5ffb700 1 -- 172.21.15.49:0/2778446600 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f18d008aa70 con 0x7f18e00fcd00 2023-12-16T07:41:03.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.667+0000 7f18e5203700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f18cc06ae40 0x7f18cc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:03.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.668+0000 7f18e5203700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f18cc06ae40 0x7f18cc06d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009b80 tx=0x7f18dc00b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:03.673 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.673+0000 7f18d5ffb700 1 -- 172.21.15.49:0/2778446600 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f18d0058820 con 0x7f18e00fcd00 2023-12-16T07:41:03.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.897+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 --> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18e0111660 con 0x7f18cc06ae40 2023-12-16T07:41:03.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.899+0000 7f18d5ffb700 1 -- 172.21.15.49:0/2778446600 <== mgr.24423 v2:172.21.15.133:6828/1992339894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f18e0111660 con 0x7f18cc06ae40 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/2 daemons upgraded", 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:41:03.900 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f18cc06ae40 msgr2=0x7f18cc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f18cc06ae40 0x7f18cc06d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009b80 tx=0x7f18dc00b040 comp rx=0 tx=0).stop 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 msgr2=0x7f18e010fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e010fc10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18d0000c00 tx=0x7f18d0009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 shutdown_connections 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:6828/1992339894,v1:172.21.15.133:6829/1992339894] conn(0x7f18cc06ae40 0x7f18cc06d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00fbaf0 0x7f18e010f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 --2- 172.21.15.49:0/2778446600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e00fcd00 0x7f18e010fc10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.901+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 >> 172.21.15.49:0/2778446600 conn(0x7f18e00f7190 msgr2=0x7f18e0065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.902+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 shutdown_connections 2023-12-16T07:41:03.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:03.902+0000 7f18e7467700 1 -- 172.21.15.49:0/2778446600 wait complete. 2023-12-16T07:41:04.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:03 smithi049 ceph-mon[111939]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 93 MiB/s wr, 345 op/s 2023-12-16T07:41:04.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:03 smithi049 ceph-mon[111939]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:04.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:03 smithi049 ceph-mon[111939]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:04.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:03 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/755333313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:04.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:03 smithi133 ceph-mon[120445]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 93 MiB/s wr, 345 op/s 2023-12-16T07:41:04.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:03 smithi133 ceph-mon[120445]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:04.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:03 smithi133 ceph-mon[120445]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:04.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:03 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/755333313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:05.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:04 smithi049 ceph-mon[111939]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:05.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:04 smithi049 ceph-mon[111939]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:05.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:04 smithi133 ceph-mon[120445]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:05.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:04 smithi133 ceph-mon[120445]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:06.133 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:05 smithi049 ceph-mon[111939]: pgmap v29: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 94 MiB/s wr, 508 op/s 2023-12-16T07:41:06.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:05 smithi133 ceph-mon[120445]: pgmap v29: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 94 MiB/s wr, 508 op/s 2023-12-16T07:41:07.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:07 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:07.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:07 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:07 smithi049 ceph-mon[111939]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2023-12-16T07:41:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:07 smithi049 ceph-mon[111939]: pgmap v30: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 32 MiB/s wr, 318 op/s 2023-12-16T07:41:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:07 smithi049 ceph-mon[111939]: Reconfiguring daemon prometheus.smithi049 on smithi049 2023-12-16T07:41:07.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:07 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:07.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:07 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:07.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:07 smithi133 ceph-mon[120445]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2023-12-16T07:41:07.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:07 smithi133 ceph-mon[120445]: pgmap v30: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 32 MiB/s wr, 318 op/s 2023-12-16T07:41:07.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:07 smithi133 ceph-mon[120445]: Reconfiguring daemon prometheus.smithi049 on smithi049 2023-12-16T07:41:09.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:09 smithi049 ceph-mon[111939]: pgmap v31: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 33 MiB/s wr, 356 op/s 2023-12-16T07:41:09.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:09 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:09.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:09 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:09.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:09 smithi133 ceph-mon[120445]: pgmap v31: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 33 MiB/s wr, 356 op/s 2023-12-16T07:41:09.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:09 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:09.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:09 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:10.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:10 smithi133 ceph-mon[120445]: Reconfiguring node-exporter.smithi133 (dependencies changed)... 2023-12-16T07:41:10.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:10 smithi133 ceph-mon[120445]: Reconfiguring daemon node-exporter.smithi133 on smithi133 2023-12-16T07:41:10.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:10 smithi049 ceph-mon[111939]: Reconfiguring node-exporter.smithi133 (dependencies changed)... 2023-12-16T07:41:10.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:10 smithi049 ceph-mon[111939]: Reconfiguring daemon node-exporter.smithi133 on smithi133 2023-12-16T07:41:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:11 smithi133 ceph-mon[120445]: pgmap v32: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 7.6 MiB/s rd, 24 MiB/s wr, 381 op/s 2023-12-16T07:41:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:11 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:11 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:11 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:41:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:11 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:41:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:11 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:11.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:11 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:11.903 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:11 smithi049 ceph-mon[111939]: pgmap v32: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 7.6 MiB/s rd, 24 MiB/s wr, 381 op/s 2023-12-16T07:41:11.903 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:11 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:11.904 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:11 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:11.904 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:11 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:41:11.904 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:11 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:41:11.904 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:11 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:11.904 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:11 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:41:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:41:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:12.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:12.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:41:12.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:41:12.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:41:12.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:12.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:12 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:41:12.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:41:12.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:12.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:12 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:13.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:13 smithi049 ceph-mon[111939]: Upgrade: Updating mgr.smithi049.rqlvwo 2023-12-16T07:41:13.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:13 smithi049 ceph-mon[111939]: Deploying daemon mgr.smithi049.rqlvwo on smithi049 2023-12-16T07:41:13.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:13 smithi049 ceph-mon[111939]: pgmap v33: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 272 op/s 2023-12-16T07:41:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:13 smithi133 ceph-mon[120445]: Upgrade: Updating mgr.smithi049.rqlvwo 2023-12-16T07:41:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:13 smithi133 ceph-mon[120445]: Deploying daemon mgr.smithi049.rqlvwo on smithi049 2023-12-16T07:41:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:13 smithi133 ceph-mon[120445]: pgmap v33: 65 pgs: 65 active+clean; 1.1 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 272 op/s 2023-12-16T07:41:16.042 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:15 smithi133 ceph-mon[120445]: pgmap v34: 65 pgs: 65 active+clean; 743 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 404 op/s 2023-12-16T07:41:16.042 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:15 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:16.043 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:15 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:16.043 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:15 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:16.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:15 smithi049 ceph-mon[111939]: pgmap v34: 65 pgs: 65 active+clean; 743 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 404 op/s 2023-12-16T07:41:16.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:15 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:16.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:15 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:16.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:15 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:17.292 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-16T07:41:17.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-16T07:41:17.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:17 smithi049 ceph-mon[111939]: pgmap v35: 65 pgs: 65 active+clean; 743 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 242 op/s 2023-12-16T07:41:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:17 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:17 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:18.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:17 smithi133 ceph-mon[120445]: pgmap v35: 65 pgs: 65 active+clean; 743 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 242 op/s 2023-12-16T07:41:18.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:17 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:18.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:17 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.815 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:19 smithi049 ceph-mon[111939]: pgmap v36: 65 pgs: 65 active+clean; 514 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 305 op/s 2023-12-16T07:41:19.815 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:19 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.815 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:19 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.815 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:19 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.815 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:19 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:19 smithi133 ceph-mon[120445]: pgmap v36: 65 pgs: 65 active+clean; 514 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 305 op/s 2023-12-16T07:41:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:19 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:19 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:19 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:19 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:21.616 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:21 smithi049 ceph-mon[111939]: pgmap v37: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.2 MiB/s wr, 324 op/s 2023-12-16T07:41:21.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:21 smithi133 ceph-mon[120445]: pgmap v37: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.2 MiB/s wr, 324 op/s 2023-12-16T07:41:22.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:22.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:22.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:22.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: Failing over to other MGR 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr fail", "who": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr fail", "who": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd='[{"prefix": "mgr fail", "who": "smithi133.wbiduk"}]': finished 2023-12-16T07:41:22.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: mgrmap e26: smithi049.rqlvwo(active, starting, since 0.00544942s) 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: mgrmap e27: smithi049.rqlvwo(active, starting, since 0.00548532s) 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/crt"}]: dispatch 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/crt"}]: dispatch 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:41:22.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:41:22.998 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/key"}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:22.999 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:23.000 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:23.000 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:41:23.000 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:22 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: Upgrade: Need to upgrade myself (mgr.smithi133.wbiduk) 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: Failing over to other MGR 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 172.21.15.133:0/3307665853' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr fail", "who": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "mgr fail", "who": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:23.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: osdmap e46: 6 total, 6 up, 6 in 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.24423 ' entity='mgr.smithi133.wbiduk' cmd='[{"prefix": "mgr fail", "who": "smithi133.wbiduk"}]': finished 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: mgrmap e26: smithi049.rqlvwo(active, starting, since 0.00544942s) 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: mgrmap e27: smithi049.rqlvwo(active, starting, since 0.00548532s) 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/crt"}]: dispatch 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/crt"}]: dispatch 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:41:23.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rqlvwo/key"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:41:23.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:23.121 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:23.121 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:23.121 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:41:23.121 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:22 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:41:24.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:24 smithi049 ceph-mon[111939]: [16/Dec/2023:07:41:23] ENGINE Bus STARTING 2023-12-16T07:41:24.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:24 smithi049 ceph-mon[111939]: [16/Dec/2023:07:41:23] ENGINE Serving on http://172.21.15.49:8765 2023-12-16T07:41:24.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:24 smithi049 ceph-mon[111939]: mgrmap e28: smithi049.rqlvwo(active, since 1.00829s) 2023-12-16T07:41:24.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:24 smithi049 ceph-mon[111939]: pgmap v3: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:41:24.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:24 smithi049 ceph-mon[111939]: [16/Dec/2023:07:41:23] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:41:24.711 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:24 smithi049 ceph-mon[111939]: [16/Dec/2023:07:41:23] ENGINE Bus STARTED 2023-12-16T07:41:25.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:24 smithi133 ceph-mon[120445]: [16/Dec/2023:07:41:23] ENGINE Bus STARTING 2023-12-16T07:41:25.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:24 smithi133 ceph-mon[120445]: [16/Dec/2023:07:41:23] ENGINE Serving on http://172.21.15.49:8765 2023-12-16T07:41:25.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:24 smithi133 ceph-mon[120445]: mgrmap e28: smithi049.rqlvwo(active, since 1.00829s) 2023-12-16T07:41:25.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:24 smithi133 ceph-mon[120445]: pgmap v3: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:41:25.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:24 smithi133 ceph-mon[120445]: [16/Dec/2023:07:41:23] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:41:25.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:24 smithi133 ceph-mon[120445]: [16/Dec/2023:07:41:23] ENGINE Bus STARTED 2023-12-16T07:41:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:25 smithi049 ceph-mon[111939]: pgmap v4: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:41:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:25 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:25.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:25 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:26.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:25 smithi133 ceph-mon[120445]: pgmap v4: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:41:26.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:25 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:26.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:25 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:26.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:26 smithi049 ceph-mon[111939]: mgrmap e29: smithi049.rqlvwo(active, since 3s) 2023-12-16T07:41:26.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:26 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:26.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:26 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:26 smithi133 ceph-mon[120445]: mgrmap e29: smithi049.rqlvwo(active, since 3s) 2023-12-16T07:41:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:26 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:26.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:26 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:27.992 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:27 smithi049 ceph-mon[111939]: pgmap v5: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:41:27.992 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:27 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:27.992 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:27 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:27.992 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:27 smithi049 ceph-mon[111939]: mgrmap e30: smithi049.rqlvwo(active, since 4s) 2023-12-16T07:41:27.992 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:27 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:27.992 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:27 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:27 smithi133 ceph-mon[120445]: pgmap v5: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:41:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:27 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:27 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:27 smithi133 ceph-mon[120445]: mgrmap e30: smithi049.rqlvwo(active, since 4s) 2023-12-16T07:41:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:27 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:28.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:27 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:29.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:29 smithi049 ceph-mon[111939]: pgmap v6: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 46 op/s 2023-12-16T07:41:30.111 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:29 smithi133 ceph-mon[120445]: pgmap v6: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 46 op/s 2023-12-16T07:41:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: pgmap v7: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 294 op/s 2023-12-16T07:41:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:41:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:41:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:41:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:41:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:41:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: pgmap v7: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 294 op/s 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/1529529381' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:32.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:41:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:41:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:41:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:41:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:41:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: mgrmap e31: smithi049.rqlvwo(active, since 9s), standbys: smithi133.wbiduk 2023-12-16T07:41:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:33.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:33.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:41:33.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:41:33.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:41:33.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:41:33.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: mgrmap e31: smithi049.rqlvwo(active, since 9s), standbys: smithi133.wbiduk 2023-12-16T07:41:33.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:33.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:33.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 -- 172.21.15.49:0/4016222425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 msgr2=0x7ff1500fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 --2- 172.21.15.49:0/4016222425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff1500fd000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff138004940 tx=0x7ff138009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 -- 172.21.15.49:0/4016222425 shutdown_connections 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 --2- 172.21.15.49:0/4016222425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1500fde00 0x7ff1500fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 --2- 172.21.15.49:0/4016222425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff1500fd000 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 -- 172.21.15.49:0/4016222425 >> 172.21.15.49:0/4016222425 conn(0x7ff1500f82d0 msgr2=0x7ff1500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 -- 172.21.15.49:0/4016222425 shutdown_connections 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.010+0000 7ff156801700 1 -- 172.21.15.49:0/4016222425 wait complete. 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff156801700 1 Processor -- start 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff156801700 1 -- start start 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff156801700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff150071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff156801700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1500fde00 0x7ff15006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff156801700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150070590 con 0x7ff1500fcbf0 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff156801700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150070700 con 0x7ff1500fde00 2023-12-16T07:41:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff14ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff150071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff14ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff150071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56558/0 (socket says 172.21.15.49:56558) 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff14ffff700 1 -- 172.21.15.49:0/295030166 learned_addr learned my addr 172.21.15.49:0/295030166 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.011+0000 7ff14f7fe700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1500fde00 0x7ff15006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff14ffff700 1 -- 172.21.15.49:0/295030166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1500fde00 msgr2=0x7ff15006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff14ffff700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1500fde00 0x7ff15006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff14ffff700 1 -- 172.21.15.49:0/295030166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138005040 con 0x7ff1500fcbf0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff14ffff700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff150071b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff138000c00 tx=0x7ff138009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff14cff9700 1 -- 172.21.15.49:0/295030166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13800e040 con 0x7ff1500fcbf0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff14cff9700 1 -- 172.21.15.49:0/295030166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff138009af0 con 0x7ff1500fcbf0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff150070980 con 0x7ff1500fcbf0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff14cff9700 1 -- 172.21.15.49:0/295030166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13801c630 con 0x7ff1500fcbf0 2023-12-16T07:41:34.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.012+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff150115500 con 0x7ff1500fcbf0 2023-12-16T07:41:34.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.013+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15004bb80 con 0x7ff1500fcbf0 2023-12-16T07:41:34.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.013+0000 7ff14cff9700 1 -- 172.21.15.49:0/295030166 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7ff13800bc50 con 0x7ff1500fcbf0 2023-12-16T07:41:34.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.014+0000 7ff14cff9700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff13c06cc00 0x7ff13c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.014+0000 7ff14cff9700 1 -- 172.21.15.49:0/295030166 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff13808d430 con 0x7ff1500fcbf0 2023-12-16T07:41:34.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.014+0000 7ff14f7fe700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff13c06cc00 0x7ff13c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.015+0000 7ff14f7fe700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff13c06cc00 0x7ff13c06f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff140009fd0 tx=0x7ff14000b040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:34.019 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.019+0000 7ff14cff9700 1 -- 172.21.15.49:0/295030166 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff13805b080 con 0x7ff1500fcbf0 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: pgmap v8: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 959 KiB/s wr, 228 op/s 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:34.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:41:34.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:41:34.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:41:34.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:41:34.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: pgmap v8: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 959 KiB/s wr, 228 op/s 2023-12-16T07:41:34.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:34.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:34.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:34.244 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.244+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff150102750 con 0x7ff13c06cc00 2023-12-16T07:41:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.245+0000 7ff14cff9700 1 -- 172.21.15.49:0/295030166 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ff150102750 con 0x7ff13c06cc00 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff13c06cc00 msgr2=0x7ff13c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff13c06cc00 0x7ff13c06f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff140009fd0 tx=0x7ff14000b040 comp rx=0 tx=0).stop 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 msgr2=0x7ff150071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff150071b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff138000c00 tx=0x7ff138009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 shutdown_connections 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff13c06cc00 0x7ff13c06f0b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1500fcbf0 0x7ff150071b10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 --2- 172.21.15.49:0/295030166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1500fde00 0x7ff15006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 >> 172.21.15.49:0/295030166 conn(0x7ff1500f82d0 msgr2=0x7ff150101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 shutdown_connections 2023-12-16T07:41:34.249 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.248+0000 7ff156801700 1 -- 172.21.15.49:0/295030166 wait complete. 2023-12-16T07:41:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:41:34.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 -- 172.21.15.49:0/110678619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 msgr2=0x7fd0bc0ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 --2- 172.21.15.49:0/110678619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc0ffb20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac004940 tx=0x7fd0ac009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:34.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 -- 172.21.15.49:0/110678619 shutdown_connections 2023-12-16T07:41:34.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 --2- 172.21.15.49:0/110678619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0bc100060 0x7fd0bc102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 --2- 172.21.15.49:0/110678619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc0ffb20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 -- 172.21.15.49:0/110678619 >> 172.21.15.49:0/110678619 conn(0x7fd0bc0f71c0 msgr2=0x7fd0bc0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:34.354 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 -- 172.21.15.49:0/110678619 shutdown_connections 2023-12-16T07:41:34.355 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 -- 172.21.15.49:0/110678619 wait complete. 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.354+0000 7fd0c257d700 1 Processor -- start 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0c257d700 1 -- start start 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0c257d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc10f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0c257d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0bc100060 0x7fd0bc10fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0c257d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc1101d0 con 0x7fd0bc0fd740 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0c257d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc110a70 con 0x7fd0bc100060 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc10f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.356 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc10f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56582/0 (socket says 172.21.15.49:56582) 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bbfff700 1 -- 172.21.15.49:0/4275901553 learned_addr learned my addr 172.21.15.49:0/4275901553 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bb7fe700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0bc100060 0x7fd0bc10fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bbfff700 1 -- 172.21.15.49:0/4275901553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0bc100060 msgr2=0x7fd0bc10fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bbfff700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0bc100060 0x7fd0bc10fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bbfff700 1 -- 172.21.15.49:0/4275901553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac005040 con 0x7fd0bc0fd740 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.355+0000 7fd0bbfff700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc10f690 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac000c00 tx=0x7fd0ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.356+0000 7fd0b8ff9700 1 -- 172.21.15.49:0/4275901553 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0ac021070 con 0x7fd0bc0fd740 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.356+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc110cf0 con 0x7fd0bc0fd740 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.356+0000 7fd0b8ff9700 1 -- 172.21.15.49:0/4275901553 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0ac01c400 con 0x7fd0bc0fd740 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.356+0000 7fd0b8ff9700 1 -- 172.21.15.49:0/4275901553 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0ac00e070 con 0x7fd0bc0fd740 2023-12-16T07:41:34.357 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.356+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc1111d0 con 0x7fd0bc0fd740 2023-12-16T07:41:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.357+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc04bb80 con 0x7fd0bc0fd740 2023-12-16T07:41:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.357+0000 7fd0b8ff9700 1 -- 172.21.15.49:0/4275901553 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fd0ac01c9c0 con 0x7fd0bc0fd740 2023-12-16T07:41:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.357+0000 7fd0b8ff9700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fd0a406cc00 0x7fd0a406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.358+0000 7fd0b8ff9700 1 -- 172.21.15.49:0/4275901553 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd0ac08d230 con 0x7fd0bc0fd740 2023-12-16T07:41:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.358+0000 7fd0bb7fe700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fd0a406cc00 0x7fd0a406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.358+0000 7fd0bb7fe700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fd0a406cc00 0x7fd0a406f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009b80 tx=0x7fd0b000b040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:34.362 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.362+0000 7fd0b8ff9700 1 -- 172.21.15.49:0/4275901553 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd0ac05ae80 con 0x7fd0bc0fd740 2023-12-16T07:41:34.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.631+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0bc111900 con 0x7fd0a406cc00 2023-12-16T07:41:34.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.633+0000 7fd0b8ff9700 1 -- 172.21.15.49:0/4275901553 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fd0b000f040 con 0x7fd0a406cc00 2023-12-16T07:41:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fd0a406cc00 msgr2=0x7fd0a406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fd0a406cc00 0x7fd0a406f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009b80 tx=0x7fd0b000b040 comp rx=0 tx=0).stop 2023-12-16T07:41:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 msgr2=0x7fd0bc10f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc10f690 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac000c00 tx=0x7fd0ac009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 shutdown_connections 2023-12-16T07:41:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fd0a406cc00 0x7fd0a406f0b0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009b80 tx=0x7fd0b000b040 comp rx=0 tx=0).stop 2023-12-16T07:41:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0bc0fd740 0x7fd0bc10f690 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac000c00 tx=0x7fd0ac009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 --2- 172.21.15.49:0/4275901553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0bc100060 0x7fd0bc10fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.637+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 >> 172.21.15.49:0/4275901553 conn(0x7fd0bc0f71c0 msgr2=0x7fd0bc0fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.638+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 shutdown_connections 2023-12-16T07:41:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.638+0000 7fd0c257d700 1 -- 172.21.15.49:0/4275901553 wait complete. 2023-12-16T07:41:34.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 -- 172.21.15.49:0/4281921018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8070510 msgr2=0x7f69d8070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 --2- 172.21.15.49:0/4281921018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8070510 0x7f69d8070980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f69c4004940 tx=0x7f69c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 -- 172.21.15.49:0/4281921018 shutdown_connections 2023-12-16T07:41:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 --2- 172.21.15.49:0/4281921018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8070510 0x7f69d8070980 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 --2- 172.21.15.49:0/4281921018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8071b60 0x7f69d806ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 -- 172.21.15.49:0/4281921018 >> 172.21.15.49:0/4281921018 conn(0x7f69d80f82d0 msgr2=0x7f69d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:34.758 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 -- 172.21.15.49:0/4281921018 shutdown_connections 2023-12-16T07:41:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 -- 172.21.15.49:0/4281921018 wait complete. 2023-12-16T07:41:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 Processor -- start 2023-12-16T07:41:34.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.757+0000 7f69df130700 1 -- start start 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69df130700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8070510 0x7f69d810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69df130700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8071b60 0x7f69d810fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69df130700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d81102c0 con 0x7f69d8071b60 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69df130700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8110b60 con 0x7f69d8070510 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8071b60 0x7f69d810fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8071b60 0x7f69d810fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56604/0 (socket says 172.21.15.49:56604) 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69d7fff700 1 -- 172.21.15.49:0/3000364047 learned_addr learned my addr 172.21.15.49:0/3000364047 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69dcecc700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8070510 0x7f69d810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69d7fff700 1 -- 172.21.15.49:0/3000364047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8070510 msgr2=0x7f69d810f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69d7fff700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8070510 0x7f69d810f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69d7fff700 1 -- 172.21.15.49:0/3000364047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4005040 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.758+0000 7f69d7fff700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8071b60 0x7f69d810fcc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69c4000c00 tx=0x7f69c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.759+0000 7f69d57fa700 1 -- 172.21.15.49:0/3000364047 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c4021070 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.759+0000 7f69d57fa700 1 -- 172.21.15.49:0/3000364047 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69c401c400 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.759+0000 7f69d57fa700 1 -- 172.21.15.49:0/3000364047 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c400e070 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.759+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d8110de0 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.759+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d81112c0 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.760+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d81096f0 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.760+0000 7f69d57fa700 1 -- 172.21.15.49:0/3000364047 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f69c401c9c0 con 0x7f69d8071b60 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.761+0000 7f69d57fa700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69c806cc00 0x7f69c806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.761+0000 7f69dcecc700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69c806cc00 0x7f69c806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.761+0000 7f69dcecc700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69c806cc00 0x7f69c806f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009b80 tx=0x7f69cc00b040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:34.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.762+0000 7f69d57fa700 1 -- 172.21.15.49:0/3000364047 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f69c408f030 con 0x7f69d8071b60 2023-12-16T07:41:34.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.765+0000 7f69d57fa700 1 -- 172.21.15.49:0/3000364047 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f69c405a5e0 con 0x7f69d8071b60 2023-12-16T07:41:34.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:34 smithi049 ceph-mon[111939]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2023-12-16T07:41:34.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:34 smithi049 ceph-mon[111939]: Reconfiguring daemon prometheus.smithi049 on smithi049 2023-12-16T07:41:34.982 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.982+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f69d8111530 con 0x7f69c806cc00 2023-12-16T07:41:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.993+0000 7f69d57fa700 1 -- 172.21.15.49:0/3000364047 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f69d8111530 con 0x7f69c806cc00 2023-12-16T07:41:34.993 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:41:34.993 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (46s) 8s ago 6m 16.5M - 0.25.0 c8568f914cd2 db2379433a74 2023-12-16T07:41:34.993 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 8s ago 7m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:41:34.993 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (6m) 9s ago 6m 7490k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:41:34.993 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (29s) 8s ago 6m 80.8M - 9.4.7 954c08fa6188 33c6915c5f5c 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (3m) 8s ago 3m 13.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (3m) 8s ago 3m 14.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (3m) 9s ago 3m 7185M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (3m) 9s ago 3m 17.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (20s) 8s ago 8m 474M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283 running (95s) 9s ago 6m 129M - 19.0.0-191-g6d933094 a29c258b5d6f eb57616ccaf3 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 8s ago 8m 89.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (6m) 9s ago 6m 63.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (49s) 8s ago 7m 14.0M - 1.5.0 0da6a335fe13 898c175e9cee 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (24s) 9s ago 6m 8619k - 1.5.0 0da6a335fe13 ca8bfa32425c 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 8s ago 5m 596M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 8s ago 5m 623M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 8s ago 5m 517M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (4m) 9s ago 4m 740M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:41:34.994 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (4m) 9s ago 4m 564M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:41:34.995 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (4m) 9s ago 4m 638M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:41:34.995 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (25s) 8s ago 6m 47.7M - 2.43.0 a07b618ecd1d 326e88ebb3bb 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69c806cc00 msgr2=0x7f69c806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69c806cc00 0x7f69c806f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009b80 tx=0x7f69cc00b040 comp rx=0 tx=0).stop 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8071b60 msgr2=0x7f69d810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8071b60 0x7f69d810fcc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69c4000c00 tx=0x7f69c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 shutdown_connections 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69c806cc00 0x7f69c806f0b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8070510 0x7f69d810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 --2- 172.21.15.49:0/3000364047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69d8071b60 0x7f69d810fcc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 >> 172.21.15.49:0/3000364047 conn(0x7f69d80f82d0 msgr2=0x7f69d80fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 shutdown_connections 2023-12-16T07:41:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:34.995+0000 7f69df130700 1 -- 172.21.15.49:0/3000364047 wait complete. 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 -- 172.21.15.49:0/2083034741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fbaf0 msgr2=0x7f5f840fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 --2- 172.21.15.49:0/2083034741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fbaf0 0x7f5f840fbf00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5f74004940 tx=0x7f5f74009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 -- 172.21.15.49:0/2083034741 shutdown_connections 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 --2- 172.21.15.49:0/2083034741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f840fcd00 0x7f5f840fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 --2- 172.21.15.49:0/2083034741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fbaf0 0x7f5f840fbf00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 -- 172.21.15.49:0/2083034741 >> 172.21.15.49:0/2083034741 conn(0x7f5f840f7190 msgr2=0x7f5f840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 -- 172.21.15.49:0/2083034741 shutdown_connections 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.102+0000 7f5f888f7700 1 -- 172.21.15.49:0/2083034741 wait complete. 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f888f7700 1 Processor -- start 2023-12-16T07:41:35.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f888f7700 1 -- start start 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f888f7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f840fbaf0 0x7f5f8410c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f888f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fcd00 0x7f5f8410c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f888f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8410cf50 con 0x7f5f840fcd00 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f888f7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8410d7f0 con 0x7f5f840fbaf0 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f81d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fcd00 0x7f5f8410c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f81d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fcd00 0x7f5f8410c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56612/0 (socket says 172.21.15.49:56612) 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f81d9b700 1 -- 172.21.15.49:0/655184488 learned_addr learned my addr 172.21.15.49:0/655184488 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f8259c700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f840fbaf0 0x7f5f8410c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f81d9b700 1 -- 172.21.15.49:0/655184488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f840fbaf0 msgr2=0x7f5f8410c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f81d9b700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f840fbaf0 0x7f5f8410c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f81d9b700 1 -- 172.21.15.49:0/655184488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74005040 con 0x7f5f840fcd00 2023-12-16T07:41:35.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.103+0000 7f5f81d9b700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fcd00 0x7f5f8410c950 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800eb70 tx=0x7f5f7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:35.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.104+0000 7f5f72ffd700 1 -- 172.21.15.49:0/655184488 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f78007cc0 con 0x7f5f840fcd00 2023-12-16T07:41:35.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.104+0000 7f5f72ffd700 1 -- 172.21.15.49:0/655184488 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f7800f040 con 0x7f5f840fcd00 2023-12-16T07:41:35.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.104+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8410da70 con 0x7f5f840fcd00 2023-12-16T07:41:35.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.104+0000 7f5f72ffd700 1 -- 172.21.15.49:0/655184488 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7800c9f0 con 0x7f5f840fcd00 2023-12-16T07:41:35.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.104+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8410dfb0 con 0x7f5f840fcd00 2023-12-16T07:41:35.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.105+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8404bb80 con 0x7f5f840fcd00 2023-12-16T07:41:35.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.105+0000 7f5f72ffd700 1 -- 172.21.15.49:0/655184488 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f5f7800cb50 con 0x7f5f840fcd00 2023-12-16T07:41:35.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.106+0000 7f5f72ffd700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5f6c06cc00 0x7f5f6c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:35.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.106+0000 7f5f72ffd700 1 -- 172.21.15.49:0/655184488 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f5f7808bbf0 con 0x7f5f840fcd00 2023-12-16T07:41:35.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.106+0000 7f5f8259c700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5f6c06cc00 0x7f5f6c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:35.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.106+0000 7f5f8259c700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5f6c06cc00 0x7f5f6c06f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f74013680 tx=0x7f5f74009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:35.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.110+0000 7f5f72ffd700 1 -- 172.21.15.49:0/655184488 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5f780597c0 con 0x7f5f840fcd00 2023-12-16T07:41:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:34 smithi133 ceph-mon[120445]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2023-12-16T07:41:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:34 smithi133 ceph-mon[120445]: Reconfiguring daemon prometheus.smithi049 on smithi049 2023-12-16T07:41:35.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.415+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f841044b0 con 0x7f5f840fcd00 2023-12-16T07:41:35.415 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.415+0000 7f5f72ffd700 1 -- 172.21.15.49:0/655184488 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f5f78077e60 con 0x7f5f840fcd00 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:41:35.416 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:41:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T07:41:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:41:35.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:41:35.417 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5f6c06cc00 msgr2=0x7f5f6c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5f6c06cc00 0x7f5f6c06f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f74013680 tx=0x7f5f74009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fcd00 msgr2=0x7f5f8410c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fcd00 0x7f5f8410c950 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800eb70 tx=0x7f5f7800b040 comp rx=0 tx=0).stop 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 shutdown_connections 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5f6c06cc00 0x7f5f6c06f0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f840fbaf0 0x7f5f8410c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 --2- 172.21.15.49:0/655184488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f840fcd00 0x7f5f8410c950 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 >> 172.21.15.49:0/655184488 conn(0x7f5f840f7190 msgr2=0x7f5f840fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 shutdown_connections 2023-12-16T07:41:35.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.418+0000 7f5f888f7700 1 -- 172.21.15.49:0/655184488 wait complete. 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 -- 172.21.15.49:0/2571176181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fbaf0 msgr2=0x7f815c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 --2- 172.21.15.49:0/2571176181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fbaf0 0x7f815c0fbf00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8144004940 tx=0x7f8144009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 -- 172.21.15.49:0/2571176181 shutdown_connections 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 --2- 172.21.15.49:0/2571176181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f815c0fcd00 0x7f815c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 --2- 172.21.15.49:0/2571176181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fbaf0 0x7f815c0fbf00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 -- 172.21.15.49:0/2571176181 >> 172.21.15.49:0/2571176181 conn(0x7f815c0f7190 msgr2=0x7f815c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 -- 172.21.15.49:0/2571176181 shutdown_connections 2023-12-16T07:41:35.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 -- 172.21.15.49:0/2571176181 wait complete. 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 Processor -- start 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.528+0000 7f81610d6700 1 -- start start 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81610d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f815c0fbaf0 0x7f815c0ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81610d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fcd00 0x7f815c0fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81610d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0fe640 con 0x7f815c0fcd00 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81610d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0fe7b0 con 0x7f815c0fbaf0 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fcd00 0x7f815c0fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fcd00 0x7f815c0fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56628/0 (socket says 172.21.15.49:56628) 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815a59c700 1 -- 172.21.15.49:0/2332651637 learned_addr learned my addr 172.21.15.49:0/2332651637 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815ad9d700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f815c0fbaf0 0x7f815c0ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815a59c700 1 -- 172.21.15.49:0/2332651637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f815c0fbaf0 msgr2=0x7f815c0ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815a59c700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f815c0fbaf0 0x7f815c0ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.530 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815a59c700 1 -- 172.21.15.49:0/2332651637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144005040 con 0x7f815c0fcd00 2023-12-16T07:41:35.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f815a59c700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fcd00 0x7f815c0fe040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f814c00eb70 tx=0x7f814c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:35.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81537fe700 1 -- 172.21.15.49:0/2332651637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c007cc0 con 0x7f815c0fcd00 2023-12-16T07:41:35.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81537fe700 1 -- 172.21.15.49:0/2332651637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f814c00f040 con 0x7f815c0fcd00 2023-12-16T07:41:35.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c0fea30 con 0x7f815c0fcd00 2023-12-16T07:41:35.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81537fe700 1 -- 172.21.15.49:0/2332651637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c00c9f0 con 0x7f815c0fcd00 2023-12-16T07:41:35.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.529+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c115540 con 0x7f815c0fcd00 2023-12-16T07:41:35.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.531+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c04bb80 con 0x7f815c0fcd00 2023-12-16T07:41:35.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.531+0000 7f81537fe700 1 -- 172.21.15.49:0/2332651637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f814c00cb50 con 0x7f815c0fcd00 2023-12-16T07:41:35.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.532+0000 7f81537fe700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f814806cc00 0x7f814806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:41:35.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.532+0000 7f815ad9d700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f814806cc00 0x7f814806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:41:35.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.532+0000 7f81537fe700 1 -- 172.21.15.49:0/2332651637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f814c08bbf0 con 0x7f815c0fcd00 2023-12-16T07:41:35.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.532+0000 7f815ad9d700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f814806cc00 0x7f814806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8144009fd0 tx=0x7f8144009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:41:35.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.536+0000 7f81537fe700 1 -- 172.21.15.49:0/2332651637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f814c0597c0 con 0x7f815c0fcd00 2023-12-16T07:41:35.863 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.863+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f815c065a80 con 0x7f814806cc00 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.864+0000 7f81537fe700 1 -- 172.21.15.49:0/2332651637 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f815c065a80 con 0x7f814806cc00 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T07:41:35.864 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2023-12-16T07:41:35.865 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:41:35.865 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:41:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f814806cc00 msgr2=0x7f814806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f814806cc00 0x7f814806f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8144009fd0 tx=0x7f8144009e30 comp rx=0 tx=0).stop 2023-12-16T07:41:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fcd00 msgr2=0x7f815c0fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:41:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fcd00 0x7f815c0fe040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f814c00eb70 tx=0x7f814c00b040 comp rx=0 tx=0).stop 2023-12-16T07:41:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 shutdown_connections 2023-12-16T07:41:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f814806cc00 0x7f814806f0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f815c0fbaf0 0x7f815c0ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 --2- 172.21.15.49:0/2332651637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f815c0fcd00 0x7f815c0fe040 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:41:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 >> 172.21.15.49:0/2332651637 conn(0x7f815c0f7190 msgr2=0x7f815c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:41:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 shutdown_connections 2023-12-16T07:41:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:41:35.866+0000 7f81610d6700 1 -- 172.21.15.49:0/2332651637 wait complete. 2023-12-16T07:41:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:35 smithi133 ceph-mon[120445]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:35 smithi133 ceph-mon[120445]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:35 smithi133 ceph-mon[120445]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1.6 MiB/s wr, 364 op/s 2023-12-16T07:41:36.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:35 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/655184488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:36.126 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:35 smithi049 ceph-mon[111939]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:36.126 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:35 smithi049 ceph-mon[111939]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:36.126 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:35 smithi049 ceph-mon[111939]: pgmap v9: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1.6 MiB/s wr, 364 op/s 2023-12-16T07:41:36.126 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:35 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/655184488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:37.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:36 smithi133 ceph-mon[120445]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:37.138 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:36 smithi049 ceph-mon[111939]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:37 smithi133 ceph-mon[120445]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:37 smithi133 ceph-mon[120445]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 334 op/s 2023-12-16T07:41:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:37 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:37 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:37 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:38.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:37 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:37 smithi049 ceph-mon[111939]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:41:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:37 smithi049 ceph-mon[111939]: pgmap v10: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 334 op/s 2023-12-16T07:41:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:37 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:37 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:37 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:38.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:37 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:39.103 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:38 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:39.103 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:38 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:39.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:38 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:41:39.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:38 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:39.818 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:39 smithi133 ceph-mon[120445]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 452 op/s 2023-12-16T07:41:39.818 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:39 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:41:39.818 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:39 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:41:39.818 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:39 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:40.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:39 smithi049 ceph-mon[111939]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 452 op/s 2023-12-16T07:41:40.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:39 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:41:40.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:39 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:41:40.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:39 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:41.087 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:40 smithi133 ceph-mon[120445]: Upgrade: Updating mgr.smithi133.wbiduk 2023-12-16T07:41:41.088 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:40 smithi133 ceph-mon[120445]: Deploying daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:41:41.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:40 smithi049 ceph-mon[111939]: Upgrade: Updating mgr.smithi133.wbiduk 2023-12-16T07:41:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:40 smithi049 ceph-mon[111939]: Deploying daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:41:42.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:41 smithi133 ceph-mon[120445]: pgmap v12: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 2.3 MiB/s wr, 1.02k op/s 2023-12-16T07:41:42.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:41 smithi049 ceph-mon[111939]: pgmap v12: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 2.3 MiB/s wr, 1.02k op/s 2023-12-16T07:41:43.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:43.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:43.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:43.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:43 smithi133 ceph-mon[120445]: pgmap v13: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 873 op/s 2023-12-16T07:41:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:43.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:43 smithi049 ceph-mon[111939]: pgmap v13: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 873 op/s 2023-12-16T07:41:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:45 smithi133 ceph-mon[120445]: pgmap v14: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2023-12-16T07:41:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:45 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:45 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:45 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:45 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:45 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:45 smithi049 ceph-mon[111939]: pgmap v14: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 1.24k op/s 2023-12-16T07:41:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:45 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:45 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:45 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:45 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:45 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:47.040 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:46 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:47.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:46 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:48.121 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:47 smithi133 ceph-mon[120445]: pgmap v15: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 1.07k op/s 2023-12-16T07:41:48.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:47 smithi049 ceph-mon[111939]: pgmap v15: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 1.07k op/s 2023-12-16T07:41:49.947 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: pgmap v16: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 1.09k op/s 2023-12-16T07:41:49.947 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rqlvwo"}]: dispatch 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rqlvwo"}]': finished 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:49.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.wbiduk"}]': finished 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.949 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:49.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:49.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:49 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: pgmap v16: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 1.09k op/s 2023-12-16T07:41:50.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rqlvwo"}]: dispatch 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rqlvwo"}]': finished 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.wbiduk"}]: dispatch 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.wbiduk"}]': finished 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:41:50.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:49 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all mgr 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all rgw 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all iscsi 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all nfs 2023-12-16T07:41:50.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:50 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all nvmeof 2023-12-16T07:41:50.930 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all mgr 2023-12-16T07:41:50.930 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all rgw 2023-12-16T07:41:50.931 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all rbd-mirror 2023-12-16T07:41:50.931 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-16T07:41:50.931 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all ceph-exporter 2023-12-16T07:41:50.931 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all iscsi 2023-12-16T07:41:50.931 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all nfs 2023-12-16T07:41:50.931 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:50 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all nvmeof 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: Upgrade: Updating node-exporter.smithi049 (1/2) 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: Deploying daemon node-exporter.smithi049 on smithi049 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: pgmap v17: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 1.11k op/s 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: Standby manager daemon smithi133.wbiduk restarted 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:41:52.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:51 smithi049 ceph-mon[111939]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:41:52.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: Upgrade: Updating node-exporter.smithi049 (1/2) 2023-12-16T07:41:52.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: Deploying daemon node-exporter.smithi049 on smithi049 2023-12-16T07:41:52.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: pgmap v17: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 1.11k op/s 2023-12-16T07:41:52.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:41:52.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk restarted 2023-12-16T07:41:52.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:41:52.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:41:52.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:41:52.369 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:51 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/352927162' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:41:53.178 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:52 smithi133 ceph-mon[120445]: mgrmap e32: smithi049.rqlvwo(active, since 29s), standbys: smithi133.wbiduk 2023-12-16T07:41:53.178 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:52 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:53.179 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:52 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:53.179 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:52 smithi133 ceph-mon[120445]: pgmap v18: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 522 op/s 2023-12-16T07:41:53.179 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:52 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:53.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:52 smithi049 ceph-mon[111939]: mgrmap e32: smithi049.rqlvwo(active, since 29s), standbys: smithi133.wbiduk 2023-12-16T07:41:53.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:52 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:53.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:52 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:53.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:52 smithi049 ceph-mon[111939]: pgmap v18: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 522 op/s 2023-12-16T07:41:53.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:52 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:41:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:55 smithi133 ceph-mon[120445]: Upgrade: Updating node-exporter.smithi133 (2/2) 2023-12-16T07:41:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:55 smithi133 ceph-mon[120445]: Deploying daemon node-exporter.smithi133 on smithi133 2023-12-16T07:41:55.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:55 smithi133 ceph-mon[120445]: pgmap v19: 65 pgs: 65 active+clean; 265 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 1.05k op/s 2023-12-16T07:41:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:55 smithi049 ceph-mon[111939]: Upgrade: Updating node-exporter.smithi133 (2/2) 2023-12-16T07:41:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:55 smithi049 ceph-mon[111939]: Deploying daemon node-exporter.smithi133 on smithi133 2023-12-16T07:41:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:55 smithi049 ceph-mon[111939]: pgmap v19: 65 pgs: 65 active+clean; 265 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 1.05k op/s 2023-12-16T07:41:57.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:57 smithi133 ceph-mon[120445]: pgmap v20: 65 pgs: 65 active+clean; 265 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 690 op/s 2023-12-16T07:41:58.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:57 smithi049 ceph-mon[111939]: pgmap v20: 65 pgs: 65 active+clean; 265 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 690 op/s 2023-12-16T07:41:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:59 smithi133 ceph-mon[120445]: pgmap v21: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 774 op/s 2023-12-16T07:41:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:59 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:59 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:41:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:41:59 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:00.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:59 smithi049 ceph-mon[111939]: pgmap v21: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 774 op/s 2023-12-16T07:42:00.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:59 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:00.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:59 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:00.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:41:59 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:02.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:01 smithi133 ceph-mon[120445]: pgmap v22: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 1.16k op/s 2023-12-16T07:42:02.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:01 smithi049 ceph-mon[111939]: pgmap v22: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 1.16k op/s 2023-12-16T07:42:02.133 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-16T07:42:02.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-16T07:42:02.468 DEBUG:teuthology.parallel:result is None 2023-12-16T07:42:03.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:03 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:03 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:03 smithi133 ceph-mon[120445]: pgmap v23: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 1.02k op/s 2023-12-16T07:42:03.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:03 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:03 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:03 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:03 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:03 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:03 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:03 smithi049 ceph-mon[111939]: pgmap v23: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 1.02k op/s 2023-12-16T07:42:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:03 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:03 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:03 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:03.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:03 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:04.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:04 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:04.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:04 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:04 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:04 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:05 smithi049 ceph-mon[111939]: pgmap v24: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 1.25k op/s 2023-12-16T07:42:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:05 smithi133 ceph-mon[120445]: pgmap v24: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 1.25k op/s 2023-12-16T07:42:06.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.032+0000 7f3d33ad7700 1 -- 172.21.15.49:0/1526426690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fcd00 msgr2=0x7f3d2c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.032+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/1526426690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c0fd150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d280049c0 tx=0x7f3d28009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:06.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.034+0000 7f3d33ad7700 1 -- 172.21.15.49:0/1526426690 shutdown_connections 2023-12-16T07:42:06.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.034+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/1526426690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c0fd150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.034+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/1526426690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fbaf0 0x7f3d2c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.036 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.034+0000 7f3d33ad7700 1 -- 172.21.15.49:0/1526426690 >> 172.21.15.49:0/1526426690 conn(0x7f3d2c0f71b0 msgr2=0x7f3d2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:06.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.037+0000 7f3d33ad7700 1 -- 172.21.15.49:0/1526426690 shutdown_connections 2023-12-16T07:42:06.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.038+0000 7f3d33ad7700 1 -- 172.21.15.49:0/1526426690 wait complete. 2023-12-16T07:42:06.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.038+0000 7f3d33ad7700 1 Processor -- start 2023-12-16T07:42:06.038 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.038+0000 7f3d33ad7700 1 -- start start 2023-12-16T07:42:06.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.038+0000 7f3d33ad7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fbaf0 0x7f3d2c113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.038+0000 7f3d33ad7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.038+0000 7f3d33ad7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c114720 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.038+0000 7f3d33ad7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c114f60 con 0x7f3d2c0fbaf0 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31072700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31072700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35244/0 (socket says 172.21.15.49:35244) 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31072700 1 -- 172.21.15.49:0/3282065168 learned_addr learned my addr 172.21.15.49:0/3282065168 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31873700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fbaf0 0x7f3d2c113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31072700 1 -- 172.21.15.49:0/3282065168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fbaf0 msgr2=0x7f3d2c113b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31072700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fbaf0 0x7f3d2c113b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31072700 1 -- 172.21.15.49:0/3282065168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d28005040 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.039+0000 7f3d31072700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c114090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d28000c00 tx=0x7f3d28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:06.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.040+0000 7f3d227fc700 1 -- 172.21.15.49:0/3282065168 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d28012460 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.040+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c1151e0 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.040+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c115720 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.041+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c04bb80 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.041+0000 7f3d227fc700 1 -- 172.21.15.49:0/3282065168 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d280125c0 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.041+0000 7f3d227fc700 1 -- 172.21.15.49:0/3282065168 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d28009660 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.052+0000 7f3d227fc700 1 -- 172.21.15.49:0/3282065168 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f3d280097c0 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.053+0000 7f3d227fc700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f3d1806cd20 0x7f3d1806f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.053+0000 7f3d227fc700 1 -- 172.21.15.49:0/3282065168 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f3d2808ddc0 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.053+0000 7f3d227fc700 1 -- 172.21.15.49:0/3282065168 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3d2808e250 con 0x7f3d2c0fcd00 2023-12-16T07:42:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.053+0000 7f3d31873700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f3d1806cd20 0x7f3d1806f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.056+0000 7f3d31873700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f3d1806cd20 0x7f3d1806f1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c006fd0 tx=0x7f3d1c008040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.280+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d2c115d70 con 0x7f3d1806cd20 2023-12-16T07:42:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.281+0000 7f3d227fc700 1 -- 172.21.15.49:0/3282065168 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f3d2c115d70 con 0x7f3d1806cd20 2023-12-16T07:42:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f3d1806cd20 msgr2=0x7f3d1806f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f3d1806cd20 0x7f3d1806f1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c006fd0 tx=0x7f3d1c008040 comp rx=0 tx=0).stop 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fcd00 msgr2=0x7f3d2c114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c114090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d28000c00 tx=0x7f3d28009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 shutdown_connections 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f3d1806cd20 0x7f3d1806f1d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c0fbaf0 0x7f3d2c113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 --2- 172.21.15.49:0/3282065168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d2c0fcd00 0x7f3d2c114090 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 >> 172.21.15.49:0/3282065168 conn(0x7f3d2c0f71b0 msgr2=0x7f3d2c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 shutdown_connections 2023-12-16T07:42:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.283+0000 7f3d33ad7700 1 -- 172.21.15.49:0/3282065168 wait complete. 2023-12-16T07:42:06.294 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:42:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 -- 172.21.15.49:0/120057751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d90100050 msgr2=0x7f2d90102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 --2- 172.21.15.49:0/120057751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d90100050 0x7f2d90102430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2d80004940 tx=0x7f2d80009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 -- 172.21.15.49:0/120057751 shutdown_connections 2023-12-16T07:42:06.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 --2- 172.21.15.49:0/120057751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d90100050 0x7f2d90102430 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 --2- 172.21.15.49:0/120057751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900fd730 0x7f2d900ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 -- 172.21.15.49:0/120057751 >> 172.21.15.49:0/120057751 conn(0x7f2d900f7190 msgr2=0x7f2d900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 -- 172.21.15.49:0/120057751 shutdown_connections 2023-12-16T07:42:06.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.394+0000 7f2d9570e700 1 -- 172.21.15.49:0/120057751 wait complete. 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d9570e700 1 Processor -- start 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d9570e700 1 -- start start 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d9570e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d900fd730 0x7f2d9010d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d9570e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90100050 0x7f2d9010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d9570e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9010dfe0 con 0x7f2d900fd730 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d9570e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9010e880 con 0x7f2d90100050 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d8effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d900fd730 0x7f2d9010d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d8effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d900fd730 0x7f2d9010d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35268/0 (socket says 172.21.15.49:35268) 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d8effd700 1 -- 172.21.15.49:0/2394778058 learned_addr learned my addr 172.21.15.49:0/2394778058 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d8e7fc700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90100050 0x7f2d9010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d8effd700 1 -- 172.21.15.49:0/2394778058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90100050 msgr2=0x7f2d9010d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d8effd700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90100050 0x7f2d9010d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.395+0000 7f2d8effd700 1 -- 172.21.15.49:0/2394778058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80005040 con 0x7f2d900fd730 2023-12-16T07:42:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.396+0000 7f2d8effd700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d900fd730 0x7f2d9010d4a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800eb40 tx=0x7f2d7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.396+0000 7f2d877fe700 1 -- 172.21.15.49:0/2394778058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d78007cc0 con 0x7f2d900fd730 2023-12-16T07:42:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.396+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9010eb00 con 0x7f2d900fd730 2023-12-16T07:42:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.396+0000 7f2d877fe700 1 -- 172.21.15.49:0/2394778058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d7800f040 con 0x7f2d900fd730 2023-12-16T07:42:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.396+0000 7f2d877fe700 1 -- 172.21.15.49:0/2394778058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7800c990 con 0x7f2d900fd730 2023-12-16T07:42:06.398 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.396+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9010f040 con 0x7f2d900fd730 2023-12-16T07:42:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.397+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9004bb80 con 0x7f2d900fd730 2023-12-16T07:42:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.398+0000 7f2d877fe700 1 -- 172.21.15.49:0/2394778058 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f2d7800cc00 con 0x7f2d900fd730 2023-12-16T07:42:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.398+0000 7f2d877fe700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2d7c06cc00 0x7f2d7c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.398+0000 7f2d877fe700 1 -- 172.21.15.49:0/2394778058 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2d7808bc50 con 0x7f2d900fd730 2023-12-16T07:42:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.398+0000 7f2d8e7fc700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2d7c06cc00 0x7f2d7c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.399+0000 7f2d8e7fc700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2d7c06cc00 0x7f2d7c06f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d80000c00 tx=0x7f2d80009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:06.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.403+0000 7f2d877fe700 1 -- 172.21.15.49:0/2394778058 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2d780598d0 con 0x7f2d900fd730 2023-12-16T07:42:06.637 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.637+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d9010f460 con 0x7f2d7c06cc00 2023-12-16T07:42:06.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.638+0000 7f2d877fe700 1 -- 172.21.15.49:0/2394778058 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f2d9010f460 con 0x7f2d7c06cc00 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2d7c06cc00 msgr2=0x7f2d7c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2d7c06cc00 0x7f2d7c06f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d80000c00 tx=0x7f2d80009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d900fd730 msgr2=0x7f2d9010d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d900fd730 0x7f2d9010d4a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800eb40 tx=0x7f2d7800b040 comp rx=0 tx=0).stop 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 shutdown_connections 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2d7c06cc00 0x7f2d7c06f0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d900fd730 0x7f2d9010d4a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 --2- 172.21.15.49:0/2394778058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d90100050 0x7f2d9010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 >> 172.21.15.49:0/2394778058 conn(0x7f2d900f7190 msgr2=0x7f2d900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 shutdown_connections 2023-12-16T07:42:06.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.640+0000 7f2d9570e700 1 -- 172.21.15.49:0/2394778058 wait complete. 2023-12-16T07:42:06.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.748+0000 7f0921c1b700 1 -- 172.21.15.49:0/2408275487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 msgr2=0x7f091c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.748+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2408275487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c0ff7a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f090c004940 tx=0x7f090c009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:06.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.748+0000 7f0921c1b700 1 -- 172.21.15.49:0/2408275487 shutdown_connections 2023-12-16T07:42:06.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.748+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2408275487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f091c0ffd70 0x7f091c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.748+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2408275487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c0ff7a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.748+0000 7f0921c1b700 1 -- 172.21.15.49:0/2408275487 >> 172.21.15.49:0/2408275487 conn(0x7f091c0f7190 msgr2=0x7f091c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 -- 172.21.15.49:0/2408275487 shutdown_connections 2023-12-16T07:42:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 -- 172.21.15.49:0/2408275487 wait complete. 2023-12-16T07:42:06.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 Processor -- start 2023-12-16T07:42:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 -- start start 2023-12-16T07:42:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f091c0ffd70 0x7f091c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c10e010 con 0x7f091c066090 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.749+0000 7f0921c1b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c10e8b0 con 0x7f091c0ffd70 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35282/0 (socket says 172.21.15.49:35282) 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091b7fe700 1 -- 172.21.15.49:0/2147050503 learned_addr learned my addr 172.21.15.49:0/2147050503 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091affd700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f091c0ffd70 0x7f091c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091b7fe700 1 -- 172.21.15.49:0/2147050503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f091c0ffd70 msgr2=0x7f091c10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091b7fe700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f091c0ffd70 0x7f091c10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091b7fe700 1 -- 172.21.15.49:0/2147050503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c005040 con 0x7f091c066090 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f091b7fe700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c10d4d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f090c008f90 tx=0x7f090c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f0903fff700 1 -- 172.21.15.49:0/2147050503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090c021070 con 0x7f091c066090 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c10eb30 con 0x7f091c066090 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f0903fff700 1 -- 172.21.15.49:0/2147050503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f090c01c400 con 0x7f091c066090 2023-12-16T07:42:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f0903fff700 1 -- 172.21.15.49:0/2147050503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090c00e030 con 0x7f091c066090 2023-12-16T07:42:06.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.750+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c10f070 con 0x7f091c066090 2023-12-16T07:42:06.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.752+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c04bb80 con 0x7f091c066090 2023-12-16T07:42:06.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.752+0000 7f0903fff700 1 -- 172.21.15.49:0/2147050503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f090c01ca00 con 0x7f091c066090 2023-12-16T07:42:06.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.752+0000 7f0903fff700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f090406cc00 0x7f090406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.752+0000 7f0903fff700 1 -- 172.21.15.49:0/2147050503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f090c08d200 con 0x7f091c066090 2023-12-16T07:42:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.752+0000 7f091affd700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f090406cc00 0x7f090406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:06.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.753+0000 7f091affd700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f090406cc00 0x7f090406f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0910009b80 tx=0x7f091000b040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:06.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.757+0000 7f0903fff700 1 -- 172.21.15.49:0/2147050503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f090c05ae50 con 0x7f091c066090 2023-12-16T07:42:06.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:06.991+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f091c10f6e0 con 0x7f090406cc00 2023-12-16T07:42:07.009 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.007+0000 7f0903fff700 1 -- 172.21.15.49:0/2147050503 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f091c10f6e0 con 0x7f090406cc00 2023-12-16T07:42:07.011 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:42:07.011 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (78s) 4s ago 7m 18.6M - 0.25.0 c8568f914cd2 db2379433a74 2023-12-16T07:42:07.011 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 4s ago 7m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:42:07.011 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (6m) 4s ago 6m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:42:07.011 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (61s) 4s ago 7m 83.2M - 9.4.7 954c08fa6188 33c6915c5f5c 2023-12-16T07:42:07.011 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (3m) 4s ago 3m 14.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:42:07.011 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (3m) 4s ago 3m 15.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (3m) 4s ago 3m 9442M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (3m) 4s ago 3m 17.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (52s) 4s ago 8m 502M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (25s) 4s ago 6m 448M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 4s ago 8m 94.1M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (6m) 4s ago 6m 66.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (15s) 4s ago 7m 8711k - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (8s) 4s ago 6m 4076k - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 4s ago 6m 808M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 4s ago 5m 850M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 4s ago 5m 697M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (5m) 4s ago 5m 1033M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (5m) 4s ago 5m 769M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:42:07.012 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (4m) 4s ago 4m 873M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:42:07.013 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (30s) 4s ago 7m 41.5M - 2.43.0 a07b618ecd1d d04938822a0b 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.012+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f090406cc00 msgr2=0x7f090406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.012+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f090406cc00 0x7f090406f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0910009b80 tx=0x7f091000b040 comp rx=0 tx=0).stop 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.012+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 msgr2=0x7f091c10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.012+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c10d4d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f090c008f90 tx=0x7f090c009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.013+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 shutdown_connections 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.014+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f090406cc00 0x7f090406f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.014+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091c066090 0x7f091c10d4d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.014+0000 7f0921c1b700 1 --2- 172.21.15.49:0/2147050503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f091c0ffd70 0x7f091c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.014+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 >> 172.21.15.49:0/2147050503 conn(0x7f091c0f7190 msgr2=0x7f091c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.016+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 shutdown_connections 2023-12-16T07:42:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.016+0000 7f0921c1b700 1 -- 172.21.15.49:0/2147050503 wait complete. 2023-12-16T07:42:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 -- 172.21.15.49:0/2695656578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 msgr2=0x7f49e80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 --2- 172.21.15.49:0/2695656578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e80fd000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49d8004940 tx=0x7f49d8009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 -- 172.21.15.49:0/2695656578 shutdown_connections 2023-12-16T07:42:07.157 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 --2- 172.21.15.49:0/2695656578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e80fde00 0x7f49e80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 --2- 172.21.15.49:0/2695656578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e80fd000 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 -- 172.21.15.49:0/2695656578 >> 172.21.15.49:0/2695656578 conn(0x7f49e80f82d0 msgr2=0x7f49e80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 -- 172.21.15.49:0/2695656578 shutdown_connections 2023-12-16T07:42:07.158 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 -- 172.21.15.49:0/2695656578 wait complete. 2023-12-16T07:42:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 Processor -- start 2023-12-16T07:42:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.157+0000 7f49ed180700 1 -- start start 2023-12-16T07:42:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49ed180700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49ed180700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e80fde00 0x7f49e810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49ed180700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e810e010 con 0x7f49e80fcbf0 2023-12-16T07:42:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49ed180700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e810e8b0 con 0x7f49e80fde00 2023-12-16T07:42:07.159 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e810d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35310/0 (socket says 172.21.15.49:35310) 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e6d9d700 1 -- 172.21.15.49:0/16035657 learned_addr learned my addr 172.21.15.49:0/16035657 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e659c700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e80fde00 0x7f49e810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e6d9d700 1 -- 172.21.15.49:0/16035657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e80fde00 msgr2=0x7f49e810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e6d9d700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e80fde00 0x7f49e810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e6d9d700 1 -- 172.21.15.49:0/16035657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8005040 con 0x7f49e80fcbf0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49e6d9d700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e810d4d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f49d8000c00 tx=0x7f49d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.158+0000 7f49cf7fe700 1 -- 172.21.15.49:0/16035657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d800e040 con 0x7f49e80fcbf0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.159+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e810eb30 con 0x7f49e80fcbf0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.159+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e810f070 con 0x7f49e80fcbf0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.159+0000 7f49cf7fe700 1 -- 172.21.15.49:0/16035657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49d8009af0 con 0x7f49e80fcbf0 2023-12-16T07:42:07.160 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.159+0000 7f49cf7fe700 1 -- 172.21.15.49:0/16035657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d8025640 con 0x7f49e80fcbf0 2023-12-16T07:42:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.160+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e804bb80 con 0x7f49e80fcbf0 2023-12-16T07:42:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.160+0000 7f49cf7fe700 1 -- 172.21.15.49:0/16035657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f49d800bcd0 con 0x7f49e80fcbf0 2023-12-16T07:42:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.161+0000 7f49cf7fe700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f49d006cc00 0x7f49d006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.161+0000 7f49cf7fe700 1 -- 172.21.15.49:0/16035657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f49d808d3d0 con 0x7f49e80fcbf0 2023-12-16T07:42:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.161+0000 7f49e659c700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f49d006cc00 0x7f49d006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:07.162 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.161+0000 7f49e659c700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f49d006cc00 0x7f49d006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009fd0 tx=0x7f49dc009f60 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:07.166 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.166+0000 7f49cf7fe700 1 -- 172.21.15.49:0/16035657 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f49d805b0c0 con 0x7f49e80fcbf0 2023-12-16T07:42:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:07 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:07 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:07 smithi133 ceph-mon[120445]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:07 smithi133 ceph-mon[120445]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:07 smithi133 ceph-mon[120445]: pgmap v25: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 722 op/s 2023-12-16T07:42:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:07 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:07 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:07 smithi049 ceph-mon[111939]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:07.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:07 smithi049 ceph-mon[111939]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:07.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:07 smithi049 ceph-mon[111939]: pgmap v25: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 722 op/s 2023-12-16T07:42:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.474+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f49e810f390 con 0x7f49e80fcbf0 2023-12-16T07:42:07.474 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.474+0000 7f49cf7fe700 1 -- 172.21.15.49:0/16035657 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f49d805ac50 con 0x7f49e80fcbf0 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:42:07.475 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:42:07.476 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:07.476 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:42:07.476 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T07:42:07.476 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:42:07.476 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:42:07.476 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:42:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.476+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f49d006cc00 msgr2=0x7f49d006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.476+0000 7f49ed180700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f49d006cc00 0x7f49d006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009fd0 tx=0x7f49dc009f60 comp rx=0 tx=0).stop 2023-12-16T07:42:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 msgr2=0x7f49e810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e810d4d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f49d8000c00 tx=0x7f49d8009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 shutdown_connections 2023-12-16T07:42:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f49d006cc00 0x7f49d006f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49e80fcbf0 0x7f49e810d4d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 --2- 172.21.15.49:0/16035657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e80fde00 0x7f49e810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 >> 172.21.15.49:0/16035657 conn(0x7f49e80f82d0 msgr2=0x7f49e8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 shutdown_connections 2023-12-16T07:42:07.478 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.477+0000 7f49ed180700 1 -- 172.21.15.49:0/16035657 wait complete. 2023-12-16T07:42:07.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 -- 172.21.15.49:0/2607601748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fbaf0 msgr2=0x7fb7c00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/2607601748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fbaf0 0x7fb7c00fbf00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc004940 tx=0x7fb7bc009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:07.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 -- 172.21.15.49:0/2607601748 shutdown_connections 2023-12-16T07:42:07.586 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/2607601748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c00fcd00 0x7fb7c00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/2607601748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fbaf0 0x7fb7c00fbf00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 -- 172.21.15.49:0/2607601748 >> 172.21.15.49:0/2607601748 conn(0x7fb7c00f7190 msgr2=0x7fb7c00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 -- 172.21.15.49:0/2607601748 shutdown_connections 2023-12-16T07:42:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.585+0000 7fb7c85a6700 1 -- 172.21.15.49:0/2607601748 wait complete. 2023-12-16T07:42:07.587 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.586+0000 7fb7c85a6700 1 Processor -- start 2023-12-16T07:42:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.586+0000 7fb7c85a6700 1 -- start start 2023-12-16T07:42:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.586+0000 7fb7c85a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c00fbaf0 0x7fb7c0110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.586+0000 7fb7c85a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fcd00 0x7fb7c0112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.586+0000 7fb7c85a6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0066130 con 0x7fb7c00fcd00 2023-12-16T07:42:07.588 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c85a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0066270 con 0x7fb7c00fbaf0 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c5b41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fcd00 0x7fb7c0112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c5b41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fcd00 0x7fb7c0112760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57780/0 (socket says 172.21.15.49:57780) 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c5b41700 1 -- 172.21.15.49:0/1330993207 learned_addr learned my addr 172.21.15.49:0/1330993207 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c5b41700 1 -- 172.21.15.49:0/1330993207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c00fbaf0 msgr2=0x7fb7c0110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c6342700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c00fbaf0 0x7fb7c0110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c5b41700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c00fbaf0 0x7fb7c0110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c5b41700 1 -- 172.21.15.49:0/1330993207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc005040 con 0x7fb7c00fcd00 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c5b41700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fcd00 0x7fb7c0112760 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000eb70 tx=0x7fb7b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7b6ffd700 1 -- 172.21.15.49:0/1330993207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7b0007cc0 con 0x7fb7c00fcd00 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7b6ffd700 1 -- 172.21.15.49:0/1330993207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7b000f040 con 0x7fb7c00fcd00 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7b6ffd700 1 -- 172.21.15.49:0/1330993207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7b00095f0 con 0x7fb7c00fcd00 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.587+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c0112d60 con 0x7fb7c00fcd00 2023-12-16T07:42:07.589 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.588+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c0113250 con 0x7fb7c00fcd00 2023-12-16T07:42:07.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.589+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c004bb80 con 0x7fb7c00fcd00 2023-12-16T07:42:07.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.589+0000 7fb7b6ffd700 1 -- 172.21.15.49:0/1330993207 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fb7b0009750 con 0x7fb7c00fcd00 2023-12-16T07:42:07.590 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.590+0000 7fb7b6ffd700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb7ac06cc00 0x7fb7ac06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:07.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.590+0000 7fb7c6342700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb7ac06cc00 0x7fb7ac06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:07.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.590+0000 7fb7b6ffd700 1 -- 172.21.15.49:0/1330993207 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb7b008bc60 con 0x7fb7c00fcd00 2023-12-16T07:42:07.591 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.590+0000 7fb7c6342700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb7ac06cc00 0x7fb7ac06f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc004890 tx=0x7fb7bc009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:07.594 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.594+0000 7fb7b6ffd700 1 -- 172.21.15.49:0/1330993207 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb7b0055da0 con 0x7fb7c00fcd00 2023-12-16T07:42:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.825+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7c0101650 con 0x7fb7ac06cc00 2023-12-16T07:42:07.826 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.826+0000 7fb7b6ffd700 1 -- 172.21.15.49:0/1330993207 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fb7c0101650 con 0x7fb7ac06cc00 2023-12-16T07:42:07.826 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading node-exporter daemons", 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:42:07.827 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:42:07.828 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb7ac06cc00 msgr2=0x7fb7ac06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb7ac06cc00 0x7fb7ac06f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc004890 tx=0x7fb7bc009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fcd00 msgr2=0x7fb7c0112760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fcd00 0x7fb7c0112760 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000eb70 tx=0x7fb7b000b040 comp rx=0 tx=0).stop 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 shutdown_connections 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb7ac06cc00 0x7fb7ac06f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c00fbaf0 0x7fb7c0110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 --2- 172.21.15.49:0/1330993207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7c00fcd00 0x7fb7c0112760 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 >> 172.21.15.49:0/1330993207 conn(0x7fb7c00f7190 msgr2=0x7fb7c00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 shutdown_connections 2023-12-16T07:42:07.829 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:07.828+0000 7fb7c85a6700 1 -- 172.21.15.49:0/1330993207 wait complete. 2023-12-16T07:42:08.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:08 smithi133 ceph-mon[120445]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:08.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:08 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/16035657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:08.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:08 smithi133 ceph-mon[120445]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:08.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:08 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:08.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:08 smithi049 ceph-mon[111939]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:08.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:08 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/16035657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:08.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:08 smithi049 ceph-mon[111939]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:08.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:08 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:09.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: pgmap v26: 65 pgs: 65 active+clean; 241 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 744 op/s 2023-12-16T07:42:09.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:09.886 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:09.887 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:09 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: pgmap v26: 65 pgs: 65 active+clean; 241 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 744 op/s 2023-12-16T07:42:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:10.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:09 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:12.044 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:11 smithi049 ceph-mon[111939]: Upgrade: Updating prometheus.smithi049 2023-12-16T07:42:12.044 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:11 smithi049 ceph-mon[111939]: Deploying daemon prometheus.smithi049 on smithi049 2023-12-16T07:42:12.044 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:11 smithi049 ceph-mon[111939]: pgmap v27: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 808 op/s 2023-12-16T07:42:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:11 smithi133 ceph-mon[120445]: Upgrade: Updating prometheus.smithi049 2023-12-16T07:42:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:11 smithi133 ceph-mon[120445]: Deploying daemon prometheus.smithi049 on smithi049 2023-12-16T07:42:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:11 smithi133 ceph-mon[120445]: pgmap v27: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 808 op/s 2023-12-16T07:42:13.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:13 smithi133 ceph-mon[120445]: pgmap v28: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 405 op/s 2023-12-16T07:42:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:13 smithi049 ceph-mon[111939]: pgmap v28: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 405 op/s 2023-12-16T07:42:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:14 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:14 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:14.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:14 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:14 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:14 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:14 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:15.012 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-16T07:42:15.013 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-16T07:42:15.330 DEBUG:teuthology.parallel:result is None 2023-12-16T07:42:15.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T07:42:15.369 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-16T07:42:15.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T07:42:15.404 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-16T07:42:15.405 DEBUG:teuthology.parallel:result is None 2023-12-16T07:42:15.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:15 smithi049 ceph-mon[111939]: pgmap v29: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 588 op/s 2023-12-16T07:42:15.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:15 smithi133 ceph-mon[120445]: pgmap v29: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 588 op/s 2023-12-16T07:42:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:17 smithi133 ceph-mon[120445]: pgmap v30: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 352 op/s 2023-12-16T07:42:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:17 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:17 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:17 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:17 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:18.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:17 smithi049 ceph-mon[111939]: pgmap v30: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 352 op/s 2023-12-16T07:42:18.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:17 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:18.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:17 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:18.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:17 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:18.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:17 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:19.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:19 smithi049 ceph-mon[111939]: pgmap v31: 65 pgs: 65 active+clean; 207 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 364 op/s 2023-12-16T07:42:20.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:19 smithi133 ceph-mon[120445]: pgmap v31: 65 pgs: 65 active+clean; 207 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 364 op/s 2023-12-16T07:42:21.971 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 402 op/s 2023-12-16T07:42:22.013 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.015 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.015 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:21 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 402 op/s 2023-12-16T07:42:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:22.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:21 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:23.016 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:22 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:42:23.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:22 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-16T07:42:23.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:23 smithi049 ceph-mon[111939]: Upgrade: Updating alertmanager.smithi049 2023-12-16T07:42:23.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:23 smithi049 ceph-mon[111939]: Deploying daemon alertmanager.smithi049 on smithi049 2023-12-16T07:42:23.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:23 smithi049 ceph-mon[111939]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 886 KiB/s wr, 255 op/s 2023-12-16T07:42:23.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:23 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:23 smithi133 ceph-mon[120445]: Upgrade: Updating alertmanager.smithi049 2023-12-16T07:42:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:23 smithi133 ceph-mon[120445]: Deploying daemon alertmanager.smithi049 on smithi049 2023-12-16T07:42:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:23 smithi133 ceph-mon[120445]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 886 KiB/s wr, 255 op/s 2023-12-16T07:42:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:23 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:25 smithi133 ceph-mon[120445]: pgmap v34: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 892 KiB/s wr, 263 op/s 2023-12-16T07:42:26.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:25 smithi049 ceph-mon[111939]: pgmap v34: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 892 KiB/s wr, 263 op/s 2023-12-16T07:42:27.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:26 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:27.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:26 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:27.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:26 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:27.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:26 smithi049 ceph-mon[111939]: pgmap v35: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 232 KiB/s wr, 80 op/s 2023-12-16T07:42:27.369 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:26 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:27.369 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:26 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:27.369 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:26 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:27.369 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:26 smithi133 ceph-mon[120445]: pgmap v35: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 232 KiB/s wr, 80 op/s 2023-12-16T07:42:30.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:29 smithi133 ceph-mon[120445]: pgmap v36: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 232 KiB/s wr, 80 op/s 2023-12-16T07:42:30.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:29 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:30.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:29 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:30.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:29 smithi049 ceph-mon[111939]: pgmap v36: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 232 KiB/s wr, 80 op/s 2023-12-16T07:42:30.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:29 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:30.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:29 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:30.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:30 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:30.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:30 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:31.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:30 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:31.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:30 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:32.112 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:31 smithi049 ceph-mon[111939]: pgmap v37: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 231 KiB/s wr, 68 op/s 2023-12-16T07:42:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:31 smithi133 ceph-mon[120445]: pgmap v37: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.7 KiB/s rd, 231 KiB/s wr, 68 op/s 2023-12-16T07:42:33.457 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:33.457 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:33 smithi049 ceph-mon[111939]: pgmap v38: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 6.0 KiB/s wr, 8 op/s 2023-12-16T07:42:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:42:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:33.620 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:33 smithi133 ceph-mon[120445]: pgmap v38: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 6.0 KiB/s wr, 8 op/s 2023-12-16T07:42:34.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:34 smithi049 ceph-mon[111939]: Upgrade: Updating grafana.smithi049 2023-12-16T07:42:34.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:34 smithi049 ceph-mon[111939]: Deploying daemon grafana.smithi049 on smithi049 2023-12-16T07:42:34.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:34 smithi133 ceph-mon[120445]: Upgrade: Updating grafana.smithi049 2023-12-16T07:42:34.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:34 smithi133 ceph-mon[120445]: Deploying daemon grafana.smithi049 on smithi049 2023-12-16T07:42:35.822 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:35 smithi049 ceph-mon[111939]: pgmap v39: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 6.0 KiB/s wr, 8 op/s 2023-12-16T07:42:35.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:35 smithi133 ceph-mon[120445]: pgmap v39: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 6.0 KiB/s wr, 8 op/s 2023-12-16T07:42:37.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:37 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:37.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:37 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:37.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:37 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:37.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:37 smithi049 ceph-mon[111939]: pgmap v40: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:37.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:37 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:37.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:37 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:37.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:37 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:37.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:37 smithi133 ceph-mon[120445]: pgmap v40: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 -- 172.21.15.49:0/4121765835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 msgr2=0x7f6ef80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 --2- 172.21.15.49:0/4121765835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80ffb10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8004940 tx=0x7f6ee8009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 -- 172.21.15.49:0/4121765835 shutdown_connections 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 --2- 172.21.15.49:0/4121765835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8100050 0x7f6ef8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 --2- 172.21.15.49:0/4121765835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80ffb10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 -- 172.21.15.49:0/4121765835 >> 172.21.15.49:0/4121765835 conn(0x7f6ef80f7190 msgr2=0x7f6ef80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 -- 172.21.15.49:0/4121765835 shutdown_connections 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.938+0000 7f6efce66700 1 -- 172.21.15.49:0/4121765835 wait complete. 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6efce66700 1 Processor -- start 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6efce66700 1 -- start start 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6efce66700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:37.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6efce66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8100050 0x7f6ef80fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6efce66700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80fbc40 con 0x7f6ef80fd730 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6efce66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80fbdb0 con 0x7f6ef8100050 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39880/0 (socket says 172.21.15.49:39880) 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef659c700 1 -- 172.21.15.49:0/1600377560 learned_addr learned my addr 172.21.15.49:0/1600377560 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef5d9b700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8100050 0x7f6ef80fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef659c700 1 -- 172.21.15.49:0/1600377560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8100050 msgr2=0x7f6ef80fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef659c700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8100050 0x7f6ef80fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef659c700 1 -- 172.21.15.49:0/1600377560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8005040 con 0x7f6ef80fd730 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef5d9b700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8100050 0x7f6ef80fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ef659c700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80fd1c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009380 tx=0x7f6ee8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.939+0000 7f6ee6ffd700 1 -- 172.21.15.49:0/1600377560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee800e040 con 0x7f6ef80fd730 2023-12-16T07:42:37.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.940+0000 7f6ee6ffd700 1 -- 172.21.15.49:0/1600377560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ee800bda0 con 0x7f6ef80fd730 2023-12-16T07:42:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.940+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef80fc030 con 0x7f6ef80fd730 2023-12-16T07:42:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.940+0000 7f6ee6ffd700 1 -- 172.21.15.49:0/1600377560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee801c630 con 0x7f6ef80fd730 2023-12-16T07:42:37.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.940+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef8115530 con 0x7f6ef80fd730 2023-12-16T07:42:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.940+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef804bb80 con 0x7f6ef80fd730 2023-12-16T07:42:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.941+0000 7f6ee6ffd700 1 -- 172.21.15.49:0/1600377560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f6ee80139d0 con 0x7f6ef80fd730 2023-12-16T07:42:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.942+0000 7f6ee6ffd700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f6ee006cc00 0x7f6ee006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.942+0000 7f6ee6ffd700 1 -- 172.21.15.49:0/1600377560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6ee808df20 con 0x7f6ef80fd730 2023-12-16T07:42:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.942+0000 7f6ef5d9b700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f6ee006cc00 0x7f6ee006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:37.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.942+0000 7f6ef5d9b700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f6ee006cc00 0x7f6ee006f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec009040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:37.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:37.946+0000 7f6ee6ffd700 1 -- 172.21.15.49:0/1600377560 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6ee805bc10 con 0x7f6ef80fd730 2023-12-16T07:42:38.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.174+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ef8100cb0 con 0x7f6ee006cc00 2023-12-16T07:42:38.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.175+0000 7f6ee6ffd700 1 -- 172.21.15.49:0/1600377560 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f6ef8100cb0 con 0x7f6ee006cc00 2023-12-16T07:42:38.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f6ee006cc00 msgr2=0x7f6ee006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f6ee006cc00 0x7f6ee006f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec009040 comp rx=0 tx=0).stop 2023-12-16T07:42:38.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 msgr2=0x7f6ef80fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80fd1c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009380 tx=0x7f6ee8009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:38.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 shutdown_connections 2023-12-16T07:42:38.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f6ee006cc00 0x7f6ee006f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ef80fd730 0x7f6ef80fd1c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 --2- 172.21.15.49:0/1600377560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8100050 0x7f6ef80fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 >> 172.21.15.49:0/1600377560 conn(0x7f6ef80f7190 msgr2=0x7f6ef80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:38.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 shutdown_connections 2023-12-16T07:42:38.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.178+0000 7f6efce66700 1 -- 172.21.15.49:0/1600377560 wait complete. 2023-12-16T07:42:38.188 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 -- 172.21.15.49:0/4017138705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 msgr2=0x7f21980fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 --2- 172.21.15.49:0/4017138705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fb2e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2188004940 tx=0x7f2188009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 -- 172.21.15.49:0/4017138705 shutdown_connections 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 --2- 172.21.15.49:0/4017138705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21980fdf60 0x7f21980fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 --2- 172.21.15.49:0/4017138705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fb2e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 -- 172.21.15.49:0/4017138705 >> 172.21.15.49:0/4017138705 conn(0x7f21980f6950 msgr2=0x7f21980f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 -- 172.21.15.49:0/4017138705 shutdown_connections 2023-12-16T07:42:38.288 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.287+0000 7f219e492700 1 -- 172.21.15.49:0/4017138705 wait complete. 2023-12-16T07:42:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f219e492700 1 Processor -- start 2023-12-16T07:42:38.289 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f219e492700 1 -- start start 2023-12-16T07:42:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f219e492700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f219e492700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21980fdf60 0x7f21980fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f219e492700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980fc470 con 0x7f21980faed0 2023-12-16T07:42:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f219e492700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980fc5e0 con 0x7f21980fdf60 2023-12-16T07:42:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f2197fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f2197fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39896/0 (socket says 172.21.15.49:39896) 2023-12-16T07:42:38.290 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f2197fff700 1 -- 172.21.15.49:0/342703405 learned_addr learned my addr 172.21.15.49:0/342703405 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.288+0000 7f21977fe700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21980fdf60 0x7f21980fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f2197fff700 1 -- 172.21.15.49:0/342703405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21980fdf60 msgr2=0x7f21980fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f2197fff700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21980fdf60 0x7f21980fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f2197fff700 1 -- 172.21.15.49:0/342703405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188005040 con 0x7f21980faed0 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f2197fff700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fd9f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2188009fd0 tx=0x7f2188009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f2194ff9700 1 -- 172.21.15.49:0/342703405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f218800e040 con 0x7f21980faed0 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21980fc860 con 0x7f21980faed0 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f2194ff9700 1 -- 172.21.15.49:0/342703405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2188013420 con 0x7f21980faed0 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f2194ff9700 1 -- 172.21.15.49:0/342703405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f218801c630 con 0x7f21980faed0 2023-12-16T07:42:38.291 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.289+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2198115610 con 0x7f21980faed0 2023-12-16T07:42:38.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.290+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21981075f0 con 0x7f21980faed0 2023-12-16T07:42:38.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.291+0000 7f2194ff9700 1 -- 172.21.15.49:0/342703405 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f218800bb80 con 0x7f21980faed0 2023-12-16T07:42:38.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.291+0000 7f2194ff9700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f218006cc00 0x7f218006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.291+0000 7f2194ff9700 1 -- 172.21.15.49:0/342703405 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f218808d260 con 0x7f21980faed0 2023-12-16T07:42:38.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.291+0000 7f21977fe700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f218006cc00 0x7f218006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.292 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.292+0000 7f21977fe700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f218006cc00 0x7f218006f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f218c004f40 tx=0x7f218c00b040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:38.296 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.296+0000 7f2194ff9700 1 -- 172.21.15.49:0/342703405 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f218805af50 con 0x7f21980faed0 2023-12-16T07:42:38.528 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.527+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f219802b1f0 con 0x7f218006cc00 2023-12-16T07:42:38.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.529+0000 7f2194ff9700 1 -- 172.21.15.49:0/342703405 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f219802b1f0 con 0x7f218006cc00 2023-12-16T07:42:38.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f218006cc00 msgr2=0x7f218006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f218006cc00 0x7f218006f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f218c004f40 tx=0x7f218c00b040 comp rx=0 tx=0).stop 2023-12-16T07:42:38.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 msgr2=0x7f21980fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fd9f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2188009fd0 tx=0x7f2188009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:38.531 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 shutdown_connections 2023-12-16T07:42:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f218006cc00 0x7f218006f0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21980faed0 0x7f21980fd9f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 --2- 172.21.15.49:0/342703405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21980fdf60 0x7f21980fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 >> 172.21.15.49:0/342703405 conn(0x7f21980f6950 msgr2=0x7f21980f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 shutdown_connections 2023-12-16T07:42:38.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.531+0000 7f219e492700 1 -- 172.21.15.49:0/342703405 wait complete. 2023-12-16T07:42:38.585 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:38 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:38.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 -- 172.21.15.49:0/3632831512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 msgr2=0x7f89040fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 --2- 172.21.15.49:0/3632831512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f89040fd5b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88f4004940 tx=0x7f88f4009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 -- 172.21.15.49:0/3632831512 shutdown_connections 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 --2- 172.21.15.49:0/3632831512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89040fdb80 0x7f8904104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 --2- 172.21.15.49:0/3632831512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f89040fd5b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 -- 172.21.15.49:0/3632831512 >> 172.21.15.49:0/3632831512 conn(0x7f89040f6950 msgr2=0x7f89040f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 -- 172.21.15.49:0/3632831512 shutdown_connections 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 -- 172.21.15.49:0/3632831512 wait complete. 2023-12-16T07:42:38.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.640+0000 7f890a69c700 1 Processor -- start 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f890a69c700 1 -- start start 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f890a69c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f890410f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f890a69c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890410fd40 0x7f8904110be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f890a69c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8904110200 con 0x7f89040fd1a0 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f890a69c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8904110340 con 0x7f890410fd40 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f8903fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f890410f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f8903fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f890410f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39920/0 (socket says 172.21.15.49:39920) 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f8903fff700 1 -- 172.21.15.49:0/1655602281 learned_addr learned my addr 172.21.15.49:0/1655602281 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f89037fe700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890410fd40 0x7f8904110be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f8903fff700 1 -- 172.21.15.49:0/1655602281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890410fd40 msgr2=0x7f8904110be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f8903fff700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890410fd40 0x7f8904110be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f8903fff700 1 -- 172.21.15.49:0/1655602281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f4005040 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.641+0000 7f8903fff700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f890410f800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f88f40093b0 tx=0x7f88f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.642+0000 7f8900ff9700 1 -- 172.21.15.49:0/1655602281 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f400e040 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.642+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89041111e0 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.642+0000 7f8900ff9700 1 -- 172.21.15.49:0/1655602281 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88f4013420 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.642+0000 7f8900ff9700 1 -- 172.21.15.49:0/1655602281 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f401c610 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.642+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89041116f0 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.643+0000 7f8900ff9700 1 -- 172.21.15.49:0/1655602281 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f88f401c8d0 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.644+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f00052e0 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.644+0000 7f8900ff9700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f88ec06cc00 0x7f88ec06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.644+0000 7f8900ff9700 1 -- 172.21.15.49:0/1655602281 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f88f408e3d0 con 0x7f89040fd1a0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.644+0000 7f89037fe700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f88ec06cc00 0x7f88ec06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.644+0000 7f89037fe700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f88ec06cc00 0x7f88ec06f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8904065340 tx=0x7f88f8009040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:38.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.653+0000 7f8900ff9700 1 -- 172.21.15.49:0/1655602281 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f88f405c020 con 0x7f89040fd1a0 2023-12-16T07:42:38.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:38 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:38.872 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.872+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f88f0000bf0 con 0x7f88ec06cc00 2023-12-16T07:42:38.882 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.882+0000 7f8900ff9700 1 -- 172.21.15.49:0/1655602281 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f88f0000bf0 con 0x7f88ec06cc00 2023-12-16T07:42:38.882 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:42:38.882 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (13s) 9s ago 8m 17.3M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:42:38.882 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 9s ago 8m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:42:38.882 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (7m) 36s ago 7m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 starting - - - - 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (4m) 9s ago 4m 14.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (4m) 9s ago 4m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (4m) 36s ago 4m 9442M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (4m) 36s ago 4m 17.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (84s) 9s ago 9m 506M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (56s) 36s ago 7m 448M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 9s ago 9m 96.5M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (7m) 36s ago 7m 66.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (47s) 9s ago 8m 9361k - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (40s) 36s ago 7m 4076k - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 9s ago 6m 876M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 9s ago 6m 926M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:42:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 9s ago 6m 763M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:42:38.884 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (5m) 36s ago 5m 1033M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:42:38.884 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (5m) 36s ago 5m 769M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:42:38.884 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (5m) 36s ago 5m 873M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:42:38.884 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (25s) 9s ago 7m 45.6M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:42:38.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f88ec06cc00 msgr2=0x7f88ec06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f88ec06cc00 0x7f88ec06f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8904065340 tx=0x7f88f8009040 comp rx=0 tx=0).stop 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 msgr2=0x7f890410f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f890410f800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f88f40093b0 tx=0x7f88f4009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 shutdown_connections 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f88ec06cc00 0x7f88ec06f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89040fd1a0 0x7f890410f800 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 --2- 172.21.15.49:0/1655602281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f890410fd40 0x7f8904110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 >> 172.21.15.49:0/1655602281 conn(0x7f89040f6950 msgr2=0x7f89040f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 shutdown_connections 2023-12-16T07:42:38.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.884+0000 7f890a69c700 1 -- 172.21.15.49:0/1655602281 wait complete. 2023-12-16T07:42:38.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.993+0000 7f2780197700 1 -- 172.21.15.49:0/2315709430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27780fd730 msgr2=0x7f27780ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.993+0000 7f2780197700 1 --2- 172.21.15.49:0/2315709430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27780fd730 0x7f27780ffb10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f276c004940 tx=0x7f276c009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:38.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 -- 172.21.15.49:0/2315709430 shutdown_connections 2023-12-16T07:42:38.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 --2- 172.21.15.49:0/2315709430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2778100050 0x7f2778102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 --2- 172.21.15.49:0/2315709430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27780fd730 0x7f27780ffb10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 -- 172.21.15.49:0/2315709430 >> 172.21.15.49:0/2315709430 conn(0x7f27780f7190 msgr2=0x7f27780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 -- 172.21.15.49:0/2315709430 shutdown_connections 2023-12-16T07:42:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 -- 172.21.15.49:0/2315709430 wait complete. 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 Processor -- start 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 -- start start 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27780fd730 0x7f27780fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2778100050 0x7f27780fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780fbc40 con 0x7f2778100050 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.994+0000 7f2780197700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780fbdb0 con 0x7f27780fd730 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277d732700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2778100050 0x7f27780fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277d732700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2778100050 0x7f27780fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39938/0 (socket says 172.21.15.49:39938) 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277d732700 1 -- 172.21.15.49:0/1892202918 learned_addr learned my addr 172.21.15.49:0/1892202918 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277df33700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27780fd730 0x7f27780fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277d732700 1 -- 172.21.15.49:0/1892202918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27780fd730 msgr2=0x7f27780fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277d732700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27780fd730 0x7f27780fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277d732700 1 -- 172.21.15.49:0/1892202918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c005040 con 0x7f2778100050 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f277d732700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2778100050 0x7f27780fb640 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f277400c8c0 tx=0x7f27740044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f276a7fc700 1 -- 172.21.15.49:0/1892202918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277400a980 con 0x7f2778100050 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27780fc090 con 0x7f2778100050 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f276a7fc700 1 -- 172.21.15.49:0/1892202918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f277400ce60 con 0x7f2778100050 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f276a7fc700 1 -- 172.21.15.49:0/1892202918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27740113a0 con 0x7f2778100050 2023-12-16T07:42:38.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.995+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2778115530 con 0x7f2778100050 2023-12-16T07:42:38.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.996+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277804bb80 con 0x7f2778100050 2023-12-16T07:42:38.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.997+0000 7f276a7fc700 1 -- 172.21.15.49:0/1892202918 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7f2774012400 con 0x7f2778100050 2023-12-16T07:42:38.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.998+0000 7f276a7fc700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f276406cc00 0x7f276406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:38.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.998+0000 7f276a7fc700 1 -- 172.21.15.49:0/1892202918 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f277408cb60 con 0x7f2778100050 2023-12-16T07:42:38.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.998+0000 7f277df33700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f276406cc00 0x7f276406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:38.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:38.998+0000 7f277df33700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f276406cc00 0x7f276406f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f276c00b3b0 tx=0x7f276c009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:39.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.002+0000 7f276a7fc700 1 -- 172.21.15.49:0/1892202918 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f277405a8e0 con 0x7f2778100050 2023-12-16T07:42:39.301 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.301+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2778105580 con 0x7f2778100050 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.301+0000 7f276a7fc700 1 -- 172.21.15.49:0/1892202918 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f277405a470 con 0x7f2778100050 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:42:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:42:39.303 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:42:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f276406cc00 msgr2=0x7f276406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f276406cc00 0x7f276406f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f276c00b3b0 tx=0x7f276c009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:39.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2778100050 msgr2=0x7f27780fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2778100050 0x7f27780fb640 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f277400c8c0 tx=0x7f27740044c0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 shutdown_connections 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f276406cc00 0x7f276406f0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27780fd730 0x7f27780fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 --2- 172.21.15.49:0/1892202918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2778100050 0x7f27780fb640 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 >> 172.21.15.49:0/1892202918 conn(0x7f27780f7190 msgr2=0x7f27780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.303+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 shutdown_connections 2023-12-16T07:42:39.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.304+0000 7f2780197700 1 -- 172.21.15.49:0/1892202918 wait complete. 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 -- 172.21.15.49:0/151548132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 msgr2=0x7fb74c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 --2- 172.21.15.49:0/151548132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0ffb10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb73c004940 tx=0x7fb73c009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 -- 172.21.15.49:0/151548132 shutdown_connections 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 --2- 172.21.15.49:0/151548132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c100050 0x7fb74c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 --2- 172.21.15.49:0/151548132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0ffb10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 -- 172.21.15.49:0/151548132 >> 172.21.15.49:0/151548132 conn(0x7fb74c0f7190 msgr2=0x7fb74c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 -- 172.21.15.49:0/151548132 shutdown_connections 2023-12-16T07:42:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.417+0000 7fb7528b7700 1 -- 172.21.15.49:0/151548132 wait complete. 2023-12-16T07:42:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb7528b7700 1 Processor -- start 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb7528b7700 1 -- start start 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb7528b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb7528b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c100050 0x7fb74c0fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb7528b7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0fbc40 con 0x7fb74c0fd730 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb7528b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0fbdb0 con 0x7fb74c100050 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb74bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb74bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39958/0 (socket says 172.21.15.49:39958) 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb74bfff700 1 -- 172.21.15.49:0/1233264415 learned_addr learned my addr 172.21.15.49:0/1233264415 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.418+0000 7fb74b7fe700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c100050 0x7fb74c0fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb74bfff700 1 -- 172.21.15.49:0/1233264415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c100050 msgr2=0x7fb74c0fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb74bfff700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c100050 0x7fb74c0fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb74bfff700 1 -- 172.21.15.49:0/1233264415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c005040 con 0x7fb74c0fd730 2023-12-16T07:42:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb74bfff700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0fd1c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009360 tx=0x7fb73c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb748ff9700 1 -- 172.21.15.49:0/1233264415 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb73c00e040 con 0x7fb74c0fd730 2023-12-16T07:42:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c0fc030 con 0x7fb74c0fd730 2023-12-16T07:42:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c115550 con 0x7fb74c0fd730 2023-12-16T07:42:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb748ff9700 1 -- 172.21.15.49:0/1233264415 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb73c00bc50 con 0x7fb74c0fd730 2023-12-16T07:42:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.419+0000 7fb748ff9700 1 -- 172.21.15.49:0/1233264415 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb73c01c3f0 con 0x7fb74c0fd730 2023-12-16T07:42:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.421+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7380052e0 con 0x7fb74c0fd730 2023-12-16T07:42:39.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.421+0000 7fb748ff9700 1 -- 172.21.15.49:0/1233264415 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 90901+0+0 (secure 0 0 0) 0x7fb73c013420 con 0x7fb74c0fd730 2023-12-16T07:42:39.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.422+0000 7fb748ff9700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb73406cc00 0x7fb73406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:42:39.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.422+0000 7fb748ff9700 1 -- 172.21.15.49:0/1233264415 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb73c08de30 con 0x7fb74c0fd730 2023-12-16T07:42:39.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.422+0000 7fb74b7fe700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb73406cc00 0x7fb73406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:42:39.423 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.423+0000 7fb74b7fe700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb73406cc00 0x7fb73406f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb740004f60 tx=0x7fb74000b040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:42:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.428+0000 7fb748ff9700 1 -- 172.21.15.49:0/1233264415 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb73c05ba60 con 0x7fb74c0fd730 2023-12-16T07:42:39.690 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.690+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb738000bf0 con 0x7fb73406cc00 2023-12-16T07:42:39.691 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.691+0000 7fb748ff9700 1 -- 172.21.15.49:0/1233264415 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fb738000bf0 con 0x7fb73406cc00 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/2 daemons upgraded", 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading grafana daemons", 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:42:39.692 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb73406cc00 msgr2=0x7fb73406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb73406cc00 0x7fb73406f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb740004f60 tx=0x7fb74000b040 comp rx=0 tx=0).stop 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 msgr2=0x7fb74c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0fd1c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009360 tx=0x7fb73c009e30 comp rx=0 tx=0).stop 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 shutdown_connections 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb73406cc00 0x7fb73406f0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb74c0fd730 0x7fb74c0fd1c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 --2- 172.21.15.49:0/1233264415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb74c100050 0x7fb74c0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.693+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 >> 172.21.15.49:0/1233264415 conn(0x7fb74c0f7190 msgr2=0x7fb74c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.694+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 shutdown_connections 2023-12-16T07:42:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:42:39.694+0000 7fb7528b7700 1 -- 172.21.15.49:0/1233264415 wait complete. 2023-12-16T07:42:39.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:39 smithi133 ceph-mon[120445]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:39.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:39 smithi133 ceph-mon[120445]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:39.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:39 smithi133 ceph-mon[120445]: pgmap v41: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:39.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:39 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/1892202918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:39 smithi049 ceph-mon[111939]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:39 smithi049 ceph-mon[111939]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:39 smithi049 ceph-mon[111939]: pgmap v41: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:39.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:39 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/1892202918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:40 smithi133 ceph-mon[120445]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:40 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:40 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:40 smithi133 ceph-mon[120445]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:40 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:40 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:40.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:40 smithi049 ceph-mon[111939]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:40.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:40 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:40.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:40 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:40.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:40 smithi049 ceph-mon[111939]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:42:40.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:40 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:40.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:40 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:41 smithi133 ceph-mon[120445]: pgmap v42: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:41.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:41 smithi049 ceph-mon[111939]: pgmap v42: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: pgmap v43: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T07:42:43.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T07:42:43.871 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:43.872 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:43.872 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:43.872 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.872 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:43.872 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:43.872 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:43.872 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:43 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: pgmap v43: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-16T07:42:43.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-16T07:42:43.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:43.964 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:43.964 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:43.964 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:43.964 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:42:43.964 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:42:43.964 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:42:43.964 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:43 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:44.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:44 smithi133 ceph-mon[120445]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:42:44.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:44 smithi133 ceph-mon[120445]: Upgrade: Finalizing container_image settings 2023-12-16T07:42:44.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:44 smithi133 ceph-mon[120445]: Upgrade: Complete! 2023-12-16T07:42:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:44 smithi049 ceph-mon[111939]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-16T07:42:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:44 smithi049 ceph-mon[111939]: Upgrade: Finalizing container_image settings 2023-12-16T07:42:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:44 smithi049 ceph-mon[111939]: Upgrade: Complete! 2023-12-16T07:42:45.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:45 smithi133 ceph-mon[120445]: pgmap v44: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:45.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:45 smithi049 ceph-mon[111939]: pgmap v44: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:48.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:47 smithi133 ceph-mon[120445]: pgmap v45: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:48.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:47 smithi049 ceph-mon[111939]: pgmap v45: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:48.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:48 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:48.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:48 smithi049 ceph-mon[111939]: pgmap v46: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:49.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:48 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:42:49.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:48 smithi133 ceph-mon[120445]: pgmap v46: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:52.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:51 smithi133 ceph-mon[120445]: pgmap v47: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:52.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:51 smithi049 ceph-mon[111939]: pgmap v47: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:53.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:53 smithi133 ceph-mon[120445]: pgmap v48: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:53.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:53 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:53 smithi049 ceph-mon[111939]: pgmap v48: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:42:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:53 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:42:54.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:54 smithi133 ceph-mon[120445]: mgrmap e33: smithi049.rqlvwo(active, since 90s), standbys: smithi133.wbiduk 2023-12-16T07:42:54.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:54 smithi049 ceph-mon[111939]: mgrmap e33: smithi049.rqlvwo(active, since 90s), standbys: smithi133.wbiduk 2023-12-16T07:42:55.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:55 smithi133 ceph-mon[120445]: pgmap v49: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:42:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:55 smithi049 ceph-mon[111939]: pgmap v49: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:42:58.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:57 smithi133 ceph-mon[120445]: pgmap v50: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:42:58.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:57 smithi049 ceph-mon[111939]: pgmap v50: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:00.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:42:59 smithi133 ceph-mon[120445]: pgmap v51: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:00.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:42:59 smithi049 ceph-mon[111939]: pgmap v51: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:02.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:01 smithi133 ceph-mon[120445]: pgmap v52: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:02.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:01 smithi049 ceph-mon[111939]: pgmap v52: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:03 smithi133 ceph-mon[120445]: pgmap v53: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:03 smithi049 ceph-mon[111939]: pgmap v53: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:06.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:05 smithi133 ceph-mon[120445]: pgmap v54: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:06.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:05 smithi049 ceph-mon[111939]: pgmap v54: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-16T07:43:08.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:07 smithi133 ceph-mon[120445]: pgmap v55: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:08.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:07 smithi049 ceph-mon[111939]: pgmap v55: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:08 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:43:09.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:08 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:43:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 -- 172.21.15.49:0/2239037355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0660b0 msgr2=0x7f51ec0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 --2- 172.21.15.49:0/2239037355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0660b0 0x7f51ec0ff780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f51e0004940 tx=0x7f51e0009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 -- 172.21.15.49:0/2239037355 shutdown_connections 2023-12-16T07:43:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 --2- 172.21.15.49:0/2239037355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0ffd50 0x7f51ec1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 --2- 172.21.15.49:0/2239037355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0660b0 0x7f51ec0ff780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 -- 172.21.15.49:0/2239037355 >> 172.21.15.49:0/2239037355 conn(0x7f51ec0f7190 msgr2=0x7f51ec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:09.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 -- 172.21.15.49:0/2239037355 shutdown_connections 2023-12-16T07:43:09.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.814+0000 7f51f2e55700 1 -- 172.21.15.49:0/2239037355 wait complete. 2023-12-16T07:43:09.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51f2e55700 1 Processor -- start 2023-12-16T07:43:09.816 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51f2e55700 1 -- start start 2023-12-16T07:43:09.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51f2e55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0660b0 0x7f51ec10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:09.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51f2e55700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0ffd50 0x7f51ec10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:09.817 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51f2e55700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec10e070 con 0x7f51ec0ffd50 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51f2e55700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec10e910 con 0x7f51ec0660b0 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0ffd50 0x7f51ec10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0ffd50 0x7f51ec10da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52090/0 (socket says 172.21.15.49:52090) 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51ebfff700 1 -- 172.21.15.49:0/3693309920 learned_addr learned my addr 172.21.15.49:0/3693309920 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.815+0000 7f51f0bf1700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0660b0 0x7f51ec10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51ebfff700 1 -- 172.21.15.49:0/3693309920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0660b0 msgr2=0x7f51ec10d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51ebfff700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0660b0 0x7f51ec10d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51ebfff700 1 -- 172.21.15.49:0/3693309920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0005040 con 0x7f51ec0ffd50 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51ebfff700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0ffd50 0x7f51ec10da70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51d8002a50 tx=0x7f51d80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51e97fa700 1 -- 172.21.15.49:0/3693309920 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51d8007cc0 con 0x7f51ec0ffd50 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51e97fa700 1 -- 172.21.15.49:0/3693309920 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51d800f040 con 0x7f51ec0ffd50 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec10ebf0 con 0x7f51ec0ffd50 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51e97fa700 1 -- 172.21.15.49:0/3693309920 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51d800d9c0 con 0x7f51ec0ffd50 2023-12-16T07:43:09.818 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.816+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec10f130 con 0x7f51ec0ffd50 2023-12-16T07:43:09.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.817+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec1075c0 con 0x7f51ec0ffd50 2023-12-16T07:43:09.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.818+0000 7f51e97fa700 1 -- 172.21.15.49:0/3693309920 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f51d800db20 con 0x7f51ec0ffd50 2023-12-16T07:43:09.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.818+0000 7f51e97fa700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f51dc06cae0 0x7f51dc06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:09.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.818+0000 7f51e97fa700 1 -- 172.21.15.49:0/3693309920 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f51d808ba00 con 0x7f51ec0ffd50 2023-12-16T07:43:09.819 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.818+0000 7f51f0bf1700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f51dc06cae0 0x7f51dc06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:09.820 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.819+0000 7f51f0bf1700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f51dc06cae0 0x7f51dc06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f51e000b3b0 tx=0x7f51e0009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:09.823 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:09.823+0000 7f51e97fa700 1 -- 172.21.15.49:0/3693309920 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f51d8059870 con 0x7f51ec0ffd50 2023-12-16T07:43:10.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.042+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51ec10f410 con 0x7f51dc06cae0 2023-12-16T07:43:10.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.043+0000 7f51e97fa700 1 -- 172.21.15.49:0/3693309920 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f51ec10f410 con 0x7f51dc06cae0 2023-12-16T07:43:10.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f51dc06cae0 msgr2=0x7f51dc06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:10.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f51dc06cae0 0x7f51dc06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f51e000b3b0 tx=0x7f51e0009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:10.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0ffd50 msgr2=0x7f51ec10da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:10.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0ffd50 0x7f51ec10da70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51d8002a50 tx=0x7f51d80046b0 comp rx=0 tx=0).stop 2023-12-16T07:43:10.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 shutdown_connections 2023-12-16T07:43:10.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f51dc06cae0 0x7f51dc06ef90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:10.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0660b0 0x7f51ec10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:10.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 --2- 172.21.15.49:0/3693309920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51ec0ffd50 0x7f51ec10da70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:10.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 >> 172.21.15.49:0/3693309920 conn(0x7f51ec0f7190 msgr2=0x7f51ec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:10.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 shutdown_connections 2023-12-16T07:43:10.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:10.045+0000 7f51f2e55700 1 -- 172.21.15.49:0/3693309920 wait complete. 2023-12-16T07:43:10.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:09 smithi049 ceph-mon[111939]: pgmap v56: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:09 smithi133 ceph-mon[120445]: pgmap v56: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:10.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-16T07:43:10.713 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.760+0000 7fe21fb24700 1 -- 172.21.15.49:0/954894298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 msgr2=0x7fe2180fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.760+0000 7fe21fb24700 1 --2- 172.21.15.49:0/954894298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe2180fbfb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe208004940 tx=0x7fe208009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 -- 172.21.15.49:0/954894298 shutdown_connections 2023-12-16T07:43:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 --2- 172.21.15.49:0/954894298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe2180fbfb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 --2- 172.21.15.49:0/954894298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218101b00 0x7fe218101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 -- 172.21.15.49:0/954894298 >> 172.21.15.49:0/954894298 conn(0x7fe2180719b0 msgr2=0x7fe218071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 -- 172.21.15.49:0/954894298 shutdown_connections 2023-12-16T07:43:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 -- 172.21.15.49:0/954894298 wait complete. 2023-12-16T07:43:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 Processor -- start 2023-12-16T07:43:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 -- start start 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe21810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218101b00 0x7fe21810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21810f290 con 0x7fe2180fbb40 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.761+0000 7fe21fb24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21810f400 con 0x7fe218101b00 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d8c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe21810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d8c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe21810e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52100/0 (socket says 172.21.15.49:52100) 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d8c0700 1 -- 172.21.15.49:0/2558253094 learned_addr learned my addr 172.21.15.49:0/2558253094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d0bf700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218101b00 0x7fe21810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d8c0700 1 -- 172.21.15.49:0/2558253094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218101b00 msgr2=0x7fe21810ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d8c0700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218101b00 0x7fe21810ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d8c0700 1 -- 172.21.15.49:0/2558253094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208005040 con 0x7fe2180fbb40 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21d8c0700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe21810e7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c830 tx=0x7fe214004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe20e7fc700 1 -- 172.21.15.49:0/2558253094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2140106f0 con 0x7fe2180fbb40 2023-12-16T07:43:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe20e7fc700 1 -- 172.21.15.49:0/2558253094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe214010d00 con 0x7fe2180fbb40 2023-12-16T07:43:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe218117770 con 0x7fe2180fbb40 2023-12-16T07:43:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe20e7fc700 1 -- 172.21.15.49:0/2558253094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe214012e90 con 0x7fe2180fbb40 2023-12-16T07:43:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.762+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe218117c80 con 0x7fe2180fbb40 2023-12-16T07:43:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.763+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe218103fb0 con 0x7fe2180fbb40 2023-12-16T07:43:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.764+0000 7fe20e7fc700 1 -- 172.21.15.49:0/2558253094 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fe214010850 con 0x7fe2180fbb40 2023-12-16T07:43:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.764+0000 7fe20e7fc700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fe20406caf0 0x7fe20406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.764+0000 7fe20e7fc700 1 -- 172.21.15.49:0/2558253094 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe21408bdb0 con 0x7fe2180fbb40 2023-12-16T07:43:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.764+0000 7fe21d0bf700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fe20406caf0 0x7fe20406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.765+0000 7fe21d0bf700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fe20406caf0 0x7fe20406efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe218065e30 tx=0x7fe208009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:11.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:11.769+0000 7fe20e7fc700 1 -- 172.21.15.49:0/2558253094 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe214056190 con 0x7fe2180fbb40 2023-12-16T07:43:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:11 smithi049 ceph-mon[111939]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:11 smithi049 ceph-mon[111939]: pgmap v57: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.058+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe21804bbb0 con 0x7fe2180fbb40 2023-12-16T07:43:12.059 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.059+0000 7fe20e7fc700 1 -- 172.21.15.49:0/2558253094 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fe2140597b0 con 0x7fe2180fbb40 2023-12-16T07:43:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fe20406caf0 msgr2=0x7fe20406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fe20406caf0 0x7fe20406efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe218065e30 tx=0x7fe208009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 msgr2=0x7fe21810e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe21810e7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c830 tx=0x7fe214004470 comp rx=0 tx=0).stop 2023-12-16T07:43:12.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 shutdown_connections 2023-12-16T07:43:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fe20406caf0 0x7fe20406efa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2180fbb40 0x7fe21810e7a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 --2- 172.21.15.49:0/2558253094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218101b00 0x7fe21810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 >> 172.21.15.49:0/2558253094 conn(0x7fe2180719b0 msgr2=0x7fe2180fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 shutdown_connections 2023-12-16T07:43:12.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:12.061+0000 7fe21fb24700 1 -- 172.21.15.49:0/2558253094 wait complete. 2023-12-16T07:43:12.072 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:43:12.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:11 smithi133 ceph-mon[120445]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:12.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:11 smithi133 ceph-mon[120445]: pgmap v57: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:12.513 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-16T07:43:12.788 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:12.894 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:12 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/2558253094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:13.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:12 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/2558253094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 -- 172.21.15.49:0/1203106088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 msgr2=0x7f8534102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 --2- 172.21.15.49:0/1203106088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534102ff0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8524004940 tx=0x7f8524009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 -- 172.21.15.49:0/1203106088 shutdown_connections 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 --2- 172.21.15.49:0/1203106088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8534065390 0x7f8534065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 --2- 172.21.15.49:0/1203106088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534102ff0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 -- 172.21.15.49:0/1203106088 >> 172.21.15.49:0/1203106088 conn(0x7f85340719b0 msgr2=0x7f8534071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 -- 172.21.15.49:0/1203106088 shutdown_connections 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 -- 172.21.15.49:0/1203106088 wait complete. 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 Processor -- start 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 -- start start 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8534065390 0x7f8534113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:13.788 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.786+0000 7f8538b41700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534114220 con 0x7f8534102c20 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8538b41700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853410d570 con 0x7f8534065390 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8531d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8531d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52116/0 (socket says 172.21.15.49:52116) 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8531d9b700 1 -- 172.21.15.49:0/3606852307 learned_addr learned my addr 172.21.15.49:0/3606852307 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f853259c700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8534065390 0x7f8534113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8531d9b700 1 -- 172.21.15.49:0/3606852307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8534065390 msgr2=0x7f8534113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8531d9b700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8534065390 0x7f8534113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8531d9b700 1 -- 172.21.15.49:0/3606852307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524005040 con 0x7f8534102c20 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8531d9b700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534113bd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f852800c830 tx=0x7f8528004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8522ffd700 1 -- 172.21.15.49:0/3606852307 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85280106f0 con 0x7f8534102c20 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853410d850 con 0x7f8534102c20 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8522ffd700 1 -- 172.21.15.49:0/3606852307 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8528010d00 con 0x7f8534102c20 2023-12-16T07:43:13.789 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8522ffd700 1 -- 172.21.15.49:0/3606852307 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8528012e90 con 0x7f8534102c20 2023-12-16T07:43:13.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.787+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853410dd90 con 0x7f8534102c20 2023-12-16T07:43:13.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.788+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85340fff40 con 0x7f8534102c20 2023-12-16T07:43:13.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.789+0000 7f8522ffd700 1 -- 172.21.15.49:0/3606852307 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f8528010850 con 0x7f8534102c20 2023-12-16T07:43:13.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.789+0000 7f8522ffd700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f851c06cae0 0x7f851c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:13.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.789+0000 7f8522ffd700 1 -- 172.21.15.49:0/3606852307 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f852808bdb0 con 0x7f8534102c20 2023-12-16T07:43:13.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.789+0000 7f853259c700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f851c06cae0 0x7f851c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:13.791 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.790+0000 7f853259c700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f851c06cae0 0x7f851c06ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8524004f90 tx=0x7f8524009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:13.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:13.794+0000 7f8522ffd700 1 -- 172.21.15.49:0/3606852307 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8528059c20 con 0x7f8534102c20 2023-12-16T07:43:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:13 smithi049 ceph-mon[111939]: pgmap v58: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.087+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f853404bb80 con 0x7f8534102c20 2023-12-16T07:43:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.088+0000 7f8522ffd700 1 -- 172.21.15.49:0/3606852307 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f85280597b0 con 0x7f8534102c20 2023-12-16T07:43:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f851c06cae0 msgr2=0x7f851c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f851c06cae0 0x7f851c06ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8524004f90 tx=0x7f8524009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 msgr2=0x7f8534113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534113bd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f852800c830 tx=0x7f8528004470 comp rx=0 tx=0).stop 2023-12-16T07:43:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 shutdown_connections 2023-12-16T07:43:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f851c06cae0 0x7f851c06ef90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8534065390 0x7f8534113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 --2- 172.21.15.49:0/3606852307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8534102c20 0x7f8534113bd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 >> 172.21.15.49:0/3606852307 conn(0x7f85340719b0 msgr2=0x7f85340fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 shutdown_connections 2023-12-16T07:43:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:14.090+0000 7f8538b41700 1 -- 172.21.15.49:0/3606852307 wait complete. 2023-12-16T07:43:14.102 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)" 2023-12-16T07:43:14.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:13 smithi133 ceph-mon[120445]: pgmap v58: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:14.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-16T07:43:14.731 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:15.021 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:14 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3606852307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:15.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:14 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3606852307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:15.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:15 smithi049 ceph-mon[111939]: pgmap v59: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.011+0000 7ff66ab84700 1 -- 172.21.15.49:0/3008173885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664102c00 msgr2=0x7ff664102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.011+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3008173885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664102c00 0x7ff664102fd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff658004940 tx=0x7ff658009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.011+0000 7ff66ab84700 1 -- 172.21.15.49:0/3008173885 shutdown_connections 2023-12-16T07:43:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.011+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3008173885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6641035a0 0x7ff6640fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.011+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3008173885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664102c00 0x7ff664102fd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.011+0000 7ff66ab84700 1 -- 172.21.15.49:0/3008173885 >> 172.21.15.49:0/3008173885 conn(0x7ff6640f8790 msgr2=0x7ff6640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.012+0000 7ff66ab84700 1 -- 172.21.15.49:0/3008173885 shutdown_connections 2023-12-16T07:43:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.012+0000 7ff66ab84700 1 -- 172.21.15.49:0/3008173885 wait complete. 2023-12-16T07:43:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.012+0000 7ff66ab84700 1 Processor -- start 2023-12-16T07:43:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.012+0000 7ff66ab84700 1 -- start start 2023-12-16T07:43:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.012+0000 7ff66ab84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff664102c00 0x7ff66406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.012+0000 7ff66ab84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641035a0 0x7ff664070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff66ab84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff664070a80 con 0x7ff6641035a0 2023-12-16T07:43:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff66ab84700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff664070bf0 con 0x7ff664102c00 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff663fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641035a0 0x7ff664070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff663fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641035a0 0x7ff664070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52128/0 (socket says 172.21.15.49:52128) 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff663fff700 1 -- 172.21.15.49:0/3278876751 learned_addr learned my addr 172.21.15.49:0/3278876751 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff668920700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff664102c00 0x7ff66406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff663fff700 1 -- 172.21.15.49:0/3278876751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff664102c00 msgr2=0x7ff66406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff663fff700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff664102c00 0x7ff66406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff663fff700 1 -- 172.21.15.49:0/3278876751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff658005040 con 0x7ff6641035a0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff663fff700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641035a0 0x7ff664070480 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff65000c890 tx=0x7ff6500044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff6617fa700 1 -- 172.21.15.49:0/3278876751 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff65000a700 con 0x7ff6641035a0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff6617fa700 1 -- 172.21.15.49:0/3278876751 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff65000ad10 con 0x7ff6641035a0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff664119850 con 0x7ff6641035a0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff6617fa700 1 -- 172.21.15.49:0/3278876751 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff650012e70 con 0x7ff6641035a0 2023-12-16T07:43:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.013+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff664119d30 con 0x7ff6641035a0 2023-12-16T07:43:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.014+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6640fff10 con 0x7ff6641035a0 2023-12-16T07:43:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.015+0000 7ff6617fa700 1 -- 172.21.15.49:0/3278876751 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7ff65000a860 con 0x7ff6641035a0 2023-12-16T07:43:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.016+0000 7ff6617fa700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff65406cae0 0x7ff65406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.016+0000 7ff668920700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff65406cae0 0x7ff65406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.016+0000 7ff6617fa700 1 -- 172.21.15.49:0/3278876751 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff65008bdf0 con 0x7ff6641035a0 2023-12-16T07:43:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.016+0000 7ff668920700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff65406cae0 0x7ff65406ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff658004f90 tx=0x7ff658009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.020+0000 7ff6617fa700 1 -- 172.21.15.49:0/3278876751 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff6500561d0 con 0x7ff6641035a0 2023-12-16T07:43:16.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:15 smithi133 ceph-mon[120445]: pgmap v59: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.307+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff6640fc390 con 0x7ff6641035a0 2023-12-16T07:43:16.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.307+0000 7ff6617fa700 1 -- 172.21.15.49:0/3278876751 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7ff6500597f0 con 0x7ff6641035a0 2023-12-16T07:43:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff65406cae0 msgr2=0x7ff65406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff65406cae0 0x7ff65406ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff658004f90 tx=0x7ff658009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641035a0 msgr2=0x7ff664070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:16.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641035a0 0x7ff664070480 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff65000c890 tx=0x7ff6500044c0 comp rx=0 tx=0).stop 2023-12-16T07:43:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 shutdown_connections 2023-12-16T07:43:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7ff65406cae0 0x7ff65406ef90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff664102c00 0x7ff66406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 --2- 172.21.15.49:0/3278876751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641035a0 0x7ff664070480 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 >> 172.21.15.49:0/3278876751 conn(0x7ff6640f8790 msgr2=0x7ff6640fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 shutdown_connections 2023-12-16T07:43:16.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:16.310+0000 7ff66ab84700 1 -- 172.21.15.49:0/3278876751 wait complete. 2023-12-16T07:43:16.321 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:43:16.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-16T07:43:16.958 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:16.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:16 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3278876751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:17.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:16 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3278876751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 -- 172.21.15.49:0/129435950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fcee0 msgr2=0x7f5d04109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/129435950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fcee0 0x7f5d04109190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4004940 tx=0x7f5cf4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 -- 172.21.15.49:0/129435950 shutdown_connections 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/129435950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fcee0 0x7f5d04109190 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/129435950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d040fc5d0 0x7f5d040fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 -- 172.21.15.49:0/129435950 >> 172.21.15.49:0/129435950 conn(0x7f5d040719b0 msgr2=0x7f5d04071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 -- 172.21.15.49:0/129435950 shutdown_connections 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.909+0000 7f5d09bd6700 1 -- 172.21.15.49:0/129435950 wait complete. 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d09bd6700 1 Processor -- start 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d09bd6700 1 -- start start 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d09bd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fc5d0 0x7f5d04115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:17.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d09bd6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d040fcee0 0x7f5d04115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d09bd6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d04116510 con 0x7f5d040fc5d0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d09bd6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0410f840 con 0x7f5d040fcee0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fc5d0 0x7f5d04115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fc5d0 0x7f5d04115980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35148/0 (socket says 172.21.15.49:35148) 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.910+0000 7f5d037fe700 1 -- 172.21.15.49:0/4086494552 learned_addr learned my addr 172.21.15.49:0/4086494552 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5d02ffd700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d040fcee0 0x7f5d04115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5d037fe700 1 -- 172.21.15.49:0/4086494552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d040fcee0 msgr2=0x7f5d04115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5d037fe700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d040fcee0 0x7f5d04115ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5d037fe700 1 -- 172.21.15.49:0/4086494552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf4005040 con 0x7f5d040fc5d0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5d037fe700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fc5d0 0x7f5d04115980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c8c0 tx=0x7f5cec0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5cfbfff700 1 -- 172.21.15.49:0/4086494552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cec00a760 con 0x7f5d040fc5d0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0410fb20 con 0x7f5d040fc5d0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5cfbfff700 1 -- 172.21.15.49:0/4086494552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5cec00ad70 con 0x7f5d040fc5d0 2023-12-16T07:43:17.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5cfbfff700 1 -- 172.21.15.49:0/4086494552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cec0113a0 con 0x7f5d040fc5d0 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.911+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d04110030 con 0x7f5d040fc5d0 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.912+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d041068c0 con 0x7f5d040fc5d0 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.913+0000 7f5cfbfff700 1 -- 172.21.15.49:0/4086494552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f5cec012400 con 0x7f5d040fc5d0 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.913+0000 7f5cfbfff700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5cf006cae0 0x7f5cf006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.913+0000 7f5cfbfff700 1 -- 172.21.15.49:0/4086494552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f5cec08be20 con 0x7f5d040fc5d0 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.913+0000 7f5d02ffd700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5cf006cae0 0x7f5cf006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.914+0000 7f5d02ffd700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5cf006cae0 0x7f5cf006ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5d04110b70 tx=0x7f5cf4009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:17.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:17.918+0000 7f5cfbfff700 1 -- 172.21.15.49:0/4086494552 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5cec059c90 con 0x7f5d040fc5d0 2023-12-16T07:43:18.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:17 smithi133 ceph-mon[120445]: pgmap v60: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:18.138 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:18.138+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d0404bb80 con 0x7f5cf006cae0 2023-12-16T07:43:18.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:17 smithi049 ceph-mon[111939]: pgmap v60: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:19.507 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.507+0000 7f5cfbfff700 1 -- 172.21.15.49:0/4086494552 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5090 (secure 0 0 0) 0x7f5d0404bb80 con 0x7f5cf006cae0 2023-12-16T07:43:19.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5cf006cae0 msgr2=0x7f5cf006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:19.509 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5cf006cae0 0x7f5cf006ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5d04110b70 tx=0x7f5cf4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fc5d0 msgr2=0x7f5d04115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fc5d0 0x7f5d04115980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c8c0 tx=0x7f5cec0044c0 comp rx=0 tx=0).stop 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 shutdown_connections 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f5cf006cae0 0x7f5cf006ef90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d040fc5d0 0x7f5d04115980 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 --2- 172.21.15.49:0/4086494552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d040fcee0 0x7f5d04115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 >> 172.21.15.49:0/4086494552 conn(0x7f5d040719b0 msgr2=0x7f5d040fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 shutdown_connections 2023-12-16T07:43:19.510 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:19.509+0000 7f5d09bd6700 1 -- 172.21.15.49:0/4086494552 wait complete. 2023-12-16T07:43:19.520 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:43:19.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T07:43:19.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:19 smithi049 ceph-mon[111939]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:19.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:19 smithi049 ceph-mon[111939]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:20.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:19 smithi133 ceph-mon[120445]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:20.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:19 smithi133 ceph-mon[120445]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:20.149 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 -- 172.21.15.49:0/1984488954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 msgr2=0x7f69e40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/1984488954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fbfb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f69d8004940 tx=0x7f69d8009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 -- 172.21.15.49:0/1984488954 shutdown_connections 2023-12-16T07:43:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/1984488954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fbfb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/1984488954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69e4101b00 0x7f69e4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 -- 172.21.15.49:0/1984488954 >> 172.21.15.49:0/1984488954 conn(0x7f69e40719b0 msgr2=0x7f69e4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 -- 172.21.15.49:0/1984488954 shutdown_connections 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.101+0000 7f69ec4b6700 1 -- 172.21.15.49:0/1984488954 wait complete. 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ec4b6700 1 Processor -- start 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ec4b6700 1 -- start start 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ec4b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ec4b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69e4101b00 0x7f69e40fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ec4b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40fe260 con 0x7f69e40fbb40 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ec4b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40fe3d0 con 0x7f69e4101b00 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ea252700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ea252700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35166/0 (socket says 172.21.15.49:35166) 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ea252700 1 -- 172.21.15.49:0/4227200948 learned_addr learned my addr 172.21.15.49:0/4227200948 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69e9a51700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69e4101b00 0x7f69e40fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ea252700 1 -- 172.21.15.49:0/4227200948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69e4101b00 msgr2=0x7f69e40fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ea252700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69e4101b00 0x7f69e40fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.102+0000 7f69ea252700 1 -- 172.21.15.49:0/4227200948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8005040 con 0x7f69e40fbb40 2023-12-16T07:43:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.103+0000 7f69ea252700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fd720 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f69e000c8c0 tx=0x7f69e00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.103+0000 7f69d6ffd700 1 -- 172.21.15.49:0/4227200948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e000a760 con 0x7f69e40fbb40 2023-12-16T07:43:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.103+0000 7f69d6ffd700 1 -- 172.21.15.49:0/4227200948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69e000ad70 con 0x7f69e40fbb40 2023-12-16T07:43:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.103+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e41198d0 con 0x7f69e40fbb40 2023-12-16T07:43:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.103+0000 7f69d6ffd700 1 -- 172.21.15.49:0/4227200948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e00113a0 con 0x7f69e40fbb40 2023-12-16T07:43:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.103+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e4119db0 con 0x7f69e40fbb40 2023-12-16T07:43:21.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.104+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e40734d0 con 0x7f69e40fbb40 2023-12-16T07:43:21.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.104+0000 7f69d6ffd700 1 -- 172.21.15.49:0/4227200948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f69e0012400 con 0x7f69e40fbb40 2023-12-16T07:43:21.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.105+0000 7f69d6ffd700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69d006cae0 0x7f69d006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:21.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.105+0000 7f69e9a51700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69d006cae0 0x7f69d006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:21.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.105+0000 7f69d6ffd700 1 -- 172.21.15.49:0/4227200948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f69e008bea0 con 0x7f69e40fbb40 2023-12-16T07:43:21.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.105+0000 7f69e9a51700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69d006cae0 0x7f69d006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f69e40ff120 tx=0x7f69d8009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:21.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.110+0000 7f69d6ffd700 1 -- 172.21.15.49:0/4227200948 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f69e00561e0 con 0x7f69e40fbb40 2023-12-16T07:43:21.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.322+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f69e40fef70 con 0x7f69d006cae0 2023-12-16T07:43:21.332 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.332+0000 7f69d6ffd700 1 -- 172.21.15.49:0/4227200948 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f69e40fef70 con 0x7f69d006cae0 2023-12-16T07:43:21.332 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:43:21.332 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (55s) 41s ago 8m 17.3M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 41s ago 8m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (8m) 78s ago 8m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (45s) 41s ago 8m 54.0M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (5m) 41s ago 5m 14.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (4m) 41s ago 4m 15.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (5m) 78s ago 4m 9442M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (4m) 78s ago 4m 17.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (2m) 41s ago 9m 507M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (99s) 78s ago 8m 448M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 41s ago 9m 97.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (8m) 78s ago 8m 66.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (89s) 41s ago 8m 9847k - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (82s) 78s ago 8m 4076k - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:43:21.333 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 41s ago 7m 876M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:43:21.334 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 41s ago 7m 927M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:43:21.334 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 41s ago 6m 763M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:43:21.334 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (6m) 78s ago 6m 1033M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:43:21.334 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (6m) 78s ago 6m 769M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:43:21.334 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (5m) 78s ago 5m 873M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:43:21.334 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (68s) 41s ago 8m 45.8M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:43:21.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69d006cae0 msgr2=0x7f69d006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69d006cae0 0x7f69d006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f69e40ff120 tx=0x7f69d8009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 msgr2=0x7f69e40fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fd720 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f69e000c8c0 tx=0x7f69e00044c0 comp rx=0 tx=0).stop 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 shutdown_connections 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f69d006cae0 0x7f69d006ef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69e40fbb40 0x7f69e40fd720 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 --2- 172.21.15.49:0/4227200948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69e4101b00 0x7f69e40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 >> 172.21.15.49:0/4227200948 conn(0x7f69e40719b0 msgr2=0x7f69e40654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 shutdown_connections 2023-12-16T07:43:21.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:21.334+0000 7f69ec4b6700 1 -- 172.21.15.49:0/4227200948 wait complete. 2023-12-16T07:43:21.717 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T07:43:21.718 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:43:21.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-16T07:43:21.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:21 smithi049 ceph-mon[111939]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:21.990 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:22.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:21 smithi133 ceph-mon[120445]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 -- 172.21.15.49:0/844286380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 msgr2=0x7fa2dc0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 --2- 172.21.15.49:0/844286380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc0fbfb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4004940 tx=0x7fa2c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 -- 172.21.15.49:0/844286380 shutdown_connections 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 --2- 172.21.15.49:0/844286380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc0fbfb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 --2- 172.21.15.49:0/844286380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc101b00 0x7fa2dc101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 -- 172.21.15.49:0/844286380 >> 172.21.15.49:0/844286380 conn(0x7fa2dc0719b0 msgr2=0x7fa2dc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 -- 172.21.15.49:0/844286380 shutdown_connections 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 -- 172.21.15.49:0/844286380 wait complete. 2023-12-16T07:43:22.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 Processor -- start 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.961+0000 7fa2e276a700 1 -- start start 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2e276a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc10c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2e276a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc101b00 0x7fa2dc10c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2e276a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc10ce50 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2e276a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc10cf90 con 0x7fa2dc101b00 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc10c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc10c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35188/0 (socket says 172.21.15.49:35188) 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2dbfff700 1 -- 172.21.15.49:0/3593959092 learned_addr learned my addr 172.21.15.49:0/3593959092 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2dbfff700 1 -- 172.21.15.49:0/3593959092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc101b00 msgr2=0x7fa2dc10c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2dbfff700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc101b00 0x7fa2dc10c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2dbfff700 1 -- 172.21.15.49:0/3593959092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4005040 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2dbfff700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc10c3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc002a50 tx=0x7fa2cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:22.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2d8ff9700 1 -- 172.21.15.49:0/3593959092 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2cc007cc0 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2d8ff9700 1 -- 172.21.15.49:0/3593959092 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2cc00f040 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc119a40 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.962+0000 7fa2d8ff9700 1 -- 172.21.15.49:0/3593959092 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2cc009540 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.963+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc119e40 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.963+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc103fb0 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.965+0000 7fa2d8ff9700 1 -- 172.21.15.49:0/3593959092 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fa2cc0096a0 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.965+0000 7fa2d8ff9700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa2c806caf0 0x7fa2c806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.965+0000 7fa2d8ff9700 1 -- 172.21.15.49:0/3593959092 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa2cc08c130 con 0x7fa2dc0fbb40 2023-12-16T07:43:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.965+0000 7fa2db7fe700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa2c806caf0 0x7fa2c806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.966+0000 7fa2db7fe700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa2c806caf0 0x7fa2c806efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4004f90 tx=0x7fa2c4009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:22.969+0000 7fa2d8ff9700 1 -- 172.21.15.49:0/3593959092 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa2cc0565b0 con 0x7fa2dc0fbb40 2023-12-16T07:43:23.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:22 smithi133 ceph-mon[120445]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:23.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.173+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fa2dc0734d0 con 0x7fa2dc0fbb40 2023-12-16T07:43:23.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.177+0000 7fa2d8ff9700 1 -- 172.21.15.49:0/3593959092 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa2cc059bd0 con 0x7fa2dc0fbb40 2023-12-16T07:43:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa2c806caf0 msgr2=0x7fa2c806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa2c806caf0 0x7fa2c806efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4004f90 tx=0x7fa2c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 msgr2=0x7fa2dc10c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc10c3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc002a50 tx=0x7fa2cc0046b0 comp rx=0 tx=0).stop 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 shutdown_connections 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa2c806caf0 0x7fa2c806efa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2dc0fbb40 0x7fa2dc10c3d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 --2- 172.21.15.49:0/3593959092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc101b00 0x7fa2dc10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 >> 172.21.15.49:0/3593959092 conn(0x7fa2dc0719b0 msgr2=0x7fa2dc0fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 shutdown_connections 2023-12-16T07:43:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:23.179+0000 7fa2e276a700 1 -- 172.21.15.49:0/3593959092 wait complete. 2023-12-16T07:43:23.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:22 smithi049 ceph-mon[111939]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:23.550 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T07:43:23.550 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:43:23.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-16T07:43:23.833 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:24.101 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:23 smithi049 ceph-mon[111939]: pgmap v63: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:24.102 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:23 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:43:24.102 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:23 smithi049 ceph-mon[111939]: from='client.? 172.21.15.49:0/3593959092' entity='client.admin' 2023-12-16T07:43:24.102 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:23 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:24.102 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:23 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:24.102 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:23 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:43:24.102 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:23 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:23 smithi133 ceph-mon[120445]: pgmap v63: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:23 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:43:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:23 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/3593959092' entity='client.admin' 2023-12-16T07:43:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:23 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:23 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:23 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:43:24.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:23 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 -- 172.21.15.49:0/2692801244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fc5d0 msgr2=0x7f34940fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 --2- 172.21.15.49:0/2692801244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fc5d0 0x7f34940fc9a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3484004940 tx=0x7f3484009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 -- 172.21.15.49:0/2692801244 shutdown_connections 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 --2- 172.21.15.49:0/2692801244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34940fcee0 0x7f3494109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 --2- 172.21.15.49:0/2692801244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fc5d0 0x7f34940fc9a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 -- 172.21.15.49:0/2692801244 >> 172.21.15.49:0/2692801244 conn(0x7f34940719b0 msgr2=0x7f3494071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 -- 172.21.15.49:0/2692801244 shutdown_connections 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.794+0000 7f349a780700 1 -- 172.21.15.49:0/2692801244 wait complete. 2023-12-16T07:43:24.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.795+0000 7f349a780700 1 Processor -- start 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.795+0000 7f349a780700 1 -- start start 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.795+0000 7f349a780700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34940fc5d0 0x7f34941158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.795+0000 7f349a780700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fcee0 0x7f3494115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.795+0000 7f349a780700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3494116450 con 0x7f34940fcee0 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.795+0000 7f349a780700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349410f780 con 0x7f34940fc5d0 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f34937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fcee0 0x7f3494115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f34937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fcee0 0x7f3494115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35194/0 (socket says 172.21.15.49:35194) 2023-12-16T07:43:24.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f34937fe700 1 -- 172.21.15.49:0/51009320 learned_addr learned my addr 172.21.15.49:0/51009320 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f3493fff700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34940fc5d0 0x7f34941158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f34937fe700 1 -- 172.21.15.49:0/51009320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34940fc5d0 msgr2=0x7f34941158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f34937fe700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34940fc5d0 0x7f34941158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f34937fe700 1 -- 172.21.15.49:0/51009320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484005040 con 0x7f34940fcee0 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f34937fe700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fcee0 0x7f3494115e00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c830 tx=0x7f347c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f3490ff9700 1 -- 172.21.15.49:0/51009320 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347c0106f0 con 0x7f34940fcee0 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f3490ff9700 1 -- 172.21.15.49:0/51009320 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f347c010d00 con 0x7f34940fcee0 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349410fa60 con 0x7f34940fcee0 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f3490ff9700 1 -- 172.21.15.49:0/51009320 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347c012e90 con 0x7f34940fcee0 2023-12-16T07:43:24.798 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.796+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349410ffa0 con 0x7f34940fcee0 2023-12-16T07:43:24.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.797+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34941068c0 con 0x7f34940fcee0 2023-12-16T07:43:24.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.798+0000 7f3490ff9700 1 -- 172.21.15.49:0/51009320 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f347c010850 con 0x7f34940fcee0 2023-12-16T07:43:24.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.798+0000 7f3490ff9700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f348006cae0 0x7f348006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:24.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.798+0000 7f3490ff9700 1 -- 172.21.15.49:0/51009320 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f347c08bd10 con 0x7f34940fcee0 2023-12-16T07:43:24.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.798+0000 7f3493fff700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f348006cae0 0x7f348006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:24.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.799+0000 7f3493fff700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f348006cae0 0x7f348006ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3484004f90 tx=0x7f3484009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:24.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:24.803+0000 7f3490ff9700 1 -- 172.21.15.49:0/51009320 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f347c059c20 con 0x7f34940fcee0 2023-12-16T07:43:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.005+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f349410bdc0 con 0x7f34940fcee0 2023-12-16T07:43:25.005 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.005+0000 7f3490ff9700 1 -- 172.21.15.49:0/51009320 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f347c0597b0 con 0x7f34940fcee0 2023-12-16T07:43:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f348006cae0 msgr2=0x7f348006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f348006cae0 0x7f348006ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3484004f90 tx=0x7f3484009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fcee0 msgr2=0x7f3494115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fcee0 0x7f3494115e00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c830 tx=0x7f347c004470 comp rx=0 tx=0).stop 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 shutdown_connections 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f348006cae0 0x7f348006ef90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34940fc5d0 0x7f34941158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 --2- 172.21.15.49:0/51009320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34940fcee0 0x7f3494115e00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 >> 172.21.15.49:0/51009320 conn(0x7f34940719b0 msgr2=0x7f34940fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 shutdown_connections 2023-12-16T07:43:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:25.007+0000 7f349a780700 1 -- 172.21.15.49:0/51009320 wait complete. 2023-12-16T07:43:25.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-16T07:43:25.681 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:25 smithi133 ceph-mon[120445]: pgmap v64: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:26.136 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:25 smithi049 ceph-mon[111939]: pgmap v64: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 -- 172.21.15.49:0/2332839438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464065390 msgr2=0x7f5464065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 --2- 172.21.15.49:0/2332839438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464065390 0x7f5464065800 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5458004940 tx=0x7f5458009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 -- 172.21.15.49:0/2332839438 shutdown_connections 2023-12-16T07:43:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 --2- 172.21.15.49:0/2332839438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464065390 0x7f5464065800 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 --2- 172.21.15.49:0/2332839438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5464102c20 0x7f5464102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 -- 172.21.15.49:0/2332839438 >> 172.21.15.49:0/2332839438 conn(0x7f54640719b0 msgr2=0x7f5464071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 -- 172.21.15.49:0/2332839438 shutdown_connections 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.760+0000 7f5468932700 1 -- 172.21.15.49:0/2332839438 wait complete. 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5468932700 1 Processor -- start 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5468932700 1 -- start start 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5468932700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5464065390 0x7f5464113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5468932700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464102c20 0x7f5464113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5468932700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54641142c0 con 0x7f5464102c20 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5468932700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546410d5f0 con 0x7f5464065390 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5461d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464102c20 0x7f5464113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5461d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464102c20 0x7f5464113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35214/0 (socket says 172.21.15.49:35214) 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5461d9b700 1 -- 172.21.15.49:0/2388015518 learned_addr learned my addr 172.21.15.49:0/2388015518 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f546259c700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5464065390 0x7f5464113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5461d9b700 1 -- 172.21.15.49:0/2388015518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5464065390 msgr2=0x7f5464113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5461d9b700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5464065390 0x7f5464113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.761+0000 7f5461d9b700 1 -- 172.21.15.49:0/2388015518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458005040 con 0x7f5464102c20 2023-12-16T07:43:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.762+0000 7f5461d9b700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464102c20 0x7f5464113c70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f545800b3b0 tx=0x7f5458009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.764+0000 7f5452ffd700 1 -- 172.21.15.49:0/2388015518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f545800e040 con 0x7f5464102c20 2023-12-16T07:43:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.764+0000 7f5452ffd700 1 -- 172.21.15.49:0/2388015518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f545801c430 con 0x7f5464102c20 2023-12-16T07:43:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.764+0000 7f5452ffd700 1 -- 172.21.15.49:0/2388015518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5458013640 con 0x7f5464102c20 2023-12-16T07:43:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.764+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546410d870 con 0x7f5464102c20 2023-12-16T07:43:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.764+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546410ddb0 con 0x7f5464102c20 2023-12-16T07:43:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.765+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54640fff40 con 0x7f5464102c20 2023-12-16T07:43:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.765+0000 7f5452ffd700 1 -- 172.21.15.49:0/2388015518 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f545801c5a0 con 0x7f5464102c20 2023-12-16T07:43:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.766+0000 7f5452ffd700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f544c06cae0 0x7f544c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.766+0000 7f5452ffd700 1 -- 172.21.15.49:0/2388015518 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f545808c820 con 0x7f5464102c20 2023-12-16T07:43:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.766+0000 7f546259c700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f544c06cae0 0x7f544c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.767+0000 7f546259c700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f544c06cae0 0x7f544c06ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54540041d0 tx=0x7f54540043c0 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.771+0000 7f5452ffd700 1 -- 172.21.15.49:0/2388015518 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f545805a7e0 con 0x7f5464102c20 2023-12-16T07:43:26.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.970+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f546404bb80 con 0x7f5464102c20 2023-12-16T07:43:26.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.970+0000 7f5452ffd700 1 -- 172.21.15.49:0/2388015518 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f545805a370 con 0x7f5464102c20 2023-12-16T07:43:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f544c06cae0 msgr2=0x7f544c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f544c06cae0 0x7f544c06ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f54540041d0 tx=0x7f54540043c0 comp rx=0 tx=0).stop 2023-12-16T07:43:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464102c20 msgr2=0x7f5464113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:26.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464102c20 0x7f5464113c70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f545800b3b0 tx=0x7f5458009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 shutdown_connections 2023-12-16T07:43:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f544c06cae0 0x7f544c06ef90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5464065390 0x7f5464113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 --2- 172.21.15.49:0/2388015518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5464102c20 0x7f5464113c70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 >> 172.21.15.49:0/2388015518 conn(0x7f54640719b0 msgr2=0x7f54640fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 shutdown_connections 2023-12-16T07:43:26.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:26.972+0000 7f5468932700 1 -- 172.21.15.49:0/2388015518 wait complete. 2023-12-16T07:43:27.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-16T07:43:27.616 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:28.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:27 smithi049 ceph-mon[111939]: pgmap v65: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:28.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:27 smithi133 ceph-mon[120445]: pgmap v65: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 -- 172.21.15.49:0/956812731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fb960 msgr2=0x7fa0b00fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/956812731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fb960 0x7fa0b00fbd30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4004940 tx=0x7fa0a4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 -- 172.21.15.49:0/956812731 shutdown_connections 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/956812731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b00fc270 0x7fa0b0108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/956812731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fb960 0x7fa0b00fbd30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 -- 172.21.15.49:0/956812731 >> 172.21.15.49:0/956812731 conn(0x7fa0b00f7690 msgr2=0x7fa0b00f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 -- 172.21.15.49:0/956812731 shutdown_connections 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 -- 172.21.15.49:0/956812731 wait complete. 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 Processor -- start 2023-12-16T07:43:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.651+0000 7fa0b6a69700 1 -- start start 2023-12-16T07:43:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0b6a69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b00fb960 0x7fa0b0115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0b6a69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fc270 0x7fa0b0115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0b6a69700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b0116480 con 0x7fa0b00fc270 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0b6a69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b010f720 con 0x7fa0b00fb960 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0affff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fc270 0x7fa0b0115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0affff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fc270 0x7fa0b0115da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37306/0 (socket says 172.21.15.49:37306) 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0affff700 1 -- 172.21.15.49:0/2907548394 learned_addr learned my addr 172.21.15.49:0/2907548394 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0b4805700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b00fb960 0x7fa0b0115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0affff700 1 -- 172.21.15.49:0/2907548394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b00fb960 msgr2=0x7fa0b0115860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0affff700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b00fb960 0x7fa0b0115860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0affff700 1 -- 172.21.15.49:0/2907548394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a4005040 con 0x7fa0b00fc270 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.652+0000 7fa0affff700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fc270 0x7fa0b0115da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b790 tx=0x7fa09c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.653+0000 7fa0ad7fa700 1 -- 172.21.15.49:0/2907548394 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09c00f770 con 0x7fa0b00fc270 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.653+0000 7fa0ad7fa700 1 -- 172.21.15.49:0/2907548394 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa09c00fd80 con 0x7fa0b00fc270 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.653+0000 7fa0ad7fa700 1 -- 172.21.15.49:0/2907548394 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09c00d310 con 0x7fa0b00fc270 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.653+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b010fa00 con 0x7fa0b00fc270 2023-12-16T07:43:28.654 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.653+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b010ff40 con 0x7fa0b00fc270 2023-12-16T07:43:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.654+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b0106700 con 0x7fa0b00fc270 2023-12-16T07:43:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.654+0000 7fa0ad7fa700 1 -- 172.21.15.49:0/2907548394 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fa09c010420 con 0x7fa0b00fc270 2023-12-16T07:43:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.655+0000 7fa0ad7fa700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa0a006caf0 0x7fa0a006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.655+0000 7fa0ad7fa700 1 -- 172.21.15.49:0/2907548394 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa09c08bc70 con 0x7fa0b00fc270 2023-12-16T07:43:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.655+0000 7fa0b4805700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa0a006caf0 0x7fa0a006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.655+0000 7fa0b4805700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa0a006caf0 0x7fa0a006efa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400b840 tx=0x7fa0a4009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.659+0000 7fa0ad7fa700 1 -- 172.21.15.49:0/2907548394 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa09c059b80 con 0x7fa0b00fc270 2023-12-16T07:43:28.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.865+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fa0b010bdc0 con 0x7fa0b00fc270 2023-12-16T07:43:28.865 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.865+0000 7fa0ad7fa700 1 -- 172.21.15.49:0/2907548394 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa09c059710 con 0x7fa0b00fc270 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa0a006caf0 msgr2=0x7fa0a006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa0a006caf0 0x7fa0a006efa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400b840 tx=0x7fa0a4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fc270 msgr2=0x7fa0b0115da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fc270 0x7fa0b0115da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b790 tx=0x7fa09c009250 comp rx=0 tx=0).stop 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 shutdown_connections 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa0a006caf0 0x7fa0a006efa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b00fb960 0x7fa0b0115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 --2- 172.21.15.49:0/2907548394 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b00fc270 0x7fa0b0115da0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:28.868 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 >> 172.21.15.49:0/2907548394 conn(0x7fa0b00f7690 msgr2=0x7fa0b00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.867+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 shutdown_connections 2023-12-16T07:43:28.869 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:28.868+0000 7fa0b6a69700 1 -- 172.21.15.49:0/2907548394 wait complete. 2023-12-16T07:43:29.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-16T07:43:29.507 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:29.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:29 smithi049 ceph-mon[111939]: pgmap v66: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:30.121 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:29 smithi133 ceph-mon[120445]: pgmap v66: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.440+0000 7fa37c48b700 1 -- 172.21.15.49:0/687948469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740fbb40 msgr2=0x7fa3740fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.440+0000 7fa37c48b700 1 --2- 172.21.15.49:0/687948469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740fbb40 0x7fa3740fbfb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa368004940 tx=0x7fa368009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 -- 172.21.15.49:0/687948469 shutdown_connections 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 --2- 172.21.15.49:0/687948469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3740fbb40 0x7fa3740fbfb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 --2- 172.21.15.49:0/687948469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa374101b00 0x7fa374101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 -- 172.21.15.49:0/687948469 >> 172.21.15.49:0/687948469 conn(0x7fa3740719b0 msgr2=0x7fa374071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 -- 172.21.15.49:0/687948469 shutdown_connections 2023-12-16T07:43:30.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 -- 172.21.15.49:0/687948469 wait complete. 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 Processor -- start 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 -- start start 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3740fbb40 0x7fa37410e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa374101b00 0x7fa37410ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37410f290 con 0x7fa374101b00 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.441+0000 7fa37c48b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37410f400 con 0x7fa3740fbb40 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa379a26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa374101b00 0x7fa37410ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa379a26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa374101b00 0x7fa37410ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37326/0 (socket says 172.21.15.49:37326) 2023-12-16T07:43:30.450 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa379a26700 1 -- 172.21.15.49:0/559776597 learned_addr learned my addr 172.21.15.49:0/559776597 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa37a227700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3740fbb40 0x7fa37410e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa379a26700 1 -- 172.21.15.49:0/559776597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3740fbb40 msgr2=0x7fa37410e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa379a26700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3740fbb40 0x7fa37410e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa379a26700 1 -- 172.21.15.49:0/559776597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368005040 con 0x7fa374101b00 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa37a227700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3740fbb40 0x7fa37410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa379a26700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa374101b00 0x7fa37410ece0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa36800b3b0 tx=0x7fa368009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa366ffd700 1 -- 172.21.15.49:0/559776597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36800e040 con 0x7fa374101b00 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa366ffd700 1 -- 172.21.15.49:0/559776597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa36800bc50 con 0x7fa374101b00 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa366ffd700 1 -- 172.21.15.49:0/559776597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa368013420 con 0x7fa374101b00 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa374117710 con 0x7fa374101b00 2023-12-16T07:43:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.442+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa374117c20 con 0x7fa374101b00 2023-12-16T07:43:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.443+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa374103fb0 con 0x7fa374101b00 2023-12-16T07:43:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.444+0000 7fa366ffd700 1 -- 172.21.15.49:0/559776597 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fa36801c430 con 0x7fa374101b00 2023-12-16T07:43:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.445+0000 7fa366ffd700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa36006cae0 0x7fa36006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.445+0000 7fa37a227700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa36006cae0 0x7fa36006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.445+0000 7fa366ffd700 1 -- 172.21.15.49:0/559776597 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa36808d480 con 0x7fa374101b00 2023-12-16T07:43:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.445+0000 7fa37a227700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa36006cae0 0x7fa36006ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa370007fd0 tx=0x7fa370009040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.449+0000 7fa366ffd700 1 -- 172.21.15.49:0/559776597 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa3680578f0 con 0x7fa374101b00 2023-12-16T07:43:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.674+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}) v1 -- 0x7fa37404bbf0 con 0x7fa36006cae0 2023-12-16T07:43:30.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.680+0000 7fa366ffd700 1 -- 172.21.15.49:0/559776597 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fa37404bbf0 con 0x7fa36006cae0 2023-12-16T07:43:30.680 INFO:teuthology.orchestra.run.smithi049.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa36006cae0 msgr2=0x7fa36006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa36006cae0 0x7fa36006ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa370007fd0 tx=0x7fa370009040 comp rx=0 tx=0).stop 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa374101b00 msgr2=0x7fa37410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa374101b00 0x7fa37410ece0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa36800b3b0 tx=0x7fa368009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 shutdown_connections 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fa36006cae0 0x7fa36006ef90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3740fbb40 0x7fa37410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 --2- 172.21.15.49:0/559776597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa374101b00 0x7fa37410ece0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:30.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 >> 172.21.15.49:0/559776597 conn(0x7fa3740719b0 msgr2=0x7fa3740fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:30.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 shutdown_connections 2023-12-16T07:43:30.685 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:30.682+0000 7fa37c48b700 1 -- 172.21.15.49:0/559776597 wait complete. 2023-12-16T07:43:31.167 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-16T07:43:31.168 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:43:31.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-16T07:43:31.502 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: pgmap v67: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:43:31.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:31 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:43:32.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: pgmap v67: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:43:32.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:31 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:32.747 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:32 smithi049 ceph-mon[111939]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:43:32.747 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:32.747 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:32.747 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:32.748 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:32.748 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:32 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T07:43:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:32 smithi133 ceph-mon[120445]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T07:43:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:33.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:32 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T07:43:33.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 -- 172.21.15.49:0/3956675533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 msgr2=0x7f61f8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 --2- 172.21.15.49:0/3956675533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f8102ff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004940 tx=0x7f61f4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:33.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 -- 172.21.15.49:0/3956675533 shutdown_connections 2023-12-16T07:43:33.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 --2- 172.21.15.49:0/3956675533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f8065390 0x7f61f8065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.394 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 --2- 172.21.15.49:0/3956675533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f8102ff0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 -- 172.21.15.49:0/3956675533 >> 172.21.15.49:0/3956675533 conn(0x7f61f80719b0 msgr2=0x7f61f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 -- 172.21.15.49:0/3956675533 shutdown_connections 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.392+0000 7f61ff41d700 1 -- 172.21.15.49:0/3956675533 wait complete. 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61ff41d700 1 Processor -- start 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61ff41d700 1 -- start start 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61ff41d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f8065390 0x7f61f80fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61ff41d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f80fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61ff41d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80fc730 con 0x7f61f8102c20 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61ff41d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80fc8a0 con 0x7f61f8065390 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fc9b8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f80fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fc9b8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f80fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37346/0 (socket says 172.21.15.49:37346) 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fc9b8700 1 -- 172.21.15.49:0/4104374979 learned_addr learned my addr 172.21.15.49:0/4104374979 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fd1b9700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f8065390 0x7f61f80fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fc9b8700 1 -- 172.21.15.49:0/4104374979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f8065390 msgr2=0x7f61f80fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fc9b8700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f8065390 0x7f61f80fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fc9b8700 1 -- 172.21.15.49:0/4104374979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4005040 con 0x7f61f8102c20 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.393+0000 7f61fc9b8700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f80fc130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f61e8002a50 tx=0x7f61e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.394+0000 7f61edffb700 1 -- 172.21.15.49:0/4104374979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e8007cc0 con 0x7f61f8102c20 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.394+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f8119910 con 0x7f61f8102c20 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.394+0000 7f61edffb700 1 -- 172.21.15.49:0/4104374979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61e800f040 con 0x7f61f8102c20 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.394+0000 7f61edffb700 1 -- 172.21.15.49:0/4104374979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61e8009540 con 0x7f61f8102c20 2023-12-16T07:43:33.396 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.394+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f8119df0 con 0x7f61f8102c20 2023-12-16T07:43:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.395+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80fff40 con 0x7f61f8102c20 2023-12-16T07:43:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.395+0000 7f61edffb700 1 -- 172.21.15.49:0/4104374979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f61e80096a0 con 0x7f61f8102c20 2023-12-16T07:43:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.396+0000 7f61edffb700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f61e406cae0 0x7f61e406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.396+0000 7f61edffb700 1 -- 172.21.15.49:0/4104374979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f61e808bbe0 con 0x7f61f8102c20 2023-12-16T07:43:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.396+0000 7f61fd1b9700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f61e406cae0 0x7f61e406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:33.397 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.396+0000 7f61fd1b9700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f61e406cae0 0x7f61e406ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004560 tx=0x7f61f4009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.400+0000 7f61edffb700 1 -- 172.21.15.49:0/4104374979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f61e8055f40 con 0x7f61f8102c20 2023-12-16T07:43:33.629 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.629+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f61f80fd330 con 0x7f61e406cae0 2023-12-16T07:43:33.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.630+0000 7f61edffb700 1 -- 172.21.15.49:0/4104374979 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f61f80fd330 con 0x7f61e406cae0 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f61e406cae0 msgr2=0x7f61e406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f61e406cae0 0x7f61e406ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61f4004560 tx=0x7f61f4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 msgr2=0x7f61f80fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f80fc130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f61e8002a50 tx=0x7f61e80046b0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 shutdown_connections 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f61e406cae0 0x7f61e406ef90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f8065390 0x7f61f80fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 --2- 172.21.15.49:0/4104374979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61f8102c20 0x7f61f80fc130 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.632+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 >> 172.21.15.49:0/4104374979 conn(0x7f61f80719b0 msgr2=0x7f61f80fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:33.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.633+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 shutdown_connections 2023-12-16T07:43:33.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.633+0000 7f61ff41d700 1 -- 172.21.15.49:0/4104374979 wait complete. 2023-12-16T07:43:33.643 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:43:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.747+0000 7fb270025700 1 -- 172.21.15.49:0/3643342734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 msgr2=0x7fb268065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.747+0000 7fb270025700 1 --2- 172.21.15.49:0/3643342734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268065800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb258004940 tx=0x7fb258009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.747+0000 7fb270025700 1 -- 172.21.15.49:0/3643342734 shutdown_connections 2023-12-16T07:43:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.747+0000 7fb270025700 1 --2- 172.21.15.49:0/3643342734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268065800 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.747+0000 7fb270025700 1 --2- 172.21.15.49:0/3643342734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268102c20 0x7fb268102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.747+0000 7fb270025700 1 -- 172.21.15.49:0/3643342734 >> 172.21.15.49:0/3643342734 conn(0x7fb2680719b0 msgr2=0x7fb268071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:33.748 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.748+0000 7fb270025700 1 -- 172.21.15.49:0/3643342734 shutdown_connections 2023-12-16T07:43:33.749 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.748+0000 7fb270025700 1 -- 172.21.15.49:0/3643342734 wait complete. 2023-12-16T07:43:33.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.748+0000 7fb270025700 1 Processor -- start 2023-12-16T07:43:33.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.748+0000 7fb270025700 1 -- start start 2023-12-16T07:43:33.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.748+0000 7fb270025700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:33.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.748+0000 7fb270025700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268102c20 0x7fb268113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:33.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.748+0000 7fb270025700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2681142c0 con 0x7fb268065390 2023-12-16T07:43:33.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb270025700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26810d5f0 con 0x7fb268102c20 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26ddc1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26ddc1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37350/0 (socket says 172.21.15.49:37350) 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26ddc1700 1 -- 172.21.15.49:0/218540791 learned_addr learned my addr 172.21.15.49:0/218540791 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26d5c0700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268102c20 0x7fb268113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26ddc1700 1 -- 172.21.15.49:0/218540791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268102c20 msgr2=0x7fb268113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26ddc1700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268102c20 0x7fb268113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26ddc1700 1 -- 172.21.15.49:0/218540791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258005040 con 0x7fb268065390 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb26ddc1700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268113730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb26400cb10 tx=0x7fb264007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb25e7fc700 1 -- 172.21.15.49:0/218540791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb264004200 con 0x7fb268065390 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26810d8d0 con 0x7fb268065390 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb25e7fc700 1 -- 172.21.15.49:0/218540791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb26400ac50 con 0x7fb268065390 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb25e7fc700 1 -- 172.21.15.49:0/218540791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb264003ce0 con 0x7fb268065390 2023-12-16T07:43:33.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.749+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26810dde0 con 0x7fb268065390 2023-12-16T07:43:33.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.750+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2680fff40 con 0x7fb268065390 2023-12-16T07:43:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.751+0000 7fb25e7fc700 1 -- 172.21.15.49:0/218540791 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fb26400a7a0 con 0x7fb268065390 2023-12-16T07:43:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.752+0000 7fb25e7fc700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb25406cae0 0x7fb25406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.752+0000 7fb25e7fc700 1 -- 172.21.15.49:0/218540791 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb26408c630 con 0x7fb268065390 2023-12-16T07:43:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.752+0000 7fb26d5c0700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb25406cae0 0x7fb25406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:33.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.752+0000 7fb26d5c0700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb25406cae0 0x7fb25406ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb26810e920 tx=0x7fb258009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:33.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.756+0000 7fb25e7fc700 1 -- 172.21.15.49:0/218540791 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb26405a4a0 con 0x7fb268065390 2023-12-16T07:43:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:33 smithi049 ceph-mon[111939]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T07:43:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:33 smithi049 ceph-mon[111939]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T07:43:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:33 smithi049 ceph-mon[111939]: Upgrade: Setting container_image for all mgr 2023-12-16T07:43:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:33 smithi049 ceph-mon[111939]: pgmap v68: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:33.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.986+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb26804bc20 con 0x7fb25406cae0 2023-12-16T07:43:33.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.987+0000 7fb25e7fc700 1 -- 172.21.15.49:0/218540791 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fb2580096f0 con 0x7fb25406cae0 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.989+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb25406cae0 msgr2=0x7fb25406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.989+0000 7fb270025700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb25406cae0 0x7fb25406ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb26810e920 tx=0x7fb258009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.989+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 msgr2=0x7fb268113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.989+0000 7fb270025700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268113730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb26400cb10 tx=0x7fb264007f90 comp rx=0 tx=0).stop 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.990+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 shutdown_connections 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.990+0000 7fb270025700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fb25406cae0 0x7fb25406ef90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.990+0000 7fb270025700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb268065390 0x7fb268113730 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.990 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.990+0000 7fb270025700 1 --2- 172.21.15.49:0/218540791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb268102c20 0x7fb268113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:33.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.990+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 >> 172.21.15.49:0/218540791 conn(0x7fb2680719b0 msgr2=0x7fb2680fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:33.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.990+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 shutdown_connections 2023-12-16T07:43:33.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:33.990+0000 7fb270025700 1 -- 172.21.15.49:0/218540791 wait complete. 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.100+0000 7f319cc94700 1 -- 172.21.15.49:0/1094547702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 msgr2=0x7f3198101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.100+0000 7f319cc94700 1 --2- 172.21.15.49:0/1094547702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f3198101ed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3188004940 tx=0x7f3188009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 -- 172.21.15.49:0/1094547702 shutdown_connections 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 --2- 172.21.15.49:0/1094547702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31980fbb40 0x7f31980fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 --2- 172.21.15.49:0/1094547702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f3198101ed0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 -- 172.21.15.49:0/1094547702 >> 172.21.15.49:0/1094547702 conn(0x7f31980719b0 msgr2=0x7f3198071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 -- 172.21.15.49:0/1094547702 shutdown_connections 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 -- 172.21.15.49:0/1094547702 wait complete. 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 Processor -- start 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 -- start start 2023-12-16T07:43:34.102 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31980fbb40 0x7f319810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f319810ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319810f1a0 con 0x7f3198101b00 2023-12-16T07:43:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.101+0000 7f319cc94700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319810f310 con 0x7f31980fbb40 2023-12-16T07:43:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3195d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f319810ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3195d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f319810ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37368/0 (socket says 172.21.15.49:37368) 2023-12-16T07:43:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3195d9b700 1 -- 172.21.15.49:0/583982182 learned_addr learned my addr 172.21.15.49:0/583982182 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:34.103 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f319659c700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31980fbb40 0x7f319810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3195d9b700 1 -- 172.21.15.49:0/583982182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31980fbb40 msgr2=0x7f319810e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3195d9b700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31980fbb40 0x7f319810e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3195d9b700 1 -- 172.21.15.49:0/583982182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188005040 con 0x7f3198101b00 2023-12-16T07:43:34.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3195d9b700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f319810ec10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f318c002a50 tx=0x7f318c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3186ffd700 1 -- 172.21.15.49:0/583982182 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318c007cc0 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3186ffd700 1 -- 172.21.15.49:0/583982182 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f318c00f040 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31981176a0 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f3186ffd700 1 -- 172.21.15.49:0/583982182 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318c00d9c0 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.102+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3198117b60 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.103+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3198103fb0 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.104+0000 7f3186ffd700 1 -- 172.21.15.49:0/583982182 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f318c00db20 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.104+0000 7f3186ffd700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f318006caf0 0x7f318006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.105+0000 7f3186ffd700 1 -- 172.21.15.49:0/583982182 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f318c08bb70 con 0x7f3198101b00 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.105+0000 7f319659c700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f318006caf0 0x7f318006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.105+0000 7f319659c700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f318006caf0 0x7f318006efa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31880043d0 tx=0x7f3188009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:34.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.110+0000 7f3186ffd700 1 -- 172.21.15.49:0/583982182 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f318c055e30 con 0x7f3198101b00 2023-12-16T07:43:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:33 smithi133 ceph-mon[120445]: Upgrade: Target is version 19.0.0-191-g6d933094 (unknown) 2023-12-16T07:43:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:33 smithi133 ceph-mon[120445]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17'] 2023-12-16T07:43:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:33 smithi133 ceph-mon[120445]: Upgrade: Setting container_image for all mgr 2023-12-16T07:43:34.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:33 smithi133 ceph-mon[120445]: pgmap v68: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:34.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.323+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3198065b90 con 0x7f318006caf0 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.335+0000 7f3186ffd700 1 -- 172.21.15.49:0/583982182 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3198065b90 con 0x7f318006caf0 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (68s) 54s ago 8m 17.3M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 54s ago 9m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (8m) 91s ago 8m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (58s) 54s ago 8m 54.0M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (5m) 54s ago 5m 14.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (5m) 54s ago 5m 15.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:43:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (5m) 91s ago 5m 9442M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (5m) 91s ago 5m 17.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (2m) 54s ago 10m 507M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (112s) 91s ago 8m 448M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (10m) 54s ago 10m 97.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 456fd7e42953 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (8m) 91s ago 8m 66.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 ffb0cb91d2fb 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (102s) 54s ago 9m 9847k - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (95s) 91s ago 8m 4076k - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 54s ago 7m 876M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 54s ago 7m 927M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 54s ago 7m 763M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (6m) 91s ago 6m 1033M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (6m) 91s ago 6m 769M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (6m) 91s ago 6m 873M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:43:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (81s) 54s ago 8m 45.8M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:43:34.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f318006caf0 msgr2=0x7f318006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f318006caf0 0x7f318006efa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31880043d0 tx=0x7f3188009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:34.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 msgr2=0x7f319810ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f319810ec10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f318c002a50 tx=0x7f318c0046b0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 shutdown_connections 2023-12-16T07:43:34.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f318006caf0 0x7f318006efa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31980fbb40 0x7f319810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 --2- 172.21.15.49:0/583982182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3198101b00 0x7f319810ec10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 >> 172.21.15.49:0/583982182 conn(0x7f31980719b0 msgr2=0x7f31980fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:34.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 shutdown_connections 2023-12-16T07:43:34.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.338+0000 7f319cc94700 1 -- 172.21.15.49:0/583982182 wait complete. 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 -- 172.21.15.49:0/925937139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 msgr2=0x7efce40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 --2- 172.21.15.49:0/925937139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce40fcc10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efcd4004940 tx=0x7efcd4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 -- 172.21.15.49:0/925937139 shutdown_connections 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 --2- 172.21.15.49:0/925937139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce40fcc10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 --2- 172.21.15.49:0/925937139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce4102c00 0x7efce4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 -- 172.21.15.49:0/925937139 >> 172.21.15.49:0/925937139 conn(0x7efce40f8790 msgr2=0x7efce40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 -- 172.21.15.49:0/925937139 shutdown_connections 2023-12-16T07:43:34.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.443+0000 7efceb306700 1 -- 172.21.15.49:0/925937139 wait complete. 2023-12-16T07:43:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.444+0000 7efceb306700 1 Processor -- start 2023-12-16T07:43:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.444+0000 7efceb306700 1 -- start start 2023-12-16T07:43:34.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.444+0000 7efceb306700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce4102c00 0x7efce4113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efceb306700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce4113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efceb306700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce410d520 con 0x7efce41035a0 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efceb306700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce410d690 con 0x7efce4102c00 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce88a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce4113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce88a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce4113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37386/0 (socket says 172.21.15.49:37386) 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce88a1700 1 -- 172.21.15.49:0/1434449847 learned_addr learned my addr 172.21.15.49:0/1434449847 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce90a2700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce4102c00 0x7efce4113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce88a1700 1 -- 172.21.15.49:0/1434449847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce4102c00 msgr2=0x7efce4113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce88a1700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce4102c00 0x7efce4113660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce88a1700 1 -- 172.21.15.49:0/1434449847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4005040 con 0x7efce41035a0 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce90a2700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce4102c00 0x7efce4113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:43:34.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efce88a1700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce4113be0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009fd0 tx=0x7efcd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efcd9ffb700 1 -- 172.21.15.49:0/1434449847 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd400e040 con 0x7efce41035a0 2023-12-16T07:43:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce410d910 con 0x7efce41035a0 2023-12-16T07:43:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efcd9ffb700 1 -- 172.21.15.49:0/1434449847 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efcd400bc50 con 0x7efce41035a0 2023-12-16T07:43:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efcd9ffb700 1 -- 172.21.15.49:0/1434449847 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd401c3f0 con 0x7efce41035a0 2023-12-16T07:43:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.445+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce410de50 con 0x7efce41035a0 2023-12-16T07:43:34.448 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.446+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce40fff10 con 0x7efce41035a0 2023-12-16T07:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.447+0000 7efcd9ffb700 1 -- 172.21.15.49:0/1434449847 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7efcd4013420 con 0x7efce41035a0 2023-12-16T07:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.447+0000 7efcd9ffb700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7efcd006cae0 0x7efcd006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.448+0000 7efcd9ffb700 1 -- 172.21.15.49:0/1434449847 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7efcd408d180 con 0x7efce41035a0 2023-12-16T07:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.448+0000 7efce90a2700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7efcd006cae0 0x7efcd006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.448+0000 7efce90a2700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7efcd006cae0 0x7efcd006ef90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efce0006fd0 tx=0x7efce0008040 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:34.452 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.452+0000 7efcd9ffb700 1 -- 172.21.15.49:0/1434449847 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efcd405aff0 con 0x7efce41035a0 2023-12-16T07:43:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.809+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efce404bb80 con 0x7efce41035a0 2023-12-16T07:43:34.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.810+0000 7efcd9ffb700 1 -- 172.21.15.49:0/1434449847 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7efcd405ab80 con 0x7efce41035a0 2023-12-16T07:43:34.810 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:43:34.810 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:43:34.810 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-16T07:43:34.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:43:34.810 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:43:34.811 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:43:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7efcd006cae0 msgr2=0x7efcd006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7efcd006cae0 0x7efcd006ef90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efce0006fd0 tx=0x7efce0008040 comp rx=0 tx=0).stop 2023-12-16T07:43:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 msgr2=0x7efce4113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce4113be0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009fd0 tx=0x7efcd4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 shutdown_connections 2023-12-16T07:43:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7efcd006cae0 0x7efcd006ef90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.812 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce4102c00 0x7efce4113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 --2- 172.21.15.49:0/1434449847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efce41035a0 0x7efce4113be0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 >> 172.21.15.49:0/1434449847 conn(0x7efce40f8790 msgr2=0x7efce40fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 shutdown_connections 2023-12-16T07:43:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.812+0000 7efceb306700 1 -- 172.21.15.49:0/1434449847 wait complete. 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.940+0000 7f2e46779700 1 -- 172.21.15.49:0/1599830492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e40070890 msgr2=0x7f2e40108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.940+0000 7f2e46779700 1 --2- 172.21.15.49:0/1599830492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e40070890 0x7f2e40108f70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2e34004970 tx=0x7f2e34009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 -- 172.21.15.49:0/1599830492 shutdown_connections 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 --2- 172.21.15.49:0/1599830492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e40070890 0x7f2e40108f70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 --2- 172.21.15.49:0/1599830492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4006ff80 0x7f2e40070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 -- 172.21.15.49:0/1599830492 >> 172.21.15.49:0/1599830492 conn(0x7f2e400f8790 msgr2=0x7f2e400faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 -- 172.21.15.49:0/1599830492 shutdown_connections 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 -- 172.21.15.49:0/1599830492 wait complete. 2023-12-16T07:43:34.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 Processor -- start 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.941+0000 7f2e46779700 1 -- start start 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e46779700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 0x7f2e40119cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e46779700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e4011a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e46779700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4011a810 con 0x7f2e4006ff80 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e46779700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40113d60 con 0x7f2e40070890 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 0x7f2e40119cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 0x7f2e40119cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37404/0 (socket says 172.21.15.49:37404) 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3ffff700 1 -- 172.21.15.49:0/1737411578 learned_addr learned my addr 172.21.15.49:0/1737411578 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3f7fe700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e4011a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3ffff700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 msgr2=0x7f2e4011a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3ffff700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e4011a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3ffff700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34005040 con 0x7f2e4006ff80 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3ffff700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 0x7f2e40119cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2e30002a50 tx=0x7f2e300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:34.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e30007cc0 con 0x7f2e4006ff80 2023-12-16T07:43:34.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.942+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e40114040 con 0x7f2e4006ff80 2023-12-16T07:43:34.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.943+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e3000f040 con 0x7f2e4006ff80 2023-12-16T07:43:34.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.943+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e30009540 con 0x7f2e4006ff80 2023-12-16T07:43:34.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.943+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e40114580 con 0x7f2e4006ff80 2023-12-16T07:43:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.944+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e40103260 con 0x7f2e4006ff80 2023-12-16T07:43:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.945+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f2e300096a0 con 0x7f2e4006ff80 2023-12-16T07:43:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.945+0000 7f2e3cff9700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2e2806cae0 0x7f2e2806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.945+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2e3008bbe0 con 0x7f2e4006ff80 2023-12-16T07:43:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.945+0000 7f2e3f7fe700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2e2806cae0 0x7f2e2806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:34.946 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.946+0000 7f2e3f7fe700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2e2806cae0 0x7f2e2806ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b370 tx=0x7f2e34009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:34.950 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:34.950+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2e30055f40 con 0x7f2e4006ff80 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 ceph-mon[111939]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 ceph-mon[111939]: Upgrade: Updating mon.smithi049 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 ceph-mon[111939]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 ceph-mon[111939]: Deploying daemon mon.smithi049 on smithi049 2023-12-16T07:43:34.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:34 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.031+0000 7f2e3ffff700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 msgr2=0x7f2e40119cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.031+0000 7f2e3ffff700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 msgr2=0x7f2e40119cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.031+0000 7f2e3ffff700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 0x7f2e40119cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2e30002a50 tx=0x7f2e300046b0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.031+0000 7f2e3ffff700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 0x7f2e40119cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2e30002a50 tx=0x7f2e300046b0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.031+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 msgr2=0x7f2e40119cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.031+0000 7f2e3cff9700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e4006ff80 0x7f2e40119cd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.032+0000 7f2e3cff9700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e280767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.032+0000 7f2e3cff9700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e28076ee0 0x7f2e28079360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.032+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28079d80 con 0x7f2e28076ee0 2023-12-16T07:43:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.032+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28079ec0 con 0x7f2e40070890 2023-12-16T07:43:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.032+0000 7f2e44d16700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e28076ee0 msgr2=0x7f2e28079360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2023-12-16T07:43:35.033 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.032+0000 7f2e44d16700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e28076ee0 0x7f2e28079360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:43:35.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.046+0000 7f2e3ffff700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e280767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:35.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.046+0000 7f2e3ffff700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e28076ee0 msgr2=0x7f2e28079360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:43:35.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.046+0000 7f2e3ffff700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e28076ee0 0x7f2e28079360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.046+0000 7f2e3ffff700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=3+}) v3 -- 0x7f2e2807a050 con 0x7f2e40070890 2023-12-16T07:43:35.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.047+0000 7f2e3ffff700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e280767e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e400fc410 tx=0x7f2e300046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:35.047 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.047+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e3005dd50 con 0x7f2e40070890 2023-12-16T07:43:35.048 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.048+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e30061f00 con 0x7f2e40070890 2023-12-16T07:43:35.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.049+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f2e30072220 con 0x7f2e40070890 2023-12-16T07:43:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:34 smithi133 ceph-mon[120445]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:34 smithi133 ceph-mon[120445]: Upgrade: Updating mon.smithi049 2023-12-16T07:43:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:34 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:34 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:43:35.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:34 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:43:35.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:34 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:35.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:34 smithi133 ceph-mon[120445]: Deploying daemon mon.smithi049 on smithi049 2023-12-16T07:43:35.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.222+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2e20005120 con 0x7f2e40070890 2023-12-16T07:43:35.223 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.223+0000 7f2e3cff9700 1 -- 172.21.15.49:0/1737411578 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f2e3003d3d0 con 0x7f2e40070890 2023-12-16T07:43:35.223 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:43:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:43:35.225 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:35.226 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:35.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2e2806cae0 msgr2=0x7f2e2806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:35.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2e2806cae0 0x7f2e2806ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b370 tx=0x7f2e34009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:35.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 msgr2=0x7f2e280767e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:35.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e280767e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e400fc410 tx=0x7f2e300046b0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 shutdown_connections 2023-12-16T07:43:35.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e28076ee0 0x7f2e28079360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e40070890 0x7f2e280767e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 --2- 172.21.15.49:0/1737411578 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f2e2806cae0 0x7f2e2806ef90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 >> 172.21.15.49:0/1737411578 conn(0x7f2e400f8790 msgr2=0x7f2e401003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:35.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.225+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 shutdown_connections 2023-12-16T07:43:35.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.226+0000 7f2e46779700 1 -- 172.21.15.49:0/1737411578 wait complete. 2023-12-16T07:43:35.228 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:43:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 -- 172.21.15.49:0/1818314755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 msgr2=0x7fc7c8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/1818314755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c8102ff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4004940 tx=0x7fc7c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 -- 172.21.15.49:0/1818314755 shutdown_connections 2023-12-16T07:43:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/1818314755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c8065390 0x7fc7c8065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/1818314755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c8102ff0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 -- 172.21.15.49:0/1818314755 >> 172.21.15.49:0/1818314755 conn(0x7fc7c80719b0 msgr2=0x7fc7c8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:35.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 -- 172.21.15.49:0/1818314755 shutdown_connections 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.339+0000 7fc7d03a0700 1 -- 172.21.15.49:0/1818314755 wait complete. 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7d03a0700 1 Processor -- start 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7d03a0700 1 -- start start 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7d03a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c8065390 0x7fc7c80fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7d03a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c80fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7d03a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80fc7c0 con 0x7fc7c8065390 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7d03a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80fc930 con 0x7fc7c8102c20 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7ce13c700 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c8065390 msgr2=0x7fc7c80fbbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2023-12-16T07:43:35.341 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7ce13c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c8065390 0x7fc7c80fbbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:43:35.342 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7cd93b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c80fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7cd93b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c80fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.49:36860/0 (socket says 172.21.15.49:36860) 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7cd93b700 1 -- 172.21.15.49:0/3753167233 learned_addr learned my addr 172.21.15.49:0/3753167233 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7cd93b700 1 -- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c8065390 msgr2=0x7fc7c80fbbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7cd93b700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c8065390 0x7fc7c80fbbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.340+0000 7fc7cd93b700 1 -- 172.21.15.49:0/3753167233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4005040 con 0x7fc7c8102c20 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.341+0000 7fc7cd93b700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c80fc130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800b760 tx=0x7fc7b8009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.341+0000 7fc7beffd700 1 -- 172.21.15.49:0/3753167233 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b8010790 con 0x7fc7c8102c20 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.341+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c8119a10 con 0x7fc7c8102c20 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.341+0000 7fc7beffd700 1 -- 172.21.15.49:0/3753167233 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7b8010da0 con 0x7fc7c8102c20 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.341+0000 7fc7beffd700 1 -- 172.21.15.49:0/3753167233 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b800f300 con 0x7fc7c8102c20 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.341+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c8119f00 con 0x7fc7c8102c20 2023-12-16T07:43:35.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.342+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c80fff40 con 0x7fc7c8102c20 2023-12-16T07:43:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.343+0000 7fc7beffd700 1 -- 172.21.15.49:0/3753167233 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7fc7b80116d0 con 0x7fc7c8102c20 2023-12-16T07:43:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.343+0000 7fc7beffd700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fc7b406ca30 0x7fc7b406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.343+0000 7fc7beffd700 1 -- 172.21.15.49:0/3753167233 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc7b808c040 con 0x7fc7c8102c20 2023-12-16T07:43:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.343+0000 7fc7ce13c700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fc7b406ca30 0x7fc7b406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:35.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.343+0000 7fc7ce13c700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fc7b406ca30 0x7fc7b406eee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000c00 tx=0x7fc7c4009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:35.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.347+0000 7fc7beffd700 1 -- 172.21.15.49:0/3753167233 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc7b8059f60 con 0x7fc7c8102c20 2023-12-16T07:43:35.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:35 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[111916]: 2023-12-16T07:43:35.030+0000 7f4186a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:43:35.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:35 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[111916]: 2023-12-16T07:43:35.030+0000 7f4186a00700 -1 mon.smithi049@0(leader) e2 *** Got Signal Terminated *** 2023-12-16T07:43:35.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:35 smithi049 bash[217305]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049 2023-12-16T07:43:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.631+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 --> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7c80fd330 con 0x7fc7b406ca30 2023-12-16T07:43:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.632+0000 7fc7beffd700 1 -- 172.21.15.49:0/3753167233 <== mgr.14656 v2:172.21.15.49:6800/2734012715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc7c80fd330 con 0x7fc7b406ca30 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/21 daemons upgraded", 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:43:35.633 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fc7b406ca30 msgr2=0x7fc7b406eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fc7b406ca30 0x7fc7b406eee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000c00 tx=0x7fc7c4009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 msgr2=0x7fc7c80fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c80fc130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800b760 tx=0x7fc7b8009220 comp rx=0 tx=0).stop 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 shutdown_connections 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7fc7b406ca30 0x7fc7b406eee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7c8065390 0x7fc7c80fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 --2- 172.21.15.49:0/3753167233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7c8102c20 0x7fc7c80fc130 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 >> 172.21.15.49:0/3753167233 conn(0x7fc7c80719b0 msgr2=0x7fc7c80facb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 shutdown_connections 2023-12-16T07:43:35.636 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.635+0000 7fc7d03a0700 1 -- 172.21.15.49:0/3753167233 wait complete. 2023-12-16T07:43:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.750+0000 7f8580c5e700 1 -- 172.21.15.49:0/991828957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c102410 msgr2=0x7f857c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.750+0000 7f8580c5e700 1 --2- 172.21.15.49:0/991828957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c102410 0x7f857c0fc2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8570004940 tx=0x7f8570009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.750+0000 7f8580c5e700 1 -- 172.21.15.49:0/991828957 shutdown_connections 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.750+0000 7f8580c5e700 1 --2- 172.21.15.49:0/991828957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c102410 0x7f857c0fc2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.750+0000 7f8580c5e700 1 --2- 172.21.15.49:0/991828957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f857c101b00 0x7f857c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.750+0000 7f8580c5e700 1 -- 172.21.15.49:0/991828957 >> 172.21.15.49:0/991828957 conn(0x7f857c0711a0 msgr2=0x7f857c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.750+0000 7f8580c5e700 1 -- 172.21.15.49:0/991828957 shutdown_connections 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.751+0000 7f8580c5e700 1 -- 172.21.15.49:0/991828957 wait complete. 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.751+0000 7f8580c5e700 1 Processor -- start 2023-12-16T07:43:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.751+0000 7f8580c5e700 1 -- start start 2023-12-16T07:43:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f8580c5e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c101b00 0x7f857c112600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f8580c5e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f857c102410 0x7f857c112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f8580c5e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c10c4c0 con 0x7f857c102410 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f8580c5e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c10c630 con 0x7f857c101b00 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f8579d9b700 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f857c102410 msgr2=0x7f857c112b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f8579d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f857c102410 0x7f857c112b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f857a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c101b00 0x7f857c112600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f857a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c101b00 0x7f857c112600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.49:36876/0 (socket says 172.21.15.49:36876) 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f857a59c700 1 -- 172.21.15.49:0/702466601 learned_addr learned my addr 172.21.15.49:0/702466601 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f857a59c700 1 -- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f857c102410 msgr2=0x7f857c112b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f857a59c700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f857c102410 0x7f857c112b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f857a59c700 1 -- 172.21.15.49:0/702466601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570005040 con 0x7f857c101b00 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.752+0000 7f857a59c700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c101b00 0x7f857c112600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f856c00b760 tx=0x7f856c009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.753+0000 7f856affd700 1 -- 172.21.15.49:0/702466601 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856c010790 con 0x7f857c101b00 2023-12-16T07:43:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.753+0000 7f856affd700 1 -- 172.21.15.49:0/702466601 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f856c010da0 con 0x7f857c101b00 2023-12-16T07:43:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.753+0000 7f856affd700 1 -- 172.21.15.49:0/702466601 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856c00f300 con 0x7f857c101b00 2023-12-16T07:43:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.753+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c10c910 con 0x7f857c101b00 2023-12-16T07:43:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.753+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c10ce50 con 0x7f857c101b00 2023-12-16T07:43:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.754+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c0fee60 con 0x7f857c101b00 2023-12-16T07:43:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.755+0000 7f856affd700 1 -- 172.21.15.49:0/702466601 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 33) v1 ==== 90799+0+0 (secure 0 0 0) 0x7f856c0116d0 con 0x7f857c101b00 2023-12-16T07:43:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.756+0000 7f856affd700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f856406ec90 0x7f8564071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:43:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.756+0000 7f856affd700 1 -- 172.21.15.49:0/702466601 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f856c08bc50 con 0x7f857c101b00 2023-12-16T07:43:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.756+0000 7f8579d9b700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f856406ec90 0x7f8564071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:43:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.757+0000 7f8579d9b700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f856406ec90 0x7f8564071140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8570000c00 tx=0x7f8570009e30 comp rx=0 tx=0).ready entity=mgr.14656 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:43:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:35.759+0000 7f856affd700 1 -- 172.21.15.49:0/702466601 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f856c08be60 con 0x7f857c101b00 2023-12-16T07:43:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:35 smithi049 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049.service: Succeeded. 2023-12-16T07:43:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:35 smithi049 systemd[1]: Stopped Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:43:35.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:35 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:43:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.079+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f857c072cc0 con 0x7f857c101b00 2023-12-16T07:43:36.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.080+0000 7f856affd700 1 -- 172.21.15.49:0/702466601 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f856c0598d0 con 0x7f857c101b00 2023-12-16T07:43:36.081 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:36.081 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:36.081 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.082+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f856406ec90 msgr2=0x7f8564071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.082+0000 7f8580c5e700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f856406ec90 0x7f8564071140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8570000c00 tx=0x7f8570009e30 comp rx=0 tx=0).stop 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.082+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c101b00 msgr2=0x7f857c112600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.082+0000 7f8580c5e700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c101b00 0x7f857c112600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f856c00b760 tx=0x7f856c009220 comp rx=0 tx=0).stop 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.082+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 shutdown_connections 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.083+0000 7f8580c5e700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:6800/2734012715,v1:172.21.15.49:6801/2734012715] conn(0x7f856406ec90 0x7f8564071140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.083+0000 7f8580c5e700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857c101b00 0x7f857c112600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.083+0000 7f8580c5e700 1 --2- 172.21.15.49:0/702466601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f857c102410 0x7f857c112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.083+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 >> 172.21.15.49:0/702466601 conn(0x7f857c0711a0 msgr2=0x7f857c0fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.083+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 shutdown_connections 2023-12-16T07:43:36.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:43:36.083+0000 7f8580c5e700 1 -- 172.21.15.49:0/702466601 wait complete. 2023-12-16T07:43:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T07:43:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev), process ceph-mon, pid 7 2023-12-16T07:43:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: pidfile_write: ignore empty --pid-file 2023-12-16T07:43:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 bash[217511]: bf29f39dfd776f0d631837115f2d9c2e825d8fe7e475c698de949afe7e97d204 2023-12-16T07:43:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: load: jerasure load: lrc 2023-12-16T07:43:36.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 systemd[1]: Started Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:43:36.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: RocksDB version: 7.9.2 2023-12-16T07:43:36.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Git sha 0 2023-12-16T07:43:36.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Compile date 2023-12-15 16:32:04 2023-12-16T07:43:36.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: DB SUMMARY 2023-12-16T07:43:36.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: DB Session ID: 51VN0QLTIQSZAASW034R 2023-12-16T07:43:36.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: CURRENT file: CURRENT 2023-12-16T07:43:36.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T07:43:36.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1169 Bytes 2023-12-16T07:43:36.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi049/store.db dir, Total Num: 1, files: 000033.sst 2023-12-16T07:43:36.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi049/store.db: 000031.log size: 39356 ; 2023-12-16T07:43:36.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.error_if_exists: 0 2023-12-16T07:43:36.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.create_if_missing: 0 2023-12-16T07:43:36.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.paranoid_checks: 1 2023-12-16T07:43:36.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T07:43:36.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T07:43:36.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T07:43:36.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.env: 0x5641b752aa60 2023-12-16T07:43:36.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T07:43:36.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.info_log: 0x5641b8dbf620 2023-12-16T07:43:36.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.statistics: (nil) 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.use_fsync: 0 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_log_file_size: 0 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T07:43:36.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.allow_fallocate: 1 2023-12-16T07:43:36.465 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T07:43:36.465 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T07:43:36.465 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.use_direct_reads: 0 2023-12-16T07:43:36.465 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T07:43:36.465 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T07:43:36.465 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.db_log_dir: 2023-12-16T07:43:36.465 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.wal_dir: 2023-12-16T07:43:36.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T07:43:36.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T07:43:36.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T07:43:36.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T07:43:36.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T07:43:36.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T07:43:36.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T07:43:36.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T07:43:36.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.write_buffer_manager: 0x5641b8d75360 2023-12-16T07:43:36.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T07:43:36.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T07:43:36.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T07:43:36.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.unordered_write: 0 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T07:43:36.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.row_cache: None 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.wal_filter: None 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.two_write_queues: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.wal_compression: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.atomic_flush: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.log_readahead_size: 0 2023-12-16T07:43:36.469 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T07:43:36.470 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T07:43:36.470 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T07:43:36.470 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T07:43:36.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T07:43:36.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T07:43:36.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T07:43:36.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_background_jobs: 2 2023-12-16T07:43:36.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_background_compactions: -1 2023-12-16T07:43:36.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_subcompactions: 1 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_open_files: -1 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_background_flushes: -1 2023-12-16T07:43:36.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Compression algorithms supported: 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kZSTD supported: 0 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kXpressCompression supported: 0 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kZlibCompression supported: 1 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kSnappyCompression supported: 1 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kLZ4Compression supported: 1 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: kBZip2Compression supported: 0 2023-12-16T07:43:36.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000015 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.merge_operator: 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_filter: None 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5641b8dbf720) 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks: 1 2023-12-16T07:43:36.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_top_level_index_and_filter: 1 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_type: 0 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_index_type: 0 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_shortening: 1 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: checksum: 4 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: no_block_cache: 0 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache: 0x5641b8e15090 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_name: BinnedLRUCache 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_options: 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: capacity : 536870912 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_shard_bits : 4 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: strict_capacity_limit : 0 2023-12-16T07:43:36.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: high_pri_pool_ratio: 0.000 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_compressed: (nil) 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: persistent_cache: (nil) 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size: 4096 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size_deviation: 10 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_restart_interval: 16 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_block_restart_interval: 1 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_block_size: 4096 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: partition_filters: 0 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: use_delta_encoding: 1 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: filter_policy: bloomfilter 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: whole_key_filtering: 1 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: verify_compression: 0 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: read_amp_bytes_per_bit: 0 2023-12-16T07:43:36.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: format_version: 5 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_index_compression: 1 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_align: 0 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_auto_readahead_size: 262144 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: prepopulate_block_cache: 0 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: initial_auto_readahead_size: 8192 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression: NoCompression 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.num_levels: 7 2023-12-16T07:43:36.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T07:43:36.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T07:43:36.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T07:43:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.table_properties_collectors: 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.inplace_update_support: 0 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T07:43:36.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.bloom_locality: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.max_successive_merges: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.ttl: 2592000 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.enable_blob_files: false 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.min_blob_size: 0 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T07:43:36.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12626, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 90771433-885f-4799-9aeb-a4f8e278a245 2023-12-16T07:43:36.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712616021843, "job": 1, "event": "recovery_started", "wal_files": [31]} 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712616022760, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 39794, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12618, "largest_seqno": 12686, "table_properties": {"data_size": 38485, "index_size": 169, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 133, "raw_key_size": 1225, "raw_average_key_size": 26, "raw_value_size": 37419, "raw_average_value_size": 796, "num_data_blocks": 8, "num_entries": 47, "num_filter_entries": 47, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702712616, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "90771433-885f-4799-9aeb-a4f8e278a245", "db_session_id": "51VN0QLTIQSZAASW034R", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712616022873, "job": 1, "event": "recovery_finished"} 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi049/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5641b8eb0000 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: DB pointer 0x5641b8e9e000 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** DB Stats ** 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T07:43:36.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L0 1/0 38.86 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L6 1/0 6.99 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Sum 2/0 7.02 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 70.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T07:43:36.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 70.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T07:43:36.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative compaction: 0.00 GB write, 9.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval compaction: 0.00 GB write, 9.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache BinnedLRUCache@0x5641b8e15090#7 capacity: 512.00 MB usage: 0.42 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.17 KB,3.27826e-05%) IndexBlock(1,0.25 KB,4.76837e-05%) Misc(1,0.00 KB,0%) 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: starting mon.smithi049 rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi049 fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???) e2 preinit fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???).mds e14 new map 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???).mds e14 print_map 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: e14 2023-12-16T07:43:36.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: legacy client fscid: 1 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Filesystem 'cephfs' (1) 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: fs_name cephfs 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: epoch 13 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:43:36.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: tableserver 0 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: root 0 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: session_timeout 60 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: session_autoclose 300 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_file_size 1099511627776 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_xattr_size 65536 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: required_client_features {} 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: last_failure 0 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: last_failure_osd_epoch 44 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_mds 1 2023-12-16T07:43:36.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: in 0 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: up {0=24305} 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: failed 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: damaged 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: stopped 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_pools [3] 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_pool 2 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: inline_data enabled 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: balancer 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: bal_rank_mask -1 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: standby_count_wanted 1 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Standby daemons: 2023-12-16T07:43:36.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T07:43:36.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-16T07:43:36.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:43:36.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:43:36.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: from='client.14806 172.21.15.49:0/1737411578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: from='client.24607 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/702466601' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049 calling monitor election 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mon.smithi049 is new leader, mons smithi049,smithi133 in quorum (ranks 0,1) 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T07:43:36.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mgrmap e33: smithi049.rqlvwo(active, since 2m), standbys: smithi133.wbiduk 2023-12-16T07:43:36.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: from='mgr.14656 ' entity='' 2023-12-16T07:43:36.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: mgrmap e34: smithi049.rqlvwo(active, since 2m), standbys: smithi133.wbiduk 2023-12-16T07:43:36.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:36.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:36.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:36 smithi049 ceph-mon[217548]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:43:36.994 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: from='mgr.14656 172.21.15.49:0/2926830309' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: from='client.14806 172.21.15.49:0/1737411578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: from='client.24607 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: from='client.? 172.21.15.49:0/702466601' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: mon.smithi049 calling monitor election 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: mon.smithi049 is new leader, mons smithi049,smithi133 in quorum (ranks 0,1) 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: osdmap e47: 6 total, 6 up, 6 in 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: mgrmap e33: smithi049.rqlvwo(active, since 2m), standbys: smithi133.wbiduk 2023-12-16T07:43:36.995 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: from='mgr.14656 ' entity='' 2023-12-16T07:43:36.996 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: mgrmap e34: smithi049.rqlvwo(active, since 2m), standbys: smithi133.wbiduk 2023-12-16T07:43:36.996 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:36.996 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:36.996 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:36 smithi133 ceph-mon[120445]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:43:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:43 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk restarted 2023-12-16T07:43:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:43 smithi133 ceph-mon[120445]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:43:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:43 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:43:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:43 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:43:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:43 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:43:43.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:43 smithi133 ceph-mon[120445]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:43:43.744 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:43 smithi049 ceph-mon[217548]: Standby manager daemon smithi133.wbiduk restarted 2023-12-16T07:43:43.744 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:43 smithi049 ceph-mon[217548]: Standby manager daemon smithi133.wbiduk started 2023-12-16T07:43:43.744 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:43 smithi049 ceph-mon[217548]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/crt"}]: dispatch 2023-12-16T07:43:43.744 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:43 smithi049 ceph-mon[217548]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-16T07:43:43.744 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:43 smithi049 ceph-mon[217548]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.wbiduk/key"}]: dispatch 2023-12-16T07:43:43.744 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:43 smithi049 ceph-mon[217548]: from='mgr.? 172.21.15.133:0/168045790' entity='mgr.smithi133.wbiduk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-16T07:43:44.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:43 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi133[120422]: 2023-12-16T07:43:43.759+0000 7fbb2c6d5700 -1 mon.smithi133@1(peon).osd e48 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-16T07:43:44.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: mgrmap e35: smithi049.rqlvwo(active, since 2m), standbys: smithi133.wbiduk 2023-12-16T07:43:44.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:43:44.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: mgrmap e36: smithi049.rqlvwo(active, starting, since 0.00538339s), standbys: smithi133.wbiduk 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: failed to encode map e48 with expected crc 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:43:44.750 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: failed to encode map e48 with expected crc 2023-12-16T07:43:44.751 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:44 smithi133 ceph-mon[120445]: failed to encode map e48 with expected crc 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: mgrmap e35: smithi049.rqlvwo(active, since 2m), standbys: smithi133.wbiduk 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: Active manager daemon smithi049.rqlvwo restarted 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: Activating manager daemon smithi049.rqlvwo 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: mgrmap e36: smithi049.rqlvwo(active, starting, since 0.00538339s), standbys: smithi133.wbiduk 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: failed to encode map e48 with expected crc 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:43:44.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.eyimyr"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ekquzl"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.takfuo"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.uedvhy"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rqlvwo", "id": "smithi049.rqlvwo"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr metadata", "who": "smithi133.wbiduk", "id": "smithi133.wbiduk"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-16T07:43:44.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: Manager daemon smithi049.rqlvwo is now available 2023-12-16T07:43:44.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:44.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:44.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:43:44.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/mirror_snapshot_schedule"}]: dispatch 2023-12-16T07:43:44.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rqlvwo/trash_purge_schedule"}]: dispatch 2023-12-16T07:43:44.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: failed to encode map e48 with expected crc 2023-12-16T07:43:44.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:44 smithi049 ceph-mon[217548]: failed to encode map e48 with expected crc 2023-12-16T07:43:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:45 smithi133 ceph-mon[120445]: [16/Dec/2023:07:43:44] ENGINE Bus STARTING 2023-12-16T07:43:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:45 smithi133 ceph-mon[120445]: mgrmap e37: smithi049.rqlvwo(active, since 1.00891s), standbys: smithi133.wbiduk 2023-12-16T07:43:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:45 smithi133 ceph-mon[120445]: pgmap v3: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:45 smithi133 ceph-mon[120445]: [16/Dec/2023:07:43:44] ENGINE Serving on http://172.21.15.49:8765 2023-12-16T07:43:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:45 smithi133 ceph-mon[120445]: [16/Dec/2023:07:43:44] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:43:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:45 smithi133 ceph-mon[120445]: [16/Dec/2023:07:43:44] ENGINE Bus STARTED 2023-12-16T07:43:45.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:45 smithi049 ceph-mon[217548]: [16/Dec/2023:07:43:44] ENGINE Bus STARTING 2023-12-16T07:43:45.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:45 smithi049 ceph-mon[217548]: mgrmap e37: smithi049.rqlvwo(active, since 1.00891s), standbys: smithi133.wbiduk 2023-12-16T07:43:45.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:45 smithi049 ceph-mon[217548]: pgmap v3: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:45.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:45 smithi049 ceph-mon[217548]: [16/Dec/2023:07:43:44] ENGINE Serving on http://172.21.15.49:8765 2023-12-16T07:43:45.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:45 smithi049 ceph-mon[217548]: [16/Dec/2023:07:43:44] ENGINE Serving on https://172.21.15.49:7150 2023-12-16T07:43:45.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:45 smithi049 ceph-mon[217548]: [16/Dec/2023:07:43:44] ENGINE Bus STARTED 2023-12-16T07:43:47.300 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:47 smithi133 ceph-mon[120445]: pgmap v4: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:47.301 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:47 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.301 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:47 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.301 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:47 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.301 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:47 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.301 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:47 smithi133 ceph-mon[120445]: mgrmap e38: smithi049.rqlvwo(active, since 3s), standbys: smithi133.wbiduk 2023-12-16T07:43:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:47 smithi049 ceph-mon[217548]: pgmap v4: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:47 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:47 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:47 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:47 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:47 smithi049 ceph-mon[217548]: mgrmap e38: smithi049.rqlvwo(active, since 3s), standbys: smithi133.wbiduk 2023-12-16T07:43:48.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:48 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:48.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:48 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:48.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:48 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:48.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:48 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:48.451 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:48 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:48.451 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:48 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:48.451 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:48 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:48.452 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:48 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:49 smithi133 ceph-mon[120445]: pgmap v5: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:49 smithi133 ceph-mon[120445]: mgrmap e39: smithi049.rqlvwo(active, since 4s), standbys: smithi133.wbiduk 2023-12-16T07:43:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:49 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:49 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:49 smithi049 ceph-mon[217548]: pgmap v5: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:49 smithi049 ceph-mon[217548]: mgrmap e39: smithi049.rqlvwo(active, since 4s), standbys: smithi133.wbiduk 2023-12-16T07:43:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:49 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:49 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:50.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:50 smithi049 ceph-mon[217548]: Detected new or changed devices on smithi133 2023-12-16T07:43:50.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:50 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi133 2023-12-16T07:43:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: pgmap v6: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: Detected new or changed devices on smithi049 2023-12-16T07:43:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:43:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:43:51.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:43:51.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:43:51.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:51 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: pgmap v6: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: Detected new or changed devices on smithi049 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: Updating smithi049:/etc/ceph/ceph.conf 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: Updating smithi133:/etc/ceph/ceph.conf 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:43:51.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:51 smithi049 ceph-mon[217548]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.472 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.473 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:52.473 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:52.473 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:52 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: Updating smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: Updating smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:52.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:52.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:43:52.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:52 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-16T07:43:53.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-mon[120445]: pgmap v7: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-16T07:43:53.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-mon[120445]: Upgrade: Updating mon.smithi133 2023-12-16T07:43:53.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:53.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:43:53.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:43:53.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-mon[120445]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:53.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-mon[120445]: Deploying daemon mon.smithi133 on smithi133 2023-12-16T07:43:53.836 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 systemd[1]: Stopping Ceph mon.smithi133 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:43:53.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:53 smithi049 ceph-mon[217548]: pgmap v7: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-16T07:43:53.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:53 smithi049 ceph-mon[217548]: Upgrade: Updating mon.smithi133 2023-12-16T07:43:53.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:53 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:53.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:53 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:43:53.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:53 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:43:53.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:53 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:43:53.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:53 smithi049 ceph-mon[217548]: Deploying daemon mon.smithi133 on smithi133 2023-12-16T07:43:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi133[120422]: 2023-12-16T07:43:53.833+0000 7fbb31ee0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi133 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:43:54.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:53 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi133[120422]: 2023-12-16T07:43:53.833+0000 7fbb31ee0700 -1 mon.smithi133@1(peon) e2 *** Got Signal Terminated *** 2023-12-16T07:43:54.496 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 bash[181366]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi133 2023-12-16T07:43:54.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi133.service: Succeeded. 2023-12-16T07:43:54.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 systemd[1]: Stopped Ceph mon.smithi133 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:43:54.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 systemd[1]: Starting Ceph mon.smithi133 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:43:55.370 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 bash[181519]: 58bb10f93e97e5080348c220901a859ecfcd5b08961714e45d935182a645ff50 2023-12-16T07:43:55.370 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: set uid:gid to 167:167 (ceph:ceph) 2023-12-16T07:43:55.370 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev), process ceph-mon, pid 7 2023-12-16T07:43:55.370 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: pidfile_write: ignore empty --pid-file 2023-12-16T07:43:55.371 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 systemd[1]: Started Ceph mon.smithi133 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:43:55.371 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: load: jerasure load: lrc 2023-12-16T07:43:55.371 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: RocksDB version: 7.9.2 2023-12-16T07:43:55.371 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Git sha 0 2023-12-16T07:43:55.371 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Compile date 2023-12-15 16:32:04 2023-12-16T07:43:55.371 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: DB SUMMARY 2023-12-16T07:43:55.372 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: DB Session ID: IMBYAAUI5XHONGD0KITF 2023-12-16T07:43:55.372 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: CURRENT file: CURRENT 2023-12-16T07:43:55.372 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: IDENTITY file: IDENTITY 2023-12-16T07:43:55.372 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1094 Bytes 2023-12-16T07:43:55.372 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi133/store.db dir, Total Num: 1, files: 000027.sst 2023-12-16T07:43:55.372 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi133/store.db: 000025.log size: 2888383 ; 2023-12-16T07:43:55.373 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.error_if_exists: 0 2023-12-16T07:43:55.373 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.create_if_missing: 0 2023-12-16T07:43:55.373 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.paranoid_checks: 1 2023-12-16T07:43:55.373 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-16T07:43:55.373 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-16T07:43:55.374 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-16T07:43:55.374 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.env: 0x55e834e58a60 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.fs: PosixFileSystem 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.info_log: 0x55e8357f5620 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_file_opening_threads: 16 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.statistics: (nil) 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.use_fsync: 0 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_log_file_size: 0 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.keep_log_file_num: 1000 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.recycle_log_file_num: 0 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.allow_fallocate: 1 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.allow_mmap_reads: 0 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.allow_mmap_writes: 0 2023-12-16T07:43:55.375 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.use_direct_reads: 0 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.create_missing_column_families: 0 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.db_log_dir: 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.wal_dir: 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.advise_random_on_open: 1 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.db_write_buffer_size: 0 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.write_buffer_manager: 0x55e8357ab360 2023-12-16T07:43:55.376 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.rate_limiter: (nil) 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.wal_recovery_mode: 2 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.enable_thread_tracking: 0 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.enable_pipelined_write: 0 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.unordered_write: 0 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.row_cache: None 2023-12-16T07:43:55.377 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.wal_filter: None 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.allow_ingest_behind: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.two_write_queues: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.manual_wal_flush: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.wal_compression: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.atomic_flush: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.log_readahead_size: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.best_efforts_recovery: 0 2023-12-16T07:43:55.378 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.allow_data_in_errors: 0 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.db_host_id: __hostname__ 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_background_jobs: 2 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_background_compactions: -1 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_subcompactions: 1 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_total_wal_size: 0 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-16T07:43:55.379 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_open_files: -1 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bytes_per_sync: 0 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_readahead_size: 0 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_background_flushes: -1 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Compression algorithms supported: 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kZSTD supported: 0 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kXpressCompression supported: 0 2023-12-16T07:43:55.380 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kLZ4HCCompression supported: 1 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kZlibCompression supported: 1 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kSnappyCompression supported: 1 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kLZ4Compression supported: 1 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: kBZip2Compression supported: 0 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi133/store.db/MANIFEST-000009 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.merge_operator: 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_filter: None 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_filter_factory: None 2023-12-16T07:43:55.381 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.sst_partitioner_factory: None 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e8357f5720) 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: cache_index_and_filter_blocks: 1 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: pin_top_level_index_and_filter: 1 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: index_type: 0 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: data_block_index_type: 0 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: index_shortening: 1 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: checksum: 4 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: no_block_cache: 0 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_cache: 0x55e83584b090 2023-12-16T07:43:55.382 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_cache_name: BinnedLRUCache 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_cache_options: 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: capacity : 536870912 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: num_shard_bits : 4 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: strict_capacity_limit : 0 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: high_pri_pool_ratio: 0.000 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_cache_compressed: (nil) 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: persistent_cache: (nil) 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_size: 4096 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_size_deviation: 10 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_restart_interval: 16 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: index_block_restart_interval: 1 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: metadata_block_size: 4096 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: partition_filters: 0 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: use_delta_encoding: 1 2023-12-16T07:43:55.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: filter_policy: bloomfilter 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: whole_key_filtering: 1 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: verify_compression: 0 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: read_amp_bytes_per_bit: 0 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: format_version: 5 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: enable_index_compression: 1 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: block_align: 0 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: max_auto_readahead_size: 262144 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: prepopulate_block_cache: 0 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: initial_auto_readahead_size: 8192 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: num_file_reads_for_auto_readahead: 2 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.write_buffer_size: 33554432 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_write_buffer_number: 2 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression: NoCompression 2023-12-16T07:43:55.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression: Disabled 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.prefix_extractor: nullptr 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.num_levels: 7 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-16T07:43:55.385 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.level: 32767 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.strategy: 0 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.enabled: false 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.target_file_size_base: 67108864 2023-12-16T07:43:55.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.arena_block_size: 1048576 2023-12-16T07:43:55.387 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.disable_auto_compactions: 0 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.table_properties_collectors: 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.inplace_update_support: 0 2023-12-16T07:43:55.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.bloom_locality: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.max_successive_merges: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.paranoid_file_checks: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.force_consistency_checks: 1 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.report_bg_io_stats: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.ttl: 2592000 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-16T07:43:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.enable_blob_files: false 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.min_blob_size: 0 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.blob_file_size: 268435456 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.blob_file_starting_level: 0 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi133/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12961, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-16T07:43:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a8f22f68-2dc2-41a8-82b3-4b169e69bd5e 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712634952829, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712634959619, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1840510, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12956, "largest_seqno": 13510, "table_properties": {"data_size": 1837216, "index_size": 1576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 6447, "raw_average_key_size": 24, "raw_value_size": 1831515, "raw_average_value_size": 6990, "num_data_blocks": 72, "num_entries": 262, "num_filter_entries": 262, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702712634, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a8f22f68-2dc2-41a8-82b3-4b169e69bd5e", "db_session_id": "IMBYAAUI5XHONGD0KITF", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702712634959737, "job": 1, "event": "recovery_finished"} 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi133/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e8358e6000 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: DB pointer 0x55e8358d4000 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: ** DB Stats ** 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-16T07:43:55.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: ** Compaction Stats [default] ** 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: L0 1/0 1.76 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 595.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: L6 1/0 6.99 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Sum 2/0 8.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 595.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 595.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: ** Compaction Stats [default] ** 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 595.6 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Cumulative compaction: 0.00 GB write, 185.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Interval compaction: 0.00 GB write, 185.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-16T07:43:55.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Block cache BinnedLRUCache@0x55e83584b090#7 capacity: 512.00 MB usage: 2.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.78 KB,0.000149012%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: starting mon.smithi133 rank 1 at public addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] at bind addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi133 fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???) e2 preinit fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???).mds e14 new map 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???).mds e14 print_map 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: e14 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: legacy client fscid: 1 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Filesystem 'cephfs' (1) 2023-12-16T07:43:55.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: fs_name cephfs 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: epoch 13 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: tableserver 0 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: root 0 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: session_timeout 60 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: session_autoclose 300 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: max_file_size 1099511627776 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: max_xattr_size 65536 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: required_client_features {} 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: last_failure 0 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: last_failure_osd_epoch 44 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:43:55.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: max_mds 1 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: in 0 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: up {0=24305} 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: failed 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: damaged 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: stopped 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: data_pools [3] 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: metadata_pool 2 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: inline_data enabled 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: balancer 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: bal_rank_mask -1 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: standby_count_wanted 1 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: [mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: Standby daemons: 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: [mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: [mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout: [mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-16T07:43:55.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:54 smithi133 ceph-mon[181557]: mon.smithi133@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-16T07:43:56.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: mon.smithi049 calling monitor election 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: mon.smithi133 calling monitor election 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: mon.smithi049 is new leader, mons smithi049,smithi133 in quorum (ranks 0,1) 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: monmap e3: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T07:43:56.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: mgrmap e39: smithi049.rqlvwo(active, since 11s), standbys: smithi133.wbiduk 2023-12-16T07:43:56.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:43:56.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:56.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:56.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:56 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:56.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: mon.smithi049 calling monitor election 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: mon.smithi133 calling monitor election 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: mon.smithi049 is new leader, mons smithi049,smithi133 in quorum (ranks 0,1) 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: monmap e3: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: fsmap cephfs:1 {0=cephfs.smithi133.takfuo=up:active} 3 up:standby 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: osdmap e48: 6 total, 6 up, 6 in 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: mgrmap e39: smithi049.rqlvwo(active, since 11s), standbys: smithi133.wbiduk 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:43:56.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:43:56.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:56.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:56.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:56 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:43:57.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:57 smithi133 ceph-mon[181557]: pgmap v9: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-16T07:43:57.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:57 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:57.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:57 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:57.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:57 smithi049 ceph-mon[217548]: pgmap v9: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-16T07:43:57.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:57 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:57.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:57 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:58.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:58 smithi049 ceph-mon[217548]: pgmap v10: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T07:43:58.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:58 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:58.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:58 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:59.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:58 smithi133 ceph-mon[181557]: pgmap v10: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T07:43:59.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:58 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:43:59.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:58 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:00.032 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:43:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:00.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:43:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:01.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: pgmap v11: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T07:44:01.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:01.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:01.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:01.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:44:01.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:01.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: Reconfiguring mon.smithi049 (monmap changed)... 2023-12-16T07:44:01.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:44:01.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:44:01.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:01.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:01 smithi049 ceph-mon[217548]: Reconfiguring daemon mon.smithi049 on smithi049 2023-12-16T07:44:01.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: pgmap v11: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T07:44:01.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:01.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:01.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:01.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:44:01.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:01.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: Reconfiguring mon.smithi049 (monmap changed)... 2023-12-16T07:44:01.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:44:01.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:44:01.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:01.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:01 smithi133 ceph-mon[181557]: Reconfiguring daemon mon.smithi049 on smithi049 2023-12-16T07:44:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:02 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:02 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:02 smithi049 ceph-mon[217548]: Reconfiguring mgr.smithi049.rqlvwo (monmap changed)... 2023-12-16T07:44:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:02 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:44:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:02 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:44:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:02 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:02.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:02 smithi049 ceph-mon[217548]: Reconfiguring daemon mgr.smithi049.rqlvwo on smithi049 2023-12-16T07:44:02.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:02 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:02.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:02 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:02.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:02 smithi133 ceph-mon[181557]: Reconfiguring mgr.smithi049.rqlvwo (monmap changed)... 2023-12-16T07:44:02.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:02 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rqlvwo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:44:02.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:02 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:44:02.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:02 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:02.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:02 smithi133 ceph-mon[181557]: Reconfiguring daemon mgr.smithi049.rqlvwo on smithi049 2023-12-16T07:44:03.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: pgmap v12: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T07:44:03.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: Reconfiguring crash.smithi049 (monmap changed)... 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: Reconfiguring daemon crash.smithi049 on smithi049 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T07:44:03.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: pgmap v12: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-16T07:44:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: Reconfiguring crash.smithi049 (monmap changed)... 2023-12-16T07:44:03.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:03.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:03.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: Reconfiguring daemon crash.smithi049 on smithi049 2023-12-16T07:44:03.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:03.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T07:44:03.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:04.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:04 smithi049 ceph-mon[217548]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T07:44:04.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:04 smithi049 ceph-mon[217548]: Reconfiguring daemon osd.0 on smithi049 2023-12-16T07:44:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:04 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:04 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:04 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T07:44:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:04 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:04 smithi133 ceph-mon[181557]: Reconfiguring osd.0 (monmap changed)... 2023-12-16T07:44:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:04 smithi133 ceph-mon[181557]: Reconfiguring daemon osd.0 on smithi049 2023-12-16T07:44:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:04 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:04 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:04 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T07:44:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:04 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:05.776 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:05 smithi049 ceph-mon[217548]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:05.776 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:05 smithi049 ceph-mon[217548]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T07:44:05.776 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:05 smithi049 ceph-mon[217548]: Reconfiguring daemon osd.1 on smithi049 2023-12-16T07:44:05.776 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:05 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:05.776 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:05 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:05.776 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:05 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T07:44:05.776 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:05 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:05 smithi133 ceph-mon[181557]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:05 smithi133 ceph-mon[181557]: Reconfiguring osd.1 (monmap changed)... 2023-12-16T07:44:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:05 smithi133 ceph-mon[181557]: Reconfiguring daemon osd.1 on smithi049 2023-12-16T07:44:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:05 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:05 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:05 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T07:44:05.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:05 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:06.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.190+0000 7f9a05560700 1 -- 172.21.15.49:0/2176646612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 msgr2=0x7f9a000fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.190+0000 7f9a05560700 1 --2- 172.21.15.49:0/2176646612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a000fbfb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99f0004940 tx=0x7f99f0009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:06.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.191+0000 7f9a05560700 1 -- 172.21.15.49:0/2176646612 shutdown_connections 2023-12-16T07:44:06.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.191+0000 7f9a05560700 1 --2- 172.21.15.49:0/2176646612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a000fbfb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.191+0000 7f9a05560700 1 --2- 172.21.15.49:0/2176646612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00101b00 0x7f9a00101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.191+0000 7f9a05560700 1 -- 172.21.15.49:0/2176646612 >> 172.21.15.49:0/2176646612 conn(0x7f9a000f76c0 msgr2=0x7f9a000f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:06.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.191+0000 7f9a05560700 1 -- 172.21.15.49:0/2176646612 shutdown_connections 2023-12-16T07:44:06.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.191+0000 7f9a05560700 1 -- 172.21.15.49:0/2176646612 wait complete. 2023-12-16T07:44:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.191+0000 7f9a05560700 1 Processor -- start 2023-12-16T07:44:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f9a05560700 1 -- start start 2023-12-16T07:44:06.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f9a05560700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a0010e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f9a05560700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00101b00 0x7f9a0010eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f9a05560700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0010f230 con 0x7f9a000fbb40 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f9a05560700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0010f370 con 0x7f9a00101b00 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99feffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a0010e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99feffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a0010e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48262/0 (socket says 172.21.15.49:48262) 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99feffd700 1 -- 172.21.15.49:0/2739652750 learned_addr learned my addr 172.21.15.49:0/2739652750 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99fe7fc700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00101b00 0x7f9a0010eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99feffd700 1 -- 172.21.15.49:0/2739652750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00101b00 msgr2=0x7f9a0010eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99feffd700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00101b00 0x7f9a0010eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99feffd700 1 -- 172.21.15.49:0/2739652750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0005040 con 0x7f9a000fbb40 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.192+0000 7f99feffd700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a0010e760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99f4002a50 tx=0x7f99f40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.193+0000 7f99e77fe700 1 -- 172.21.15.49:0/2739652750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99f4007cc0 con 0x7f9a000fbb40 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.193+0000 7f99e77fe700 1 -- 172.21.15.49:0/2739652750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99f400f040 con 0x7f9a000fbb40 2023-12-16T07:44:06.194 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.193+0000 7f99e77fe700 1 -- 172.21.15.49:0/2739652750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99f400d9c0 con 0x7f9a000fbb40 2023-12-16T07:44:06.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.193+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a001176d0 con 0x7f9a000fbb40 2023-12-16T07:44:06.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.193+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a00117be0 con 0x7f9a000fbb40 2023-12-16T07:44:06.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.194+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a00103fb0 con 0x7f9a000fbb40 2023-12-16T07:44:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.194+0000 7f99e77fe700 1 -- 172.21.15.49:0/2739652750 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f99f400db20 con 0x7f9a000fbb40 2023-12-16T07:44:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.195+0000 7f99e77fe700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f99e806cf80 0x7f99e806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.195+0000 7f99e77fe700 1 -- 172.21.15.49:0/2739652750 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f99f408c270 con 0x7f9a000fbb40 2023-12-16T07:44:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.195+0000 7f99fe7fc700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f99e806cf80 0x7f99e806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.195+0000 7f99fe7fc700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f99e806cf80 0x7f99e806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a000666c0 tx=0x7f99f0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.200+0000 7f99e77fe700 1 -- 172.21.15.49:0/2739652750 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f99f4055f30 con 0x7f9a000fbb40 2023-12-16T07:44:06.427 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.427+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a00066400 con 0x7f99e806cf80 2023-12-16T07:44:06.429 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.429+0000 7f99e77fe700 1 -- 172.21.15.49:0/2739652750 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9a00066400 con 0x7f99e806cf80 2023-12-16T07:44:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f99e806cf80 msgr2=0x7f99e806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f99e806cf80 0x7f99e806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a000666c0 tx=0x7f99f0009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 msgr2=0x7f9a0010e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a0010e760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99f4002a50 tx=0x7f99f40046b0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 shutdown_connections 2023-12-16T07:44:06.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f99e806cf80 0x7f99e806f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a000fbb40 0x7f9a0010e760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 --2- 172.21.15.49:0/2739652750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a00101b00 0x7f9a0010eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 >> 172.21.15.49:0/2739652750 conn(0x7f9a000f76c0 msgr2=0x7f9a000f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:06.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 shutdown_connections 2023-12-16T07:44:06.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.431+0000 7f9a05560700 1 -- 172.21.15.49:0/2739652750 wait complete. 2023-12-16T07:44:06.443 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:44:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/3279203399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 msgr2=0x7f9e78102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/3279203399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78102fd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e68004940 tx=0x7f9e68009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/3279203399 shutdown_connections 2023-12-16T07:44:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/3279203399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e781035a0 0x7f9e780fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/3279203399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78102fd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/3279203399 >> 172.21.15.49:0/3279203399 conn(0x7f9e780f8790 msgr2=0x7f9e780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/3279203399 shutdown_connections 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.541+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/3279203399 wait complete. 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7f2c0700 1 Processor -- start 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7f2c0700 1 -- start start 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7f2c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7f2c0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e781035a0 0x7f9e78113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7f2c0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e781141e0 con 0x7f9e78102c00 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7f2c0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7810d4d0 con 0x7f9e781035a0 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7d05c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7d05c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48280/0 (socket says 172.21.15.49:48280) 2023-12-16T07:44:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7d05c700 1 -- 172.21.15.49:0/1783824527 learned_addr learned my addr 172.21.15.49:0/1783824527 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7c85b700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e781035a0 0x7f9e78113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7d05c700 1 -- 172.21.15.49:0/1783824527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e781035a0 msgr2=0x7f9e78113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7d05c700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e781035a0 0x7f9e78113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.542+0000 7f9e7d05c700 1 -- 172.21.15.49:0/1783824527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68005040 con 0x7f9e78102c00 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.543+0000 7f9e7d05c700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78113610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b3b0 tx=0x7f9e68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.543+0000 7f9e6dffb700 1 -- 172.21.15.49:0/1783824527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6800e040 con 0x7f9e78102c00 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.543+0000 7f9e6dffb700 1 -- 172.21.15.49:0/1783824527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e6800bc50 con 0x7f9e78102c00 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.543+0000 7f9e6dffb700 1 -- 172.21.15.49:0/1783824527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e68013420 con 0x7f9e78102c00 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.543+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7810d700 con 0x7f9e78102c00 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.543+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7810dc40 con 0x7f9e78102c00 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.544+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e780fff10 con 0x7f9e78102c00 2023-12-16T07:44:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.544+0000 7f9e6dffb700 1 -- 172.21.15.49:0/1783824527 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f9e6801c430 con 0x7f9e78102c00 2023-12-16T07:44:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.545+0000 7f9e6dffb700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9e6406cf80 0x7f9e6406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.545+0000 7f9e6dffb700 1 -- 172.21.15.49:0/1783824527 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9e6808d2f0 con 0x7f9e78102c00 2023-12-16T07:44:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.545+0000 7f9e7c85b700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9e6406cf80 0x7f9e6406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.545+0000 7f9e7c85b700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9e6406cf80 0x7f9e6406f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e7810eeb0 tx=0x7f9e7400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:06.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.550+0000 7f9e6dffb700 1 -- 172.21.15.49:0/1783824527 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9e6805ab70 con 0x7f9e78102c00 2023-12-16T07:44:06.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:06 smithi049 ceph-mon[217548]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T07:44:06.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:06 smithi049 ceph-mon[217548]: Reconfiguring daemon osd.2 on smithi049 2023-12-16T07:44:06.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:06.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:06.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ekquzl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:06.737 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:06.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.782+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e7804bbf0 con 0x7f9e6406cf80 2023-12-16T07:44:06.783 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.783+0000 7f9e6dffb700 1 -- 172.21.15.49:0/1783824527 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9e7804bbf0 con 0x7f9e6406cf80 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9e6406cf80 msgr2=0x7f9e6406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9e6406cf80 0x7f9e6406f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e7810eeb0 tx=0x7f9e7400b040 comp rx=0 tx=0).stop 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 msgr2=0x7f9e78113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78113610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b3b0 tx=0x7f9e68009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 shutdown_connections 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9e6406cf80 0x7f9e6406f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e78102c00 0x7f9e78113610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 --2- 172.21.15.49:0/1783824527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e781035a0 0x7f9e78113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 >> 172.21.15.49:0/1783824527 conn(0x7f9e780f8790 msgr2=0x7f9e780fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.785+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 shutdown_connections 2023-12-16T07:44:06.786 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.786+0000 7f9e7f2c0700 1 -- 172.21.15.49:0/1783824527 wait complete. 2023-12-16T07:44:06.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:06 smithi133 ceph-mon[181557]: Reconfiguring osd.2 (monmap changed)... 2023-12-16T07:44:06.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:06 smithi133 ceph-mon[181557]: Reconfiguring daemon osd.2 on smithi049 2023-12-16T07:44:06.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:06.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:06.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ekquzl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:06.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:06.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/3299176531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a58104e10 msgr2=0x7f4a581051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/3299176531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a58104e10 0x7f4a581051e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004940 tx=0x7f4a54009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/3299176531 shutdown_connections 2023-12-16T07:44:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/3299176531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a581057b0 0x7f4a580fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/3299176531 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a58104e10 0x7f4a581051e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/3299176531 >> 172.21.15.49:0/3299176531 conn(0x7f4a580fa960 msgr2=0x7f4a580fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/3299176531 shutdown_connections 2023-12-16T07:44:06.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.892+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/3299176531 wait complete. 2023-12-16T07:44:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5f4fe700 1 Processor -- start 2023-12-16T07:44:06.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5f4fe700 1 -- start start 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5f4fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a58104e10 0x7f4a581158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5f4fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a581057b0 0x7f4a58115e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5f4fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58116480 con 0x7f4a581057b0 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5f4fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5810f7b0 con 0x7f4a58104e10 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5ca99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a581057b0 0x7f4a58115e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5ca99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a581057b0 0x7f4a58115e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48306/0 (socket says 172.21.15.49:48306) 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5ca99700 1 -- 172.21.15.49:0/2996404926 learned_addr learned my addr 172.21.15.49:0/2996404926 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.893+0000 7f4a5d29a700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a58104e10 0x7f4a581158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a5ca99700 1 -- 172.21.15.49:0/2996404926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a58104e10 msgr2=0x7f4a581158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a5ca99700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a58104e10 0x7f4a581158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a5ca99700 1 -- 172.21.15.49:0/2996404926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54005040 con 0x7f4a581057b0 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a5d29a700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a58104e10 0x7f4a581158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a5ca99700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a581057b0 0x7f4a58115e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c890 tx=0x7f4a480044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:06.895 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a4dffb700 1 -- 172.21.15.49:0/2996404926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a4800a7d0 con 0x7f4a581057b0 2023-12-16T07:44:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a4dffb700 1 -- 172.21.15.49:0/2996404926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a4800ade0 con 0x7f4a581057b0 2023-12-16T07:44:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5810fa90 con 0x7f4a581057b0 2023-12-16T07:44:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a4dffb700 1 -- 172.21.15.49:0/2996404926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a480113a0 con 0x7f4a581057b0 2023-12-16T07:44:06.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.894+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5810ffd0 con 0x7f4a581057b0 2023-12-16T07:44:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.895+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58102120 con 0x7f4a581057b0 2023-12-16T07:44:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.896+0000 7f4a4dffb700 1 -- 172.21.15.49:0/2996404926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f4a4800a930 con 0x7f4a581057b0 2023-12-16T07:44:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.896+0000 7f4a4dffb700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f4a4406cf80 0x7f4a4406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.896+0000 7f4a4dffb700 1 -- 172.21.15.49:0/2996404926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4a4808c410 con 0x7f4a581057b0 2023-12-16T07:44:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.897+0000 7f4a5d29a700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f4a4406cf80 0x7f4a4406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:06.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.897+0000 7f4a5d29a700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f4a4406cf80 0x7f4a4406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004f90 tx=0x7f4a54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:06.901 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:06.901+0000 7f4a4dffb700 1 -- 172.21.15.49:0/2996404926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f4a48059d90 con 0x7f4a581057b0 2023-12-16T07:44:07.118 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.118+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a5810bdd0 con 0x7f4a4406cf80 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.129+0000 7f4a4dffb700 1 -- 172.21.15.49:0/2996404926 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4a5810bdd0 con 0x7f4a4406cf80 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (101s) 19s ago 9m 17.4M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 19s ago 9m 7440k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 e8517b177034 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (8m) 10s ago 8m 7486k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 5f046b93795a 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (91s) 19s ago 9m 86.2M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (5m) 19s ago 5m 14.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:44:07.129 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (5m) 19s ago 5m 15.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (5m) 10s ago 5m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (5m) 10s ago 5m 18.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (2m) 19s ago 10m 478M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (2m) 10s ago 8m 446M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (31s) 19s ago 10m 28.9M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (12s) 10s ago 8m 26.0M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (2m) 19s ago 9m 17.0M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (2m) 10s ago 8m 17.6M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (8m) 19s ago 8m 880M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 2fe7b6b95773 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 19s ago 7m 931M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 19s ago 7m 765M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (7m) 10s ago 7m 1116M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (7m) 10s ago 7m 830M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (6m) 10s ago 6m 939M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:44:07.130 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (113s) 19s ago 9m 56.2M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:44:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f4a4406cf80 msgr2=0x7f4a4406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f4a4406cf80 0x7f4a4406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004f90 tx=0x7f4a54009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a581057b0 msgr2=0x7f4a58115e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a581057b0 0x7f4a58115e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c890 tx=0x7f4a480044c0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 shutdown_connections 2023-12-16T07:44:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a58104e10 0x7f4a581158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f4a4406cf80 0x7f4a4406f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 --2- 172.21.15.49:0/2996404926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a581057b0 0x7f4a58115e30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 >> 172.21.15.49:0/2996404926 conn(0x7f4a580fa960 msgr2=0x7f4a580fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 shutdown_connections 2023-12-16T07:44:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.131+0000 7f4a5f4fe700 1 -- 172.21.15.49:0/2996404926 wait complete. 2023-12-16T07:44:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/378307804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 msgr2=0x7f5fb0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/378307804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb0065800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c004940 tx=0x7f5f9c009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/378307804 shutdown_connections 2023-12-16T07:44:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/378307804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb0065800 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/378307804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb0102c20 0x7f5fb0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/378307804 >> 172.21.15.49:0/378307804 conn(0x7f5fb00719b0 msgr2=0x7f5fb0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/378307804 shutdown_connections 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.234+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/378307804 wait complete. 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb6e0c700 1 Processor -- start 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb6e0c700 1 -- start start 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb6e0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb6e0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb0102c20 0x7f5fb00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb6e0c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00fc6c0 con 0x7f5fb0065390 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb6e0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00fc830 con 0x7f5fb0102c20 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb4ba8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb4ba8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb00fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48326/0 (socket says 172.21.15.49:48326) 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.235+0000 7f5fb4ba8700 1 -- 172.21.15.49:0/660235884 learned_addr learned my addr 172.21.15.49:0/660235884 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5faffff700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb0102c20 0x7f5fb00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fb4ba8700 1 -- 172.21.15.49:0/660235884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb0102c20 msgr2=0x7f5fb00fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fb4ba8700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb0102c20 0x7f5fb00fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fb4ba8700 1 -- 172.21.15.49:0/660235884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c005040 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fb4ba8700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb00fbbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c8c0 tx=0x7f5fa40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fad7fa700 1 -- 172.21.15.49:0/660235884 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa400a760 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fad7fa700 1 -- 172.21.15.49:0/660235884 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5fa400ad70 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb0119970 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fad7fa700 1 -- 172.21.15.49:0/660235884 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa40113a0 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.236+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb0119dd0 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.237+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00fff40 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.238+0000 7f5fad7fa700 1 -- 172.21.15.49:0/660235884 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f5fa4012400 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.238+0000 7f5fad7fa700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5fa006cf80 0x7f5fa006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.238+0000 7f5fad7fa700 1 -- 172.21.15.49:0/660235884 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5fa408c390 con 0x7f5fb0065390 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.238+0000 7f5faffff700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5fa006cf80 0x7f5fa006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.238+0000 7f5faffff700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5fa006cf80 0x7f5fa006f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00b3b0 tx=0x7f5f9c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:07.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.243+0000 7f5fad7fa700 1 -- 172.21.15.49:0/660235884 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f5fa4056280 con 0x7f5fb0065390 2023-12-16T07:44:07.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.545+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5fb00fd330 con 0x7f5fb0065390 2023-12-16T07:44:07.546 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.546+0000 7f5fad7fa700 1 -- 172.21.15.49:0/660235884 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7f5fa40598a0 con 0x7f5fb0065390 2023-12-16T07:44:07.546 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:44:07.546 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:44:07.546 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:44:07.546 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:07.546 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 10, 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:44:07.547 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:44:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5fa006cf80 msgr2=0x7f5fa006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5fa006cf80 0x7f5fa006f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00b3b0 tx=0x7f5f9c009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 msgr2=0x7f5fb00fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb00fbbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c8c0 tx=0x7f5fa40044c0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 shutdown_connections 2023-12-16T07:44:07.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5fa006cf80 0x7f5fa006f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fb0065390 0x7f5fb00fbbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 --2- 172.21.15.49:0/660235884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb0102c20 0x7f5fb00fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 >> 172.21.15.49:0/660235884 conn(0x7f5fb00719b0 msgr2=0x7f5fb00fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 shutdown_connections 2023-12-16T07:44:07.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.548+0000 7f5fb6e0c700 1 -- 172.21.15.49:0/660235884 wait complete. 2023-12-16T07:44:07.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 -- 172.21.15.49:0/810694065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 msgr2=0x7fb168101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/810694065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 0x7fb168101ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb158004940 tx=0x7fb158009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:07.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 -- 172.21.15.49:0/810694065 shutdown_connections 2023-12-16T07:44:07.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/810694065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 0x7fb1680fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.665 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/810694065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 0x7fb168101ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 -- 172.21.15.49:0/810694065 >> 172.21.15.49:0/810694065 conn(0x7fb1680f76c0 msgr2=0x7fb1680f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 -- 172.21.15.49:0/810694065 shutdown_connections 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 -- 172.21.15.49:0/810694065 wait complete. 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.663+0000 7fb16dcdd700 1 Processor -- start 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb16dcdd700 1 -- start start 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb16dcdd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 0x7fb168113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb16dcdd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 0x7fb168113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb16dcdd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168114220 con 0x7fb168101b00 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb16dcdd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16810d510 con 0x7fb1680fbb40 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 0x7fb168113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 0x7fb168113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.49:42798/0 (socket says 172.21.15.49:42798) 2023-12-16T07:44:07.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb1677fe700 1 -- 172.21.15.49:0/2927142674 learned_addr learned my addr 172.21.15.49:0/2927142674 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb166ffd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 0x7fb168113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb166ffd700 1 -- 172.21.15.49:0/2927142674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 msgr2=0x7fb168113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb166ffd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 0x7fb168113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb166ffd700 1 -- 172.21.15.49:0/2927142674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158005040 con 0x7fb168101b00 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.664+0000 7fb1677fe700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 0x7fb168113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.665+0000 7fb166ffd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 0x7fb168113bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb150002820 tx=0x7fb150004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.665+0000 7fb15ffff700 1 -- 172.21.15.49:0/2927142674 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb150007cc0 con 0x7fb168101b00 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.665+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16810d7f0 con 0x7fb168101b00 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.665+0000 7fb15ffff700 1 -- 172.21.15.49:0/2927142674 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb15000f040 con 0x7fb168101b00 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.665+0000 7fb15ffff700 1 -- 172.21.15.49:0/2927142674 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1500137d0 con 0x7fb168101b00 2023-12-16T07:44:07.667 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.665+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16810dd30 con 0x7fb168101b00 2023-12-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.666+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb168113320 con 0x7fb168101b00 2023-12-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.667+0000 7fb15ffff700 1 -- 172.21.15.49:0/2927142674 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fb150013a50 con 0x7fb168101b00 2023-12-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.667+0000 7fb15ffff700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb15406cf80 0x7fb15406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.667+0000 7fb15ffff700 1 -- 172.21.15.49:0/2927142674 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb15008c840 con 0x7fb168101b00 2023-12-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.667+0000 7fb1677fe700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb15406cf80 0x7fb15406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.668+0000 7fb1677fe700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb15406cf80 0x7fb15406f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb158004560 tx=0x7fb158009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:07.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.671+0000 7fb15ffff700 1 -- 172.21.15.49:0/2927142674 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb15005a010 con 0x7fb168101b00 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: pgmap v14: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: Reconfiguring mds.cephfs.smithi049.ekquzl (monmap changed)... 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: Reconfiguring daemon mds.cephfs.smithi049.ekquzl on smithi049 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.eyimyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:07.736 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:07.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: pgmap v14: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:07.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: Reconfiguring mds.cephfs.smithi049.ekquzl (monmap changed)... 2023-12-16T07:44:07.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: Reconfiguring daemon mds.cephfs.smithi049.ekquzl on smithi049 2023-12-16T07:44:07.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:07.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:07.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:07.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.eyimyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:07.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:07.929 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.929+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb168108ab0 con 0x7fb168101b00 2023-12-16T07:44:07.930 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.929+0000 7fb15ffff700 1 -- 172.21.15.49:0/2927142674 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1847 (secure 0 0 0) 0x7fb168108ab0 con 0x7fb168101b00 2023-12-16T07:44:07.930 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:44:07.930 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:44:07.930 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:44:07.931 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:44:07.932 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:44:07.933 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:07.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:07.935 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:44:07.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:07.935 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:07.935 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:07.935 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb15406cf80 msgr2=0x7fb15406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb15406cf80 0x7fb15406f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb158004560 tx=0x7fb158009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 msgr2=0x7fb168113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 0x7fb168113bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb150002820 tx=0x7fb150004570 comp rx=0 tx=0).stop 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 shutdown_connections 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680fbb40 0x7fb168113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb15406cf80 0x7fb15406f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 --2- 172.21.15.49:0/2927142674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb168101b00 0x7fb168113bd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.931+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 >> 172.21.15.49:0/2927142674 conn(0x7fb1680f76c0 msgr2=0x7fb168065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:07.936 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.932+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 shutdown_connections 2023-12-16T07:44:07.937 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:07.932+0000 7fb16dcdd700 1 -- 172.21.15.49:0/2927142674 wait complete. 2023-12-16T07:44:07.937 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/3065156629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e54101b00 msgr2=0x7f6e54101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/3065156629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e54101b00 0x7f6e54101ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e44004940 tx=0x7f6e44009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/3065156629 shutdown_connections 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/3065156629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540fbb40 0x7f6e540fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/3065156629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e54101b00 0x7f6e54101ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/3065156629 >> 172.21.15.49:0/3065156629 conn(0x7f6e540719b0 msgr2=0x7f6e54071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/3065156629 shutdown_connections 2023-12-16T07:44:08.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.040+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/3065156629 wait complete. 2023-12-16T07:44:08.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.041+0000 7f6e5c2c3700 1 Processor -- start 2023-12-16T07:44:08.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.041+0000 7f6e5c2c3700 1 -- start start 2023-12-16T07:44:08.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.041+0000 7f6e5c2c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e540fbb40 0x7f6e54112550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.041+0000 7f6e5c2c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e54101b00 0x7f6e54112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.041+0000 7f6e5c2c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e541130e0 con 0x7f6e540fbb40 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.041+0000 7f6e5c2c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5410c410 con 0x7f6e54101b00 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5a05f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e540fbb40 0x7f6e54112550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5a05f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e540fbb40 0x7f6e54112550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48844/0 (socket says 172.21.15.49:48844) 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5a05f700 1 -- 172.21.15.49:0/4175888632 learned_addr learned my addr 172.21.15.49:0/4175888632 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5985e700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e54101b00 0x7f6e54112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5a05f700 1 -- 172.21.15.49:0/4175888632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e54101b00 msgr2=0x7f6e54112a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5a05f700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e54101b00 0x7f6e54112a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5a05f700 1 -- 172.21.15.49:0/4175888632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44005040 con 0x7f6e540fbb40 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5a05f700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e540fbb40 0x7f6e54112550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400b3b0 tx=0x7f6e44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e4affd700 1 -- 172.21.15.49:0/4175888632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4400e040 con 0x7f6e540fbb40 2023-12-16T07:44:08.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e4affd700 1 -- 172.21.15.49:0/4175888632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e44009af0 con 0x7f6e540fbb40 2023-12-16T07:44:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5410c690 con 0x7f6e540fbb40 2023-12-16T07:44:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e4affd700 1 -- 172.21.15.49:0/4175888632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e44013660 con 0x7f6e540fbb40 2023-12-16T07:44:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.042+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5410cbd0 con 0x7f6e540fbb40 2023-12-16T07:44:08.045 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.043+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e540734d0 con 0x7f6e540fbb40 2023-12-16T07:44:08.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.044+0000 7f6e4affd700 1 -- 172.21.15.49:0/4175888632 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f6e440138e0 con 0x7f6e540fbb40 2023-12-16T07:44:08.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.044+0000 7f6e4affd700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f6e4006cf80 0x7f6e4006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:08.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.044+0000 7f6e4affd700 1 -- 172.21.15.49:0/4175888632 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6e44090080 con 0x7f6e540fbb40 2023-12-16T07:44:08.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.044+0000 7f6e5985e700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f6e4006cf80 0x7f6e4006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:08.046 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.045+0000 7f6e5985e700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f6e4006cf80 0x7f6e4006f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e5410ddf0 tx=0x7f6e5000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:08.049 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.049+0000 7f6e4affd700 1 -- 172.21.15.49:0/4175888632 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6e4405d7d0 con 0x7f6e540fbb40 2023-12-16T07:44:08.273 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.273+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e5410dbc0 con 0x7f6e4006cf80 2023-12-16T07:44:08.274 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.274+0000 7f6e4affd700 1 -- 172.21.15.49:0/4175888632 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6e5410dbc0 con 0x7f6e4006cf80 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "4/21 daemons upgraded", 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mon daemons", 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:44:08.275 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:44:08.276 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f6e4006cf80 msgr2=0x7f6e4006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f6e4006cf80 0x7f6e4006f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e5410ddf0 tx=0x7f6e5000b040 comp rx=0 tx=0).stop 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e540fbb40 msgr2=0x7f6e54112550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e540fbb40 0x7f6e54112550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400b3b0 tx=0x7f6e44009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 shutdown_connections 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f6e4006cf80 0x7f6e4006f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e540fbb40 0x7f6e54112550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 --2- 172.21.15.49:0/4175888632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e54101b00 0x7f6e54112a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 >> 172.21.15.49:0/4175888632 conn(0x7f6e540719b0 msgr2=0x7f6e540fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 shutdown_connections 2023-12-16T07:44:08.277 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.276+0000 7f6e5c2c3700 1 -- 172.21.15.49:0/4175888632 wait complete. 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 -- 172.21.15.49:0/3962835508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 msgr2=0x7f8248101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 --2- 172.21.15.49:0/3962835508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f8248101ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f823c004940 tx=0x7f823c009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 -- 172.21.15.49:0/3962835508 shutdown_connections 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 --2- 172.21.15.49:0/3962835508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82480fbb40 0x7f82480fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 --2- 172.21.15.49:0/3962835508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f8248101ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 -- 172.21.15.49:0/3962835508 >> 172.21.15.49:0/3962835508 conn(0x7f82480719b0 msgr2=0x7f8248071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 -- 172.21.15.49:0/3962835508 shutdown_connections 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.380+0000 7f824ebe9700 1 -- 172.21.15.49:0/3962835508 wait complete. 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f824ebe9700 1 Processor -- start 2023-12-16T07:44:08.381 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f824ebe9700 1 -- start start 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f824ebe9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82480fbb40 0x7f824810c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f824ebe9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f824810c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f824ebe9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824810ccf0 con 0x7f8248101b00 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f824ebe9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824810ce30 con 0x7f82480fbb40 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f8247fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f824810c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f8247fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f824810c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48866/0 (socket says 172.21.15.49:48866) 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f8247fff700 1 -- 172.21.15.49:0/680854395 learned_addr learned my addr 172.21.15.49:0/680854395 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.381+0000 7f824c985700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82480fbb40 0x7f824810c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f8247fff700 1 -- 172.21.15.49:0/680854395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82480fbb40 msgr2=0x7f824810c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.383 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f8247fff700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82480fbb40 0x7f824810c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f8247fff700 1 -- 172.21.15.49:0/680854395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c005040 con 0x7f8248101b00 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f8247fff700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f824810c7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8234002a80 tx=0x7f82340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f82457fa700 1 -- 172.21.15.49:0/680854395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8234007cc0 con 0x7f8248101b00 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f82457fa700 1 -- 172.21.15.49:0/680854395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f823400f040 con 0x7f8248101b00 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82481198e0 con 0x7f8248101b00 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f82457fa700 1 -- 172.21.15.49:0/680854395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823400da60 con 0x7f8248101b00 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.382+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8248119ce0 con 0x7f8248101b00 2023-12-16T07:44:08.384 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.383+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8248103fb0 con 0x7f8248101b00 2023-12-16T07:44:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.384+0000 7f82457fa700 1 -- 172.21.15.49:0/680854395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f823400dbc0 con 0x7f8248101b00 2023-12-16T07:44:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.385+0000 7f82457fa700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f823806cf80 0x7f823806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.385+0000 7f82457fa700 1 -- 172.21.15.49:0/680854395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f823408c7b0 con 0x7f8248101b00 2023-12-16T07:44:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.385+0000 7f824c985700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f823806cf80 0x7f823806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:08.385 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.385+0000 7f824c985700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f823806cf80 0x7f823806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f823c0043d0 tx=0x7f823c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:08.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.389+0000 7f82457fa700 1 -- 172.21.15.49:0/680854395 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f8234056450 con 0x7f8248101b00 2023-12-16T07:44:08.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.676+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8248073520 con 0x7f8248101b00 2023-12-16T07:44:08.676 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.676+0000 7f82457fa700 1 -- 172.21.15.49:0/680854395 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8234059a70 con 0x7f8248101b00 2023-12-16T07:44:08.676 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:44:08.677 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:44:08.677 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:44:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f823806cf80 msgr2=0x7f823806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f823806cf80 0x7f823806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f823c0043d0 tx=0x7f823c009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 msgr2=0x7f824810c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f824810c7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8234002a80 tx=0x7f82340046b0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 shutdown_connections 2023-12-16T07:44:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82480fbb40 0x7f824810c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f823806cf80 0x7f823806f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 --2- 172.21.15.49:0/680854395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8248101b00 0x7f824810c7b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 >> 172.21.15.49:0/680854395 conn(0x7f82480719b0 msgr2=0x7f82480faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 shutdown_connections 2023-12-16T07:44:08.680 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:08.678+0000 7f824ebe9700 1 -- 172.21.15.49:0/680854395 wait complete. 2023-12-16T07:44:08.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:08.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:08.850 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: Reconfiguring mds.cephfs.smithi049.eyimyr (monmap changed)... 2023-12-16T07:44:08.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: Reconfiguring daemon mds.cephfs.smithi049.eyimyr on smithi049 2023-12-16T07:44:08.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/660235884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:08.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2927142674' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:44:08.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:08.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:08.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:08.851 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:08 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: Reconfiguring mds.cephfs.smithi049.eyimyr (monmap changed)... 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: Reconfiguring daemon mds.cephfs.smithi049.eyimyr on smithi049 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/660235884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2927142674' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:08.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:08.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:08 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:09.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: pgmap v15: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:09.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: Reconfiguring crash.smithi133 (monmap changed)... 2023-12-16T07:44:09.773 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: Reconfiguring daemon crash.smithi133 on smithi133 2023-12-16T07:44:09.774 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:09.774 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/680854395' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:44:09.774 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:09.774 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:09.774 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:44:09.774 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:44:09.774 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:09 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: pgmap v15: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: Reconfiguring crash.smithi133 (monmap changed)... 2023-12-16T07:44:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: Reconfiguring daemon crash.smithi133 on smithi133 2023-12-16T07:44:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/680854395' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:44:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.wbiduk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-16T07:44:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-16T07:44:09.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:09 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:10.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:10 smithi133 ceph-mon[181557]: Reconfiguring mgr.smithi133.wbiduk (monmap changed)... 2023-12-16T07:44:10.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:10 smithi133 ceph-mon[181557]: Reconfiguring daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:44:10.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:10.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:10.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:44:10.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:44:10.749 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:10.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:10 smithi049 ceph-mon[217548]: Reconfiguring mgr.smithi133.wbiduk (monmap changed)... 2023-12-16T07:44:10.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:10 smithi049 ceph-mon[217548]: Reconfiguring daemon mgr.smithi133.wbiduk on smithi133 2023-12-16T07:44:10.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:10.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:10.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-16T07:44:10.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-16T07:44:10.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:11.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:11 smithi133 ceph-mon[181557]: pgmap v16: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:11.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:11 smithi133 ceph-mon[181557]: Reconfiguring mon.smithi133 (monmap changed)... 2023-12-16T07:44:11.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:11 smithi133 ceph-mon[181557]: Reconfiguring daemon mon.smithi133 on smithi133 2023-12-16T07:44:11.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:11 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:11.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:11 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:11.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:11 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T07:44:11.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:11 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:11 smithi049 ceph-mon[217548]: pgmap v16: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:11 smithi049 ceph-mon[217548]: Reconfiguring mon.smithi133 (monmap changed)... 2023-12-16T07:44:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:11 smithi049 ceph-mon[217548]: Reconfiguring daemon mon.smithi133 on smithi133 2023-12-16T07:44:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:11 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:11 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:11 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T07:44:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:11 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:12.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:12 smithi133 ceph-mon[181557]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T07:44:12.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:12 smithi133 ceph-mon[181557]: Reconfiguring daemon osd.3 on smithi133 2023-12-16T07:44:12.803 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:12 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:12.804 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:12 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:12.804 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:12 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T07:44:12.804 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:12 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:12.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:12 smithi049 ceph-mon[217548]: Reconfiguring osd.3 (monmap changed)... 2023-12-16T07:44:12.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:12 smithi049 ceph-mon[217548]: Reconfiguring daemon osd.3 on smithi133 2023-12-16T07:44:12.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:12 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:12.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:12 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:12.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:12 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T07:44:12.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:12 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:13.810 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:13 smithi133 ceph-mon[181557]: pgmap v17: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:13.810 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:13 smithi133 ceph-mon[181557]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T07:44:13.810 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:13 smithi133 ceph-mon[181557]: Reconfiguring daemon osd.4 on smithi133 2023-12-16T07:44:13.811 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:13.811 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:13.811 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T07:44:13.811 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:13 smithi049 ceph-mon[217548]: pgmap v17: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:13 smithi049 ceph-mon[217548]: Reconfiguring osd.4 (monmap changed)... 2023-12-16T07:44:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:13 smithi049 ceph-mon[217548]: Reconfiguring daemon osd.4 on smithi133 2023-12-16T07:44:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T07:44:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:14.796 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:14 smithi133 ceph-mon[181557]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T07:44:14.796 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:14 smithi133 ceph-mon[181557]: Reconfiguring daemon osd.5 on smithi133 2023-12-16T07:44:14.796 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:14.796 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:14.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:14.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.takfuo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:14.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:14 smithi049 ceph-mon[217548]: Reconfiguring osd.5 (monmap changed)... 2023-12-16T07:44:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:14 smithi049 ceph-mon[217548]: Reconfiguring daemon osd.5 on smithi133 2023-12-16T07:44:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.takfuo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:14.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:15.768 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:15 smithi133 ceph-mon[181557]: pgmap v18: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:15.769 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:15 smithi133 ceph-mon[181557]: Reconfiguring mds.cephfs.smithi133.takfuo (monmap changed)... 2023-12-16T07:44:15.769 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:15 smithi133 ceph-mon[181557]: Reconfiguring daemon mds.cephfs.smithi133.takfuo on smithi133 2023-12-16T07:44:15.769 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:15 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:15.769 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:15 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:15.769 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:15 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.uedvhy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:15.769 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:15 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:15.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:15 smithi049 ceph-mon[217548]: pgmap v18: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:15.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:15 smithi049 ceph-mon[217548]: Reconfiguring mds.cephfs.smithi133.takfuo (monmap changed)... 2023-12-16T07:44:15.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:15 smithi049 ceph-mon[217548]: Reconfiguring daemon mds.cephfs.smithi133.takfuo on smithi133 2023-12-16T07:44:15.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:15 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:15 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:15 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.uedvhy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-16T07:44:15.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:15 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: Reconfiguring mds.cephfs.smithi133.uedvhy (monmap changed)... 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: Reconfiguring daemon mds.cephfs.smithi133.uedvhy on smithi133 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]: dispatch 2023-12-16T07:44:16.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]': finished 2023-12-16T07:44:16.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]: dispatch 2023-12-16T07:44:16.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:16 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]': finished 2023-12-16T07:44:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: Reconfiguring mds.cephfs.smithi133.uedvhy (monmap changed)... 2023-12-16T07:44:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: Reconfiguring daemon mds.cephfs.smithi133.uedvhy on smithi133 2023-12-16T07:44:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:16.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]: dispatch 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]': finished 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]: dispatch 2023-12-16T07:44:16.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:16 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]': finished 2023-12-16T07:44:17.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:17 smithi133 ceph-mon[181557]: pgmap v19: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:17.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:17 smithi133 ceph-mon[181557]: Upgrade: Setting container_image for all mon 2023-12-16T07:44:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:17 smithi049 ceph-mon[217548]: pgmap v19: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:17.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:17 smithi049 ceph-mon[217548]: Upgrade: Setting container_image for all mon 2023-12-16T07:44:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:18 smithi133 ceph-mon[181557]: Upgrade: Updating crash.smithi049 (1/2) 2023-12-16T07:44:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:18 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:18 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:18 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:18.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:18 smithi133 ceph-mon[181557]: Deploying daemon crash.smithi049 on smithi049 2023-12-16T07:44:18.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:18 smithi049 ceph-mon[217548]: Upgrade: Updating crash.smithi049 (1/2) 2023-12-16T07:44:18.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:18 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:18.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:18 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:18.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:18 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:18.910 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:18 smithi049 ceph-mon[217548]: Deploying daemon crash.smithi049 on smithi049 2023-12-16T07:44:19.601 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:19 smithi049 ceph-mon[217548]: pgmap v20: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:19.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:19 smithi133 ceph-mon[181557]: pgmap v20: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:20 smithi133 ceph-mon[181557]: pgmap v21: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:20 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:21.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:20 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:21.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:20 smithi049 ceph-mon[217548]: pgmap v21: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:21.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:20 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:21.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:20 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:22.113 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:21 smithi133 ceph-mon[181557]: Upgrade: Updating crash.smithi133 (2/2) 2023-12-16T07:44:22.113 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:21 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:22.113 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:21 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:22.113 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:21 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:22.113 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:21 smithi133 ceph-mon[181557]: Deploying daemon crash.smithi133 on smithi133 2023-12-16T07:44:22.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:21 smithi049 ceph-mon[217548]: Upgrade: Updating crash.smithi133 (2/2) 2023-12-16T07:44:22.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:21 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:22.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:21 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-16T07:44:22.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:21 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:22.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:21 smithi049 ceph-mon[217548]: Deploying daemon crash.smithi133 on smithi133 2023-12-16T07:44:23.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:23 smithi133 ceph-mon[181557]: pgmap v22: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:23.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:23 smithi049 ceph-mon[217548]: pgmap v22: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:24 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:24 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:24 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:24 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:24.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:24 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:24.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:24 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:24.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:24 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:24.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:24 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:24.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:24 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:24.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:24 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:25.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:25 smithi049 ceph-mon[217548]: pgmap v23: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:25.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:25 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:25.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:25 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:25 smithi133 ceph-mon[181557]: pgmap v23: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:25 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:25.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:25 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:26 smithi133 ceph-mon[181557]: pgmap v24: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:27.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:26 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:26 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:26 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:26 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:26 smithi049 ceph-mon[217548]: pgmap v24: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:27.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:26 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:26 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:26 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:27.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:26 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:28 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:28 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:28 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:28 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:28 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:28 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:28 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:28 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:29 smithi133 ceph-mon[181557]: pgmap v25: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:29.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:29 smithi049 ceph-mon[217548]: pgmap v25: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:29.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:31.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: pgmap v26: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:31.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: Upgrade: Setting container_image for all crash 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]: dispatch 2023-12-16T07:44:31.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]': finished 2023-12-16T07:44:31.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]: dispatch 2023-12-16T07:44:31.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]': finished 2023-12-16T07:44:31.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T07:44:31.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T07:44:31.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:30 smithi133 ceph-mon[181557]: Upgrade: osd.0 is safe to restart 2023-12-16T07:44:31.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: pgmap v26: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:31.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:31.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: Upgrade: Setting container_image for all crash 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]': finished 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]': finished 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-16T07:44:31.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:30 smithi049 ceph-mon[217548]: Upgrade: osd.0 is safe to restart 2023-12-16T07:44:32.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:31 smithi133 ceph-mon[181557]: Upgrade: Updating osd.0 2023-12-16T07:44:32.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:31 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:32.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:31 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T07:44:32.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:31 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:32.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:31 smithi133 ceph-mon[181557]: Deploying daemon osd.0 on smithi049 2023-12-16T07:44:32.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:31 smithi049 ceph-mon[217548]: Upgrade: Updating osd.0 2023-12-16T07:44:32.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:31 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:32.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:31 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-16T07:44:32.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:31 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:32.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:31 smithi049 ceph-mon[217548]: Deploying daemon osd.0 on smithi049 2023-12-16T07:44:33.130 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:33 smithi049 ceph-mon[217548]: pgmap v27: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:33.384 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:33 smithi133 ceph-mon[181557]: pgmap v27: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:33.459 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:33 smithi049 systemd[1]: Stopping Ceph osd.0 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:44:33.459 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:33 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[134901]: 2023-12-16T07:44:33.307+0000 7fcfc0018700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:44:33.459 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:33 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[134901]: 2023-12-16T07:44:33.307+0000 7fcfc0018700 -1 osd.0 48 *** Got signal Terminated *** 2023-12-16T07:44:33.459 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:33 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[134901]: 2023-12-16T07:44:33.307+0000 7fcfc0018700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:44:34.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:34 smithi133 ceph-mon[181557]: osd.0 marked itself down and dead 2023-12-16T07:44:34.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:34 smithi049 ceph-mon[217548]: osd.0 marked itself down and dead 2023-12-16T07:44:34.958 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:34 smithi049 bash[230562]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0 2023-12-16T07:44:35.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:35 smithi133 ceph-mon[181557]: pgmap v28: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:35.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:35 smithi133 ceph-mon[181557]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:44:35.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:35 smithi133 ceph-mon[181557]: failed to encode map e49 with expected crc 2023-12-16T07:44:35.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:35 smithi133 ceph-mon[181557]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T07:44:35.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:35 smithi049 ceph-mon[217548]: pgmap v28: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:35.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:35 smithi049 ceph-mon[217548]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:44:35.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:35 smithi049 ceph-mon[217548]: failed to encode map e49 with expected crc 2023-12-16T07:44:35.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:35 smithi049 ceph-mon[217548]: osdmap e49: 6 total, 5 up, 6 in 2023-12-16T07:44:36.064 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:35 smithi049 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.0.service: Succeeded. 2023-12-16T07:44:36.064 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:35 smithi049 systemd[1]: Stopped Ceph osd.0 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:44:36.064 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:35 smithi049 systemd[1]: Starting Ceph osd.0 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:44:36.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:36 smithi133 ceph-mon[181557]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:36 smithi133 ceph-mon[181557]: osdmap e50: 6 total, 5 up, 6 in 2023-12-16T07:44:36.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:36 smithi133 ceph-mon[181557]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:36 smithi133 ceph-mon[181557]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:36 smithi133 ceph-mon[181557]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:36 smithi133 ceph-mon[181557]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:36 smithi133 ceph-mon[181557]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:36 smithi049 ceph-mon[217548]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:36 smithi049 ceph-mon[217548]: osdmap e50: 6 total, 5 up, 6 in 2023-12-16T07:44:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:36 smithi049 ceph-mon[217548]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:36 smithi049 ceph-mon[217548]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:36 smithi049 ceph-mon[217548]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:36 smithi049 ceph-mon[217548]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:36 smithi049 ceph-mon[217548]: failed to encode map e50 with expected crc 2023-12-16T07:44:36.959 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:36 smithi049 bash[230826]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T07:44:36.959 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:36 smithi049 bash[230826]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T07:44:36.959 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:36 smithi049 bash[230826]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T07:44:36.960 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:36 smithi049 bash[230826]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T07:44:36.960 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:36 smithi049 bash[230826]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-16T07:44:36.960 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:36 smithi049 bash[230826]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T07:44:36.960 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:36 smithi049 bash[230826]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-16T07:44:37.316 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:37 smithi049 ceph-mon[217548]: pgmap v31: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:37.316 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:37 smithi049 ceph-mon[217548]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2023-12-16T07:44:37.316 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:37 smithi049 ceph-osd[231144]: -- 172.21.15.49:0/3923659102 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562bbd44f6c0 con 0x562bbd41ec00 2023-12-16T07:44:37.316 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:37 smithi049 bash[231106]: bb0cb3d699c6f64f367aed396ce8ac5cce03b54c81491a6ac568c095074406c0 2023-12-16T07:44:37.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:37 smithi133 ceph-mon[181557]: pgmap v31: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:37.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:37 smithi133 ceph-mon[181557]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2023-12-16T07:44:37.709 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:37 smithi049 systemd[1]: Started Ceph osd.0 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:44:38.209 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:37 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[231121]: 2023-12-16T07:44:37.844+0000 7f238f60b640 -1 Falling back to public interface 2023-12-16T07:44:38.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:38.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:38.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:38.659 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:38.659 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:38.659 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 -- 172.21.15.49:0/3232079850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4102c20 msgr2=0x7f9da4102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 --2- 172.21.15.49:0/3232079850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4102c20 0x7f9da4102ff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d98004940 tx=0x7f9d98009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 -- 172.21.15.49:0/3232079850 shutdown_connections 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 --2- 172.21.15.49:0/3232079850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da4065390 0x7f9da4065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 --2- 172.21.15.49:0/3232079850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4102c20 0x7f9da4102ff0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 -- 172.21.15.49:0/3232079850 >> 172.21.15.49:0/3232079850 conn(0x7f9da40719b0 msgr2=0x7f9da4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 -- 172.21.15.49:0/3232079850 shutdown_connections 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 -- 172.21.15.49:0/3232079850 wait complete. 2023-12-16T07:44:38.803 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 Processor -- start 2023-12-16T07:44:38.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.802+0000 7f9daad2d700 1 -- start start 2023-12-16T07:44:38.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9daad2d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4065390 0x7f9da4113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:38.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9daad2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da4102c20 0x7f9da4113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:38.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9daad2d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da4114220 con 0x7f9da4065390 2023-12-16T07:44:38.804 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9daad2d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da410d570 con 0x7f9da4102c20 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da8ac9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4065390 0x7f9da4113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da8ac9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4065390 0x7f9da4113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48136/0 (socket says 172.21.15.49:48136) 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da8ac9700 1 -- 172.21.15.49:0/2474993587 learned_addr learned my addr 172.21.15.49:0/2474993587 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da3fff700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da4102c20 0x7f9da4113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da8ac9700 1 -- 172.21.15.49:0/2474993587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da4102c20 msgr2=0x7f9da4113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da8ac9700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da4102c20 0x7f9da4113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da8ac9700 1 -- 172.21.15.49:0/2474993587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98005040 con 0x7f9da4065390 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.803+0000 7f9da8ac9700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4065390 0x7f9da4113690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009180 tx=0x7f9d98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.804+0000 7f9da17fa700 1 -- 172.21.15.49:0/2474993587 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d9800e040 con 0x7f9da4065390 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.804+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da410d7f0 con 0x7f9da4065390 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.804+0000 7f9da17fa700 1 -- 172.21.15.49:0/2474993587 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d98013420 con 0x7f9da4065390 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.804+0000 7f9da17fa700 1 -- 172.21.15.49:0/2474993587 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d9801c630 con 0x7f9da4065390 2023-12-16T07:44:38.806 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.804+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da410dd30 con 0x7f9da4065390 2023-12-16T07:44:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.805+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da40fff40 con 0x7f9da4065390 2023-12-16T07:44:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.805+0000 7f9da17fa700 1 -- 172.21.15.49:0/2474993587 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f9d980139e0 con 0x7f9da4065390 2023-12-16T07:44:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.805+0000 7f9da17fa700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d9406cf80 0x7f9d9406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.806+0000 7f9da17fa700 1 -- 172.21.15.49:0/2474993587 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9d9808d850 con 0x7f9da4065390 2023-12-16T07:44:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.806+0000 7f9da3fff700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d9406cf80 0x7f9d9406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:38.807 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.806+0000 7f9da3fff700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d9406cf80 0x7f9d9406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007fd0 tx=0x7f9d90009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:38.810 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:38.810+0000 7f9da17fa700 1 -- 172.21.15.49:0/2474993587 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9d9805b020 con 0x7f9da4065390 2023-12-16T07:44:39.061 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.061+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9da404bb80 con 0x7f9d9406cf80 2023-12-16T07:44:39.062 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.062+0000 7f9da17fa700 1 -- 172.21.15.49:0/2474993587 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9da404bb80 con 0x7f9d9406cf80 2023-12-16T07:44:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d9406cf80 msgr2=0x7f9d9406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d9406cf80 0x7f9d9406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007fd0 tx=0x7f9d90009040 comp rx=0 tx=0).stop 2023-12-16T07:44:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4065390 msgr2=0x7f9da4113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4065390 0x7f9da4113690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009180 tx=0x7f9d98009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 shutdown_connections 2023-12-16T07:44:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d9406cf80 0x7f9d9406f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9da4065390 0x7f9da4113690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 --2- 172.21.15.49:0/2474993587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da4102c20 0x7f9da4113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.064+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 >> 172.21.15.49:0/2474993587 conn(0x7f9da40719b0 msgr2=0x7f9da40fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:39.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.065+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 shutdown_connections 2023-12-16T07:44:39.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.065+0000 7f9daad2d700 1 -- 172.21.15.49:0/2474993587 wait complete. 2023-12-16T07:44:39.075 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.187+0000 7f39f3d2d700 1 -- 172.21.15.49:0/3273077669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 msgr2=0x7f39ec0fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.187+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/3273077669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec0fb630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39dc004940 tx=0x7f39dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.187+0000 7f39f3d2d700 1 -- 172.21.15.49:0/3273077669 shutdown_connections 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.187+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/3273077669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec0fb630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.187+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/3273077669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec102c70 0x7f39ec103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.187+0000 7f39f3d2d700 1 -- 172.21.15.49:0/3273077669 >> 172.21.15.49:0/3273077669 conn(0x7f39ec0711a0 msgr2=0x7f39ec0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 -- 172.21.15.49:0/3273077669 shutdown_connections 2023-12-16T07:44:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 -- 172.21.15.49:0/3273077669 wait complete. 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 Processor -- start 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 -- start start 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec102c70 0x7f39ec113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec1141e0 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f3d2d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec10d4d0 con 0x7f39ec102c70 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f1ac9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f1ac9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48166/0 (socket says 172.21.15.49:48166) 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.188+0000 7f39f1ac9700 1 -- 172.21.15.49:0/735416031 learned_addr learned my addr 172.21.15.49:0/735416031 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39f12c8700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec102c70 0x7f39ec113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39f1ac9700 1 -- 172.21.15.49:0/735416031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec102c70 msgr2=0x7f39ec113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39f1ac9700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec102c70 0x7f39ec113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39f1ac9700 1 -- 172.21.15.49:0/735416031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc005040 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39f1ac9700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec113610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39e8002a50 tx=0x7f39e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39e27fc700 1 -- 172.21.15.49:0/735416031 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e8007cc0 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39e27fc700 1 -- 172.21.15.49:0/735416031 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39e800f040 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ec10d760 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39e27fc700 1 -- 172.21.15.49:0/735416031 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e8009540 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.189+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec10dca0 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.190+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec105050 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.191+0000 7f39e27fc700 1 -- 172.21.15.49:0/735416031 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f39e80096a0 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.191+0000 7f39e27fc700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f39d806cf80 0x7f39d806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.191+0000 7f39e27fc700 1 -- 172.21.15.49:0/735416031 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f39e808c350 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.191+0000 7f39f12c8700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f39d806cf80 0x7f39d806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.191+0000 7f39f12c8700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f39d806cf80 0x7f39d806f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39dc004f90 tx=0x7f39dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:39.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.196+0000 7f39e27fc700 1 -- 172.21.15.49:0/735416031 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f39e8059aa0 con 0x7f39ec0fb1e0 2023-12-16T07:44:39.426 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.426+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39ec10ebf0 con 0x7f39d806cf80 2023-12-16T07:44:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.428+0000 7f39e27fc700 1 -- 172.21.15.49:0/735416031 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f39ec10ebf0 con 0x7f39d806cf80 2023-12-16T07:44:39.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f39d806cf80 msgr2=0x7f39d806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f39d806cf80 0x7f39d806f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39dc004f90 tx=0x7f39dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:39.431 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 msgr2=0x7f39ec113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec113610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39e8002a50 tx=0x7f39e80046b0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 shutdown_connections 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f39d806cf80 0x7f39d806f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39ec0fb1e0 0x7f39ec113610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 --2- 172.21.15.49:0/735416031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec102c70 0x7f39ec113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 >> 172.21.15.49:0/735416031 conn(0x7f39ec0711a0 msgr2=0x7f39ec0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 shutdown_connections 2023-12-16T07:44:39.432 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.431+0000 7f39f3d2d700 1 -- 172.21.15.49:0/735416031 wait complete. 2023-12-16T07:44:39.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 -- 172.21.15.49:0/2094347513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de0102c00 msgr2=0x7f0de0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 --2- 172.21.15.49:0/2094347513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de0102c00 0x7f0de0102fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc004940 tx=0x7f0ddc009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 -- 172.21.15.49:0/2094347513 shutdown_connections 2023-12-16T07:44:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 --2- 172.21.15.49:0/2094347513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de01035a0 0x7f0de00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 --2- 172.21.15.49:0/2094347513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de0102c00 0x7f0de0102fd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 -- 172.21.15.49:0/2094347513 >> 172.21.15.49:0/2094347513 conn(0x7f0de00f8790 msgr2=0x7f0de00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 -- 172.21.15.49:0/2094347513 shutdown_connections 2023-12-16T07:44:39.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.548+0000 7f0de7d39700 1 -- 172.21.15.49:0/2094347513 wait complete. 2023-12-16T07:44:39.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de7d39700 1 Processor -- start 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de7d39700 1 -- start start 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de7d39700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de0102c00 0x7f0de0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de7d39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de01035a0 0x7f0de0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de7d39700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01141e0 con 0x7f0de01035a0 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de7d39700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de010d4d0 con 0x7f0de0102c00 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de52d4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de01035a0 0x7f0de0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de52d4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de01035a0 0x7f0de0113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48182/0 (socket says 172.21.15.49:48182) 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de52d4700 1 -- 172.21.15.49:0/761035544 learned_addr learned my addr 172.21.15.49:0/761035544 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de5ad5700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de0102c00 0x7f0de0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de52d4700 1 -- 172.21.15.49:0/761035544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de0102c00 msgr2=0x7f0de0113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de52d4700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de0102c00 0x7f0de0113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.549+0000 7f0de52d4700 1 -- 172.21.15.49:0/761035544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc005040 con 0x7f0de01035a0 2023-12-16T07:44:39.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.550+0000 7f0de52d4700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de01035a0 0x7f0de0113b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0002a50 tx=0x7f0dd0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:39.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.550+0000 7f0dd67fc700 1 -- 172.21.15.49:0/761035544 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd0007cc0 con 0x7f0de01035a0 2023-12-16T07:44:39.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.550+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de010d760 con 0x7f0de01035a0 2023-12-16T07:44:39.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.550+0000 7f0dd67fc700 1 -- 172.21.15.49:0/761035544 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0dd000f040 con 0x7f0de01035a0 2023-12-16T07:44:39.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.550+0000 7f0dd67fc700 1 -- 172.21.15.49:0/761035544 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd000d920 con 0x7f0de01035a0 2023-12-16T07:44:39.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.550+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de010dca0 con 0x7f0de01035a0 2023-12-16T07:44:39.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.551+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de00fff10 con 0x7f0de01035a0 2023-12-16T07:44:39.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.551+0000 7f0dd67fc700 1 -- 172.21.15.49:0/761035544 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f0dd0009680 con 0x7f0de01035a0 2023-12-16T07:44:39.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.552+0000 7f0dd67fc700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0dcc06cf80 0x7f0dcc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.552+0000 7f0dd67fc700 1 -- 172.21.15.49:0/761035544 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0dd008c2a0 con 0x7f0de01035a0 2023-12-16T07:44:39.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.552+0000 7f0de5ad5700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0dcc06cf80 0x7f0dcc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.552+0000 7f0de5ad5700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0dcc06cf80 0x7f0dcc06f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00b3b0 tx=0x7f0ddc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:39.557 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.556+0000 7f0dd67fc700 1 -- 172.21.15.49:0/761035544 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0dd00599f0 con 0x7f0de01035a0 2023-12-16T07:44:39.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:39 smithi049 ceph-mon[217548]: pgmap v32: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.778+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0de010ebf0 con 0x7f0dcc06cf80 2023-12-16T07:44:39.790 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.790+0000 7f0dd67fc700 1 -- 172.21.15.49:0/761035544 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f0de010ebf0 con 0x7f0dcc06cf80 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (2m) 13s ago 10m 26.4M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (20s) 13s ago 10m 7465k - 19.0.0-191-g6d933094 a29c258b5d6f ae149580b967 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (17s) 14s ago 9m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f b4d081b98e26 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (2m) 13s ago 9m 85.9M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (6m) 13s ago 6m 14.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (6m) 13s ago 6m 16.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (6m) 14s ago 6m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (6m) 14s ago 6m 18.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (3m) 13s ago 11m 504M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (2m) 14s ago 9m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:44:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (63s) 13s ago 11m 50.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (45s) 14s ago 9m 40.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (2m) 13s ago 10m 17.0M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (2m) 14s ago 9m 17.9M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 starting - - - 1568M 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (8m) 13s ago 8m 933M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 49404aa03150 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (8m) 13s ago 8m 767M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (7m) 14s ago 7m 1118M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (7m) 14s ago 7m 831M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (7m) 14s ago 7m 940M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:44:39.792 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (2m) 13s ago 9m 60.7M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0dcc06cf80 msgr2=0x7f0dcc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0dcc06cf80 0x7f0dcc06f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00b3b0 tx=0x7f0ddc009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de01035a0 msgr2=0x7f0de0113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de01035a0 0x7f0de0113b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0002a50 tx=0x7f0dd0004600 comp rx=0 tx=0).stop 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 shutdown_connections 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de0102c00 0x7f0de0113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0dcc06cf80 0x7f0dcc06f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 --2- 172.21.15.49:0/761035544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0de01035a0 0x7f0de0113b90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.792+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 >> 172.21.15.49:0/761035544 conn(0x7f0de00f8790 msgr2=0x7f0de00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.793+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 shutdown_connections 2023-12-16T07:44:39.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.793+0000 7f0de7d39700 1 -- 172.21.15.49:0/761035544 wait complete. 2023-12-16T07:44:39.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:39 smithi133 ceph-mon[181557]: pgmap v32: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.899+0000 7efe116ae700 1 -- 172.21.15.49:0/1708275696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 msgr2=0x7efe0c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.899+0000 7efe116ae700 1 --2- 172.21.15.49:0/1708275696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c101ed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efdfc004940 tx=0x7efdfc009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.900+0000 7efe116ae700 1 -- 172.21.15.49:0/1708275696 shutdown_connections 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.900+0000 7efe116ae700 1 --2- 172.21.15.49:0/1708275696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe0c0fbb40 0x7efe0c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.900+0000 7efe116ae700 1 --2- 172.21.15.49:0/1708275696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c101ed0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.900+0000 7efe116ae700 1 -- 172.21.15.49:0/1708275696 >> 172.21.15.49:0/1708275696 conn(0x7efe0c0f76c0 msgr2=0x7efe0c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.900+0000 7efe116ae700 1 -- 172.21.15.49:0/1708275696 shutdown_connections 2023-12-16T07:44:39.900 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.900+0000 7efe116ae700 1 -- 172.21.15.49:0/1708275696 wait complete. 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe116ae700 1 Processor -- start 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe116ae700 1 -- start start 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe116ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe0c0fbb40 0x7efe0c1124e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe116ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe116ae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c113070 con 0x7efe0c101b00 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe116ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c10c3a0 con 0x7efe0c0fbb40 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe0a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe0a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c112a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48204/0 (socket says 172.21.15.49:48204) 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe0a7fc700 1 -- 172.21.15.49:0/2497124042 learned_addr learned my addr 172.21.15.49:0/2497124042 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:39.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe0affd700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe0c0fbb40 0x7efe0c1124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe0a7fc700 1 -- 172.21.15.49:0/2497124042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe0c0fbb40 msgr2=0x7efe0c1124e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe0a7fc700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe0c0fbb40 0x7efe0c1124e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.901+0000 7efe0a7fc700 1 -- 172.21.15.49:0/2497124042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc005040 con 0x7efe0c101b00 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.902+0000 7efe0a7fc700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c112a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe00010d50 tx=0x7efe0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.902+0000 7efdf37fe700 1 -- 172.21.15.49:0/2497124042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0000ed60 con 0x7efe0c101b00 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.902+0000 7efdf37fe700 1 -- 172.21.15.49:0/2497124042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe000090d0 con 0x7efe0c101b00 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.902+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c10c620 con 0x7efe0c101b00 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.902+0000 7efdf37fe700 1 -- 172.21.15.49:0/2497124042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe00012650 con 0x7efe0c101b00 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.902+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c10cb60 con 0x7efe0c101b00 2023-12-16T07:44:39.903 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.903+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c0fb2c0 con 0x7efe0c101b00 2023-12-16T07:44:39.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.904+0000 7efdf37fe700 1 -- 172.21.15.49:0/2497124042 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7efe00018030 con 0x7efe0c101b00 2023-12-16T07:44:39.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.904+0000 7efdf37fe700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7efdf406cf80 0x7efdf406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:39.904 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.904+0000 7efdf37fe700 1 -- 172.21.15.49:0/2497124042 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efe00016070 con 0x7efe0c101b00 2023-12-16T07:44:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.904+0000 7efe0affd700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7efdf406cf80 0x7efdf406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:39.905 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.905+0000 7efe0affd700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7efdf406cf80 0x7efdf406f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000c00 tx=0x7efdfc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:39.908 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:39.908+0000 7efdf37fe700 1 -- 172.21.15.49:0/2497124042 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7efe0005c280 con 0x7efe0c101b00 2023-12-16T07:44:40.216 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.216+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efe0c108ab0 con 0x7efe0c101b00 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.217+0000 7efdf37fe700 1 -- 172.21.15.49:0/2497124042 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7efe0005be10 con 0x7efe0c101b00 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 9, 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:44:40.218 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:44:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7efdf406cf80 msgr2=0x7efdf406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7efdf406cf80 0x7efdf406f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000c00 tx=0x7efdfc009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 msgr2=0x7efe0c112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c112a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe00010d50 tx=0x7efe0000b040 comp rx=0 tx=0).stop 2023-12-16T07:44:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 shutdown_connections 2023-12-16T07:44:40.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe0c0fbb40 0x7efe0c1124e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7efdf406cf80 0x7efdf406f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 --2- 172.21.15.49:0/2497124042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c101b00 0x7efe0c112a20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 >> 172.21.15.49:0/2497124042 conn(0x7efe0c0f76c0 msgr2=0x7efe0c0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 shutdown_connections 2023-12-16T07:44:40.220 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.219+0000 7efe116ae700 1 -- 172.21.15.49:0/2497124042 wait complete. 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 -- 172.21.15.49:0/2987181608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 msgr2=0x7fc5ac103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2987181608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac103040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc59c004940 tx=0x7fc59c009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 -- 172.21.15.49:0/2987181608 shutdown_connections 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2987181608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ac0fb1e0 0x7fc5ac0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2987181608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac103040 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 -- 172.21.15.49:0/2987181608 >> 172.21.15.49:0/2987181608 conn(0x7fc5ac0711a0 msgr2=0x7fc5ac0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 -- 172.21.15.49:0/2987181608 shutdown_connections 2023-12-16T07:44:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.336+0000 7fc5b2848700 1 -- 172.21.15.49:0/2987181608 wait complete. 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.337+0000 7fc5b2848700 1 Processor -- start 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.337+0000 7fc5b2848700 1 -- start start 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.337+0000 7fc5b2848700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ac0fb1e0 0x7fc5ac113580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.337+0000 7fc5b2848700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5b2848700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac114110 con 0x7fc5ac102c70 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5b2848700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac10d440 con 0x7fc5ac0fb1e0 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5ab7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5ab7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48224/0 (socket says 172.21.15.49:48224) 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5ab7fe700 1 -- 172.21.15.49:0/2042456355 learned_addr learned my addr 172.21.15.49:0/2042456355 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5abfff700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ac0fb1e0 0x7fc5ac113580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5ab7fe700 1 -- 172.21.15.49:0/2042456355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ac0fb1e0 msgr2=0x7fc5ac113580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5ab7fe700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ac0fb1e0 0x7fc5ac113580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5ab7fe700 1 -- 172.21.15.49:0/2042456355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c005040 con 0x7fc5ac102c70 2023-12-16T07:44:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5ab7fe700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac113ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000eb70 tx=0x7fc5a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.338+0000 7fc5a8ff9700 1 -- 172.21.15.49:0/2042456355 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a0007cc0 con 0x7fc5ac102c70 2023-12-16T07:44:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.339+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac10d6c0 con 0x7fc5ac102c70 2023-12-16T07:44:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.339+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac10dc00 con 0x7fc5ac102c70 2023-12-16T07:44:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.340+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac072cc0 con 0x7fc5ac102c70 2023-12-16T07:44:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.340+0000 7fc5a8ff9700 1 -- 172.21.15.49:0/2042456355 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5a000f040 con 0x7fc5ac102c70 2023-12-16T07:44:40.340 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.340+0000 7fc5a8ff9700 1 -- 172.21.15.49:0/2042456355 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a000c910 con 0x7fc5ac102c70 2023-12-16T07:44:40.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.344+0000 7fc5a8ff9700 1 -- 172.21.15.49:0/2042456355 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fc5a0009680 con 0x7fc5ac102c70 2023-12-16T07:44:40.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.345+0000 7fc5a8ff9700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc59406cf80 0x7fc59406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:40.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.345+0000 7fc5a8ff9700 1 -- 172.21.15.49:0/2042456355 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc5a008c510 con 0x7fc5ac102c70 2023-12-16T07:44:40.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.345+0000 7fc5abfff700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc59406cf80 0x7fc59406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:40.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.346+0000 7fc5abfff700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc59406cf80 0x7fc59406f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc59c000c00 tx=0x7fc59c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:40.346 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.346+0000 7fc5a8ff9700 1 -- 172.21.15.49:0/2042456355 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc5a0059d70 con 0x7fc5ac102c70 2023-12-16T07:44:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.625+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc5ac10eb60 con 0x7fc5ac102c70 2023-12-16T07:44:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.625+0000 7fc5a8ff9700 1 -- 172.21.15.49:0/2042456355 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1847 (secure 0 0 0) 0x7fc5a0059900 con 0x7fc5ac102c70 2023-12-16T07:44:40.626 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:44:40.626 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:44:40.626 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:44:40.626 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:44:40.626 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:44:40.627 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2023-12-16T07:44:40.628 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:40.629 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc59406cf80 msgr2=0x7fc59406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc59406cf80 0x7fc59406f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc59c000c00 tx=0x7fc59c009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 msgr2=0x7fc5ac113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac113ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000eb70 tx=0x7fc5a000b040 comp rx=0 tx=0).stop 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 shutdown_connections 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ac0fb1e0 0x7fc5ac113580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc59406cf80 0x7fc59406f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 --2- 172.21.15.49:0/2042456355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5ac102c70 0x7fc5ac113ac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 >> 172.21.15.49:0/2042456355 conn(0x7fc5ac0711a0 msgr2=0x7fc5ac0fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 shutdown_connections 2023-12-16T07:44:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.628+0000 7fc5b2848700 1 -- 172.21.15.49:0/2042456355 wait complete. 2023-12-16T07:44:40.631 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:44:40.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:40 smithi049 ceph-mon[217548]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:40.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:40 smithi049 ceph-mon[217548]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:40.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:40 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2497124042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 -- 172.21.15.49:0/798353483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 msgr2=0x7ff0fc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 --2- 172.21.15.49:0/798353483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc101ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec004940 tx=0x7ff0ec009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 -- 172.21.15.49:0/798353483 shutdown_connections 2023-12-16T07:44:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 --2- 172.21.15.49:0/798353483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0fc0fbb40 0x7ff0fc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 --2- 172.21.15.49:0/798353483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc101ed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 -- 172.21.15.49:0/798353483 >> 172.21.15.49:0/798353483 conn(0x7ff0fc0719b0 msgr2=0x7ff0fc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 -- 172.21.15.49:0/798353483 shutdown_connections 2023-12-16T07:44:40.737 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.736+0000 7ff101b81700 1 -- 172.21.15.49:0/798353483 wait complete. 2023-12-16T07:44:40.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff101b81700 1 Processor -- start 2023-12-16T07:44:40.738 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff101b81700 1 -- start start 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff101b81700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0fc0fbb40 0x7ff0fc1157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff101b81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff101b81700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc116380 con 0x7ff0fc101b00 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff101b81700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc10f6b0 con 0x7ff0fc0fbb40 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48240/0 (socket says 172.21.15.49:48240) 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff0faffd700 1 -- 172.21.15.49:0/3035816358 learned_addr learned my addr 172.21.15.49:0/3035816358 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.737+0000 7ff0fb7fe700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0fc0fbb40 0x7ff0fc1157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff0faffd700 1 -- 172.21.15.49:0/3035816358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0fc0fbb40 msgr2=0x7ff0fc1157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff0faffd700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0fc0fbb40 0x7ff0fc1157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff0faffd700 1 -- 172.21.15.49:0/3035816358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec005040 con 0x7ff0fc101b00 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff0faffd700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc115d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400eb40 tx=0x7ff0e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff0f3fff700 1 -- 172.21.15.49:0/3035816358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e4007cc0 con 0x7ff0fc101b00 2023-12-16T07:44:40.739 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc10f930 con 0x7ff0fc101b00 2023-12-16T07:44:40.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff0f3fff700 1 -- 172.21.15.49:0/3035816358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0e400f040 con 0x7ff0fc101b00 2023-12-16T07:44:40.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff0f3fff700 1 -- 172.21.15.49:0/3035816358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0e400c990 con 0x7ff0fc101b00 2023-12-16T07:44:40.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.738+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc10fe70 con 0x7ff0fc101b00 2023-12-16T07:44:40.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.739+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc0734d0 con 0x7ff0fc101b00 2023-12-16T07:44:40.740 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.739+0000 7ff0f3fff700 1 -- 172.21.15.49:0/3035816358 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ff0e400cc00 con 0x7ff0fc101b00 2023-12-16T07:44:40.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.740+0000 7ff0f3fff700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff0e806cf80 0x7ff0e806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:40.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.740+0000 7ff0f3fff700 1 -- 172.21.15.49:0/3035816358 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff0e408c140 con 0x7ff0fc101b00 2023-12-16T07:44:40.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.740+0000 7ff0fb7fe700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff0e806cf80 0x7ff0e806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:40.741 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.740+0000 7ff0fb7fe700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff0e806cf80 0x7ff0e806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009fd0 tx=0x7ff0ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:40.744 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.744+0000 7ff0f3fff700 1 -- 172.21.15.49:0/3035816358 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff0e40599b0 con 0x7ff0fc101b00 2023-12-16T07:44:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:40 smithi133 ceph-mon[181557]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:40 smithi133 ceph-mon[181557]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:40.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:40 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2497124042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:40.989 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.989+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0fc1154c0 con 0x7ff0e806cf80 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.991+0000 7ff0f3fff700 1 -- 172.21.15.49:0/3035816358 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff0fc1154c0 con 0x7ff0e806cf80 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2023-12-16T07:44:40.991 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:44:40.992 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:44:40.992 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "7/21 daemons upgraded", 2023-12-16T07:44:40.992 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T07:44:40.992 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:44:40.992 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:44:40.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff0e806cf80 msgr2=0x7ff0e806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff0e806cf80 0x7ff0e806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009fd0 tx=0x7ff0ec009e30 comp rx=0 tx=0).stop 2023-12-16T07:44:40.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 msgr2=0x7ff0fc115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:40.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc115d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400eb40 tx=0x7ff0e400b040 comp rx=0 tx=0).stop 2023-12-16T07:44:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 shutdown_connections 2023-12-16T07:44:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0fc0fbb40 0x7ff0fc1157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff0e806cf80 0x7ff0e806f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 --2- 172.21.15.49:0/3035816358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0fc101b00 0x7ff0fc115d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 >> 172.21.15.49:0/3035816358 conn(0x7ff0fc0719b0 msgr2=0x7ff0fc0653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 shutdown_connections 2023-12-16T07:44:40.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:40.993+0000 7ff101b81700 1 -- 172.21.15.49:0/3035816358 wait complete. 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.105+0000 7f8b65ea2700 1 -- 172.21.15.49:0/4039302251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 msgr2=0x7f8b600fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.105+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/4039302251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b600fb2d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b54004a50 tx=0x7f8b5400af40 comp rx=0 tx=0).stop 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.105+0000 7f8b65ea2700 1 -- 172.21.15.49:0/4039302251 shutdown_connections 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.105+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/4039302251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b600fb2d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.105+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/4039302251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b60101270 0x7f8b60101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.105+0000 7f8b65ea2700 1 -- 172.21.15.49:0/4039302251 >> 172.21.15.49:0/4039302251 conn(0x7f8b600711a0 msgr2=0x7f8b600715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.105+0000 7f8b65ea2700 1 -- 172.21.15.49:0/4039302251 shutdown_connections 2023-12-16T07:44:41.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.106+0000 7f8b65ea2700 1 -- 172.21.15.49:0/4039302251 wait complete. 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.106+0000 7f8b65ea2700 1 Processor -- start 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.106+0000 7f8b65ea2700 1 -- start start 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.106+0000 7f8b65ea2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b60101270 0x7f8b60111350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.106+0000 7f8b65ea2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b60111890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.106+0000 7f8b65ea2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60111ee0 con 0x7f8b60101c10 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b65ea2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6010b1f0 con 0x7f8b60101270 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b60111890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b60111890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48256/0 (socket says 172.21.15.49:48256) 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5effd700 1 -- 172.21.15.49:0/3838748761 learned_addr learned my addr 172.21.15.49:0/3838748761 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5f7fe700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b60101270 0x7f8b60111350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:41.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5effd700 1 -- 172.21.15.49:0/3838748761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b60101270 msgr2=0x7f8b60111350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5effd700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b60101270 0x7f8b60111350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5effd700 1 -- 172.21.15.49:0/3838748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b54005040 con 0x7f8b60101c10 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b5effd700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b60111890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b54004710 tx=0x7f8b5400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.107+0000 7f8b47fff700 1 -- 172.21.15.49:0/3838748761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5400f070 con 0x7f8b60101c10 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.108+0000 7f8b47fff700 1 -- 172.21.15.49:0/3838748761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b5401c8d0 con 0x7f8b60101c10 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.108+0000 7f8b47fff700 1 -- 172.21.15.49:0/3838748761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b540147d0 con 0x7f8b60101c10 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.108+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6010b470 con 0x7f8b60101c10 2023-12-16T07:44:41.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.108+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6010b950 con 0x7f8b60101c10 2023-12-16T07:44:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.109+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60072cc0 con 0x7f8b60101c10 2023-12-16T07:44:41.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.110+0000 7f8b47fff700 1 -- 172.21.15.49:0/3838748761 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f8b5401ca40 con 0x7f8b60101c10 2023-12-16T07:44:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.111+0000 7f8b47fff700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f8b4806f180 0x7f8b48071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:44:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.111+0000 7f8b47fff700 1 -- 172.21.15.49:0/3838748761 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8b5408dc40 con 0x7f8b60101c10 2023-12-16T07:44:41.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.111+0000 7f8b5f7fe700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f8b4806f180 0x7f8b48071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:44:41.112 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.112+0000 7f8b5f7fe700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f8b4806f180 0x7f8b48071630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b50004990 tx=0x7f8b50009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:44:41.115 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.115+0000 7f8b47fff700 1 -- 172.21.15.49:0/3838748761 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f8b5405b4b0 con 0x7f8b60101c10 2023-12-16T07:44:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.412+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8b60107970 con 0x7f8b60101c10 2023-12-16T07:44:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.413+0000 7f8b47fff700 1 -- 172.21.15.49:0/3838748761 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1406 (secure 0 0 0) 0x7f8b5402b590 con 0x7f8b60101c10 2023-12-16T07:44:41.413 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 42/222 objects degraded (18.919%), 17 pgs degraded 2023-12-16T07:44:41.413 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:44:41.413 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: osd.0 (root=default,host=smithi049) is down 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 42/222 objects degraded (18.919%), 17 pgs degraded 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2023-12-16T07:44:41.414 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2023-12-16T07:44:41.415 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2023-12-16T07:44:41.415 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2023-12-16T07:44:41.415 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2023-12-16T07:44:41.415 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2023-12-16T07:44:41.415 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.415+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f8b4806f180 msgr2=0x7f8b48071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.415+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f8b4806f180 0x7f8b48071630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8b50004990 tx=0x7f8b50009ee0 comp rx=0 tx=0).stop 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.415+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 msgr2=0x7f8b60111890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.415+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b60111890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b54004710 tx=0x7f8b5400af40 comp rx=0 tx=0).stop 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.416+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 shutdown_connections 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.416+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b60101270 0x7f8b60111350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.416+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f8b4806f180 0x7f8b48071630 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.416+0000 7f8b65ea2700 1 --2- 172.21.15.49:0/3838748761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b60101c10 0x7f8b60111890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.416+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 >> 172.21.15.49:0/3838748761 conn(0x7f8b600711a0 msgr2=0x7f8b600fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.416+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 shutdown_connections 2023-12-16T07:44:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:44:41.416+0000 7f8b65ea2700 1 -- 172.21.15.49:0/3838748761 wait complete. 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: pgmap v33: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 42/222 objects degraded (18.919%) 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: Health check failed: Degraded data redundancy: 42/222 objects degraded (18.919%), 17 pgs degraded (PG_DEGRADED) 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2042456355' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:44:41.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:41 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: pgmap v33: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 42/222 objects degraded (18.919%) 2023-12-16T07:44:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: Health check failed: Degraded data redundancy: 42/222 objects degraded (18.919%), 17 pgs degraded (PG_DEGRADED) 2023-12-16T07:44:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2023-12-16T07:44:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:41.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2042456355' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:44:41.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:41 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:42.459 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:42 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[231121]: 2023-12-16T07:44:42.375+0000 7f238f60b640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-16T07:44:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:42 smithi049 ceph-mon[217548]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:42 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/3838748761' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:44:42.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:42 smithi133 ceph-mon[181557]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:44:42.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:42.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:42 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/3838748761' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:44:43.209 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:42 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[231121]: 2023-12-16T07:44:42.914+0000 7f238f60b640 -1 osd.0 48 log_to_monitors true 2023-12-16T07:44:43.665 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:44:43 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[231121]: 2023-12-16T07:44:43.412+0000 7f237da76700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:44:43.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:43 smithi049 ceph-mon[217548]: pgmap v34: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 42/222 objects degraded (18.919%) 2023-12-16T07:44:43.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:43 smithi049 ceph-mon[217548]: from='osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T07:44:43.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:43 smithi133 ceph-mon[181557]: pgmap v34: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 42/222 objects degraded (18.919%) 2023-12-16T07:44:43.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:43 smithi133 ceph-mon[181557]: from='osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-16T07:44:44.400 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T07:44:44.401 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: failed to encode map e51 with expected crc 2023-12-16T07:44:44.401 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: osdmap e51: 6 total, 5 up, 6 in 2023-12-16T07:44:44.401 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:44:44.401 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:44.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:44:44.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-16T07:44:44.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: failed to encode map e51 with expected crc 2023-12-16T07:44:44.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: osdmap e51: 6 total, 5 up, 6 in 2023-12-16T07:44:44.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:44:44.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:44:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: pgmap v36: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 42/222 objects degraded (18.919%) 2023-12-16T07:44:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:44:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T07:44:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:44:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: failed to encode map e51 with expected crc 2023-12-16T07:44:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792] boot 2023-12-16T07:44:45.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: osdmap e52: 6 total, 6 up, 6 in 2023-12-16T07:44:45.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:45 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:44:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: pgmap v36: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 42/222 objects degraded (18.919%) 2023-12-16T07:44:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:44:45.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-16T07:44:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:44:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: failed to encode map e51 with expected crc 2023-12-16T07:44:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: osd.0 [v2:172.21.15.49:6802/1847908792,v1:172.21.15.49:6803/1847908792] boot 2023-12-16T07:44:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: osdmap e52: 6 total, 6 up, 6 in 2023-12-16T07:44:45.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:45 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-16T07:44:46.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:46 smithi049 ceph-mon[217548]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:46 smithi049 ceph-mon[217548]: osdmap e53: 6 total, 6 up, 6 in 2023-12-16T07:44:46.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:46 smithi049 ceph-mon[217548]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:46 smithi049 ceph-mon[217548]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:46 smithi049 ceph-mon[217548]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:46 smithi049 ceph-mon[217548]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:46 smithi049 ceph-mon[217548]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:46 smithi133 ceph-mon[181557]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:46 smithi133 ceph-mon[181557]: osdmap e53: 6 total, 6 up, 6 in 2023-12-16T07:44:46.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:46 smithi133 ceph-mon[181557]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:46 smithi133 ceph-mon[181557]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:46 smithi133 ceph-mon[181557]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:46 smithi133 ceph-mon[181557]: failed to encode map e53 with expected crc 2023-12-16T07:44:46.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:46 smithi133 ceph-mon[181557]: failed to encode map e53 with expected crc 2023-12-16T07:44:47.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:47 smithi049 ceph-mon[217548]: pgmap v39: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-16T07:44:47.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:47 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T07:44:47.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:47 smithi133 ceph-mon[181557]: pgmap v39: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-16T07:44:47.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:47 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T07:44:49.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:49 smithi049 ceph-mon[217548]: pgmap v40: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-16T07:44:49.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:49 smithi133 ceph-mon[181557]: pgmap v40: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2023-12-16T07:44:50.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:50 smithi133 ceph-mon[181557]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2023-12-16T07:44:50.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:50 smithi049 ceph-mon[217548]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2023-12-16T07:44:51.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:51 smithi133 ceph-mon[181557]: pgmap v41: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:51.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:51 smithi049 ceph-mon[217548]: pgmap v41: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:53.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:53 smithi133 ceph-mon[181557]: pgmap v42: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:53.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:53 smithi049 ceph-mon[217548]: pgmap v42: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:55.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:55 smithi133 ceph-mon[181557]: pgmap v43: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:55.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:55 smithi049 ceph-mon[217548]: pgmap v43: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:57.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:57 smithi133 ceph-mon[181557]: pgmap v44: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:57.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:57 smithi049 ceph-mon[217548]: pgmap v44: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:59.751 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:59 smithi049 ceph-mon[217548]: pgmap v45: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:59.751 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:59.751 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:59.751 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:59.752 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:44:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:44:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:59 smithi133 ceph-mon[181557]: pgmap v45: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:44:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:44:59.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:44:59.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:44:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:45:00.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:00 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:45:00.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:00 smithi049 ceph-mon[217548]: Upgrade: osd.1 is safe to restart 2023-12-16T07:45:00.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:00 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:00.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:00 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T07:45:00.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:00 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:00 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-16T07:45:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:00 smithi133 ceph-mon[181557]: Upgrade: osd.1 is safe to restart 2023-12-16T07:45:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:00 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:00 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-16T07:45:00.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:00 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:01.593 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:01 smithi049 ceph-mon[217548]: pgmap v46: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:45:01.593 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:01 smithi049 ceph-mon[217548]: Upgrade: Updating osd.1 2023-12-16T07:45:01.593 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:01 smithi049 ceph-mon[217548]: Deploying daemon osd.1 on smithi049 2023-12-16T07:45:01.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:01 smithi133 ceph-mon[181557]: pgmap v46: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:45:01.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:01 smithi133 ceph-mon[181557]: Upgrade: Updating osd.1 2023-12-16T07:45:01.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:01 smithi133 ceph-mon[181557]: Deploying daemon osd.1 on smithi049 2023-12-16T07:45:02.485 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:02 smithi049 systemd[1]: Stopping Ceph osd.1 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:45:02.486 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:02 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[144670]: 2023-12-16T07:45:02.427+0000 7f1ea21ac700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:45:02.486 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:02 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[144670]: 2023-12-16T07:45:02.427+0000 7f1ea21ac700 -1 osd.1 53 *** Got signal Terminated *** 2023-12-16T07:45:02.486 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:02 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[144670]: 2023-12-16T07:45:02.427+0000 7f1ea21ac700 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:45:02.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:02 smithi133 ceph-mon[181557]: osd.1 marked itself down and dead 2023-12-16T07:45:02.954 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:02 smithi049 ceph-mon[217548]: osd.1 marked itself down and dead 2023-12-16T07:45:03.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:03 smithi049 bash[237186]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1 2023-12-16T07:45:03.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:03 smithi133 ceph-mon[181557]: pgmap v47: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:45:03.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:03 smithi133 ceph-mon[181557]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:45:03.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:03 smithi133 ceph-mon[181557]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T07:45:03.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:03 smithi133 ceph-mon[181557]: failed to encode map e54 with expected crc 2023-12-16T07:45:03.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:03 smithi133 ceph-mon[181557]: failed to encode map e54 with expected crc 2023-12-16T07:45:03.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:03 smithi133 ceph-mon[181557]: failed to encode map e54 with expected crc 2023-12-16T07:45:03.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:03 smithi133 ceph-mon[181557]: failed to encode map e54 with expected crc 2023-12-16T07:45:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:03 smithi049 ceph-mon[217548]: pgmap v47: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:45:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:03 smithi049 ceph-mon[217548]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:45:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:03 smithi049 ceph-mon[217548]: osdmap e54: 6 total, 5 up, 6 in 2023-12-16T07:45:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:03 smithi049 ceph-mon[217548]: failed to encode map e54 with expected crc 2023-12-16T07:45:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:03 smithi049 ceph-mon[217548]: failed to encode map e54 with expected crc 2023-12-16T07:45:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:03 smithi049 ceph-mon[217548]: failed to encode map e54 with expected crc 2023-12-16T07:45:03.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:03 smithi049 ceph-mon[217548]: failed to encode map e54 with expected crc 2023-12-16T07:45:04.660 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:04 smithi049 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.1.service: Succeeded. 2023-12-16T07:45:04.660 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:04 smithi049 systemd[1]: Stopped Ceph osd.1 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:45:04.661 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:04 smithi049 systemd[1]: Starting Ceph osd.1 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: osdmap e55: 6 total, 5 up, 6 in 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:04 smithi049 ceph-mon[217548]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.869 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: osdmap e55: 6 total, 5 up, 6 in 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:04.870 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:04 smithi133 ceph-mon[181557]: failed to encode map e55 with expected crc 2023-12-16T07:45:05.459 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237454]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T07:45:05.459 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237454]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T07:45:05.459 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237454]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T07:45:05.459 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237454]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T07:45:05.459 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237454]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-16T07:45:05.459 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237454]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T07:45:05.459 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237454]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-16T07:45:05.784 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:05 smithi049 ceph-mon[217548]: pgmap v50: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:45:05.784 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:05 smithi049 ceph-mon[217548]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-16T07:45:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:05 smithi133 ceph-mon[181557]: pgmap v50: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-16T07:45:05.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:05 smithi133 ceph-mon[181557]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-16T07:45:06.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 ceph-osd[237755]: -- 172.21.15.49:0/2160186633 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557bcf5056c0 con 0x557bcf4d5000 2023-12-16T07:45:06.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 bash[237716]: ac94960b0db862fc1ada4694efc472815e43701304ea347d06789f8a36da4830 2023-12-16T07:45:06.209 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:05 smithi049 systemd[1]: Started Ceph osd.1 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:45:06.709 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[237731]: 2023-12-16T07:45:06.370+0000 7f2e37b12640 -1 Falling back to public interface 2023-12-16T07:45:07.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-mon[217548]: pgmap v51: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2023-12-16T07:45:07.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:07.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:06 smithi049 ceph-mon[217548]: Health check failed: Degraded data redundancy: 28/222 objects degraded (12.613%), 11 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:06 smithi133 ceph-mon[181557]: pgmap v51: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2023-12-16T07:45:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:07.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:07.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:06 smithi133 ceph-mon[181557]: Health check failed: Degraded data redundancy: 28/222 objects degraded (12.613%), 11 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:09.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:08 smithi049 ceph-mon[217548]: pgmap v52: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2023-12-16T07:45:09.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:08 smithi133 ceph-mon[181557]: pgmap v52: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2023-12-16T07:45:10.411 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.411 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.411 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.411 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:10.959 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:10 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[237731]: 2023-12-16T07:45:10.930+0000 7f2e37b12640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-16T07:45:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:11 smithi049 ceph-mon[217548]: pgmap v53: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:11 smithi049 ceph-mon[217548]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T07:45:11.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 -- 172.21.15.49:0/980298235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc1035a0 msgr2=0x7f11bc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:11.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 --2- 172.21.15.49:0/980298235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc1035a0 0x7f11bc0fcc10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f11b0004940 tx=0x7f11b0009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:11.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 -- 172.21.15.49:0/980298235 shutdown_connections 2023-12-16T07:45:11.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 --2- 172.21.15.49:0/980298235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc1035a0 0x7f11bc0fcc10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 --2- 172.21.15.49:0/980298235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11bc102c00 0x7f11bc102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 -- 172.21.15.49:0/980298235 >> 172.21.15.49:0/980298235 conn(0x7f11bc0f8790 msgr2=0x7f11bc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:11.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 -- 172.21.15.49:0/980298235 shutdown_connections 2023-12-16T07:45:11.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.549+0000 7f11c2881700 1 -- 172.21.15.49:0/980298235 wait complete. 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.550+0000 7f11c2881700 1 Processor -- start 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.550+0000 7f11c2881700 1 -- start start 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11c2881700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc102c00 0x7f11bc113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11c2881700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11bc1035a0 0x7f11bc113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11c2881700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc114210 con 0x7f11bc102c00 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11c2881700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc10d500 con 0x7f11bc1035a0 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc102c00 0x7f11bc113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc102c00 0x7f11bc113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45466/0 (socket says 172.21.15.49:45466) 2023-12-16T07:45:11.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bbfff700 1 -- 172.21.15.49:0/1989366127 learned_addr learned my addr 172.21.15.49:0/1989366127 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bb7fe700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11bc1035a0 0x7f11bc113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bbfff700 1 -- 172.21.15.49:0/1989366127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11bc1035a0 msgr2=0x7f11bc113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bbfff700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11bc1035a0 0x7f11bc113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bbfff700 1 -- 172.21.15.49:0/1989366127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0005040 con 0x7f11bc102c00 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11bbfff700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc102c00 0x7f11bc113680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002a50 tx=0x7f11ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.551+0000 7f11b8ff9700 1 -- 172.21.15.49:0/1989366127 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11ac007cc0 con 0x7f11bc102c00 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.552+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc10d7e0 con 0x7f11bc102c00 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.552+0000 7f11b8ff9700 1 -- 172.21.15.49:0/1989366127 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11ac00f040 con 0x7f11bc102c00 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.552+0000 7f11b8ff9700 1 -- 172.21.15.49:0/1989366127 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11ac009540 con 0x7f11bc102c00 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.552+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc10dd20 con 0x7f11bc102c00 2023-12-16T07:45:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.553+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc113330 con 0x7f11bc102c00 2023-12-16T07:45:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.555+0000 7f11b8ff9700 1 -- 172.21.15.49:0/1989366127 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f11ac0096a0 con 0x7f11bc102c00 2023-12-16T07:45:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.555+0000 7f11b8ff9700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f11a4071390 0x7f11a4073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.555+0000 7f11b8ff9700 1 -- 172.21.15.49:0/1989366127 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f11ac08c350 con 0x7f11bc102c00 2023-12-16T07:45:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.555+0000 7f11bb7fe700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f11a4071390 0x7f11a4073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.556+0000 7f11bb7fe700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f11a4071390 0x7f11a4073840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11b000b3b0 tx=0x7f11b0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.560+0000 7f11b8ff9700 1 -- 172.21.15.49:0/1989366127 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f11ac059aa0 con 0x7f11bc102c00 2023-12-16T07:45:11.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:11 smithi133 ceph-mon[181557]: pgmap v53: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:11.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:11 smithi133 ceph-mon[181557]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T07:45:11.808 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.808+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11bc10ec20 con 0x7f11a4071390 2023-12-16T07:45:11.809 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.809+0000 7f11b8ff9700 1 -- 172.21.15.49:0/1989366127 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f11bc10ec20 con 0x7f11a4071390 2023-12-16T07:45:11.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.812+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f11a4071390 msgr2=0x7f11a4073840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:11.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.812+0000 7f11c2881700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f11a4071390 0x7f11a4073840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11b000b3b0 tx=0x7f11b0009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:11.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.812+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc102c00 msgr2=0x7f11bc113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:11.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc102c00 0x7f11bc113680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11ac002a50 tx=0x7f11ac0046b0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 shutdown_connections 2023-12-16T07:45:11.813 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f11a4071390 0x7f11a4073840 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f11bc102c00 0x7f11bc113680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 --2- 172.21.15.49:0/1989366127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11bc1035a0 0x7f11bc113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 >> 172.21.15.49:0/1989366127 conn(0x7f11bc0f8790 msgr2=0x7f11bc0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:11.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 shutdown_connections 2023-12-16T07:45:11.814 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.813+0000 7f11c2881700 1 -- 172.21.15.49:0/1989366127 wait complete. 2023-12-16T07:45:11.824 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:45:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1552494770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc101b00 msgr2=0x7f0adc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1552494770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc101b00 0x7f0adc101ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0acc004940 tx=0x7f0acc009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1552494770 shutdown_connections 2023-12-16T07:45:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1552494770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0adc102410 0x7f0adc0fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1552494770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc101b00 0x7f0adc101ed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1552494770 >> 172.21.15.49:0/1552494770 conn(0x7f0adc0711a0 msgr2=0x7f0adc0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1552494770 shutdown_connections 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.937+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1552494770 wait complete. 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ae16eb700 1 Processor -- start 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ae16eb700 1 -- start start 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ae16eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0adc101b00 0x7f0adc113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ae16eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc102410 0x7f0adc113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ae16eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1141f0 con 0x7f0adc102410 2023-12-16T07:45:11.939 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ae16eb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc10d4e0 con 0x7f0adc101b00 2023-12-16T07:45:11.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ada7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc102410 0x7f0adc113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:11.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ada7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc102410 0x7f0adc113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45490/0 (socket says 172.21.15.49:45490) 2023-12-16T07:45:11.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0ada7fc700 1 -- 172.21.15.49:0/1683126750 learned_addr learned my addr 172.21.15.49:0/1683126750 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.938+0000 7f0adaffd700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0adc101b00 0x7f0adc113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ada7fc700 1 -- 172.21.15.49:0/1683126750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0adc101b00 msgr2=0x7f0adc113620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ada7fc700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0adc101b00 0x7f0adc113620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ada7fc700 1 -- 172.21.15.49:0/1683126750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc005040 con 0x7f0adc102410 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ada7fc700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc102410 0x7f0adc113ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0002a50 tx=0x7f0ad0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ac37fe700 1 -- 172.21.15.49:0/1683126750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ad0007cc0 con 0x7f0adc102410 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc10d770 con 0x7f0adc102410 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ac37fe700 1 -- 172.21.15.49:0/1683126750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ad000f040 con 0x7f0adc102410 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ac37fe700 1 -- 172.21.15.49:0/1683126750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ad000d920 con 0x7f0adc102410 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.939+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc10dcb0 con 0x7f0adc102410 2023-12-16T07:45:11.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.940+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc0ffe70 con 0x7f0adc102410 2023-12-16T07:45:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.941+0000 7f0ac37fe700 1 -- 172.21.15.49:0/1683126750 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f0ad0009680 con 0x7f0adc102410 2023-12-16T07:45:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.941+0000 7f0ac37fe700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0ac406cf80 0x7f0ac406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.941+0000 7f0ac37fe700 1 -- 172.21.15.49:0/1683126750 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0ad008c2a0 con 0x7f0adc102410 2023-12-16T07:45:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.941+0000 7f0adaffd700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0ac406cf80 0x7f0ac406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:11.942 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.942+0000 7f0adaffd700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0ac406cf80 0x7f0ac406f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00b3b0 tx=0x7f0acc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:11.947+0000 7f0ac37fe700 1 -- 172.21.15.49:0/1683126750 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0ad00599f0 con 0x7f0adc102410 2023-12-16T07:45:11.958 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:11 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[237731]: 2023-12-16T07:45:11.612+0000 7f2e37b12640 -1 osd.1 53 log_to_monitors true 2023-12-16T07:45:12.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.173+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0adc10ec00 con 0x7f0ac406cf80 2023-12-16T07:45:12.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.174+0000 7f0ac37fe700 1 -- 172.21.15.49:0/1683126750 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0adc10ec00 con 0x7f0ac406cf80 2023-12-16T07:45:12.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0ac406cf80 msgr2=0x7f0ac406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0ac406cf80 0x7f0ac406f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00b3b0 tx=0x7f0acc009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:12.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc102410 msgr2=0x7f0adc113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc102410 0x7f0adc113ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0002a50 tx=0x7f0ad0004600 comp rx=0 tx=0).stop 2023-12-16T07:45:12.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 shutdown_connections 2023-12-16T07:45:12.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0adc101b00 0x7f0adc113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0ac406cf80 0x7f0ac406f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 --2- 172.21.15.49:0/1683126750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0adc102410 0x7f0adc113ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 >> 172.21.15.49:0/1683126750 conn(0x7f0adc0711a0 msgr2=0x7f0adc1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:12.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 shutdown_connections 2023-12-16T07:45:12.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.177+0000 7f0ae16eb700 1 -- 172.21.15.49:0/1683126750 wait complete. 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 -- 172.21.15.49:0/3171029220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c103590 msgr2=0x7ff95c0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 --2- 172.21.15.49:0/3171029220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c103590 0x7ff95c0fcc00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff948004940 tx=0x7ff948009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 -- 172.21.15.49:0/3171029220 shutdown_connections 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 --2- 172.21.15.49:0/3171029220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c103590 0x7ff95c0fcc00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 --2- 172.21.15.49:0/3171029220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c102bf0 0x7ff95c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 -- 172.21.15.49:0/3171029220 >> 172.21.15.49:0/3171029220 conn(0x7ff95c0f87a0 msgr2=0x7ff95c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 -- 172.21.15.49:0/3171029220 shutdown_connections 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.305+0000 7ff962b7d700 1 -- 172.21.15.49:0/3171029220 wait complete. 2023-12-16T07:45:12.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff962b7d700 1 Processor -- start 2023-12-16T07:45:12.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff962b7d700 1 -- start start 2023-12-16T07:45:12.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff962b7d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c102bf0 0x7ff95c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:12.308 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff962b7d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c103590 0x7ff95c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff962b7d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c070a80 con 0x7ff95c102bf0 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff962b7d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c070bf0 con 0x7ff95c103590 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff960919700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c102bf0 0x7ff95c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff960919700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c102bf0 0x7ff95c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45504/0 (socket says 172.21.15.49:45504) 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff960919700 1 -- 172.21.15.49:0/2006464783 learned_addr learned my addr 172.21.15.49:0/2006464783 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.306+0000 7ff95bfff700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c103590 0x7ff95c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff960919700 1 -- 172.21.15.49:0/2006464783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c103590 msgr2=0x7ff95c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff960919700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c103590 0x7ff95c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff960919700 1 -- 172.21.15.49:0/2006464783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948005040 con 0x7ff95c102bf0 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff960919700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c102bf0 0x7ff95c06ff40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff950002a50 tx=0x7ff9500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:12.309 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff9597fa700 1 -- 172.21.15.49:0/2006464783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff950007cc0 con 0x7ff95c102bf0 2023-12-16T07:45:12.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff9597fa700 1 -- 172.21.15.49:0/2006464783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff95000f040 con 0x7ff95c102bf0 2023-12-16T07:45:12.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95c119860 con 0x7ff95c102bf0 2023-12-16T07:45:12.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff9597fa700 1 -- 172.21.15.49:0/2006464783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff95000d9c0 con 0x7ff95c102bf0 2023-12-16T07:45:12.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.307+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95c119d10 con 0x7ff95c102bf0 2023-12-16T07:45:12.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.308+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95c1050c0 con 0x7ff95c102bf0 2023-12-16T07:45:12.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.309+0000 7ff9597fa700 1 -- 172.21.15.49:0/2006464783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ff95000db20 con 0x7ff95c102bf0 2023-12-16T07:45:12.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.310+0000 7ff9597fa700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff94c06cf80 0x7ff94c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:12.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.310+0000 7ff9597fa700 1 -- 172.21.15.49:0/2006464783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff95008c250 con 0x7ff95c102bf0 2023-12-16T07:45:12.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.310+0000 7ff95bfff700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff94c06cf80 0x7ff94c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:12.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.310+0000 7ff95bfff700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff94c06cf80 0x7ff94c06f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b3b0 tx=0x7ff948009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:12.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.315+0000 7ff9597fa700 1 -- 172.21.15.49:0/2006464783 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff950055f10 con 0x7ff95c102bf0 2023-12-16T07:45:12.420 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:45:12 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[237731]: 2023-12-16T07:45:12.175+0000 7f2e28f83700 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:45:12.420 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:12 smithi049 ceph-mon[217548]: from='osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T07:45:12.538 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.537+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff95c071680 con 0x7ff94c06cf80 2023-12-16T07:45:12.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.548+0000 7ff9597fa700 1 -- 172.21.15.49:0/2006464783 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7ff95c071680 con 0x7ff94c06cf80 2023-12-16T07:45:12.549 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:45:12.549 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (2m) 3s ago 10m 28.5M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:45:12.549 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (53s) 3s ago 10m 7465k - 19.0.0-191-g6d933094 a29c258b5d6f ae149580b967 2023-12-16T07:45:12.549 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (49s) 47s ago 10m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f b4d081b98e26 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (2m) 3s ago 10m 86.0M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (6m) 3s ago 6m 15.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (6m) 3s ago 6m 16.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (6m) 47s ago 6m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (6m) 47s ago 6m 18.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (3m) 3s ago 11m 509M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (3m) 47s ago 9m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:45:12.550 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (96s) 3s ago 11m 56.9M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (77s) 47s ago 9m 40.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (3m) 3s ago 10m 17.5M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (3m) 47s ago 9m 17.9M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (35s) 3s ago 9m 122M 1568M 19.0.0-191-g6d933094 a29c258b5d6f bb0cb3d699c6 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6s) 3s ago 9m 11.7M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ac94960b0db8 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (8m) 3s ago 8m 773M 1568M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b79a38574d4d 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (8m) 47s ago 8m 1118M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (8m) 47s ago 8m 831M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (7m) 47s ago 7m 940M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:45:12.551 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (2m) 3s ago 10m 60.8M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:45:12.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.550+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff94c06cf80 msgr2=0x7ff94c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.550+0000 7ff962b7d700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff94c06cf80 0x7ff94c06f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b3b0 tx=0x7ff948009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:12.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.550+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c102bf0 msgr2=0x7ff95c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.550+0000 7ff962b7d700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c102bf0 0x7ff95c06ff40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff950002a50 tx=0x7ff9500046b0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.551+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 shutdown_connections 2023-12-16T07:45:12.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.551+0000 7ff962b7d700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff94c06cf80 0x7ff94c06f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.551+0000 7ff962b7d700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff95c102bf0 0x7ff95c06ff40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.551+0000 7ff962b7d700 1 --2- 172.21.15.49:0/2006464783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c103590 0x7ff95c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.551+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 >> 172.21.15.49:0/2006464783 conn(0x7ff95c0f87a0 msgr2=0x7ff95c0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:12.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.552+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 shutdown_connections 2023-12-16T07:45:12.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.552+0000 7ff962b7d700 1 -- 172.21.15.49:0/2006464783 wait complete. 2023-12-16T07:45:12.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:12 smithi133 ceph-mon[181557]: from='osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.665+0000 7f9518129700 1 -- 172.21.15.49:0/46514661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 msgr2=0x7f9510109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.665+0000 7f9518129700 1 --2- 172.21.15.49:0/46514661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510109050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9500004940 tx=0x7f9500009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.665+0000 7f9518129700 1 -- 172.21.15.49:0/46514661 shutdown_connections 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.665+0000 7f9518129700 1 --2- 172.21.15.49:0/46514661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510109050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.665+0000 7f9518129700 1 --2- 172.21.15.49:0/46514661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95100fb9e0 0x7f95100fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.665+0000 7f9518129700 1 -- 172.21.15.49:0/46514661 >> 172.21.15.49:0/46514661 conn(0x7f95100f7690 msgr2=0x7f95100f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.666+0000 7f9518129700 1 -- 172.21.15.49:0/46514661 shutdown_connections 2023-12-16T07:45:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.666+0000 7f9518129700 1 -- 172.21.15.49:0/46514661 wait complete. 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.666+0000 7f9518129700 1 Processor -- start 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.666+0000 7f9518129700 1 -- start start 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f9518129700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95100fb9e0 0x7f95101158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f9518129700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f9518129700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9510116430 con 0x7f95100fc2f0 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f9518129700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951010f760 con 0x7f95100fb9e0 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95156c4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95156c4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45526/0 (socket says 172.21.15.49:45526) 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95156c4700 1 -- 172.21.15.49:0/2447849710 learned_addr learned my addr 172.21.15.49:0/2447849710 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f9515ec5700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95100fb9e0 0x7f95101158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95156c4700 1 -- 172.21.15.49:0/2447849710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95100fb9e0 msgr2=0x7f95101158a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95156c4700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95100fb9e0 0x7f95101158a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95156c4700 1 -- 172.21.15.49:0/2447849710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500005040 con 0x7f95100fc2f0 2023-12-16T07:45:12.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95156c4700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510115de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9500000c00 tx=0x7f9500009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:12.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95067fc700 1 -- 172.21.15.49:0/2447849710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9500021070 con 0x7f95100fc2f0 2023-12-16T07:45:12.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95067fc700 1 -- 172.21.15.49:0/2447849710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f95000093b0 con 0x7f95100fc2f0 2023-12-16T07:45:12.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f95067fc700 1 -- 172.21.15.49:0/2447849710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f950000e070 con 0x7f95100fc2f0 2023-12-16T07:45:12.669 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.667+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951010f9e0 con 0x7f95100fc2f0 2023-12-16T07:45:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.668+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951010ff20 con 0x7f95100fc2f0 2023-12-16T07:45:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.669+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9510106780 con 0x7f95100fc2f0 2023-12-16T07:45:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.669+0000 7f95067fc700 1 -- 172.21.15.49:0/2447849710 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f9500013af0 con 0x7f95100fc2f0 2023-12-16T07:45:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.669+0000 7f95067fc700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f94fc06cf80 0x7f94fc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.670+0000 7f95067fc700 1 -- 172.21.15.49:0/2447849710 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f950008d560 con 0x7f95100fc2f0 2023-12-16T07:45:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.670+0000 7f9515ec5700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f94fc06cf80 0x7f94fc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.670+0000 7f9515ec5700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f94fc06cf80 0x7f94fc06f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f950c009b80 tx=0x7f950c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.675+0000 7f95067fc700 1 -- 172.21.15.49:0/2447849710 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f950005ad10 con 0x7f95100fc2f0 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.969+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f951010bdb0 con 0x7f95100fc2f0 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.970+0000 7f95067fc700 1 -- 172.21.15.49:0/2447849710 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f950005a8a0 con 0x7f95100fc2f0 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 1 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 8, 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 5 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:45:12.971 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:45:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f94fc06cf80 msgr2=0x7f94fc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f94fc06cf80 0x7f94fc06f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f950c009b80 tx=0x7f950c00b040 comp rx=0 tx=0).stop 2023-12-16T07:45:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 msgr2=0x7f9510115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510115de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9500000c00 tx=0x7f9500009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 shutdown_connections 2023-12-16T07:45:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95100fb9e0 0x7f95101158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f94fc06cf80 0x7f94fc06f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 --2- 172.21.15.49:0/2447849710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95100fc2f0 0x7f9510115de0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:12.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 >> 172.21.15.49:0/2447849710 conn(0x7f95100f7690 msgr2=0x7f95100f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:12.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 shutdown_connections 2023-12-16T07:45:12.973 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:12.972+0000 7f9518129700 1 -- 172.21.15.49:0/2447849710 wait complete. 2023-12-16T07:45:13.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 -- 172.21.15.49:0/1959980815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 msgr2=0x7fe7380fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/1959980815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7380fbfb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe728004940 tx=0x7fe728009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:13.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 -- 172.21.15.49:0/1959980815 shutdown_connections 2023-12-16T07:45:13.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/1959980815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7380fbfb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/1959980815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe738101b00 0x7fe738101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 -- 172.21.15.49:0/1959980815 >> 172.21.15.49:0/1959980815 conn(0x7fe7380719b0 msgr2=0x7fe738071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:13.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 -- 172.21.15.49:0/1959980815 shutdown_connections 2023-12-16T07:45:13.077 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 -- 172.21.15.49:0/1959980815 wait complete. 2023-12-16T07:45:13.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 Processor -- start 2023-12-16T07:45:13.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.076+0000 7fe73f3c7700 1 -- start start 2023-12-16T07:45:13.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73f3c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7381135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73f3c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe738101b00 0x7fe738113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73f3c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe738114170 con 0x7fe7380fbb40 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73f3c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73810d4a0 con 0x7fe738101b00 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73d163700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7381135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73d163700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7381135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45552/0 (socket says 172.21.15.49:45552) 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73d163700 1 -- 172.21.15.49:0/984736135 learned_addr learned my addr 172.21.15.49:0/984736135 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73c962700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe738101b00 0x7fe738113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73d163700 1 -- 172.21.15.49:0/984736135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe738101b00 msgr2=0x7fe738113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73d163700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe738101b00 0x7fe738113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73d163700 1 -- 172.21.15.49:0/984736135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728005040 con 0x7fe7380fbb40 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73d163700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7381135e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe73400eb70 tx=0x7fe73400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe72dffb700 1 -- 172.21.15.49:0/984736135 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe734007cc0 con 0x7fe7380fbb40 2023-12-16T07:45:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73810d720 con 0x7fe7380fbb40 2023-12-16T07:45:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe72dffb700 1 -- 172.21.15.49:0/984736135 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe73400f040 con 0x7fe7380fbb40 2023-12-16T07:45:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.077+0000 7fe72dffb700 1 -- 172.21.15.49:0/984736135 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73400c9f0 con 0x7fe7380fbb40 2023-12-16T07:45:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.078+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73810dc30 con 0x7fe7380fbb40 2023-12-16T07:45:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.079+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7380734d0 con 0x7fe7380fbb40 2023-12-16T07:45:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.079+0000 7fe72dffb700 1 -- 172.21.15.49:0/984736135 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fe73400cb50 con 0x7fe7380fbb40 2023-12-16T07:45:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.079+0000 7fe72dffb700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe72406cf80 0x7fe72406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.080+0000 7fe72dffb700 1 -- 172.21.15.49:0/984736135 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe73408c0b0 con 0x7fe7380fbb40 2023-12-16T07:45:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.080+0000 7fe73c962700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe72406cf80 0x7fe72406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.080+0000 7fe73c962700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe72406cf80 0x7fe72406f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe73810e7d0 tx=0x7fe728009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.084+0000 7fe72dffb700 1 -- 172.21.15.49:0/984736135 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe734059800 con 0x7fe7380fbb40 2023-12-16T07:45:13.344 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.344+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe738108ad0 con 0x7fe7380fbb40 2023-12-16T07:45:13.345 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.344+0000 7fe72dffb700 1 -- 172.21.15.49:0/984736135 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1847 (secure 0 0 0) 0x7fe734059390 con 0x7fe7380fbb40 2023-12-16T07:45:13.345 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:45:13.345 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:45:13.345 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:45:13.345 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:45:13.345 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:13.345 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2023-12-16T07:45:13.346 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:45:13.347 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:13.348 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe72406cf80 msgr2=0x7fe72406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe72406cf80 0x7fe72406f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe73810e7d0 tx=0x7fe728009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 msgr2=0x7fe7381135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7381135e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe73400eb70 tx=0x7fe73400b040 comp rx=0 tx=0).stop 2023-12-16T07:45:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 shutdown_connections 2023-12-16T07:45:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe72406cf80 0x7fe72406f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.349 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7380fbb40 0x7fe7381135e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 --2- 172.21.15.49:0/984736135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe738101b00 0x7fe738113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 >> 172.21.15.49:0/984736135 conn(0x7fe7380719b0 msgr2=0x7fe738065470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 shutdown_connections 2023-12-16T07:45:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.347+0000 7fe73f3c7700 1 -- 172.21.15.49:0/984736135 wait complete. 2023-12-16T07:45:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 -- 172.21.15.49:0/2999478992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 msgr2=0x7fc1e0103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 --2- 172.21.15.49:0/2999478992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e0103040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004940 tx=0x7fc1dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 -- 172.21.15.49:0/2999478992 shutdown_connections 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 --2- 172.21.15.49:0/2999478992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1e00fb1e0 0x7fc1e00fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 --2- 172.21.15.49:0/2999478992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e0103040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 -- 172.21.15.49:0/2999478992 >> 172.21.15.49:0/2999478992 conn(0x7fc1e00711a0 msgr2=0x7fc1e00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 -- 172.21.15.49:0/2999478992 shutdown_connections 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 -- 172.21.15.49:0/2999478992 wait complete. 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 Processor -- start 2023-12-16T07:45:13.455 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.453+0000 7fc1e8652700 1 -- start start 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e8652700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1e00fb1e0 0x7fc1e00fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e8652700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e00fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e8652700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00fcf00 con 0x7fc1e0102c70 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e8652700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00fd070 con 0x7fc1e00fb1e0 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e5bed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e00fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e5bed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e00fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45576/0 (socket says 172.21.15.49:45576) 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e5bed700 1 -- 172.21.15.49:0/822998222 learned_addr learned my addr 172.21.15.49:0/822998222 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e63ee700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1e00fb1e0 0x7fc1e00fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e5bed700 1 -- 172.21.15.49:0/822998222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1e00fb1e0 msgr2=0x7fc1e00fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e5bed700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1e00fb1e0 0x7fc1e00fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e5bed700 1 -- 172.21.15.49:0/822998222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc005040 con 0x7fc1e0102c70 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e63ee700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1e00fb1e0 0x7fc1e00fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:45:13.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e5bed700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e00fc900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c830 tx=0x7fc1d0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/822998222 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d000a760 con 0x7fc1e0102c70 2023-12-16T07:45:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/822998222 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1d000ad70 con 0x7fc1e0102c70 2023-12-16T07:45:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e0119840 con 0x7fc1e0102c70 2023-12-16T07:45:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/822998222 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d00113a0 con 0x7fc1e0102c70 2023-12-16T07:45:13.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.454+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e0119d20 con 0x7fc1e0102c70 2023-12-16T07:45:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.455+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e00fff10 con 0x7fc1e0102c70 2023-12-16T07:45:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.456+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/822998222 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fc1d0012400 con 0x7fc1e0102c70 2023-12-16T07:45:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.457+0000 7fc1d6ffd700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc1cc06cf80 0x7fc1cc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.457+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/822998222 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc1d008cfe0 con 0x7fc1e0102c70 2023-12-16T07:45:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.457+0000 7fc1e63ee700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc1cc06cf80 0x7fc1cc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.457+0000 7fc1e63ee700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc1cc06cf80 0x7fc1cc06f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004f90 tx=0x7fc1dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:13.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: pgmap v54: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: osdmap e56: 6 total, 5 up, 6 in 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: failed to encode map e56 with expected crc 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: failed to encode map e56 with expected crc 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:13.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:13 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2447849710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.461+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/822998222 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc1d0056e50 con 0x7fc1e0102c70 2023-12-16T07:45:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: pgmap v54: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-16T07:45:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: osdmap e56: 6 total, 5 up, 6 in 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: failed to encode map e56 with expected crc 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: failed to encode map e56 with expected crc 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:13.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:13.619 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:13 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2447849710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:13.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.683+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e00fdb00 con 0x7fc1cc06cf80 2023-12-16T07:45:13.684 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.685+0000 7fc1d6ffd700 1 -- 172.21.15.49:0/822998222 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc1e00fdb00 con 0x7fc1cc06cf80 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "8/21 daemons upgraded", 2023-12-16T07:45:13.685 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T07:45:13.686 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:45:13.686 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc1cc06cf80 msgr2=0x7fc1cc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc1cc06cf80 0x7fc1cc06f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004f90 tx=0x7fc1dc009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 msgr2=0x7fc1e00fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e00fc900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c830 tx=0x7fc1d0004470 comp rx=0 tx=0).stop 2023-12-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 shutdown_connections 2023-12-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1e00fb1e0 0x7fc1e00fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc1cc06cf80 0x7fc1cc06f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 --2- 172.21.15.49:0/822998222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1e0102c70 0x7fc1e00fc900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 >> 172.21.15.49:0/822998222 conn(0x7fc1e00711a0 msgr2=0x7fc1e00fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:13.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 shutdown_connections 2023-12-16T07:45:13.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.687+0000 7fc1e8652700 1 -- 172.21.15.49:0/822998222 wait complete. 2023-12-16T07:45:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 -- 172.21.15.49:0/1177143174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7118101b00 msgr2=0x7f7118101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 --2- 172.21.15.49:0/1177143174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7118101b00 0x7f7118101ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7108004940 tx=0x7f7108009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 -- 172.21.15.49:0/1177143174 shutdown_connections 2023-12-16T07:45:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 --2- 172.21.15.49:0/1177143174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71180fbb40 0x7f71180fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 --2- 172.21.15.49:0/1177143174 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7118101b00 0x7f7118101ed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 -- 172.21.15.49:0/1177143174 >> 172.21.15.49:0/1177143174 conn(0x7f71180719b0 msgr2=0x7f7118071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:13.792 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 -- 172.21.15.49:0/1177143174 shutdown_connections 2023-12-16T07:45:13.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.791+0000 7f711fe1c700 1 -- 172.21.15.49:0/1177143174 wait complete. 2023-12-16T07:45:13.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711fe1c700 1 Processor -- start 2023-12-16T07:45:13.793 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711fe1c700 1 -- start start 2023-12-16T07:45:13.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711fe1c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71180fbb40 0x7f711810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711fe1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7118101b00 0x7f711810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.794 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711fe1c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711810f1c0 con 0x7f71180fbb40 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711fe1c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711810f300 con 0x7f7118101b00 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711dbb8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71180fbb40 0x7f711810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711dbb8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71180fbb40 0x7f711810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45598/0 (socket says 172.21.15.49:45598) 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711dbb8700 1 -- 172.21.15.49:0/2267028245 learned_addr learned my addr 172.21.15.49:0/2267028245 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711dbb8700 1 -- 172.21.15.49:0/2267028245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7118101b00 msgr2=0x7f711810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711d3b7700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7118101b00 0x7f711810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711dbb8700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7118101b00 0x7f711810ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.792+0000 7f711dbb8700 1 -- 172.21.15.49:0/2267028245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108005040 con 0x7f71180fbb40 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.793+0000 7f711dbb8700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71180fbb40 0x7f711810e6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f710800b3b0 tx=0x7f7108009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.793+0000 7f710e7fc700 1 -- 172.21.15.49:0/2267028245 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f710800e040 con 0x7f71180fbb40 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.793+0000 7f710e7fc700 1 -- 172.21.15.49:0/2267028245 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f710800bc50 con 0x7f71180fbb40 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.793+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7118117600 con 0x7f71180fbb40 2023-12-16T07:45:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.793+0000 7f710e7fc700 1 -- 172.21.15.49:0/2267028245 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7108013420 con 0x7f71180fbb40 2023-12-16T07:45:13.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.793+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7118117b10 con 0x7f71180fbb40 2023-12-16T07:45:13.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.794+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7118103fb0 con 0x7f71180fbb40 2023-12-16T07:45:13.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.795+0000 7f710e7fc700 1 -- 172.21.15.49:0/2267028245 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f710801c430 con 0x7f71180fbb40 2023-12-16T07:45:13.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.795+0000 7f710e7fc700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f710406cf80 0x7f710406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:13.796 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.795+0000 7f710e7fc700 1 -- 172.21.15.49:0/2267028245 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f710808daa0 con 0x7f71180fbb40 2023-12-16T07:45:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.795+0000 7f711d3b7700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f710406cf80 0x7f710406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:13.797 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.796+0000 7f711d3b7700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f710406cf80 0x7f710406f430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7118065e30 tx=0x7f7114009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:13.799 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:13.799+0000 7f710e7fc700 1 -- 172.21.15.49:0/2267028245 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7108057930 con 0x7f71180fbb40 2023-12-16T07:45:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.088+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f71180734d0 con 0x7f71180fbb40 2023-12-16T07:45:14.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.089+0000 7f710e7fc700 1 -- 172.21.15.49:0/2267028245 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1037 (secure 0 0 0) 0x7f710805af50 con 0x7f71180fbb40 2023-12-16T07:45:14.089 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2023-12-16T07:45:14.090 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2023-12-16T07:45:14.091 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2023-12-16T07:45:14.091 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-16T07:45:14.091 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-16T07:45:14.091 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-16T07:45:14.091 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2023-12-16T07:45:14.091 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f710406cf80 msgr2=0x7f710406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f710406cf80 0x7f710406f430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7118065e30 tx=0x7f7114009040 comp rx=0 tx=0).stop 2023-12-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71180fbb40 msgr2=0x7f711810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71180fbb40 0x7f711810e6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f710800b3b0 tx=0x7f7108009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 shutdown_connections 2023-12-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f710406cf80 0x7f710406f430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71180fbb40 0x7f711810e6f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 --2- 172.21.15.49:0/2267028245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7118101b00 0x7f711810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 >> 172.21.15.49:0/2267028245 conn(0x7f71180719b0 msgr2=0x7f71180fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 shutdown_connections 2023-12-16T07:45:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:14.091+0000 7f711fe1c700 1 -- 172.21.15.49:0/2267028245 wait complete. 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: failed to encode map e57 with expected crc 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732] boot 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: osdmap e57: 6 total, 6 up, 6 in 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: failed to encode map e56 with expected crc 2023-12-16T07:45:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: failed to encode map e56 with expected crc 2023-12-16T07:45:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/984736135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:45:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:45:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:14 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2267028245' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:45:14.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:14.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-16T07:45:14.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:45:14.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: failed to encode map e57 with expected crc 2023-12-16T07:45:14.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: osd.1 [v2:172.21.15.49:6810/3307407732,v1:172.21.15.49:6811/3307407732] boot 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: osdmap e57: 6 total, 6 up, 6 in 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: failed to encode map e56 with expected crc 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: failed to encode map e56 with expected crc 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/984736135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:45:14.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:14 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2267028245' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: pgmap v57: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: osdmap e58: 6 total, 6 up, 6 in 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:15 smithi049 ceph-mon[217548]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: pgmap v57: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:15.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: osdmap e58: 6 total, 6 up, 6 in 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:15.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:15 smithi133 ceph-mon[181557]: failed to encode map e58 with expected crc 2023-12-16T07:45:16.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:16 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:16.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:16 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:17.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:17 smithi049 ceph-mon[217548]: pgmap v59: 65 pgs: 2 peering, 6 active+undersized+degraded, 6 active+undersized, 51 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 15/222 objects degraded (6.757%) 2023-12-16T07:45:17.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:17 smithi133 ceph-mon[181557]: pgmap v59: 65 pgs: 2 peering, 6 active+undersized+degraded, 6 active+undersized, 51 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 15/222 objects degraded (6.757%) 2023-12-16T07:45:18.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:18 smithi049 ceph-mon[217548]: mgrmap e40: smithi049.rqlvwo(active, since 93s), standbys: smithi133.wbiduk 2023-12-16T07:45:18.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:18 smithi133 ceph-mon[181557]: mgrmap e40: smithi049.rqlvwo(active, since 93s), standbys: smithi133.wbiduk 2023-12-16T07:45:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:19 smithi049 ceph-mon[217548]: pgmap v60: 65 pgs: 2 peering, 63 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:45:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:19 smithi049 ceph-mon[217548]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/222 objects degraded (6.757%), 6 pgs degraded) 2023-12-16T07:45:19.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:19 smithi133 ceph-mon[181557]: pgmap v60: 65 pgs: 2 peering, 63 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-16T07:45:19.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:19 smithi133 ceph-mon[181557]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/222 objects degraded (6.757%), 6 pgs degraded) 2023-12-16T07:45:21.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:21 smithi049 ceph-mon[217548]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 402 B/s wr, 0 op/s 2023-12-16T07:45:21.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:21 smithi133 ceph-mon[181557]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 402 B/s wr, 0 op/s 2023-12-16T07:45:23.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:23 smithi049 ceph-mon[217548]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 356 B/s wr, 0 op/s 2023-12-16T07:45:23.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:23 smithi133 ceph-mon[181557]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 356 B/s wr, 0 op/s 2023-12-16T07:45:25.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:25 smithi049 ceph-mon[217548]: pgmap v63: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2023-12-16T07:45:25.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:25 smithi133 ceph-mon[181557]: pgmap v63: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2023-12-16T07:45:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:27 smithi049 ceph-mon[217548]: pgmap v64: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 264 B/s wr, 0 op/s 2023-12-16T07:45:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:27 smithi133 ceph-mon[181557]: pgmap v64: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 264 B/s wr, 0 op/s 2023-12-16T07:45:28.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:28 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:28.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:28 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:29.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: pgmap v65: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: Upgrade: osd.2 is safe to restart 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T07:45:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: pgmap v65: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-16T07:45:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: Upgrade: osd.2 is safe to restart 2023-12-16T07:45:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:45:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-16T07:45:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:30.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:30 smithi049 ceph-mon[217548]: Upgrade: Updating osd.2 2023-12-16T07:45:30.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:30 smithi049 ceph-mon[217548]: Deploying daemon osd.2 on smithi049 2023-12-16T07:45:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:30 smithi133 ceph-mon[181557]: Upgrade: Updating osd.2 2023-12-16T07:45:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:30 smithi133 ceph-mon[181557]: Deploying daemon osd.2 on smithi049 2023-12-16T07:45:31.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:31 smithi049 ceph-mon[217548]: pgmap v66: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:31.459 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:31 smithi049 systemd[1]: Stopping Ceph osd.2 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:45:31.459 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:31 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[153878]: 2023-12-16T07:45:31.406+0000 7fb11ed9f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:45:31.460 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:31 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[153878]: 2023-12-16T07:45:31.406+0000 7fb11ed9f700 -1 osd.2 58 *** Got signal Terminated *** 2023-12-16T07:45:31.460 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:31 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[153878]: 2023-12-16T07:45:31.406+0000 7fb11ed9f700 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:45:31.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:31 smithi133 ceph-mon[181557]: pgmap v66: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:32.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:32 smithi133 ceph-mon[181557]: osd.2 marked itself down and dead 2023-12-16T07:45:32.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:32 smithi049 ceph-mon[217548]: osd.2 marked itself down and dead 2023-12-16T07:45:33.209 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:32 smithi049 bash[244596]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2 2023-12-16T07:45:33.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:33 smithi049 ceph-mon[217548]: pgmap v67: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:33.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:33 smithi049 ceph-mon[217548]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:45:33.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:33 smithi049 ceph-mon[217548]: failed to encode map e59 with expected crc 2023-12-16T07:45:33.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:33 smithi049 ceph-mon[217548]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T07:45:33.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:33 smithi049 ceph-mon[217548]: failed to encode map e59 with expected crc 2023-12-16T07:45:33.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:33 smithi049 ceph-mon[217548]: failed to encode map e59 with expected crc 2023-12-16T07:45:33.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:33 smithi133 ceph-mon[181557]: pgmap v67: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:33.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:33 smithi133 ceph-mon[181557]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:45:33.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:33 smithi133 ceph-mon[181557]: failed to encode map e59 with expected crc 2023-12-16T07:45:33.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:33 smithi133 ceph-mon[181557]: osdmap e59: 6 total, 5 up, 6 in 2023-12-16T07:45:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:33 smithi133 ceph-mon[181557]: failed to encode map e59 with expected crc 2023-12-16T07:45:33.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:33 smithi133 ceph-mon[181557]: failed to encode map e59 with expected crc 2023-12-16T07:45:34.460 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:34 smithi049 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.2.service: Succeeded. 2023-12-16T07:45:34.460 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:34 smithi049 systemd[1]: Stopped Ceph osd.2 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:45:34.460 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:34 smithi049 systemd[1]: Starting Ceph osd.2 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:45:34.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: osdmap e60: 6 total, 5 up, 6 in 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:34 smithi049 ceph-mon[217548]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: osdmap e60: 6 total, 5 up, 6 in 2023-12-16T07:45:34.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:34.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:34 smithi133 ceph-mon[181557]: failed to encode map e60 with expected crc 2023-12-16T07:45:35.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:35 smithi049 ceph-mon[217548]: pgmap v70: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2023-12-16T07:45:36.616 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:35 smithi049 ceph-mon[217548]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 4 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:36.617 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[244866]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T07:45:36.617 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[244866]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T07:45:36.617 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[244866]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T07:45:36.617 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[244866]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T07:45:36.617 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[244866]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-16T07:45:36.617 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[244866]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T07:45:36.618 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[244866]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-16T07:45:36.618 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 ceph-osd[245182]: -- 172.21.15.49:0/3572978539 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eeff4096c0 con 0x55eeff3d9000 2023-12-16T07:45:36.618 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 bash[245145]: 0eb7426982e856a13d756b547c6c140397cd240c15dc9b03a361c667c2086d32 2023-12-16T07:45:36.618 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:35 smithi049 systemd[1]: Started Ceph osd.2 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:45:36.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:35 smithi133 ceph-mon[181557]: pgmap v70: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2023-12-16T07:45:36.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:35 smithi133 ceph-mon[181557]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 4 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:36.709 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:36 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[245159]: 2023-12-16T07:45:36.315+0000 7fdfe32a2640 -1 Falling back to public interface 2023-12-16T07:45:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:36 smithi133 ceph-mon[181557]: pgmap v71: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 17/222 objects degraded (7.658%) 2023-12-16T07:45:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:36 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:36 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:37.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:36 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:36 smithi049 ceph-mon[217548]: pgmap v71: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 17/222 objects degraded (7.658%) 2023-12-16T07:45:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:36 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:36 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:37.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:36 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:38.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:38 smithi049 ceph-mon[217548]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:39.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:38 smithi133 ceph-mon[181557]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:40.134 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:39 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.134 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:39 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.134 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:39 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.134 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:39 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:39 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:39 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:39 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:39 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:40.439 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:40 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[245159]: 2023-12-16T07:45:40.278+0000 7fdfe32a2640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-16T07:45:41.209 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:40 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[245159]: 2023-12-16T07:45:40.757+0000 7fdfe32a2640 -1 osd.2 58 log_to_monitors true 2023-12-16T07:45:41.930 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:45:41 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[245159]: 2023-12-16T07:45:41.693+0000 7fdfd1f0e700 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:45:41.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:41 smithi049 ceph-mon[217548]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:41.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:41 smithi049 ceph-mon[217548]: from='osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T07:45:41.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:41 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:42.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:41 smithi133 ceph-mon[181557]: pgmap v73: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:42.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:41 smithi133 ceph-mon[181557]: from='osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-16T07:45:42.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:41 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: osdmap e61: 6 total, 5 up, 6 in 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:45:42.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:42.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:42.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:42.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:42.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:42.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:42 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:43.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-16T07:45:43.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: osdmap e61: 6 total, 5 up, 6 in 2023-12-16T07:45:43.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2023-12-16T07:45:43.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:43.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:42 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: pgmap v75: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: failed to encode map e61 with expected crc 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532] boot 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: osdmap e62: 6 total, 6 up, 6 in 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: failed to encode map e61 with expected crc 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: failed to encode map e61 with expected crc 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: failed to encode map e62 with expected crc 2023-12-16T07:45:43.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:43 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:45:44.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: pgmap v75: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:45:44.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:44.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T07:45:44.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: failed to encode map e61 with expected crc 2023-12-16T07:45:44.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:45:44.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: osd.2 [v2:172.21.15.49:6818/4059212532,v1:172.21.15.49:6819/4059212532] boot 2023-12-16T07:45:44.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: osdmap e62: 6 total, 6 up, 6 in 2023-12-16T07:45:44.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: failed to encode map e61 with expected crc 2023-12-16T07:45:44.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: failed to encode map e61 with expected crc 2023-12-16T07:45:44.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: failed to encode map e62 with expected crc 2023-12-16T07:45:44.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:43 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/2447995811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b340fbb40 msgr2=0x7f9b340fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/2447995811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b340fbb40 0x7f9b340fbfb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b24004940 tx=0x7f9b24009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/2447995811 shutdown_connections 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/2447995811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b340fbb40 0x7f9b340fbfb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/2447995811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b34101b00 0x7f9b34101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/2447995811 >> 172.21.15.49:0/2447995811 conn(0x7f9b340719b0 msgr2=0x7f9b34071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/2447995811 shutdown_connections 2023-12-16T07:45:44.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.210+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/2447995811 wait complete. 2023-12-16T07:45:44.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b3b8e6700 1 Processor -- start 2023-12-16T07:45:44.212 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b3b8e6700 1 -- start start 2023-12-16T07:45:44.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b3b8e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b340fbb40 0x7f9b340fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b3b8e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b34101b00 0x7f9b340fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b3b8e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340fe2d0 con 0x7f9b34101b00 2023-12-16T07:45:44.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b3b8e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340fe440 con 0x7f9b340fbb40 2023-12-16T07:45:44.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b38e81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b34101b00 0x7f9b340fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b38e81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b34101b00 0x7f9b340fdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45596/0 (socket says 172.21.15.49:45596) 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b38e81700 1 -- 172.21.15.49:0/506657323 learned_addr learned my addr 172.21.15.49:0/506657323 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.211+0000 7f9b39682700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b340fbb40 0x7f9b340fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b38e81700 1 -- 172.21.15.49:0/506657323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b340fbb40 msgr2=0x7f9b340fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b38e81700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b340fbb40 0x7f9b340fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b38e81700 1 -- 172.21.15.49:0/506657323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24005040 con 0x7f9b34101b00 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b38e81700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b34101b00 0x7f9b340fdc80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400b3b0 tx=0x7f9b24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b29ffb700 1 -- 172.21.15.49:0/506657323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2400e040 con 0x7f9b34101b00 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b29ffb700 1 -- 172.21.15.49:0/506657323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b2400bc50 con 0x7f9b34101b00 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b341198f0 con 0x7f9b34101b00 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b29ffb700 1 -- 172.21.15.49:0/506657323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b24013420 con 0x7f9b34101b00 2023-12-16T07:45:44.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.212+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b34119dd0 con 0x7f9b34101b00 2023-12-16T07:45:44.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.213+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b340734d0 con 0x7f9b34101b00 2023-12-16T07:45:44.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.214+0000 7f9b29ffb700 1 -- 172.21.15.49:0/506657323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f9b2401c430 con 0x7f9b34101b00 2023-12-16T07:45:44.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.214+0000 7f9b29ffb700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9b2006ce60 0x7f9b2006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.214+0000 7f9b29ffb700 1 -- 172.21.15.49:0/506657323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9b2408cf10 con 0x7f9b34101b00 2023-12-16T07:45:44.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.214+0000 7f9b39682700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9b2006ce60 0x7f9b2006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.215 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.215+0000 7f9b39682700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9b2006ce60 0x7f9b2006f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b30004990 tx=0x7f9b30009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:44.219 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.219+0000 7f9b29ffb700 1 -- 172.21.15.49:0/506657323 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9b24056fc0 con 0x7f9b34101b00 2023-12-16T07:45:44.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.442+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b340feed0 con 0x7f9b2006ce60 2023-12-16T07:45:44.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.443+0000 7f9b29ffb700 1 -- 172.21.15.49:0/506657323 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9b340feed0 con 0x7f9b2006ce60 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.445+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9b2006ce60 msgr2=0x7f9b2006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.445+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9b2006ce60 0x7f9b2006f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b30004990 tx=0x7f9b30009ee0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.445+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b34101b00 msgr2=0x7f9b340fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.445+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b34101b00 0x7f9b340fdc80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400b3b0 tx=0x7f9b24009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.446+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 shutdown_connections 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.446+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b340fbb40 0x7f9b340fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.446+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9b2006ce60 0x7f9b2006f310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.446+0000 7f9b3b8e6700 1 --2- 172.21.15.49:0/506657323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b34101b00 0x7f9b340fdc80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.446 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.446+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 >> 172.21.15.49:0/506657323 conn(0x7f9b340719b0 msgr2=0x7f9b340654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:44.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.446+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 shutdown_connections 2023-12-16T07:45:44.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.446+0000 7f9b3b8e6700 1 -- 172.21.15.49:0/506657323 wait complete. 2023-12-16T07:45:44.456 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:45:44.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 -- 172.21.15.49:0/4128314806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c102c20 msgr2=0x7f9d2c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 --2- 172.21.15.49:0/4128314806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c102c20 0x7f9d2c102ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c004940 tx=0x7f9d1c009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 -- 172.21.15.49:0/4128314806 shutdown_connections 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 --2- 172.21.15.49:0/4128314806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2c065390 0x7f9d2c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 --2- 172.21.15.49:0/4128314806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c102c20 0x7f9d2c102ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 -- 172.21.15.49:0/4128314806 >> 172.21.15.49:0/4128314806 conn(0x7f9d2c0719b0 msgr2=0x7f9d2c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 -- 172.21.15.49:0/4128314806 shutdown_connections 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 -- 172.21.15.49:0/4128314806 wait complete. 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.551+0000 7f9d343da700 1 Processor -- start 2023-12-16T07:45:44.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d343da700 1 -- start start 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d343da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c065390 0x7f9d2c0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d343da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2c102c20 0x7f9d2c0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d343da700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0fc730 con 0x7f9d2c065390 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d343da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0fc8a0 con 0x7f9d2c102c20 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d32176700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c065390 0x7f9d2c0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d32176700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c065390 0x7f9d2c0fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45612/0 (socket says 172.21.15.49:45612) 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d32176700 1 -- 172.21.15.49:0/43961007 learned_addr learned my addr 172.21.15.49:0/43961007 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:44.554 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d31975700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2c102c20 0x7f9d2c0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d32176700 1 -- 172.21.15.49:0/43961007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2c102c20 msgr2=0x7f9d2c0fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d32176700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2c102c20 0x7f9d2c0fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d32176700 1 -- 172.21.15.49:0/43961007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c005040 con 0x7f9d2c065390 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d32176700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c065390 0x7f9d2c0fbbf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009fd0 tx=0x7f9d1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.552+0000 7f9d22ffd700 1 -- 172.21.15.49:0/43961007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1c00e040 con 0x7f9d2c065390 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.553+0000 7f9d22ffd700 1 -- 172.21.15.49:0/43961007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d1c00bc50 con 0x7f9d2c065390 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.553+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c119910 con 0x7f9d2c065390 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.553+0000 7f9d22ffd700 1 -- 172.21.15.49:0/43961007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1c013ea0 con 0x7f9d2c065390 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.553+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c119d70 con 0x7f9d2c065390 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.554+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c0fff40 con 0x7f9d2c065390 2023-12-16T07:45:44.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.554+0000 7f9d22ffd700 1 -- 172.21.15.49:0/43961007 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f9d1c013420 con 0x7f9d2c065390 2023-12-16T07:45:44.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.554+0000 7f9d22ffd700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d1806ce70 0x7f9d1806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.555+0000 7f9d22ffd700 1 -- 172.21.15.49:0/43961007 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9d1c08d810 con 0x7f9d2c065390 2023-12-16T07:45:44.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.555+0000 7f9d31975700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d1806ce70 0x7f9d1806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.556 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.555+0000 7f9d31975700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d1806ce70 0x7f9d1806f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0fd5f0 tx=0x7f9d28009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:44.559 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.559+0000 7f9d22ffd700 1 -- 172.21.15.49:0/43961007 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9d1c0576f0 con 0x7f9d2c065390 2023-12-16T07:45:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.781+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d2c0fd330 con 0x7f9d1806ce70 2023-12-16T07:45:44.782 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.782+0000 7f9d22ffd700 1 -- 172.21.15.49:0/43961007 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9d2c0fd330 con 0x7f9d1806ce70 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d1806ce70 msgr2=0x7f9d1806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d1806ce70 0x7f9d1806f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0fd5f0 tx=0x7f9d28009ee0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c065390 msgr2=0x7f9d2c0fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c065390 0x7f9d2c0fbbf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009fd0 tx=0x7f9d1c009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 shutdown_connections 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9d1806ce70 0x7f9d1806f320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d2c065390 0x7f9d2c0fbbf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.784+0000 7f9d343da700 1 --2- 172.21.15.49:0/43961007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2c102c20 0x7f9d2c0fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.785+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 >> 172.21.15.49:0/43961007 conn(0x7f9d2c0719b0 msgr2=0x7f9d2c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.785+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 shutdown_connections 2023-12-16T07:45:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.785+0000 7f9d343da700 1 -- 172.21.15.49:0/43961007 wait complete. 2023-12-16T07:45:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 -- 172.21.15.49:0/3703285266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360065390 msgr2=0x7fe360065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 --2- 172.21.15.49:0/3703285266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360065390 0x7fe360065800 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe350004940 tx=0x7fe350009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 -- 172.21.15.49:0/3703285266 shutdown_connections 2023-12-16T07:45:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 --2- 172.21.15.49:0/3703285266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360065390 0x7fe360065800 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 --2- 172.21.15.49:0/3703285266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe360102c20 0x7fe360102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.890 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 -- 172.21.15.49:0/3703285266 >> 172.21.15.49:0/3703285266 conn(0x7fe3600719b0 msgr2=0x7fe360071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 -- 172.21.15.49:0/3703285266 shutdown_connections 2023-12-16T07:45:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.889+0000 7fe36856f700 1 -- 172.21.15.49:0/3703285266 wait complete. 2023-12-16T07:45:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe36856f700 1 Processor -- start 2023-12-16T07:45:44.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe36856f700 1 -- start start 2023-12-16T07:45:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe36856f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe360065390 0x7fe360113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe36856f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360102c20 0x7fe360113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe36856f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601142c0 con 0x7fe360102c20 2023-12-16T07:45:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe36856f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36010d5f0 con 0x7fe360065390 2023-12-16T07:45:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe365b0a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360102c20 0x7fe360113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe365b0a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360102c20 0x7fe360113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45628/0 (socket says 172.21.15.49:45628) 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe365b0a700 1 -- 172.21.15.49:0/658873915 learned_addr learned my addr 172.21.15.49:0/658873915 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.890+0000 7fe36630b700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe360065390 0x7fe360113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe365b0a700 1 -- 172.21.15.49:0/658873915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe360065390 msgr2=0x7fe360113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe365b0a700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe360065390 0x7fe360113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe365b0a700 1 -- 172.21.15.49:0/658873915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350005040 con 0x7fe360102c20 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe365b0a700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360102c20 0x7fe360113c70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe350009fd0 tx=0x7fe350009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe356ffd700 1 -- 172.21.15.49:0/658873915 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe35000e040 con 0x7fe360102c20 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe356ffd700 1 -- 172.21.15.49:0/658873915 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe350013420 con 0x7fe360102c20 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36010d870 con 0x7fe360102c20 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe356ffd700 1 -- 172.21.15.49:0/658873915 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe35001c630 con 0x7fe360102c20 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.891+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36010ddb0 con 0x7fe360102c20 2023-12-16T07:45:44.893 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.892+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3600fff40 con 0x7fe360102c20 2023-12-16T07:45:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.893+0000 7fe356ffd700 1 -- 172.21.15.49:0/658873915 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe350013590 con 0x7fe360102c20 2023-12-16T07:45:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.893+0000 7fe356ffd700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe34c06ce70 0x7fe34c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.893+0000 7fe356ffd700 1 -- 172.21.15.49:0/658873915 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe35008d480 con 0x7fe360102c20 2023-12-16T07:45:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.893+0000 7fe36630b700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe34c06ce70 0x7fe34c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:44.894 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.893+0000 7fe36630b700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe34c06ce70 0x7fe34c06f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe35c004f40 tx=0x7fe35c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:44.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:44.897+0000 7fe356ffd700 1 -- 172.21.15.49:0/658873915 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe35005af10 con 0x7fe360102c20 2023-12-16T07:45:44.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: failed to encode map e63 with expected crc 2023-12-16T07:45:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: osdmap e63: 6 total, 6 up, 6 in 2023-12-16T07:45:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: failed to encode map e63 with expected crc 2023-12-16T07:45:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: failed to encode map e63 with expected crc 2023-12-16T07:45:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: failed to encode map e63 with expected crc 2023-12-16T07:45:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:45:44.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:45.111 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.111+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe36004bb80 con 0x7fe34c06ce70 2023-12-16T07:45:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: failed to encode map e63 with expected crc 2023-12-16T07:45:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: osdmap e63: 6 total, 6 up, 6 in 2023-12-16T07:45:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: failed to encode map e63 with expected crc 2023-12-16T07:45:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: failed to encode map e63 with expected crc 2023-12-16T07:45:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: failed to encode map e63 with expected crc 2023-12-16T07:45:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:45:45.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:45.121 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.121+0000 7fe356ffd700 1 -- 172.21.15.49:0/658873915 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe36004bb80 con 0x7fe34c06ce70 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (3m) 6s ago 11m 28.5M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (85s) 6s ago 11m 7465k - 19.0.0-191-g6d933094 a29c258b5d6f ae149580b967 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (82s) 80s ago 10m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f b4d081b98e26 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (3m) 6s ago 10m 88.2M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (7m) 6s ago 7m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (7m) 6s ago 7m 16.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (7m) 80s ago 7m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (7m) 80s ago 7m 18.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (4m) 6s ago 12m 511M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (4m) 80s ago 10m 447M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:45:45.122 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (2m) 6s ago 12m 62.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (110s) 80s ago 10m 40.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (3m) 6s ago 11m 17.5M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (3m) 80s ago 10m 17.9M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (68s) 6s ago 9m 129M 1568M 19.0.0-191-g6d933094 a29c258b5d6f bb0cb3d699c6 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (39s) 6s ago 9m 130M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ac94960b0db8 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9s) 6s ago 9m 17.1M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 0eb7426982e8 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (8m) 80s ago 8m 1118M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 d0fe82862106 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (8m) 80s ago 8m 831M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (8m) 80s ago 8m 940M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:45:45.123 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (3m) 6s ago 10m 60.9M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe34c06ce70 msgr2=0x7fe34c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe34c06ce70 0x7fe34c06f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe35c004f40 tx=0x7fe35c00b040 comp rx=0 tx=0).stop 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360102c20 msgr2=0x7fe360113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360102c20 0x7fe360113c70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe350009fd0 tx=0x7fe350009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 shutdown_connections 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe360065390 0x7fe360113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe34c06ce70 0x7fe34c06f320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 --2- 172.21.15.49:0/658873915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe360102c20 0x7fe360113c70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 >> 172.21.15.49:0/658873915 conn(0x7fe3600719b0 msgr2=0x7fe3600fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 shutdown_connections 2023-12-16T07:45:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.124+0000 7fe36856f700 1 -- 172.21.15.49:0/658873915 wait complete. 2023-12-16T07:45:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 -- 172.21.15.49:0/703451147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c102c20 msgr2=0x7fc92c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 --2- 172.21.15.49:0/703451147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c102c20 0x7fc92c102ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc928004940 tx=0x7fc928009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 -- 172.21.15.49:0/703451147 shutdown_connections 2023-12-16T07:45:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 --2- 172.21.15.49:0/703451147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c065390 0x7fc92c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 --2- 172.21.15.49:0/703451147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c102c20 0x7fc92c102ff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 -- 172.21.15.49:0/703451147 >> 172.21.15.49:0/703451147 conn(0x7fc92c0719b0 msgr2=0x7fc92c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 -- 172.21.15.49:0/703451147 shutdown_connections 2023-12-16T07:45:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 -- 172.21.15.49:0/703451147 wait complete. 2023-12-16T07:45:45.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 Processor -- start 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.227+0000 7fc933440700 1 -- start start 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc933440700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c065390 0x7fc92c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc933440700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c102c20 0x7fc92c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc933440700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c114220 con 0x7fc92c065390 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc933440700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c10d570 con 0x7fc92c102c20 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9311dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c065390 0x7fc92c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9311dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c065390 0x7fc92c113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45652/0 (socket says 172.21.15.49:45652) 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9311dc700 1 -- 172.21.15.49:0/2145177623 learned_addr learned my addr 172.21.15.49:0/2145177623 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9309db700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c102c20 0x7fc92c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9311dc700 1 -- 172.21.15.49:0/2145177623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c102c20 msgr2=0x7fc92c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9311dc700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c102c20 0x7fc92c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9311dc700 1 -- 172.21.15.49:0/2145177623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc928005040 con 0x7fc92c065390 2023-12-16T07:45:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9309db700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c102c20 0x7fc92c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:45:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc9311dc700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c065390 0x7fc92c113690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc928009180 tx=0x7fc928009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc921ffb700 1 -- 172.21.15.49:0/2145177623 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92800e040 con 0x7fc92c065390 2023-12-16T07:45:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc921ffb700 1 -- 172.21.15.49:0/2145177623 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc928013420 con 0x7fc92c065390 2023-12-16T07:45:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c10d7f0 con 0x7fc92c065390 2023-12-16T07:45:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.228+0000 7fc921ffb700 1 -- 172.21.15.49:0/2145177623 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92801c630 con 0x7fc92c065390 2023-12-16T07:45:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.229+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c10dd30 con 0x7fc92c065390 2023-12-16T07:45:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.230+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c0fff40 con 0x7fc92c065390 2023-12-16T07:45:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.230+0000 7fc921ffb700 1 -- 172.21.15.49:0/2145177623 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc9280139e0 con 0x7fc92c065390 2023-12-16T07:45:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.230+0000 7fc921ffb700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc91806ce60 0x7fc91806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.231+0000 7fc921ffb700 1 -- 172.21.15.49:0/2145177623 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc92808d580 con 0x7fc92c065390 2023-12-16T07:45:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.231+0000 7fc9309db700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc91806ce60 0x7fc91806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.231+0000 7fc9309db700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc91806ce60 0x7fc91806f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc91c007fd0 tx=0x7fc91c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.235+0000 7fc921ffb700 1 -- 172.21.15.49:0/2145177623 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc92805b010 con 0x7fc92c065390 2023-12-16T07:45:45.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.522+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc92c04bb80 con 0x7fc92c065390 2023-12-16T07:45:45.523 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.523+0000 7fc921ffb700 1 -- 172.21.15.49:0/2145177623 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7fc92805aba0 con 0x7fc92c065390 2023-12-16T07:45:45.523 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:45:45.523 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:45:45.523 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 3, 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 3 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 7, 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 7 2023-12-16T07:45:45.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:45:45.525 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:45:45.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc91806ce60 msgr2=0x7fc91806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.525 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc91806ce60 0x7fc91806f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc91c007fd0 tx=0x7fc91c009040 comp rx=0 tx=0).stop 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c065390 msgr2=0x7fc92c113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c065390 0x7fc92c113690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc928009180 tx=0x7fc928009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 shutdown_connections 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc91806ce60 0x7fc91806f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc92c065390 0x7fc92c113690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 --2- 172.21.15.49:0/2145177623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c102c20 0x7fc92c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 >> 172.21.15.49:0/2145177623 conn(0x7fc92c0719b0 msgr2=0x7fc92c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 shutdown_connections 2023-12-16T07:45:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.525+0000 7fc933440700 1 -- 172.21.15.49:0/2145177623 wait complete. 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 -- 172.21.15.49:0/571799168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79081035a0 msgr2=0x7f79080fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 --2- 172.21.15.49:0/571799168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79081035a0 0x7f79080fcc10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78f8004940 tx=0x7f78f8009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 -- 172.21.15.49:0/571799168 shutdown_connections 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 --2- 172.21.15.49:0/571799168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79081035a0 0x7f79080fcc10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 --2- 172.21.15.49:0/571799168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7908102c00 0x7f7908102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 -- 172.21.15.49:0/571799168 >> 172.21.15.49:0/571799168 conn(0x7f79080f8790 msgr2=0x7f79080faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 -- 172.21.15.49:0/571799168 shutdown_connections 2023-12-16T07:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.629+0000 7f790fc5f700 1 -- 172.21.15.49:0/571799168 wait complete. 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790fc5f700 1 Processor -- start 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790fc5f700 1 -- start start 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790fc5f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7908102c00 0x7f7908113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790fc5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79081035a0 0x7f7908113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790fc5f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7908114210 con 0x7f7908102c00 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790fc5f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790810d500 con 0x7f79081035a0 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790d9fb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7908102c00 0x7f7908113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790d9fb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7908102c00 0x7f7908113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45664/0 (socket says 172.21.15.49:45664) 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790d9fb700 1 -- 172.21.15.49:0/2220197450 learned_addr learned my addr 172.21.15.49:0/2220197450 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.630+0000 7f790d1fa700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79081035a0 0x7f7908113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f790d9fb700 1 -- 172.21.15.49:0/2220197450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79081035a0 msgr2=0x7f7908113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f790d9fb700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79081035a0 0x7f7908113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f790d9fb700 1 -- 172.21.15.49:0/2220197450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8005040 con 0x7f7908102c00 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f790d9fb700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7908102c00 0x7f7908113680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7904002a50 tx=0x7f79040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f78fe7fc700 1 -- 172.21.15.49:0/2220197450 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7904007cc0 con 0x7f7908102c00 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790810d7e0 con 0x7f7908102c00 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f78fe7fc700 1 -- 172.21.15.49:0/2220197450 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f790400f040 con 0x7f7908102c00 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f78fe7fc700 1 -- 172.21.15.49:0/2220197450 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790400d9c0 con 0x7f7908102c00 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.631+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790810dcf0 con 0x7f7908102c00 2023-12-16T07:45:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.632+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7908113330 con 0x7f7908102c00 2023-12-16T07:45:45.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.632+0000 7f78fe7fc700 1 -- 172.21.15.49:0/2220197450 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f790400db20 con 0x7f7908102c00 2023-12-16T07:45:45.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.633+0000 7f78fe7fc700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f78f406ce60 0x7f78f406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.633+0000 7f78fe7fc700 1 -- 172.21.15.49:0/2220197450 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f790408c000 con 0x7f7908102c00 2023-12-16T07:45:45.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.633+0000 7f790d1fa700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f78f406ce60 0x7f78f406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:45.634 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.633+0000 7f790d1fa700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f78f406ce60 0x7f78f406f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78f800b3b0 tx=0x7f78f8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.638+0000 7f78fe7fc700 1 -- 172.21.15.49:0/2220197450 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7904059970 con 0x7f7908102c00 2023-12-16T07:45:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.887+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f790810ec20 con 0x7f7908102c00 2023-12-16T07:45:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.887+0000 7f78fe7fc700 1 -- 172.21.15.49:0/2220197450 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1847 (secure 0 0 0) 0x7f7904059500 con 0x7f7908102c00 2023-12-16T07:45:45.887 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:45:45.887 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:45:45.887 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:45:45.888 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:45:45.889 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:45.890 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f78f406ce60 msgr2=0x7f78f406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f78f406ce60 0x7f78f406f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f78f800b3b0 tx=0x7f78f8009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7908102c00 msgr2=0x7f7908113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7908102c00 0x7f7908113680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7904002a50 tx=0x7f79040046b0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 shutdown_connections 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f78f406ce60 0x7f78f406f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7908102c00 0x7f7908113680 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 --2- 172.21.15.49:0/2220197450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79081035a0 0x7f7908113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 >> 172.21.15.49:0/2220197450 conn(0x7f79080f8790 msgr2=0x7f79080fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 shutdown_connections 2023-12-16T07:45:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.889+0000 7f790fc5f700 1 -- 172.21.15.49:0/2220197450 wait complete. 2023-12-16T07:45:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:45:45.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:45 smithi049 ceph-mon[217548]: pgmap v78: 65 pgs: 5 peering, 10 active+undersized+degraded, 12 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2023-12-16T07:45:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:45 smithi049 ceph-mon[217548]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:45.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:45 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2145177623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:45.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 -- 172.21.15.49:0/3311324790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c0fbb40 msgr2=0x7f3b9c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:45.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3311324790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c0fbb40 0x7f3b9c0fbfb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b90004940 tx=0x7f3b90009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:45.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 -- 172.21.15.49:0/3311324790 shutdown_connections 2023-12-16T07:45:45.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3311324790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c0fbb40 0x7f3b9c0fbfb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3311324790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b9c101b00 0x7f3b9c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 -- 172.21.15.49:0/3311324790 >> 172.21.15.49:0/3311324790 conn(0x7f3b9c0719b0 msgr2=0x7f3b9c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 -- 172.21.15.49:0/3311324790 shutdown_connections 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.994+0000 7f3ba346c700 1 -- 172.21.15.49:0/3311324790 wait complete. 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba346c700 1 Processor -- start 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba346c700 1 -- start start 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba346c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b9c0fbb40 0x7f3b9c1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba346c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c101b00 0x7f3b9c113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba346c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c114290 con 0x7f3b9c101b00 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba346c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c10d580 con 0x7f3b9c0fbb40 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba0a07700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c101b00 0x7f3b9c113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba0a07700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c101b00 0x7f3b9c113c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45690/0 (socket says 172.21.15.49:45690) 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba0a07700 1 -- 172.21.15.49:0/3807675069 learned_addr learned my addr 172.21.15.49:0/3807675069 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.995+0000 7f3ba1208700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b9c0fbb40 0x7f3b9c1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3ba0a07700 1 -- 172.21.15.49:0/3807675069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b9c0fbb40 msgr2=0x7f3b9c1136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3ba0a07700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b9c0fbb40 0x7f3b9c1136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3ba0a07700 1 -- 172.21.15.49:0/3807675069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90005040 con 0x7f3b9c101b00 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3ba1208700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b9c0fbb40 0x7f3b9c1136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3ba0a07700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c101b00 0x7f3b9c113c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000b3b0 tx=0x7f3b90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3b8dffb700 1 -- 172.21.15.49:0/3807675069 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9000e040 con 0x7f3b9c101b00 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3b8dffb700 1 -- 172.21.15.49:0/3807675069 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b9000bc50 con 0x7f3b9c101b00 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c10d7b0 con 0x7f3b9c101b00 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3b8dffb700 1 -- 172.21.15.49:0/3807675069 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b90013420 con 0x7f3b9c101b00 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.996+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c10dcf0 con 0x7f3b9c101b00 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.997+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c0734d0 con 0x7f3b9c101b00 2023-12-16T07:45:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.998+0000 7f3b8dffb700 1 -- 172.21.15.49:0/3807675069 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f3b9001c430 con 0x7f3b9c101b00 2023-12-16T07:45:46.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.998+0000 7f3b8dffb700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f3b8806ce60 0x7f3b8806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:46.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.999+0000 7f3b8dffb700 1 -- 172.21.15.49:0/3807675069 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3b9008d830 con 0x7f3b9c101b00 2023-12-16T07:45:46.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.999+0000 7f3ba1208700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f3b8806ce60 0x7f3b8806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:46.001 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:45.999+0000 7f3ba1208700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f3b8806ce60 0x7f3b8806f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009fd0 tx=0x7f3b98009f00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:46.002 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.002+0000 7f3b8dffb700 1 -- 172.21.15.49:0/3807675069 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f3b9005b370 con 0x7f3b9c101b00 2023-12-16T07:45:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:45 smithi133 ceph-mon[181557]: pgmap v78: 65 pgs: 5 peering, 10 active+undersized+degraded, 12 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2023-12-16T07:45:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:45 smithi133 ceph-mon[181557]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:45 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2145177623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:45:46.225 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.225+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b9c10edb0 con 0x7f3b8806ce60 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.226+0000 7f3b8dffb700 1 -- 172.21.15.49:0/3807675069 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3b9c10edb0 con 0x7f3b8806ce60 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2023-12-16T07:45:46.226 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2023-12-16T07:45:46.227 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:45:46.227 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:45:46.227 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "9/21 daemons upgraded", 2023-12-16T07:45:46.227 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T07:45:46.227 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:45:46.227 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:45:46.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f3b8806ce60 msgr2=0x7f3b8806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:46.228 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f3b8806ce60 0x7f3b8806f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009fd0 tx=0x7f3b98009f00 comp rx=0 tx=0).stop 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c101b00 msgr2=0x7f3b9c113c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c101b00 0x7f3b9c113c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000b3b0 tx=0x7f3b90009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 shutdown_connections 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b9c0fbb40 0x7f3b9c1136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f3b8806ce60 0x7f3b8806f310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 --2- 172.21.15.49:0/3807675069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b9c101b00 0x7f3b9c113c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 >> 172.21.15.49:0/3807675069 conn(0x7f3b9c0719b0 msgr2=0x7f3b9c065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 shutdown_connections 2023-12-16T07:45:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.228+0000 7f3ba346c700 1 -- 172.21.15.49:0/3807675069 wait complete. 2023-12-16T07:45:46.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 -- 172.21.15.49:0/538316527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 msgr2=0x7f283c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 --2- 172.21.15.49:0/538316527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0fcc10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2830004940 tx=0x7f2830009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 -- 172.21.15.49:0/538316527 shutdown_connections 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 --2- 172.21.15.49:0/538316527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0fcc10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 --2- 172.21.15.49:0/538316527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f283c102c00 0x7f283c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 -- 172.21.15.49:0/538316527 >> 172.21.15.49:0/538316527 conn(0x7f283c0f8790 msgr2=0x7f283c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 -- 172.21.15.49:0/538316527 shutdown_connections 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.334+0000 7f2842754700 1 -- 172.21.15.49:0/538316527 wait complete. 2023-12-16T07:45:46.335 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f2842754700 1 Processor -- start 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f2842754700 1 -- start start 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f2842754700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f283c102c00 0x7f283c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f2842754700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f2842754700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c070af0 con 0x7f283c1035a0 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f2842754700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c070c60 con 0x7f283c102c00 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45700/0 (socket says 172.21.15.49:45700) 2023-12-16T07:45:46.337 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283b7fe700 1 -- 172.21.15.49:0/677607677 learned_addr learned my addr 172.21.15.49:0/677607677 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283bfff700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f283c102c00 0x7f283c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283b7fe700 1 -- 172.21.15.49:0/677607677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f283c102c00 msgr2=0x7f283c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283b7fe700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f283c102c00 0x7f283c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283b7fe700 1 -- 172.21.15.49:0/677607677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830005040 con 0x7f283c1035a0 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.335+0000 7f283bfff700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f283c102c00 0x7f283c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.336+0000 7f283b7fe700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0704a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f283000b3b0 tx=0x7f2830009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.336+0000 7f2838ff9700 1 -- 172.21.15.49:0/677607677 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283000e040 con 0x7f283c1035a0 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.336+0000 7f2838ff9700 1 -- 172.21.15.49:0/677607677 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2830013420 con 0x7f283c1035a0 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.336+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c119880 con 0x7f283c1035a0 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.336+0000 7f2838ff9700 1 -- 172.21.15.49:0/677607677 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283001c610 con 0x7f283c1035a0 2023-12-16T07:45:46.338 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.336+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c119d60 con 0x7f283c1035a0 2023-12-16T07:45:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.337+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c1050d0 con 0x7f283c1035a0 2023-12-16T07:45:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.337+0000 7f2838ff9700 1 -- 172.21.15.49:0/677607677 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2830013a20 con 0x7f283c1035a0 2023-12-16T07:45:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.338+0000 7f2838ff9700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f282406ce60 0x7f282406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:45:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.338+0000 7f2838ff9700 1 -- 172.21.15.49:0/677607677 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f283008d580 con 0x7f283c1035a0 2023-12-16T07:45:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.338+0000 7f283bfff700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f282406ce60 0x7f282406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:45:46.339 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.338+0000 7f283bfff700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f282406ce60 0x7f282406f310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2834004550 tx=0x7f2834009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:45:46.343 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.343+0000 7f2838ff9700 1 -- 172.21.15.49:0/677607677 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f28300574e0 con 0x7f283c1035a0 2023-12-16T07:45:46.639 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.639+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f283c0fc390 con 0x7f283c1035a0 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.639+0000 7f2838ff9700 1 -- 172.21.15.49:0/677607677 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+929 (secure 0 0 0) 0x7f283005ab00 con 0x7f283c1035a0 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2023-12-16T07:45:46.640 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2023-12-16T07:45:46.641 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2023-12-16T07:45:46.641 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2023-12-16T07:45:46.641 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2023-12-16T07:45:46.641 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f282406ce60 msgr2=0x7f282406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f282406ce60 0x7f282406f310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2834004550 tx=0x7f2834009040 comp rx=0 tx=0).stop 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 msgr2=0x7f283c0704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0704a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f283000b3b0 tx=0x7f2830009e30 comp rx=0 tx=0).stop 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 shutdown_connections 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f283c102c00 0x7f283c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f282406ce60 0x7f282406f310 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 --2- 172.21.15.49:0/677607677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f283c1035a0 0x7f283c0704a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 >> 172.21.15.49:0/677607677 conn(0x7f283c0f8790 msgr2=0x7f283c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 shutdown_connections 2023-12-16T07:45:46.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:45:46.642+0000 7f2842754700 1 -- 172.21.15.49:0/677607677 wait complete. 2023-12-16T07:45:46.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:46 smithi049 ceph-mon[217548]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:46.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:46 smithi049 ceph-mon[217548]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:46.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:46 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2220197450' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:45:46.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:46 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:46.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:46 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/677607677' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:45:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:46 smithi133 ceph-mon[181557]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:46 smithi133 ceph-mon[181557]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:46 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2220197450' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:45:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:46 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T07:45:47.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:46 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/677607677' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:45:47.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:47 smithi049 ceph-mon[217548]: pgmap v79: 65 pgs: 5 peering, 6 active+undersized+degraded, 6 active+undersized, 48 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2023-12-16T07:45:47.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:47 smithi049 ceph-mon[217548]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:48.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:47 smithi133 ceph-mon[181557]: pgmap v79: 65 pgs: 5 peering, 6 active+undersized+degraded, 6 active+undersized, 48 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2023-12-16T07:45:48.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:47 smithi133 ceph-mon[181557]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:45:48.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:48 smithi049 ceph-mon[217548]: pgmap v80: 65 pgs: 5 peering, 60 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:48.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:48 smithi049 ceph-mon[217548]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/222 objects degraded (8.108%), 6 pgs degraded) 2023-12-16T07:45:49.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:48 smithi133 ceph-mon[181557]: pgmap v80: 65 pgs: 5 peering, 60 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:49.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:48 smithi133 ceph-mon[181557]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/222 objects degraded (8.108%), 6 pgs degraded) 2023-12-16T07:45:51.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:50 smithi133 ceph-mon[181557]: pgmap v81: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:51.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:50 smithi049 ceph-mon[217548]: pgmap v81: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:53.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:53 smithi133 ceph-mon[181557]: pgmap v82: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:53.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:53 smithi049 ceph-mon[217548]: pgmap v82: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:55.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:54 smithi049 ceph-mon[217548]: pgmap v83: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:55.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:54 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:55.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:54 smithi133 ceph-mon[181557]: pgmap v83: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:55.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:54 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:57.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:57 smithi133 ceph-mon[181557]: pgmap v84: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:57.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:57 smithi049 ceph-mon[217548]: pgmap v84: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:58.229 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:58 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:58.229 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:58 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:58.229 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:58 smithi133 ceph-mon[181557]: Upgrade: osd.3 is safe to restart 2023-12-16T07:45:58.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:58 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:58.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:58 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-16T07:45:58.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:58 smithi049 ceph-mon[217548]: Upgrade: osd.3 is safe to restart 2023-12-16T07:45:59.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: pgmap v85: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:59.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: Upgrade: Updating osd.3 2023-12-16T07:45:59.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:59.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T07:45:59.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:59.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: Deploying daemon osd.3 on smithi133 2023-12-16T07:45:59.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:59.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:45:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: pgmap v85: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: Upgrade: Updating osd.3 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: Deploying daemon osd.3 on smithi133 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:45:59.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:45:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:00.617 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:00 smithi133 systemd[1]: Stopping Ceph osd.3 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:46:01.117 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:00 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[126802]: 2023-12-16T07:46:00.662+0000 7f110a447700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:46:01.117 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:00 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[126802]: 2023-12-16T07:46:00.662+0000 7f110a447700 -1 osd.3 63 *** Got signal Terminated *** 2023-12-16T07:46:01.117 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:00 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[126802]: 2023-12-16T07:46:00.662+0000 7f110a447700 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:46:01.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:01 smithi133 ceph-mon[181557]: pgmap v86: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:01.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:01 smithi133 ceph-mon[181557]: osd.3 marked itself down and dead 2023-12-16T07:46:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:01 smithi049 ceph-mon[217548]: pgmap v86: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:01.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:01 smithi049 ceph-mon[217548]: osd.3 marked itself down and dead 2023-12-16T07:46:02.336 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:01 smithi133 bash[192797]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3 2023-12-16T07:46:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:02 smithi133 ceph-mon[181557]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:46:02.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:02 smithi133 ceph-mon[181557]: failed to encode map e64 with expected crc 2023-12-16T07:46:02.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:02 smithi133 ceph-mon[181557]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T07:46:02.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:02 smithi049 ceph-mon[217548]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:46:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:02 smithi049 ceph-mon[217548]: failed to encode map e64 with expected crc 2023-12-16T07:46:02.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:02 smithi049 ceph-mon[217548]: osdmap e64: 6 total, 5 up, 6 in 2023-12-16T07:46:03.544 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: pgmap v88: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:03.545 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T07:46:03.545 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: osdmap e65: 6 total, 5 up, 6 in 2023-12-16T07:46:03.545 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.545 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.545 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.545 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.545 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:03 smithi133 ceph-mon[181557]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.545 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:03 smithi133 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.3.service: Succeeded. 2023-12-16T07:46:03.545 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:03 smithi133 systemd[1]: Stopped Ceph osd.3 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:46:03.546 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:03 smithi133 systemd[1]: Starting Ceph osd.3 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: pgmap v88: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: osdmap e65: 6 total, 5 up, 6 in 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: failed to encode map e65 with expected crc 2023-12-16T07:46:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:03 smithi049 ceph-mon[217548]: failed to encode map e65 with expected crc 2023-12-16T07:46:04.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193067]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T07:46:04.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193067]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-16T07:46:04.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193067]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-16T07:46:04.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193067]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-16T07:46:04.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193067]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-16T07:46:04.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193067]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T07:46:04.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193067]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-16T07:46:04.650 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:04 smithi133 ceph-mon[181557]: Health check failed: Degraded data redundancy: 9/222 objects degraded (4.054%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:04.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:04 smithi049 ceph-mon[217548]: Health check failed: Degraded data redundancy: 9/222 objects degraded (4.054%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:05.117 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 ceph-osd[193359]: -- 172.21.15.133:0/2894570491 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564993f076c0 con 0x564993ed7000 2023-12-16T07:46:05.117 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 bash[193321]: 2b93a8668da209a341b042a8cc2056c5998f787ee541de25244f774c6bdbae60 2023-12-16T07:46:05.117 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:04 smithi133 systemd[1]: Started Ceph osd.3 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:46:05.617 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:05 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[193336]: 2023-12-16T07:46:05.242+0000 7f18ccb62640 -1 Falling back to public interface 2023-12-16T07:46:05.625 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:05 smithi133 ceph-mon[181557]: pgmap v90: 65 pgs: 3 active+undersized+degraded, 13 peering, 10 stale+active+clean, 4 active+undersized, 35 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 9/222 objects degraded (4.054%) 2023-12-16T07:46:05.625 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:05 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:05.625 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:05 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:05.625 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:05 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:05.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:05 smithi049 ceph-mon[217548]: pgmap v90: 65 pgs: 3 active+undersized+degraded, 13 peering, 10 stale+active+clean, 4 active+undersized, 35 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 9/222 objects degraded (4.054%) 2023-12-16T07:46:05.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:05 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:05.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:05 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:05.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:05 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:07 smithi049 ceph-mon[217548]: pgmap v91: 65 pgs: 10 active+undersized+degraded, 13 peering, 15 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2023-12-16T07:46:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:07.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:07.981 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:07 smithi133 ceph-mon[181557]: pgmap v91: 65 pgs: 10 active+undersized+degraded, 13 peering, 15 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2023-12-16T07:46:07.982 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:07.982 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:07.982 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:07.982 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:08.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:08 smithi133 ceph-mon[181557]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T07:46:08.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:08 smithi049 ceph-mon[217548]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-16T07:46:09.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:09 smithi133 ceph-mon[181557]: pgmap v92: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/222 objects degraded (22.973%) 2023-12-16T07:46:09.867 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:09 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[193336]: 2023-12-16T07:46:09.850+0000 7f18ccb62640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-16T07:46:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:09 smithi049 ceph-mon[217548]: pgmap v92: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/222 objects degraded (22.973%) 2023-12-16T07:46:10.867 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[193336]: 2023-12-16T07:46:10.460+0000 7f18ccb62640 -1 osd.3 63 log_to_monitors true 2023-12-16T07:46:11.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: pgmap v93: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/222 objects degraded (22.973%) 2023-12-16T07:46:11.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:11.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:11.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='osd.3 [v2:172.21.15.133:6800/2696134742,v1:172.21.15.133:6801/2696134742]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:46:11.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:10 smithi049 ceph-mon[217548]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:46:11.367 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[193336]: 2023-12-16T07:46:10.995+0000 7f18bb7ce700 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:46:11.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: pgmap v93: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/222 objects degraded (22.973%) 2023-12-16T07:46:11.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:11.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:11.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='osd.3 [v2:172.21.15.133:6800/2696134742,v1:172.21.15.133:6801/2696134742]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:46:11.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:10 smithi133 ceph-mon[181557]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-16T07:46:12.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:11 smithi133 ceph-mon[181557]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T07:46:12.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:11 smithi133 ceph-mon[181557]: from='osd.3 [v2:172.21.15.133:6800/2696134742,v1:172.21.15.133:6801/2696134742]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:12.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:11 smithi133 ceph-mon[181557]: osdmap e66: 6 total, 5 up, 6 in 2023-12-16T07:46:12.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:11 smithi133 ceph-mon[181557]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:12.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:11 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 51/222 objects degraded (22.973%), 17 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:12.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:11 smithi049 ceph-mon[217548]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-16T07:46:12.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:11 smithi049 ceph-mon[217548]: from='osd.3 [v2:172.21.15.133:6800/2696134742,v1:172.21.15.133:6801/2696134742]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:12.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:11 smithi049 ceph-mon[217548]: osdmap e66: 6 total, 5 up, 6 in 2023-12-16T07:46:12.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:11 smithi049 ceph-mon[217548]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:12.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:11 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 51/222 objects degraded (22.973%), 17 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:13.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: failed to encode map e66 with expected crc 2023-12-16T07:46:13.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: failed to encode map e66 with expected crc 2023-12-16T07:46:13.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: pgmap v95: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/222 objects degraded (22.973%) 2023-12-16T07:46:13.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:46:13.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: failed to encode map e67 with expected crc 2023-12-16T07:46:13.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: osd.3 [v2:172.21.15.133:6800/2696134742,v1:172.21.15.133:6801/2696134742] boot 2023-12-16T07:46:13.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: osdmap e67: 6 total, 6 up, 6 in 2023-12-16T07:46:13.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:46:13.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:13 smithi133 ceph-mon[181557]: osdmap e68: 6 total, 6 up, 6 in 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: failed to encode map e66 with expected crc 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: failed to encode map e66 with expected crc 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: pgmap v95: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/222 objects degraded (22.973%) 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: failed to encode map e67 with expected crc 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: osd.3 [v2:172.21.15.133:6800/2696134742,v1:172.21.15.133:6801/2696134742] boot 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: osdmap e67: 6 total, 6 up, 6 in 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-16T07:46:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:13 smithi049 ceph-mon[217548]: osdmap e68: 6 total, 6 up, 6 in 2023-12-16T07:46:14.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:14.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: failed to encode map e68 with expected crc 2023-12-16T07:46:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:14.460 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:15.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:15 smithi133 ceph-mon[181557]: pgmap v98: 65 pgs: 7 peering, 12 active+undersized+degraded, 15 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2023-12-16T07:46:15.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:15 smithi049 ceph-mon[217548]: pgmap v98: 65 pgs: 7 peering, 12 active+undersized+degraded, 15 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2023-12-16T07:46:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 -- 172.21.15.49:0/2087468448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544102ba0 msgr2=0x7f0544102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 --2- 172.21.15.49:0/2087468448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544102ba0 0x7f0544102f70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0540004940 tx=0x7f0540009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 -- 172.21.15.49:0/2087468448 shutdown_connections 2023-12-16T07:46:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 --2- 172.21.15.49:0/2087468448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0544103540 0x7f05440fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 --2- 172.21.15.49:0/2087468448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544102ba0 0x7f0544102f70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 -- 172.21.15.49:0/2087468448 >> 172.21.15.49:0/2087468448 conn(0x7f05440f8730 msgr2=0x7f05440fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 -- 172.21.15.49:0/2087468448 shutdown_connections 2023-12-16T07:46:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 -- 172.21.15.49:0/2087468448 wait complete. 2023-12-16T07:46:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.762+0000 7f054b846700 1 Processor -- start 2023-12-16T07:46:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f054b846700 1 -- start start 2023-12-16T07:46:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f054b846700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0544102ba0 0x7f05441135a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f054b846700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544103540 0x7f0544113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f054b846700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544114130 con 0x7f0544103540 2023-12-16T07:46:16.769 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f054b846700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054410d460 con 0x7f0544102ba0 2023-12-16T07:46:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f0548de1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544103540 0x7f0544113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f0548de1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544103540 0x7f0544113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35530/0 (socket says 172.21.15.49:35530) 2023-12-16T07:46:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f0548de1700 1 -- 172.21.15.49:0/1432270121 learned_addr learned my addr 172.21.15.49:0/1432270121 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f05495e2700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0544102ba0 0x7f05441135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f0548de1700 1 -- 172.21.15.49:0/1432270121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0544102ba0 msgr2=0x7f05441135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:16.770 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f0548de1700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0544102ba0 0x7f05441135a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.763+0000 7f0548de1700 1 -- 172.21.15.49:0/1432270121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540005040 con 0x7f0544103540 2023-12-16T07:46:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.764+0000 7f0548de1700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544103540 0x7f0544113ae0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0534002a50 tx=0x7f0534004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.764+0000 7f0539ffb700 1 -- 172.21.15.49:0/1432270121 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0534007cc0 con 0x7f0544103540 2023-12-16T07:46:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.764+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054410d740 con 0x7f0544103540 2023-12-16T07:46:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.764+0000 7f0539ffb700 1 -- 172.21.15.49:0/1432270121 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f053400f040 con 0x7f0544103540 2023-12-16T07:46:16.771 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.764+0000 7f0539ffb700 1 -- 172.21.15.49:0/1432270121 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053400d920 con 0x7f0544103540 2023-12-16T07:46:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.764+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054410dc80 con 0x7f0544103540 2023-12-16T07:46:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.765+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05440ffeb0 con 0x7f0544103540 2023-12-16T07:46:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.765+0000 7f0539ffb700 1 -- 172.21.15.49:0/1432270121 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0534009680 con 0x7f0544103540 2023-12-16T07:46:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.766+0000 7f0539ffb700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f053006ce70 0x7f053006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.766+0000 7f0539ffb700 1 -- 172.21.15.49:0/1432270121 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f053408bf50 con 0x7f0544103540 2023-12-16T07:46:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.766+0000 7f05495e2700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f053006ce70 0x7f053006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.766+0000 7f05495e2700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f053006ce70 0x7f053006f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f054000b3b0 tx=0x7f0540009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.771+0000 7f0539ffb700 1 -- 172.21.15.49:0/1432270121 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f05340bf300 con 0x7f0544103540 2023-12-16T07:46:16.993 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.993+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f054404bbf0 con 0x7f053006ce70 2023-12-16T07:46:16.994 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.994+0000 7f0539ffb700 1 -- 172.21.15.49:0/1432270121 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f054404bbf0 con 0x7f053006ce70 2023-12-16T07:46:16.996 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f053006ce70 msgr2=0x7f053006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:16.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f053006ce70 0x7f053006f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f054000b3b0 tx=0x7f0540009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:16.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544103540 msgr2=0x7f0544113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:16.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544103540 0x7f0544113ae0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0534002a50 tx=0x7f0534004600 comp rx=0 tx=0).stop 2023-12-16T07:46:16.997 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 shutdown_connections 2023-12-16T07:46:16.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0544102ba0 0x7f05441135a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:16.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f053006ce70 0x7f053006f320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:16.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 --2- 172.21.15.49:0/1432270121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0544103540 0x7f0544113ae0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:16.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 >> 172.21.15.49:0/1432270121 conn(0x7f05440f8730 msgr2=0x7f05440fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:16.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 shutdown_connections 2023-12-16T07:46:16.998 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:16.996+0000 7f054b846700 1 -- 172.21.15.49:0/1432270121 wait complete. 2023-12-16T07:46:17.007 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:46:17.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/2645562648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 msgr2=0x7f0b140fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/2645562648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b140fb630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b08004940 tx=0x7f0b08009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/2645562648 shutdown_connections 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/2645562648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b140fb630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/2645562648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b14102c70 0x7f0b14103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/2645562648 >> 172.21.15.49:0/2645562648 conn(0x7f0b140711a0 msgr2=0x7f0b140715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/2645562648 shutdown_connections 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.101+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/2645562648 wait complete. 2023-12-16T07:46:17.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b1a8d8700 1 Processor -- start 2023-12-16T07:46:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b1a8d8700 1 -- start start 2023-12-16T07:46:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b1a8d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b14113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b1a8d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b14102c70 0x7f0b14113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b1a8d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14114260 con 0x7f0b140fb1e0 2023-12-16T07:46:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b1a8d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1410d550 con 0x7f0b14102c70 2023-12-16T07:46:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b14113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.102+0000 7f0b13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b14113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35544/0 (socket says 172.21.15.49:35544) 2023-12-16T07:46:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b13fff700 1 -- 172.21.15.49:0/1492727583 learned_addr learned my addr 172.21.15.49:0/1492727583 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b137fe700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b14102c70 0x7f0b14113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b13fff700 1 -- 172.21.15.49:0/1492727583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b14102c70 msgr2=0x7f0b14113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b13fff700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b14102c70 0x7f0b14113c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b13fff700 1 -- 172.21.15.49:0/1492727583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08005040 con 0x7f0b140fb1e0 2023-12-16T07:46:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b13fff700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b14113690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0b04002a50 tx=0x7f0b040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:17.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b10ff9700 1 -- 172.21.15.49:0/1492727583 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b04007cc0 con 0x7f0b140fb1e0 2023-12-16T07:46:17.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b10ff9700 1 -- 172.21.15.49:0/1492727583 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b0400f040 con 0x7f0b140fb1e0 2023-12-16T07:46:17.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1410d7e0 con 0x7f0b140fb1e0 2023-12-16T07:46:17.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b10ff9700 1 -- 172.21.15.49:0/1492727583 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0400d9c0 con 0x7f0b140fb1e0 2023-12-16T07:46:17.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.103+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1410dd20 con 0x7f0b140fb1e0 2023-12-16T07:46:17.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.104+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b14105050 con 0x7f0b140fb1e0 2023-12-16T07:46:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.105+0000 7f0b10ff9700 1 -- 172.21.15.49:0/1492727583 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0b0400db60 con 0x7f0b140fb1e0 2023-12-16T07:46:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.105+0000 7f0b10ff9700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0afc06ce60 0x7f0afc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.105+0000 7f0b10ff9700 1 -- 172.21.15.49:0/1492727583 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0b0408b940 con 0x7f0b140fb1e0 2023-12-16T07:46:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.105+0000 7f0b137fe700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0afc06ce60 0x7f0afc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.109 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.106+0000 7f0b137fe700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0afc06ce60 0x7f0afc06f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0b08004f90 tx=0x7f0b08009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:17.110 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.110+0000 7f0b10ff9700 1 -- 172.21.15.49:0/1492727583 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0b040592b0 con 0x7f0b140fb1e0 2023-12-16T07:46:17.330 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.330+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b1410ec70 con 0x7f0afc06ce60 2023-12-16T07:46:17.331 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.331+0000 7f0b10ff9700 1 -- 172.21.15.49:0/1492727583 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0b1410ec70 con 0x7f0afc06ce60 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0afc06ce60 msgr2=0x7f0afc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0afc06ce60 0x7f0afc06f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0b08004f90 tx=0x7f0b08009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 msgr2=0x7f0b14113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b14113690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0b04002a50 tx=0x7f0b040046b0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 shutdown_connections 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0afc06ce60 0x7f0afc06f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b140fb1e0 0x7f0b14113690 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 --2- 172.21.15.49:0/1492727583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b14102c70 0x7f0b14113c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 >> 172.21.15.49:0/1492727583 conn(0x7f0b140711a0 msgr2=0x7f0b140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 shutdown_connections 2023-12-16T07:46:17.334 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.333+0000 7f0b1a8d8700 1 -- 172.21.15.49:0/1492727583 wait complete. 2023-12-16T07:46:17.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:17 smithi133 ceph-mon[181557]: pgmap v99: 65 pgs: 7 peering, 10 active+undersized+degraded, 9 active+undersized, 39 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2023-12-16T07:46:17.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:17 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 -- 172.21.15.49:0/505974770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 msgr2=0x7fe5800fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 --2- 172.21.15.49:0/505974770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5800fbfb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe574004940 tx=0x7fe574009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 -- 172.21.15.49:0/505974770 shutdown_connections 2023-12-16T07:46:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 --2- 172.21.15.49:0/505974770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5800fbfb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 --2- 172.21.15.49:0/505974770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580101b00 0x7fe580101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 -- 172.21.15.49:0/505974770 >> 172.21.15.49:0/505974770 conn(0x7fe5800719b0 msgr2=0x7fe580071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 -- 172.21.15.49:0/505974770 shutdown_connections 2023-12-16T07:46:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 -- 172.21.15.49:0/505974770 wait complete. 2023-12-16T07:46:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.438+0000 7fe585ff8700 1 Processor -- start 2023-12-16T07:46:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe585ff8700 1 -- start start 2023-12-16T07:46:17.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe585ff8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5801136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe585ff8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580101b00 0x7fe580113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe585ff8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580114270 con 0x7fe5800fbb40 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe585ff8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58010d560 con 0x7fe580101b00 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe57f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5801136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe57f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5801136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57946/0 (socket says 172.21.15.49:57946) 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe57f7fe700 1 -- 172.21.15.49:0/661338925 learned_addr learned my addr 172.21.15.49:0/661338925 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe57effd700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580101b00 0x7fe580113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe57f7fe700 1 -- 172.21.15.49:0/661338925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580101b00 msgr2=0x7fe580113c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe57f7fe700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580101b00 0x7fe580113c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.439+0000 7fe57f7fe700 1 -- 172.21.15.49:0/661338925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574005040 con 0x7fe5800fbb40 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.440+0000 7fe57f7fe700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5801136a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe570002a50 tx=0x7fe5700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.440+0000 7fe567fff700 1 -- 172.21.15.49:0/661338925 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe570007cc0 con 0x7fe5800fbb40 2023-12-16T07:46:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.440+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58010d7f0 con 0x7fe5800fbb40 2023-12-16T07:46:17.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.440+0000 7fe567fff700 1 -- 172.21.15.49:0/661338925 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe57000f040 con 0x7fe5800fbb40 2023-12-16T07:46:17.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.440+0000 7fe567fff700 1 -- 172.21.15.49:0/661338925 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57000d9c0 con 0x7fe5800fbb40 2023-12-16T07:46:17.442 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.440+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58010dd30 con 0x7fe5800fbb40 2023-12-16T07:46:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.441+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5800734d0 con 0x7fe5800fbb40 2023-12-16T07:46:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.442+0000 7fe567fff700 1 -- 172.21.15.49:0/661338925 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe57000db60 con 0x7fe5800fbb40 2023-12-16T07:46:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.442+0000 7fe567fff700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe56806ce60 0x7fe56806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.442+0000 7fe567fff700 1 -- 172.21.15.49:0/661338925 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe57008b940 con 0x7fe5800fbb40 2023-12-16T07:46:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.442+0000 7fe57effd700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe56806ce60 0x7fe56806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.442+0000 7fe57effd700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe56806ce60 0x7fe56806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe58010ef40 tx=0x7fe574009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.447+0000 7fe567fff700 1 -- 172.21.15.49:0/661338925 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe5700592b0 con 0x7fe5800fbb40 2023-12-16T07:46:17.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:17 smithi049 ceph-mon[217548]: pgmap v99: 65 pgs: 7 peering, 10 active+undersized+degraded, 9 active+undersized, 39 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2023-12-16T07:46:17.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:17 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:17.658 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.658+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe58010df50 con 0x7fe56806ce60 2023-12-16T07:46:17.668 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.668+0000 7fe567fff700 1 -- 172.21.15.49:0/661338925 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe58010df50 con 0x7fe56806ce60 2023-12-16T07:46:17.668 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:46:17.668 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (3m) 38s ago 11m 28.5M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (118s) 38s ago 11m 7465k - 19.0.0-191-g6d933094 a29c258b5d6f ae149580b967 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (114s) 11s ago 11m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f b4d081b98e26 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (3m) 38s ago 11m 88.2M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (7m) 38s ago 7m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (7m) 38s ago 7m 16.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (7m) 11s ago 7m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (7m) 11s ago 7m 18.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (5m) 38s ago 12m 511M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (4m) 11s ago 11m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (2m) 38s ago 12m 62.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (2m) 11s ago 10m 52.8M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (4m) 38s ago 11m 17.5M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:46:17.669 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (4m) 11s ago 11m 17.8M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:46:17.670 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (100s) 38s ago 10m 129M 1568M 19.0.0-191-g6d933094 a29c258b5d6f bb0cb3d699c6 2023-12-16T07:46:17.670 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (72s) 38s ago 10m 130M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ac94960b0db8 2023-12-16T07:46:17.670 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (42s) 38s ago 9m 17.1M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 0eb7426982e8 2023-12-16T07:46:17.670 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (13s) 11s ago 9m 13.7M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 2b93a8668da2 2023-12-16T07:46:17.670 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (9m) 11s ago 9m 851M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 512c40f401a9 2023-12-16T07:46:17.670 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (8m) 11s ago 8m 959M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:46:17.670 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (4m) 38s ago 11m 60.9M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe56806ce60 msgr2=0x7fe56806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe56806ce60 0x7fe56806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe58010ef40 tx=0x7fe574009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 msgr2=0x7fe5801136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5801136a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe570002a50 tx=0x7fe5700046b0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 shutdown_connections 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe56806ce60 0x7fe56806f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5800fbb40 0x7fe5801136a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 --2- 172.21.15.49:0/661338925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580101b00 0x7fe580113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 >> 172.21.15.49:0/661338925 conn(0x7fe5800719b0 msgr2=0x7fe580065430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 shutdown_connections 2023-12-16T07:46:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.670+0000 7fe585ff8700 1 -- 172.21.15.49:0/661338925 wait complete. 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 -- 172.21.15.49:0/1545558353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c0fbb30 msgr2=0x7ff90c0fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 --2- 172.21.15.49:0/1545558353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c0fbb30 0x7ff90c0fbfa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff908004940 tx=0x7ff908009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 -- 172.21.15.49:0/1545558353 shutdown_connections 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 --2- 172.21.15.49:0/1545558353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c0fbb30 0x7ff90c0fbfa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 --2- 172.21.15.49:0/1545558353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff90c101af0 0x7ff90c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 -- 172.21.15.49:0/1545558353 >> 172.21.15.49:0/1545558353 conn(0x7ff90c0f7690 msgr2=0x7ff90c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 -- 172.21.15.49:0/1545558353 shutdown_connections 2023-12-16T07:46:17.775 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 -- 172.21.15.49:0/1545558353 wait complete. 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 Processor -- start 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.773+0000 7ff914148700 1 -- start start 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff914148700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff90c0fbb30 0x7ff90c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff914148700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c101af0 0x7ff90c10ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff914148700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c10f1c0 con 0x7ff90c101af0 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff914148700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c10f330 con 0x7ff90c0fbb30 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9116e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c101af0 0x7ff90c10ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9116e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c101af0 0x7ff90c10ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57964/0 (socket says 172.21.15.49:57964) 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9116e3700 1 -- 172.21.15.49:0/1575687527 learned_addr learned my addr 172.21.15.49:0/1575687527 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:17.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff911ee4700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff90c0fbb30 0x7ff90c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9116e3700 1 -- 172.21.15.49:0/1575687527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff90c0fbb30 msgr2=0x7ff90c10e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9116e3700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff90c0fbb30 0x7ff90c10e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9116e3700 1 -- 172.21.15.49:0/1575687527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908005040 con 0x7ff90c101af0 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9116e3700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c101af0 0x7ff90c10ec10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff908009360 tx=0x7ff908009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9027fc700 1 -- 172.21.15.49:0/1575687527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff90800e040 con 0x7ff90c101af0 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c117640 con 0x7ff90c101af0 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9027fc700 1 -- 172.21.15.49:0/1575687527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff908013420 con 0x7ff90c101af0 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.774+0000 7ff9027fc700 1 -- 172.21.15.49:0/1575687527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff90801c610 con 0x7ff90c101af0 2023-12-16T07:46:17.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.775+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90c117b50 con 0x7ff90c101af0 2023-12-16T07:46:17.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.775+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90c103fa0 con 0x7ff90c101af0 2023-12-16T07:46:17.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.776+0000 7ff9027fc700 1 -- 172.21.15.49:0/1575687527 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7ff908013590 con 0x7ff90c101af0 2023-12-16T07:46:17.778 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.776+0000 7ff9027fc700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff8f806ce70 0x7ff8f806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:17.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.776+0000 7ff9027fc700 1 -- 172.21.15.49:0/1575687527 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff90808d550 con 0x7ff90c101af0 2023-12-16T07:46:17.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.776+0000 7ff911ee4700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff8f806ce70 0x7ff8f806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:17.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.777+0000 7ff911ee4700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff8f806ce70 0x7ff8f806f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009fd0 tx=0x7ff8fc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:17.781 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:17.781+0000 7ff9027fc700 1 -- 172.21.15.49:0/1575687527 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7ff9080574e0 con 0x7ff90c101af0 2023-12-16T07:46:18.075 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.075+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff90c0647b0 con 0x7ff90c101af0 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.075+0000 7ff9027fc700 1 -- 172.21.15.49:0/1575687527 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7ff90805ab00 con 0x7ff90c101af0 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:18.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2, 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 4 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6, 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 8 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:46:18.077 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff8f806ce70 msgr2=0x7ff8f806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff8f806ce70 0x7ff8f806f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009fd0 tx=0x7ff8fc00b040 comp rx=0 tx=0).stop 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c101af0 msgr2=0x7ff90c10ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c101af0 0x7ff90c10ec10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff908009360 tx=0x7ff908009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 shutdown_connections 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff90c0fbb30 0x7ff90c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7ff8f806ce70 0x7ff8f806f320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 --2- 172.21.15.49:0/1575687527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff90c101af0 0x7ff90c10ec10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 >> 172.21.15.49:0/1575687527 conn(0x7ff90c0f7690 msgr2=0x7ff90c0f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 shutdown_connections 2023-12-16T07:46:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.078+0000 7ff914148700 1 -- 172.21.15.49:0/1575687527 wait complete. 2023-12-16T07:46:18.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 -- 172.21.15.49:0/2721231984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8864102c70 msgr2=0x7f8864103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 --2- 172.21.15.49:0/2721231984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8864102c70 0x7f8864103040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8854004940 tx=0x7f8854009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 -- 172.21.15.49:0/2721231984 shutdown_connections 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 --2- 172.21.15.49:0/2721231984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88640fb1e0 0x7f88640fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 --2- 172.21.15.49:0/2721231984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8864102c70 0x7f8864103040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 -- 172.21.15.49:0/2721231984 >> 172.21.15.49:0/2721231984 conn(0x7f88640711a0 msgr2=0x7f88640715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 -- 172.21.15.49:0/2721231984 shutdown_connections 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 -- 172.21.15.49:0/2721231984 wait complete. 2023-12-16T07:46:18.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.182+0000 7f8869b8b700 1 Processor -- start 2023-12-16T07:46:18.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f8869b8b700 1 -- start start 2023-12-16T07:46:18.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f8869b8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88640fb1e0 0x7f8864113600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f8869b8b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8864102c70 0x7f8864113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f8869b8b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641141d0 con 0x7f88640fb1e0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f8869b8b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886410d4c0 con 0x7f8864102c70 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f88637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88640fb1e0 0x7f8864113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f88637fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88640fb1e0 0x7f8864113600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57982/0 (socket says 172.21.15.49:57982) 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f88637fe700 1 -- 172.21.15.49:0/4026563112 learned_addr learned my addr 172.21.15.49:0/4026563112 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f88637fe700 1 -- 172.21.15.49:0/4026563112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8864102c70 msgr2=0x7f8864113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f88637fe700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8864102c70 0x7f8864113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f88637fe700 1 -- 172.21.15.49:0/4026563112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854005040 con 0x7f88640fb1e0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.183+0000 7f88637fe700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88640fb1e0 0x7f8864113600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f885400b3b0 tx=0x7f8854009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.184+0000 7f884bfff700 1 -- 172.21.15.49:0/4026563112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f885400e040 con 0x7f88640fb1e0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.184+0000 7f884bfff700 1 -- 172.21.15.49:0/4026563112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f885400bc50 con 0x7f88640fb1e0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.184+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886410d6f0 con 0x7f88640fb1e0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.184+0000 7f884bfff700 1 -- 172.21.15.49:0/4026563112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8854013420 con 0x7f88640fb1e0 2023-12-16T07:46:18.185 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.184+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886410dc30 con 0x7f88640fb1e0 2023-12-16T07:46:18.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.185+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88640fff10 con 0x7f88640fb1e0 2023-12-16T07:46:18.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.185+0000 7f884bfff700 1 -- 172.21.15.49:0/4026563112 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f885401c430 con 0x7f88640fb1e0 2023-12-16T07:46:18.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.186+0000 7f884bfff700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f884c06ce60 0x7f884c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.186 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.186+0000 7f884bfff700 1 -- 172.21.15.49:0/4026563112 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f885408cfb0 con 0x7f88640fb1e0 2023-12-16T07:46:18.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.186+0000 7f8862ffd700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f884c06ce60 0x7f884c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.187 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.186+0000 7f8862ffd700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f884c06ce60 0x7f884c06f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f886410eea0 tx=0x7f8858009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:18.190 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.190+0000 7f884bfff700 1 -- 172.21.15.49:0/4026563112 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f885405aaf0 con 0x7f88640fb1e0 2023-12-16T07:46:18.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:18 smithi133 ceph-mon[181557]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:18.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:18 smithi133 ceph-mon[181557]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:18.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:18 smithi133 ceph-mon[181557]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.439+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f886410ebe0 con 0x7f88640fb1e0 2023-12-16T07:46:18.440 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.440+0000 7f884bfff700 1 -- 172.21.15.49:0/4026563112 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1847 (secure 0 0 0) 0x7f885405a680 con 0x7f88640fb1e0 2023-12-16T07:46:18.440 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:46:18.440 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:46:18.440 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:46:18.441 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:46:18.442 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:18.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f884c06ce60 msgr2=0x7f884c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f884c06ce60 0x7f884c06f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f886410eea0 tx=0x7f8858009ce0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88640fb1e0 msgr2=0x7f8864113600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88640fb1e0 0x7f8864113600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f885400b3b0 tx=0x7f8854009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 shutdown_connections 2023-12-16T07:46:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f884c06ce60 0x7f884c06f310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.444 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88640fb1e0 0x7f8864113600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 --2- 172.21.15.49:0/4026563112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8864102c70 0x7f8864113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 >> 172.21.15.49:0/4026563112 conn(0x7f88640711a0 msgr2=0x7f88640fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 shutdown_connections 2023-12-16T07:46:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.442+0000 7f8869b8b700 1 -- 172.21.15.49:0/4026563112 wait complete. 2023-12-16T07:46:18.445 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:46:18.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:18 smithi049 ceph-mon[217548]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:18.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:18 smithi049 ceph-mon[217548]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:18.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:18 smithi049 ceph-mon[217548]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 -- 172.21.15.49:0/1780494007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 msgr2=0x7f5474101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1780494007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f5474101ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f545c004940 tx=0x7f545c009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 -- 172.21.15.49:0/1780494007 shutdown_connections 2023-12-16T07:46:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1780494007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54740fbb40 0x7f54740fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1780494007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f5474101ed0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.548 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 -- 172.21.15.49:0/1780494007 >> 172.21.15.49:0/1780494007 conn(0x7f54740719b0 msgr2=0x7f5474071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 -- 172.21.15.49:0/1780494007 shutdown_connections 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.547+0000 7f5479eb2700 1 -- 172.21.15.49:0/1780494007 wait complete. 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5479eb2700 1 Processor -- start 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5479eb2700 1 -- start start 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5479eb2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54740fbb40 0x7f547410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5479eb2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f547410ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5479eb2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547410f1a0 con 0x7f5474101b00 2023-12-16T07:46:18.549 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5479eb2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547410f310 con 0x7f54740fbb40 2023-12-16T07:46:18.550 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5472ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f547410ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5472ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f547410ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57996/0 (socket says 172.21.15.49:57996) 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f5472ffd700 1 -- 172.21.15.49:0/1026226333 learned_addr learned my addr 172.21.15.49:0/1026226333 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.548+0000 7f54737fe700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54740fbb40 0x7f547410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f5472ffd700 1 -- 172.21.15.49:0/1026226333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54740fbb40 msgr2=0x7f547410e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f5472ffd700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54740fbb40 0x7f547410e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f5472ffd700 1 -- 172.21.15.49:0/1026226333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c005040 con 0x7f5474101b00 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f54737fe700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54740fbb40 0x7f547410e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f5472ffd700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f547410ec10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5464002a50 tx=0x7f54640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f546bfff700 1 -- 172.21.15.49:0/1026226333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5464007cc0 con 0x7f5474101b00 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f546bfff700 1 -- 172.21.15.49:0/1026226333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f546400f040 con 0x7f5474101b00 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54741176a0 con 0x7f5474101b00 2023-12-16T07:46:18.551 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f546bfff700 1 -- 172.21.15.49:0/1026226333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5464009540 con 0x7f5474101b00 2023-12-16T07:46:18.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.549+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5474117b60 con 0x7f5474101b00 2023-12-16T07:46:18.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.550+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5474103fb0 con 0x7f5474101b00 2023-12-16T07:46:18.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.550+0000 7f546bfff700 1 -- 172.21.15.49:0/1026226333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f54640096a0 con 0x7f5474101b00 2023-12-16T07:46:18.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.551+0000 7f546bfff700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f546006ce60 0x7f546006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.551+0000 7f546bfff700 1 -- 172.21.15.49:0/1026226333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f546408c0b0 con 0x7f5474101b00 2023-12-16T07:46:18.552 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.551+0000 7f54737fe700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f546006ce60 0x7f546006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.553 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.551+0000 7f54737fe700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f546006ce60 0x7f546006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f545c004560 tx=0x7f545c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:18.555 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.556+0000 7f546bfff700 1 -- 172.21.15.49:0/1026226333 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f5464055f90 con 0x7f5474101b00 2023-12-16T07:46:18.776 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.776+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5474065b90 con 0x7f546006ce60 2023-12-16T07:46:18.777 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.777+0000 7f546bfff700 1 -- 172.21.15.49:0/1026226333 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5474065b90 con 0x7f546006ce60 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "10/21 daemons upgraded", 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:46:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:46:18.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f546006ce60 msgr2=0x7f546006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.779 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f546006ce60 0x7f546006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f545c004560 tx=0x7f545c009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 msgr2=0x7f547410ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f547410ec10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5464002a50 tx=0x7f54640046b0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 shutdown_connections 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54740fbb40 0x7f547410e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f546006ce60 0x7f546006f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 --2- 172.21.15.49:0/1026226333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5474101b00 0x7f547410ec10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 >> 172.21.15.49:0/1026226333 conn(0x7f54740719b0 msgr2=0x7f54740fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 shutdown_connections 2023-12-16T07:46:18.780 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.779+0000 7f5479eb2700 1 -- 172.21.15.49:0/1026226333 wait complete. 2023-12-16T07:46:18.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 -- 172.21.15.49:0/2030616424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fe580 msgr2=0x7efff8106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 --2- 172.21.15.49:0/2030616424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fe580 0x7efff8106c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7effe8004940 tx=0x7effe8009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:18.885 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 -- 172.21.15.49:0/2030616424 shutdown_connections 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 --2- 172.21.15.49:0/2030616424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fe580 0x7efff8106c50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 --2- 172.21.15.49:0/2030616424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80fdbe0 0x7efff80fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 -- 172.21.15.49:0/2030616424 >> 172.21.15.49:0/2030616424 conn(0x7efff80f7680 msgr2=0x7efff80f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 -- 172.21.15.49:0/2030616424 shutdown_connections 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 -- 172.21.15.49:0/2030616424 wait complete. 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 Processor -- start 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.883+0000 7f0000031700 1 -- start start 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7f0000031700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fdbe0 0x7efff80fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7f0000031700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80fe580 0x7efff80fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7f0000031700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff80fc5e0 con 0x7efff80fdbe0 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7f0000031700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff80fc750 con 0x7efff80fe580 2023-12-16T07:46:18.886 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffddcd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fdbe0 0x7efff80fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffddcd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fdbe0 0x7efff80fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58006/0 (socket says 172.21.15.49:58006) 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffddcd700 1 -- 172.21.15.49:0/94983718 learned_addr learned my addr 172.21.15.49:0/94983718 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffd5cc700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80fe580 0x7efff80fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffddcd700 1 -- 172.21.15.49:0/94983718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80fe580 msgr2=0x7efff80fbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffddcd700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80fe580 0x7efff80fbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffddcd700 1 -- 172.21.15.49:0/94983718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8005040 con 0x7efff80fdbe0 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffd5cc700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80fe580 0x7efff80fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.884+0000 7efffddcd700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fdbe0 0x7efff80fbaa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efff400c830 tx=0x7efff4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:18.887 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.885+0000 7effee7fc700 1 -- 172.21.15.49:0/94983718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efff400a760 con 0x7efff80fdbe0 2023-12-16T07:46:18.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.885+0000 7effee7fc700 1 -- 172.21.15.49:0/94983718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efff400ad70 con 0x7efff80fdbe0 2023-12-16T07:46:18.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.885+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff81198f0 con 0x7efff80fdbe0 2023-12-16T07:46:18.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.885+0000 7effee7fc700 1 -- 172.21.15.49:0/94983718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efff40113a0 con 0x7efff80fdbe0 2023-12-16T07:46:18.888 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.885+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff8119dd0 con 0x7efff80fdbe0 2023-12-16T07:46:18.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.886+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff81042b0 con 0x7efff80fdbe0 2023-12-16T07:46:18.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.886+0000 7effee7fc700 1 -- 172.21.15.49:0/94983718 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7efff4012400 con 0x7efff80fdbe0 2023-12-16T07:46:18.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.887+0000 7effee7fc700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7effe406ce60 0x7effe406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:18.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.887+0000 7effee7fc700 1 -- 172.21.15.49:0/94983718 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efff408c3b0 con 0x7efff80fdbe0 2023-12-16T07:46:18.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.887+0000 7efffd5cc700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7effe406ce60 0x7effe406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:18.889 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.887+0000 7efffd5cc700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7effe406ce60 0x7effe406f310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effe8004560 tx=0x7effe8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:18.891 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:18.891+0000 7effee7fc700 1 -- 172.21.15.49:0/94983718 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7efff4056270 con 0x7efff80fdbe0 2023-12-16T07:46:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.180+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efff80fb280 con 0x7efff80fdbe0 2023-12-16T07:46:19.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.181+0000 7effee7fc700 1 -- 172.21.15.49:0/94983718 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efff4059890 con 0x7efff80fdbe0 2023-12-16T07:46:19.182 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:46:19.182 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:46:19.182 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7effe406ce60 msgr2=0x7effe406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7effe406ce60 0x7effe406f310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effe8004560 tx=0x7effe8009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fdbe0 msgr2=0x7efff80fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fdbe0 0x7efff80fbaa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efff400c830 tx=0x7efff4004470 comp rx=0 tx=0).stop 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 shutdown_connections 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7effe406ce60 0x7effe406f310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efff80fdbe0 0x7efff80fbaa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 --2- 172.21.15.49:0/94983718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80fe580 0x7efff80fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:19.183 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 >> 172.21.15.49:0/94983718 conn(0x7efff80f7680 msgr2=0x7efff8101430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 shutdown_connections 2023-12-16T07:46:19.184 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:19.183+0000 7f0000031700 1 -- 172.21.15.49:0/94983718 wait complete. 2023-12-16T07:46:19.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:19 smithi133 ceph-mon[181557]: pgmap v100: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:19.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:19 smithi133 ceph-mon[181557]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded) 2023-12-16T07:46:19.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:19 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/1575687527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:19.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:19 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/4026563112' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:46:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:19 smithi049 ceph-mon[217548]: pgmap v100: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:19 smithi049 ceph-mon[217548]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 10 pgs degraded) 2023-12-16T07:46:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:19 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/1575687527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:19 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/4026563112' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:46:20.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:20 smithi133 ceph-mon[181557]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:20.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:20 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/94983718' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:46:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:20 smithi049 ceph-mon[217548]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:20.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:20 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/94983718' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:46:21.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:21 smithi049 ceph-mon[217548]: pgmap v101: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:21.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:21 smithi133 ceph-mon[181557]: pgmap v101: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:23.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:23 smithi133 ceph-mon[181557]: pgmap v102: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:23.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:23 smithi049 ceph-mon[217548]: pgmap v102: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:25.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:24 smithi049 ceph-mon[217548]: pgmap v103: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:25.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:24 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:24 smithi133 ceph-mon[181557]: pgmap v103: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:24 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:25 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:25 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:26.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:25 smithi133 ceph-mon[181557]: Upgrade: osd.4 is safe to restart 2023-12-16T07:46:26.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:25 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:26.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:25 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-16T07:46:26.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:25 smithi049 ceph-mon[217548]: Upgrade: osd.4 is safe to restart 2023-12-16T07:46:27.584 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:27 smithi133 ceph-mon[181557]: pgmap v104: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:27.584 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:27 smithi133 ceph-mon[181557]: Upgrade: Updating osd.4 2023-12-16T07:46:27.584 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:27 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:27.585 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:27 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T07:46:27.585 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:27 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:27.585 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:27 smithi133 ceph-mon[181557]: Deploying daemon osd.4 on smithi133 2023-12-16T07:46:27.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:27 smithi049 ceph-mon[217548]: pgmap v104: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:27.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:27 smithi049 ceph-mon[217548]: Upgrade: Updating osd.4 2023-12-16T07:46:27.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:27 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:27.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:27 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-16T07:46:27.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:27 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:27.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:27 smithi049 ceph-mon[217548]: Deploying daemon osd.4 on smithi133 2023-12-16T07:46:28.474 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:28 smithi133 systemd[1]: Stopping Ceph osd.4 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:46:28.867 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:28 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[135518]: 2023-12-16T07:46:28.472+0000 7f2ec5038700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:46:28.867 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:28 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[135518]: 2023-12-16T07:46:28.472+0000 7f2ec5038700 -1 osd.4 68 *** Got signal Terminated *** 2023-12-16T07:46:28.867 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:28 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[135518]: 2023-12-16T07:46:28.472+0000 7f2ec5038700 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:46:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:29 smithi133 ceph-mon[181557]: pgmap v105: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:29 smithi133 ceph-mon[181557]: osd.4 marked itself down and dead 2023-12-16T07:46:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:29.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:29.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:29 smithi049 ceph-mon[217548]: pgmap v105: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:29.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:29 smithi049 ceph-mon[217548]: osd.4 marked itself down and dead 2023-12-16T07:46:29.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:29.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:30.221 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:29 smithi133 bash[199679]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4 2023-12-16T07:46:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:30 smithi133 ceph-mon[181557]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:46:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:30 smithi133 ceph-mon[181557]: failed to encode map e69 with expected crc 2023-12-16T07:46:30.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:30 smithi133 ceph-mon[181557]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T07:46:30.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:30 smithi049 ceph-mon[217548]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:46:30.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:30 smithi049 ceph-mon[217548]: failed to encode map e69 with expected crc 2023-12-16T07:46:30.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:30 smithi049 ceph-mon[217548]: osdmap e69: 6 total, 5 up, 6 in 2023-12-16T07:46:31.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.4.service: Succeeded. 2023-12-16T07:46:31.368 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 systemd[1]: Stopped Ceph osd.4 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:46:31.368 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 systemd[1]: Starting Ceph osd.4 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: pgmap v107: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: osdmap e70: 6 total, 5 up, 6 in 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:31 smithi133 ceph-mon[181557]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: pgmap v107: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: osdmap e70: 6 total, 5 up, 6 in 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: failed to encode map e70 with expected crc 2023-12-16T07:46:31.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:31 smithi049 ceph-mon[217548]: failed to encode map e70 with expected crc 2023-12-16T07:46:32.277 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 bash[199948]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T07:46:32.277 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 bash[199948]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-16T07:46:32.277 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 bash[199948]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-16T07:46:32.278 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 bash[199948]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-16T07:46:32.278 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 bash[199948]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-16T07:46:32.278 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 bash[199948]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T07:46:32.278 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:31 smithi133 bash[199948]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-16T07:46:32.534 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:32 smithi133 ceph-mon[181557]: Health check failed: Degraded data redundancy: 20/222 objects degraded (9.009%), 5 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:32.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:32 smithi049 ceph-mon[217548]: Health check failed: Degraded data redundancy: 20/222 objects degraded (9.009%), 5 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:32.867 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:32 smithi133 ceph-osd[200238]: -- 172.21.15.133:0/1729003500 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55612d2eb6c0 con 0x55612d2bac00 2023-12-16T07:46:32.867 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:32 smithi133 bash[200199]: dadd713e3e6a90702a83fc4ec4f183da6077aaac9b988da2bd4fa4dda9912c97 2023-12-16T07:46:32.867 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:32 smithi133 systemd[1]: Started Ceph osd.4 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:46:33.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:33 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:46:33.062+0000 7f6c91bf3640 -1 Falling back to public interface 2023-12-16T07:46:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:33 smithi133 ceph-mon[181557]: pgmap v109: 65 pgs: 5 active+undersized+degraded, 5 peering, 3 stale+active+clean, 8 active+undersized, 44 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/222 objects degraded (9.009%) 2023-12-16T07:46:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:33 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:33 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:33.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:33 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:33 smithi049 ceph-mon[217548]: pgmap v109: 65 pgs: 5 active+undersized+degraded, 5 peering, 3 stale+active+clean, 8 active+undersized, 44 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/222 objects degraded (9.009%) 2023-12-16T07:46:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:33 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:33.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:33 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:33.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:33 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:35.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:35 smithi133 ceph-mon[181557]: pgmap v110: 65 pgs: 13 active+undersized+degraded, 5 peering, 16 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2023-12-16T07:46:35.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:35 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:35.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:35 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:35.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:35 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:35.868 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:35 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:35 smithi049 ceph-mon[217548]: pgmap v110: 65 pgs: 13 active+undersized+degraded, 5 peering, 16 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2023-12-16T07:46:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:35 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:35 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:35 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:35.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:35 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:37.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:37 smithi133 ceph-mon[181557]: pgmap v111: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-16T07:46:37.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:37 smithi133 ceph-mon[181557]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T07:46:37.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:37 smithi049 ceph-mon[217548]: pgmap v111: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-16T07:46:37.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:37 smithi049 ceph-mon[217548]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T07:46:37.737 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:37 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:46:37.660+0000 7f6c91bf3640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-16T07:46:38.617 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:46:38.214+0000 7f6c91bf3640 -1 osd.4 68 log_to_monitors true 2023-12-16T07:46:39.106 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: pgmap v112: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-16T07:46:39.106 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:39.106 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:39.106 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:39.106 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:46:39.106 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='osd.4 [v2:172.21.15.133:6808/2539677492,v1:172.21.15.133:6809/2539677492]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:46:39.107 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:38 smithi133 ceph-mon[181557]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:46:39.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: pgmap v112: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-16T07:46:39.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:39.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:39.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:39.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:39.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-16T07:46:39.211 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='osd.4 [v2:172.21.15.133:6808/2539677492,v1:172.21.15.133:6809/2539677492]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:46:39.211 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:38 smithi049 ceph-mon[217548]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-16T07:46:39.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:46:39 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:46:39.105+0000 7f6c82062700 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:46:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:40 smithi133 ceph-mon[181557]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T07:46:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:40 smithi133 ceph-mon[181557]: failed to encode map e71 with expected crc 2023-12-16T07:46:40.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:40 smithi133 ceph-mon[181557]: osdmap e71: 6 total, 5 up, 6 in 2023-12-16T07:46:40.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:40 smithi133 ceph-mon[181557]: from='osd.4 [v2:172.21.15.133:6808/2539677492,v1:172.21.15.133:6809/2539677492]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:40.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:40 smithi133 ceph-mon[181557]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:40 smithi049 ceph-mon[217548]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-16T07:46:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:40 smithi049 ceph-mon[217548]: failed to encode map e71 with expected crc 2023-12-16T07:46:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:40 smithi049 ceph-mon[217548]: osdmap e71: 6 total, 5 up, 6 in 2023-12-16T07:46:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:40 smithi049 ceph-mon[217548]: from='osd.4 [v2:172.21.15.133:6808/2539677492,v1:172.21.15.133:6809/2539677492]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:40.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:40 smithi049 ceph-mon[217548]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:46:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:41 smithi049 ceph-mon[217548]: pgmap v114: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-16T07:46:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:41 smithi049 ceph-mon[217548]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:46:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:41 smithi049 ceph-mon[217548]: failed to encode map e72 with expected crc 2023-12-16T07:46:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:41 smithi049 ceph-mon[217548]: osd.4 [v2:172.21.15.133:6808/2539677492,v1:172.21.15.133:6809/2539677492] boot 2023-12-16T07:46:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:41 smithi049 ceph-mon[217548]: osdmap e72: 6 total, 6 up, 6 in 2023-12-16T07:46:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:41 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:46:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:41 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 39/222 objects degraded (17.568%), 15 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:41.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:41 smithi133 ceph-mon[181557]: pgmap v114: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2023-12-16T07:46:41.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:41 smithi133 ceph-mon[181557]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:46:41.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:41 smithi133 ceph-mon[181557]: failed to encode map e72 with expected crc 2023-12-16T07:46:41.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:41 smithi133 ceph-mon[181557]: osd.4 [v2:172.21.15.133:6808/2539677492,v1:172.21.15.133:6809/2539677492] boot 2023-12-16T07:46:41.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:41 smithi133 ceph-mon[181557]: osdmap e72: 6 total, 6 up, 6 in 2023-12-16T07:46:41.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:41 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-16T07:46:41.368 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:41 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 39/222 objects degraded (17.568%), 15 pgs degraded (PG_DEGRADED) 2023-12-16T07:46:42.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:42 smithi133 ceph-mon[181557]: osdmap e73: 6 total, 6 up, 6 in 2023-12-16T07:46:42.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:42 smithi133 ceph-mon[181557]: failed to encode map e73 with expected crc 2023-12-16T07:46:42.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:42 smithi133 ceph-mon[181557]: failed to encode map e73 with expected crc 2023-12-16T07:46:42.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:42 smithi133 ceph-mon[181557]: failed to encode map e73 with expected crc 2023-12-16T07:46:42.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:42 smithi133 ceph-mon[181557]: failed to encode map e73 with expected crc 2023-12-16T07:46:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:42 smithi049 ceph-mon[217548]: osdmap e73: 6 total, 6 up, 6 in 2023-12-16T07:46:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:42 smithi049 ceph-mon[217548]: failed to encode map e73 with expected crc 2023-12-16T07:46:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:42 smithi049 ceph-mon[217548]: failed to encode map e73 with expected crc 2023-12-16T07:46:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:42 smithi049 ceph-mon[217548]: failed to encode map e73 with expected crc 2023-12-16T07:46:42.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:42 smithi049 ceph-mon[217548]: failed to encode map e73 with expected crc 2023-12-16T07:46:43.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:43 smithi133 ceph-mon[181557]: pgmap v117: 65 pgs: 10 peering, 10 active+undersized+degraded, 13 active+undersized, 32 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19/222 objects degraded (8.559%) 2023-12-16T07:46:43.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:43 smithi049 ceph-mon[217548]: pgmap v117: 65 pgs: 10 peering, 10 active+undersized+degraded, 13 active+undersized, 32 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19/222 objects degraded (8.559%) 2023-12-16T07:46:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:44 smithi133 ceph-mon[181557]: pgmap v118: 65 pgs: 10 peering, 3 active+undersized+degraded, 7 active+undersized, 45 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2023-12-16T07:46:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:45.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:45.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:44 smithi049 ceph-mon[217548]: pgmap v118: 65 pgs: 10 peering, 3 active+undersized+degraded, 7 active+undersized, 45 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2023-12-16T07:46:45.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:45.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:46.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:45 smithi049 ceph-mon[217548]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded) 2023-12-16T07:46:46.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:45 smithi133 ceph-mon[181557]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded) 2023-12-16T07:46:47.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:47 smithi133 ceph-mon[181557]: pgmap v119: 65 pgs: 10 peering, 55 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:47 smithi049 ceph-mon[217548]: pgmap v119: 65 pgs: 10 peering, 55 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:49.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 -- 172.21.15.49:0/1403223069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fe590 msgr2=0x7f6214106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 --2- 172.21.15.49:0/1403223069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fe590 0x7f6214106c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6204004940 tx=0x7f6204009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:49.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 -- 172.21.15.49:0/1403223069 shutdown_connections 2023-12-16T07:46:49.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 --2- 172.21.15.49:0/1403223069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fe590 0x7f6214106c60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 --2- 172.21.15.49:0/1403223069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62140fdbf0 0x7f62140fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 -- 172.21.15.49:0/1403223069 >> 172.21.15.49:0/1403223069 conn(0x7f62140f7690 msgr2=0x7f62140f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:49.304 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 -- 172.21.15.49:0/1403223069 shutdown_connections 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 -- 172.21.15.49:0/1403223069 wait complete. 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.302+0000 7f621bc18700 1 Processor -- start 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f621bc18700 1 -- start start 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f621bc18700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fdbf0 0x7f62141135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f621bc18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62140fe590 0x7f6214113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f621bc18700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62141141c0 con 0x7f62140fdbf0 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f621bc18700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621410d4b0 con 0x7f62140fe590 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62199b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fdbf0 0x7f62141135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62199b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fdbf0 0x7f62141135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58684/0 (socket says 172.21.15.49:58684) 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62199b4700 1 -- 172.21.15.49:0/1303941592 learned_addr learned my addr 172.21.15.49:0/1303941592 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62191b3700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62140fe590 0x7f6214113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62199b4700 1 -- 172.21.15.49:0/1303941592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62140fe590 msgr2=0x7f6214113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.305 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62199b4700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62140fe590 0x7f6214113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62199b4700 1 -- 172.21.15.49:0/1303941592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204005040 con 0x7f62140fdbf0 2023-12-16T07:46:49.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.303+0000 7f62199b4700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fdbf0 0x7f62141135f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6210002a50 tx=0x7f62100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:49.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.304+0000 7f620a7fc700 1 -- 172.21.15.49:0/1303941592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6210007cc0 con 0x7f62140fdbf0 2023-12-16T07:46:49.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.304+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621410d740 con 0x7f62140fdbf0 2023-12-16T07:46:49.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.304+0000 7f620a7fc700 1 -- 172.21.15.49:0/1303941592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f621000f040 con 0x7f62140fdbf0 2023-12-16T07:46:49.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.304+0000 7f620a7fc700 1 -- 172.21.15.49:0/1303941592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6210009540 con 0x7f62140fdbf0 2023-12-16T07:46:49.306 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.304+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621410dc80 con 0x7f62140fdbf0 2023-12-16T07:46:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.305+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62141042c0 con 0x7f62140fdbf0 2023-12-16T07:46:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.305+0000 7f620a7fc700 1 -- 172.21.15.49:0/1303941592 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f62100096a0 con 0x7f62140fdbf0 2023-12-16T07:46:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.306+0000 7f620a7fc700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f620006ce60 0x7f620006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.306+0000 7f620a7fc700 1 -- 172.21.15.49:0/1303941592 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f621008c0f0 con 0x7f62140fdbf0 2023-12-16T07:46:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.306+0000 7f62191b3700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f620006ce60 0x7f620006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.307 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.306+0000 7f62191b3700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f620006ce60 0x7f620006f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f620400b3b0 tx=0x7f6204009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:49.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.310+0000 7f620a7fc700 1 -- 172.21.15.49:0/1303941592 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f6210059a60 con 0x7f62140fdbf0 2023-12-16T07:46:49.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:49 smithi133 ceph-mon[181557]: pgmap v120: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:49.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:49 smithi049 ceph-mon[217548]: pgmap v120: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:49.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.532+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f621410ebd0 con 0x7f620006ce60 2023-12-16T07:46:49.534 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.534+0000 7f620a7fc700 1 -- 172.21.15.49:0/1303941592 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f621410ebd0 con 0x7f620006ce60 2023-12-16T07:46:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.535+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f620006ce60 msgr2=0x7f620006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.535+0000 7f621bc18700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f620006ce60 0x7f620006f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f620400b3b0 tx=0x7f6204009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.535+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fdbf0 msgr2=0x7f62141135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.535+0000 7f621bc18700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fdbf0 0x7f62141135f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6210002a50 tx=0x7f62100046b0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.536+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 shutdown_connections 2023-12-16T07:46:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.536+0000 7f621bc18700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f620006ce60 0x7f620006f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.536+0000 7f621bc18700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62140fdbf0 0x7f62141135f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.536+0000 7f621bc18700 1 --2- 172.21.15.49:0/1303941592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62140fe590 0x7f6214113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.536+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 >> 172.21.15.49:0/1303941592 conn(0x7f62140f7690 msgr2=0x7f6214101440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.536+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 shutdown_connections 2023-12-16T07:46:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.536+0000 7f621bc18700 1 -- 172.21.15.49:0/1303941592 wait complete. 2023-12-16T07:46:49.546 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:46:49.641 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 -- 172.21.15.49:0/116620251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 msgr2=0x7f5bc0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 --2- 172.21.15.49:0/116620251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0065800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0004940 tx=0x7f5bb0009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 -- 172.21.15.49:0/116620251 shutdown_connections 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 --2- 172.21.15.49:0/116620251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0065800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 --2- 172.21.15.49:0/116620251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bc0102c20 0x7f5bc0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 -- 172.21.15.49:0/116620251 >> 172.21.15.49:0/116620251 conn(0x7f5bc00719b0 msgr2=0x7f5bc0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 -- 172.21.15.49:0/116620251 shutdown_connections 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 -- 172.21.15.49:0/116620251 wait complete. 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.641+0000 7f5bc613f700 1 Processor -- start 2023-12-16T07:46:49.642 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bc613f700 1 -- start start 2023-12-16T07:46:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bc613f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bc613f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bc0102c20 0x7f5bc0113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.643 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bc613f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc01142c0 con 0x7f5bc0065390 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bc613f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc010d5f0 con 0x7f5bc0102c20 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58692/0 (socket says 172.21.15.49:58692) 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbf7fe700 1 -- 172.21.15.49:0/3239374839 learned_addr learned my addr 172.21.15.49:0/3239374839 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbeffd700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bc0102c20 0x7f5bc0113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbf7fe700 1 -- 172.21.15.49:0/3239374839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bc0102c20 msgr2=0x7f5bc0113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbf7fe700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bc0102c20 0x7f5bc0113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbf7fe700 1 -- 172.21.15.49:0/3239374839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0005040 con 0x7f5bc0065390 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbeffd700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bc0102c20 0x7f5bc0113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.642+0000 7f5bbf7fe700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0113730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8002a50 tx=0x7f5ba80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.643+0000 7f5bb7fff700 1 -- 172.21.15.49:0/3239374839 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ba8007cc0 con 0x7f5bc0065390 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.643+0000 7f5bb7fff700 1 -- 172.21.15.49:0/3239374839 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ba800f040 con 0x7f5bc0065390 2023-12-16T07:46:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.643+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc010d8d0 con 0x7f5bc0065390 2023-12-16T07:46:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.643+0000 7f5bb7fff700 1 -- 172.21.15.49:0/3239374839 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ba8009540 con 0x7f5bc0065390 2023-12-16T07:46:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.643+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc010de10 con 0x7f5bc0065390 2023-12-16T07:46:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.644+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc00fff40 con 0x7f5bc0065390 2023-12-16T07:46:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.644+0000 7f5bb7fff700 1 -- 172.21.15.49:0/3239374839 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5ba80096a0 con 0x7f5bc0065390 2023-12-16T07:46:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.644+0000 7f5bb7fff700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5bac06ce60 0x7f5bac06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.645+0000 7f5bb7fff700 1 -- 172.21.15.49:0/3239374839 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5ba808bfe0 con 0x7f5bc0065390 2023-12-16T07:46:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.645+0000 7f5bbeffd700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5bac06ce60 0x7f5bac06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.646 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.645+0000 7f5bbeffd700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5bac06ce60 0x7f5bac06f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b3b0 tx=0x7f5bb0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:49.649 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.649+0000 7f5bb7fff700 1 -- 172.21.15.49:0/3239374839 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f5ba80599d0 con 0x7f5bc0065390 2023-12-16T07:46:49.870 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.870+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bc004bbf0 con 0x7f5bac06ce60 2023-12-16T07:46:49.871 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.871+0000 7f5bb7fff700 1 -- 172.21.15.49:0/3239374839 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5bc004bbf0 con 0x7f5bac06ce60 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5bac06ce60 msgr2=0x7f5bac06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5bac06ce60 0x7f5bac06f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b3b0 tx=0x7f5bb0009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 msgr2=0x7f5bc0113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0113730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8002a50 tx=0x7f5ba80046b0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 shutdown_connections 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f5bac06ce60 0x7f5bac06f310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5bc0065390 0x7f5bc0113730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 --2- 172.21.15.49:0/3239374839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bc0102c20 0x7f5bc0113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 >> 172.21.15.49:0/3239374839 conn(0x7f5bc00719b0 msgr2=0x7f5bc00fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 shutdown_connections 2023-12-16T07:46:49.874 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.873+0000 7f5bc613f700 1 -- 172.21.15.49:0/3239374839 wait complete. 2023-12-16T07:46:49.978 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 -- 172.21.15.49:0/1992314719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 msgr2=0x7f192c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 --2- 172.21.15.49:0/1992314719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c101ec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1928004940 tx=0x7f1928009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 -- 172.21.15.49:0/1992314719 shutdown_connections 2023-12-16T07:46:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 --2- 172.21.15.49:0/1992314719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f192c0fbb30 0x7f192c0fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 --2- 172.21.15.49:0/1992314719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c101ec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 -- 172.21.15.49:0/1992314719 >> 172.21.15.49:0/1992314719 conn(0x7f192c0f7690 msgr2=0x7f192c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 -- 172.21.15.49:0/1992314719 shutdown_connections 2023-12-16T07:46:49.979 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 -- 172.21.15.49:0/1992314719 wait complete. 2023-12-16T07:46:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.978+0000 7f1933342700 1 Processor -- start 2023-12-16T07:46:49.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f1933342700 1 -- start start 2023-12-16T07:46:49.983 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f1933342700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f192c0fbb30 0x7f192c1124e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f1933342700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f1933342700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c113070 con 0x7f192c101af0 2023-12-16T07:46:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f1933342700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c10c3a0 con 0x7f192c0fbb30 2023-12-16T07:46:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19308dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19308dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c112a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58702/0 (socket says 172.21.15.49:58702) 2023-12-16T07:46:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19308dd700 1 -- 172.21.15.49:0/1305345512 learned_addr learned my addr 172.21.15.49:0/1305345512 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19310de700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f192c0fbb30 0x7f192c1124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19308dd700 1 -- 172.21.15.49:0/1305345512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f192c0fbb30 msgr2=0x7f192c1124e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19308dd700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f192c0fbb30 0x7f192c1124e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19308dd700 1 -- 172.21.15.49:0/1305345512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928005040 con 0x7f192c101af0 2023-12-16T07:46:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.979+0000 7f19308dd700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c112a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f191c00eb40 tx=0x7f191c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.980+0000 7f1921ffb700 1 -- 172.21.15.49:0/1305345512 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f191c007cc0 con 0x7f192c101af0 2023-12-16T07:46:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.980+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c10c620 con 0x7f192c101af0 2023-12-16T07:46:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.980+0000 7f1921ffb700 1 -- 172.21.15.49:0/1305345512 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f191c00f040 con 0x7f192c101af0 2023-12-16T07:46:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.980+0000 7f1921ffb700 1 -- 172.21.15.49:0/1305345512 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f191c00c990 con 0x7f192c101af0 2023-12-16T07:46:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.980+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c10cb60 con 0x7f192c101af0 2023-12-16T07:46:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.981+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c103fa0 con 0x7f192c101af0 2023-12-16T07:46:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.981+0000 7f1921ffb700 1 -- 172.21.15.49:0/1305345512 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f191c00cc00 con 0x7f192c101af0 2023-12-16T07:46:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.982+0000 7f1921ffb700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f191806ce60 0x7f191806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.982+0000 7f1921ffb700 1 -- 172.21.15.49:0/1305345512 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f191c08bed0 con 0x7f192c101af0 2023-12-16T07:46:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.982+0000 7f19310de700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f191806ce60 0x7f191806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.982+0000 7f19310de700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f191806ce60 0x7f191806f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1928000c00 tx=0x7f1928009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:49.986+0000 7f1921ffb700 1 -- 172.21.15.49:0/1305345512 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f191c0598f0 con 0x7f192c101af0 2023-12-16T07:46:50.201 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.200+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f192c04bbf0 con 0x7f191806ce60 2023-12-16T07:46:50.211 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.211+0000 7f1921ffb700 1 -- 172.21.15.49:0/1305345512 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f192c04bbf0 con 0x7f191806ce60 2023-12-16T07:46:50.211 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:46:50.211 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (4m) 71s ago 12m 28.5M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:46:50.211 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (2m) 71s ago 12m 7465k - 19.0.0-191-g6d933094 a29c258b5d6f ae149580b967 2023-12-16T07:46:50.211 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (2m) 15s ago 11m 7448k - 19.0.0-191-g6d933094 a29c258b5d6f b4d081b98e26 2023-12-16T07:46:50.211 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (4m) 71s ago 12m 88.2M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (8m) 71s ago 8m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (8m) 71s ago 8m 16.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (8m) 15s ago 8m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (8m) 15s ago 8m 18.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (5m) 71s ago 13m 511M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (5m) 15s ago 11m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (3m) 71s ago 13m 62.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (2m) 15s ago 11m 55.5M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (4m) 71s ago 12m 17.5M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (4m) 15s ago 11m 17.7M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (2m) 71s ago 11m 129M 1568M 19.0.0-191-g6d933094 a29c258b5d6f bb0cb3d699c6 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (104s) 71s ago 10m 130M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ac94960b0db8 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (74s) 71s ago 10m 17.1M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 0eb7426982e8 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (45s) 15s ago 10m 141M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 2b93a8668da2 2023-12-16T07:46:50.212 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (17s) 15s ago 9m 13.7M 2592M 19.0.0-191-g6d933094 a29c258b5d6f dadd713e3e6a 2023-12-16T07:46:50.213 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (9m) 15s ago 9m 966M 2592M 17.2.7-125-g1f2f5510 60cc83a9c8f1 b7f8c4b9d41e 2023-12-16T07:46:50.213 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (4m) 71s ago 11m 60.9M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:46:50.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f191806ce60 msgr2=0x7f191806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f191806ce60 0x7f191806f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1928000c00 tx=0x7f1928009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:50.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 msgr2=0x7f192c112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.213 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c112a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f191c00eb40 tx=0x7f191c00b040 comp rx=0 tx=0).stop 2023-12-16T07:46:50.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 shutdown_connections 2023-12-16T07:46:50.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f192c0fbb30 0x7f192c1124e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f191806ce60 0x7f191806f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 --2- 172.21.15.49:0/1305345512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f192c101af0 0x7f192c112a20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 >> 172.21.15.49:0/1305345512 conn(0x7f192c0f7690 msgr2=0x7f192c0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:50.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 shutdown_connections 2023-12-16T07:46:50.214 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.213+0000 7f1933342700 1 -- 172.21.15.49:0/1305345512 wait complete. 2023-12-16T07:46:50.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 -- 172.21.15.49:0/4096258298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 msgr2=0x7f58b0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.318 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 --2- 172.21.15.49:0/4096258298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b0101ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f58ac004940 tx=0x7f58ac009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 -- 172.21.15.49:0/4096258298 shutdown_connections 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 --2- 172.21.15.49:0/4096258298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58b00fbb40 0x7f58b00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 --2- 172.21.15.49:0/4096258298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b0101ed0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 -- 172.21.15.49:0/4096258298 >> 172.21.15.49:0/4096258298 conn(0x7f58b00719b0 msgr2=0x7f58b0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 -- 172.21.15.49:0/4096258298 shutdown_connections 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.316+0000 7f58b75cb700 1 -- 172.21.15.49:0/4096258298 wait complete. 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b75cb700 1 Processor -- start 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b75cb700 1 -- start start 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b75cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58b00fbb40 0x7f58b010e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b75cb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b010ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b75cb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b010f1c0 con 0x7f58b0101b00 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b75cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b010f300 con 0x7f58b00fbb40 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b4b66700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b010ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:50.319 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b4b66700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b010ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58722/0 (socket says 172.21.15.49:58722) 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b4b66700 1 -- 172.21.15.49:0/3055361469 learned_addr learned my addr 172.21.15.49:0/3055361469 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b5367700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58b00fbb40 0x7f58b010e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b4b66700 1 -- 172.21.15.49:0/3055361469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58b00fbb40 msgr2=0x7f58b010e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b4b66700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58b00fbb40 0x7f58b010e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b4b66700 1 -- 172.21.15.49:0/3055361469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac005040 con 0x7f58b0101b00 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.317+0000 7f58b4b66700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b010ec30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c830 tx=0x7f58a4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.318+0000 7f58a1ffb700 1 -- 172.21.15.49:0/3055361469 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a400a760 con 0x7f58b0101b00 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.318+0000 7f58a1ffb700 1 -- 172.21.15.49:0/3055361469 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58a400ad70 con 0x7f58b0101b00 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.318+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b0117660 con 0x7f58b0101b00 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.318+0000 7f58a1ffb700 1 -- 172.21.15.49:0/3055361469 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a40113a0 con 0x7f58b0101b00 2023-12-16T07:46:50.320 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.318+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b0117b70 con 0x7f58b0101b00 2023-12-16T07:46:50.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.319+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b0103fb0 con 0x7f58b0101b00 2023-12-16T07:46:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.319+0000 7f58a1ffb700 1 -- 172.21.15.49:0/3055361469 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f58a4012400 con 0x7f58b0101b00 2023-12-16T07:46:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.320+0000 7f58a1ffb700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f589c06ce70 0x7f589c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.320+0000 7f58a1ffb700 1 -- 172.21.15.49:0/3055361469 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f58a408c220 con 0x7f58b0101b00 2023-12-16T07:46:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.320+0000 7f58b5367700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f589c06ce70 0x7f589c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:50.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.320+0000 7f58b5367700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f589c06ce70 0x7f589c06f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00b3b0 tx=0x7f58ac009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:50.324 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.324+0000 7f58a1ffb700 1 -- 172.21.15.49:0/3055361469 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f58a4056220 con 0x7f58b0101b00 2023-12-16T07:46:50.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:50 smithi133 ceph-mon[181557]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:50.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:50 smithi049 ceph-mon[217548]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:50.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.610+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f58b0065b70 con 0x7f58b0101b00 2023-12-16T07:46:50.611 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.611+0000 7f58a1ffb700 1 -- 172.21.15.49:0/3055361469 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f58a4059840 con 0x7f58b0101b00 2023-12-16T07:46:50.611 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 5 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:46:50.612 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5, 2023-12-16T07:46:50.613 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 9 2023-12-16T07:46:50.613 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:46:50.613 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:46:50.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f589c06ce70 msgr2=0x7f589c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.613 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f589c06ce70 0x7f589c06f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00b3b0 tx=0x7f58ac009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 msgr2=0x7f58b010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b010ec30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c830 tx=0x7f58a4004470 comp rx=0 tx=0).stop 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 shutdown_connections 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58b00fbb40 0x7f58b010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f589c06ce70 0x7f589c06f320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 --2- 172.21.15.49:0/3055361469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58b0101b00 0x7f58b010ec30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 >> 172.21.15.49:0/3055361469 conn(0x7f58b00719b0 msgr2=0x7f58b00fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 shutdown_connections 2023-12-16T07:46:50.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.613+0000 7f58b75cb700 1 -- 172.21.15.49:0/3055361469 wait complete. 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.717+0000 7f23fae29700 1 -- 172.21.15.49:0/780989809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f41035a0 msgr2=0x7f23f40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.717+0000 7f23fae29700 1 --2- 172.21.15.49:0/780989809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f41035a0 0x7f23f40fcc10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23e0004940 tx=0x7f23e0009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.717+0000 7f23fae29700 1 -- 172.21.15.49:0/780989809 shutdown_connections 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.717+0000 7f23fae29700 1 --2- 172.21.15.49:0/780989809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f41035a0 0x7f23f40fcc10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.717+0000 7f23fae29700 1 --2- 172.21.15.49:0/780989809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23f4102c00 0x7f23f4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.717+0000 7f23fae29700 1 -- 172.21.15.49:0/780989809 >> 172.21.15.49:0/780989809 conn(0x7f23f40f8790 msgr2=0x7f23f40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.718+0000 7f23fae29700 1 -- 172.21.15.49:0/780989809 shutdown_connections 2023-12-16T07:46:50.718 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.718+0000 7f23fae29700 1 -- 172.21.15.49:0/780989809 wait complete. 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.718+0000 7f23fae29700 1 Processor -- start 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.718+0000 7f23fae29700 1 -- start start 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23fae29700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f4102c00 0x7f23f41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23fae29700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23f41035a0 0x7f23f4113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23fae29700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f4114280 con 0x7f23f4102c00 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23fae29700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f410d570 con 0x7f23f41035a0 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f8bc5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f4102c00 0x7f23f41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:50.720 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f8bc5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f4102c00 0x7f23f41136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58736/0 (socket says 172.21.15.49:58736) 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f8bc5700 1 -- 172.21.15.49:0/3660233933 learned_addr learned my addr 172.21.15.49:0/3660233933 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f3fff700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23f41035a0 0x7f23f4113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f8bc5700 1 -- 172.21.15.49:0/3660233933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23f41035a0 msgr2=0x7f23f4113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f8bc5700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23f41035a0 0x7f23f4113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f8bc5700 1 -- 172.21.15.49:0/3660233933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0005040 con 0x7f23f4102c00 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f3fff700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23f41035a0 0x7f23f4113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.719+0000 7f23f8bc5700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f4102c00 0x7f23f41136f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f23e8002a50 tx=0x7f23e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.720+0000 7f23f17fa700 1 -- 172.21.15.49:0/3660233933 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e8007cc0 con 0x7f23f4102c00 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.720+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f410d850 con 0x7f23f4102c00 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.720+0000 7f23f17fa700 1 -- 172.21.15.49:0/3660233933 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23e800f040 con 0x7f23f4102c00 2023-12-16T07:46:50.721 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.720+0000 7f23f17fa700 1 -- 172.21.15.49:0/3660233933 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e800da70 con 0x7f23f4102c00 2023-12-16T07:46:50.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.720+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f410dd90 con 0x7f23f4102c00 2023-12-16T07:46:50.722 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.721+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f41133a0 con 0x7f23f4102c00 2023-12-16T07:46:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.721+0000 7f23f17fa700 1 -- 172.21.15.49:0/3660233933 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f23e800dc10 con 0x7f23f4102c00 2023-12-16T07:46:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.721+0000 7f23f17fa700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f23e406ce70 0x7f23e406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.722+0000 7f23f17fa700 1 -- 172.21.15.49:0/3660233933 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f23e808b9f0 con 0x7f23f4102c00 2023-12-16T07:46:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.722+0000 7f23f3fff700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f23e406ce70 0x7f23e406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.722+0000 7f23f3fff700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f23e406ce70 0x7f23e406f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23e000b3b0 tx=0x7f23e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:50.726 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.726+0000 7f23f17fa700 1 -- 172.21.15.49:0/3660233933 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f23e808de60 con 0x7f23f4102c00 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.971+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23f410ec90 con 0x7f23f4102c00 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.972+0000 7f23f17fa700 1 -- 172.21.15.49:0/3660233933 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1847 (secure 0 0 0) 0x7f23e8059360 con 0x7f23f4102c00 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stdout:e14 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:50.972 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 13 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:created 2023-12-16T07:38:17.449056+0000 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2023-12-16T07:38:28.491615+0000 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2023-12-16T07:46:50.973 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 44 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24305} 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.takfuo{0:24305} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.133:6824/1044825502,v1:172.21.15.133:6825/1044825502] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:50.974 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:50.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:50.975 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2023-12-16T07:46:50.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:46:50.975 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.eyimyr{-1:14478} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.49:6828/186303549,v1:172.21.15.49:6829/186303549] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:50.975 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ekquzl{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3806583046,v1:172.21.15.49:6827/3806583046] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:50.975 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi133.uedvhy{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/1973165985,v1:172.21.15.133:6827/1973165985] compat {c=[1],r=[1],i=[7ff]}] 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f23e406ce70 msgr2=0x7f23e406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f23e406ce70 0x7f23e406f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23e000b3b0 tx=0x7f23e0009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f4102c00 msgr2=0x7f23f41136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f4102c00 0x7f23f41136f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f23e8002a50 tx=0x7f23e80046b0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 shutdown_connections 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f23e406ce70 0x7f23e406f320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f4102c00 0x7f23f41136f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 --2- 172.21.15.49:0/3660233933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23f41035a0 0x7f23f4113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 >> 172.21.15.49:0/3660233933 conn(0x7f23f40f8790 msgr2=0x7f23f40fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:50.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 shutdown_connections 2023-12-16T07:46:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:50.974+0000 7f23fae29700 1 -- 172.21.15.49:0/3660233933 wait complete. 2023-12-16T07:46:50.977 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2023-12-16T07:46:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 -- 172.21.15.49:0/3537140832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8480fbb40 msgr2=0x7fe8480fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 --2- 172.21.15.49:0/3537140832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8480fbb40 0x7fe8480fbfb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe83c004940 tx=0x7fe83c009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 -- 172.21.15.49:0/3537140832 shutdown_connections 2023-12-16T07:46:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 --2- 172.21.15.49:0/3537140832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8480fbb40 0x7fe8480fbfb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 --2- 172.21.15.49:0/3537140832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe848101b00 0x7fe848101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 -- 172.21.15.49:0/3537140832 >> 172.21.15.49:0/3537140832 conn(0x7fe8480719b0 msgr2=0x7fe848071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:51.079 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 -- 172.21.15.49:0/3537140832 shutdown_connections 2023-12-16T07:46:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.078+0000 7fe84dadb700 1 -- 172.21.15.49:0/3537140832 wait complete. 2023-12-16T07:46:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.079+0000 7fe84dadb700 1 Processor -- start 2023-12-16T07:46:51.080 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.079+0000 7fe84dadb700 1 -- start start 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.079+0000 7fe84dadb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8480fbb40 0x7fe8480fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.079+0000 7fe84dadb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe848101b00 0x7fe8480fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.079+0000 7fe84dadb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8480fe2d0 con 0x7fe848101b00 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.079+0000 7fe84dadb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8480fe440 con 0x7fe8480fbb40 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe846ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe848101b00 0x7fe8480fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe846ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe848101b00 0x7fe8480fdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58750/0 (socket says 172.21.15.49:58750) 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe846ffd700 1 -- 172.21.15.49:0/1028507162 learned_addr learned my addr 172.21.15.49:0/1028507162 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe8477fe700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8480fbb40 0x7fe8480fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe846ffd700 1 -- 172.21.15.49:0/1028507162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8480fbb40 msgr2=0x7fe8480fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe846ffd700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8480fbb40 0x7fe8480fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe846ffd700 1 -- 172.21.15.49:0/1028507162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c005040 con 0x7fe848101b00 2023-12-16T07:46:51.081 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.080+0000 7fe846ffd700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe848101b00 0x7fe8480fdc80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009360 tx=0x7fe83c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.082+0000 7fe82ffff700 1 -- 172.21.15.49:0/1028507162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83c00e040 con 0x7fe848101b00 2023-12-16T07:46:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.082+0000 7fe82ffff700 1 -- 172.21.15.49:0/1028507162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe83c013420 con 0x7fe848101b00 2023-12-16T07:46:51.082 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.082+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8481198f0 con 0x7fe848101b00 2023-12-16T07:46:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.082+0000 7fe82ffff700 1 -- 172.21.15.49:0/1028507162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83c01c610 con 0x7fe848101b00 2023-12-16T07:46:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.082+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe848119dd0 con 0x7fe848101b00 2023-12-16T07:46:51.083 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.083+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8480734d0 con 0x7fe848101b00 2023-12-16T07:46:51.084 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.084+0000 7fe82ffff700 1 -- 172.21.15.49:0/1028507162 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe83c013590 con 0x7fe848101b00 2023-12-16T07:46:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.084+0000 7fe82ffff700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe83006ce70 0x7fe83006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.084+0000 7fe82ffff700 1 -- 172.21.15.49:0/1028507162 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe83c08d470 con 0x7fe848101b00 2023-12-16T07:46:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.084+0000 7fe8477fe700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe83006ce70 0x7fe83006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:51.085 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.085+0000 7fe8477fe700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe83006ce70 0x7fe83006f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe838007fd0 tx=0x7fe838009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:51.089 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.089+0000 7fe82ffff700 1 -- 172.21.15.49:0/1028507162 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe83c057480 con 0x7fe848101b00 2023-12-16T07:46:51.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:51 smithi049 ceph-mon[217548]: pgmap v121: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:51.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:51 smithi049 ceph-mon[217548]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:51.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:51 smithi049 ceph-mon[217548]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:51.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:51 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/3055361469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:51.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:51 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/3660233933' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:46:51.310 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.308+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8480fef00 con 0x7fe83006ce70 2023-12-16T07:46:51.311 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.310+0000 7fe82ffff700 1 -- 172.21.15.49:0/1028507162 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe8480fef00 con 0x7fe83006ce70 2023-12-16T07:46:51.311 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:46:51.311 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:46:51.311 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:46:51.311 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:46:51.311 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "11/21 daemons upgraded", 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2023-12-16T07:46:51.312 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:46:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe83006ce70 msgr2=0x7fe83006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe83006ce70 0x7fe83006f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe838007fd0 tx=0x7fe838009040 comp rx=0 tx=0).stop 2023-12-16T07:46:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe848101b00 msgr2=0x7fe8480fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe848101b00 0x7fe8480fdc80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009360 tx=0x7fe83c009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 shutdown_connections 2023-12-16T07:46:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8480fbb40 0x7fe8480fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe83006ce70 0x7fe83006f320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 --2- 172.21.15.49:0/1028507162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe848101b00 0x7fe8480fdc80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 >> 172.21.15.49:0/1028507162 conn(0x7fe8480719b0 msgr2=0x7fe8480654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 shutdown_connections 2023-12-16T07:46:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.312+0000 7fe84dadb700 1 -- 172.21.15.49:0/1028507162 wait complete. 2023-12-16T07:46:51.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:51 smithi133 ceph-mon[181557]: pgmap v121: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:51.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:51 smithi133 ceph-mon[181557]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:51.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:51 smithi133 ceph-mon[181557]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:51.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:51 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/3055361469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:46:51.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:51 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/3660233933' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-16T07:46:51.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 -- 172.21.15.49:0/248565602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 msgr2=0x7fe7bc0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/248565602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc0fbfb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4004940 tx=0x7fe7a4009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:51.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 -- 172.21.15.49:0/248565602 shutdown_connections 2023-12-16T07:46:51.419 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/248565602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc0fbfb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/248565602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc101b00 0x7fe7bc101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 -- 172.21.15.49:0/248565602 >> 172.21.15.49:0/248565602 conn(0x7fe7bc0719b0 msgr2=0x7fe7bc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 -- 172.21.15.49:0/248565602 shutdown_connections 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.416+0000 7fe7c0fae700 1 -- 172.21.15.49:0/248565602 wait complete. 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7c0fae700 1 Processor -- start 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7c0fae700 1 -- start start 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7c0fae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc10e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7c0fae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc101b00 0x7fe7bc10ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7c0fae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc10f280 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7c0fae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc10f3f0 con 0x7fe7bc101b00 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7ba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc10e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7ba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc10e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58772/0 (socket says 172.21.15.49:58772) 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7ba59c700 1 -- 172.21.15.49:0/2689037073 learned_addr learned my addr 172.21.15.49:0/2689037073 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:46:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7b9d9b700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc101b00 0x7fe7bc10ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7ba59c700 1 -- 172.21.15.49:0/2689037073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc101b00 msgr2=0x7fe7bc10ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7ba59c700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc101b00 0x7fe7bc10ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.417+0000 7fe7ba59c700 1 -- 172.21.15.49:0/2689037073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4005040 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.418+0000 7fe7ba59c700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc10e740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00c8c0 tx=0x7fe7ac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.418+0000 7fe7b2ffd700 1 -- 172.21.15.49:0/2689037073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7ac00a920 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.418+0000 7fe7b2ffd700 1 -- 172.21.15.49:0/2689037073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7ac00ce60 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.418+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc117740 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.418+0000 7fe7b2ffd700 1 -- 172.21.15.49:0/2689037073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7ac0113a0 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.421 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.418+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc117c80 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.419+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc103fb0 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.419+0000 7fe7b2ffd700 1 -- 172.21.15.49:0/2689037073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe7ac012400 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.420+0000 7fe7b2ffd700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe7a806ce70 0x7fe7a806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:46:51.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.420+0000 7fe7b2ffd700 1 -- 172.21.15.49:0/2689037073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe7ac08c3b0 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.420+0000 7fe7b9d9b700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe7a806ce70 0x7fe7a806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:46:51.422 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.420+0000 7fe7b9d9b700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe7a806ce70 0x7fe7a806f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400b020 tx=0x7fe7a4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:46:51.425 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.425+0000 7fe7b2ffd700 1 -- 172.21.15.49:0/2689037073 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fe7ac056310 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.712+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe7bc0734d0 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.712+0000 7fe7b2ffd700 1 -- 172.21.15.49:0/2689037073 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe7ac05ee60 con 0x7fe7bc0fbb40 2023-12-16T07:46:51.713 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-16T07:46:51.713 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:46:51.713 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.714+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe7a806ce70 msgr2=0x7fe7a806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.714+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe7a806ce70 0x7fe7a806f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400b020 tx=0x7fe7a4009e30 comp rx=0 tx=0).stop 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.714+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 msgr2=0x7fe7bc10e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.714+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc10e740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00c8c0 tx=0x7fe7ac0044c0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.715+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 shutdown_connections 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.715+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fe7a806ce70 0x7fe7a806f320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.715+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7bc0fbb40 0x7fe7bc10e740 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.715+0000 7fe7c0fae700 1 --2- 172.21.15.49:0/2689037073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc101b00 0x7fe7bc10ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:46:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.715+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 >> 172.21.15.49:0/2689037073 conn(0x7fe7bc0719b0 msgr2=0x7fe7bc0fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:46:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.715+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 shutdown_connections 2023-12-16T07:46:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:46:51.715+0000 7fe7c0fae700 1 -- 172.21.15.49:0/2689037073 wait complete. 2023-12-16T07:46:52.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:52 smithi133 ceph-mon[181557]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:52.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:52 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2689037073' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:46:52.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:52 smithi049 ceph-mon[217548]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:46:52.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:52 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2689037073' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:46:53.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:53 smithi133 ceph-mon[181557]: pgmap v122: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:53.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:53 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:53.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:53 smithi049 ceph-mon[217548]: pgmap v122: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:53.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:53 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:54.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:54 smithi133 ceph-mon[181557]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:54.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:54 smithi133 ceph-mon[181557]: Upgrade: osd.5 is safe to restart 2023-12-16T07:46:54.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:54 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:54.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:54 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:54.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:54 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T07:46:54.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:54 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:54.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:54 smithi049 ceph-mon[217548]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-16T07:46:54.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:54 smithi049 ceph-mon[217548]: Upgrade: osd.5 is safe to restart 2023-12-16T07:46:54.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:54 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:54.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:54 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:54.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:54 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-16T07:46:54.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:54 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:46:55.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:55 smithi133 ceph-mon[181557]: pgmap v123: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:55.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:55 smithi133 ceph-mon[181557]: Upgrade: Updating osd.5 2023-12-16T07:46:55.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:55 smithi133 ceph-mon[181557]: Deploying daemon osd.5 on smithi133 2023-12-16T07:46:55.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:55 smithi049 ceph-mon[217548]: pgmap v123: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:55.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:55 smithi049 ceph-mon[217548]: Upgrade: Updating osd.5 2023-12-16T07:46:55.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:55 smithi049 ceph-mon[217548]: Deploying daemon osd.5 on smithi133 2023-12-16T07:46:56.428 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:56 smithi133 systemd[1]: Stopping Ceph osd.5 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:46:56.867 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:56 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[144071]: 2023-12-16T07:46:56.427+0000 7f38a2fbe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:46:56.867 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:56 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[144071]: 2023-12-16T07:46:56.427+0000 7f38a2fbe700 -1 osd.5 73 *** Got signal Terminated *** 2023-12-16T07:46:56.867 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:56 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[144071]: 2023-12-16T07:46:56.427+0000 7f38a2fbe700 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:46:57.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:57 smithi133 ceph-mon[181557]: pgmap v124: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:57.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:57 smithi133 ceph-mon[181557]: osd.5 marked itself down and dead 2023-12-16T07:46:57.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:57 smithi049 ceph-mon[217548]: pgmap v124: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:57.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:57 smithi049 ceph-mon[217548]: osd.5 marked itself down and dead 2023-12-16T07:46:58.109 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:57 smithi133 bash[206512]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5 2023-12-16T07:46:58.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:58 smithi133 ceph-mon[181557]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:46:58.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:58 smithi133 ceph-mon[181557]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T07:46:58.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:58 smithi049 ceph-mon[217548]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-16T07:46:58.463 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:58 smithi049 ceph-mon[217548]: osdmap e74: 6 total, 5 up, 6 in 2023-12-16T07:46:59.262 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:58 smithi133 systemd[1]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.5.service: Succeeded. 2023-12-16T07:46:59.262 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:58 smithi133 systemd[1]: Stopped Ceph osd.5 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:46:59.262 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 systemd[1]: Starting Ceph osd.5 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:46:59.262 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:59 smithi133 ceph-mon[181557]: pgmap v126: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:59.262 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:59 smithi133 ceph-mon[181557]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T07:46:59.262 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:59 smithi133 ceph-mon[181557]: osdmap e75: 6 total, 5 up, 6 in 2023-12-16T07:46:59.262 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:59.262 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:46:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:46:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:59 smithi049 ceph-mon[217548]: pgmap v126: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-16T07:46:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:59 smithi049 ceph-mon[217548]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-16T07:46:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:59 smithi049 ceph-mon[217548]: osdmap e75: 6 total, 5 up, 6 in 2023-12-16T07:46:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:46:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:46:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:00.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 bash[206782]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T07:47:00.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 bash[206782]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-16T07:47:00.118 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 bash[206782]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-16T07:47:00.118 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 bash[206782]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-16T07:47:00.118 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 bash[206782]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-16T07:47:00.118 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 bash[206782]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T07:47:00.118 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:46:59 smithi133 bash[206782]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-16T07:47:00.433 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:00 smithi133 ceph-mon[181557]: Health check failed: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T07:47:00.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:00 smithi049 ceph-mon[217548]: Health check failed: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded (PG_DEGRADED) 2023-12-16T07:47:00.867 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:47:00 smithi133 ceph-osd[207074]: -- 172.21.15.133:0/1449362872 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fed4e7b6c0 con 0x55fed4e4b000 2023-12-16T07:47:00.867 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:47:00 smithi133 bash[207036]: 0bc0256e3adce5da975e7acf398bcb264a7ce5b3911b9c7d587b5599331b192d 2023-12-16T07:47:00.867 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:47:00 smithi133 systemd[1]: Started Ceph osd.5 for 4ed9995e-9be5-11ee-95a5-87774f69a715. 2023-12-16T07:47:01.367 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:47:00 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:47:00.949+0000 7f621ce99640 -1 Falling back to public interface 2023-12-16T07:47:01.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:01 smithi133 ceph-mon[181557]: pgmap v128: 65 pgs: 3 active+undersized+degraded, 3 peering, 6 stale+active+clean, 7 active+undersized, 46 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2023-12-16T07:47:01.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:01.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:01.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:01 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:47:01.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:01 smithi049 ceph-mon[217548]: pgmap v128: 65 pgs: 3 active+undersized+degraded, 3 peering, 6 stale+active+clean, 7 active+undersized, 46 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7/222 objects degraded (3.153%) 2023-12-16T07:47:01.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:01.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:01.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:01 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:47:03.699 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:03 smithi133 ceph-mon[181557]: pgmap v129: 65 pgs: 10 active+undersized+degraded, 3 peering, 15 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2023-12-16T07:47:03.699 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:03.699 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:03.699 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:03.700 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:03 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:03.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:03 smithi049 ceph-mon[217548]: pgmap v129: 65 pgs: 10 active+undersized+degraded, 3 peering, 15 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2023-12-16T07:47:03.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:03.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:03 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:04.867 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:04 smithi133 ceph-mon[181557]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T07:47:04.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:04 smithi049 ceph-mon[217548]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-16T07:47:05.623 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:47:05 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:47:05.472+0000 7f621ce99640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-16T07:47:05.623 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:05 smithi133 ceph-mon[181557]: pgmap v130: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:05 smithi049 ceph-mon[217548]: pgmap v130: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:06.367 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:47:05 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:47:05.917+0000 7f621ce99640 -1 osd.5 73 log_to_monitors true 2023-12-16T07:47:06.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:06.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:06.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:47:06.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:47:06.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:06.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:47:06.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:06.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:06.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:06.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:06.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:06.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T07:47:06.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T07:47:06.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T07:47:06.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T07:47:06.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='osd.5 [v2:172.21.15.133:6816/2784436312,v1:172.21.15.133:6817/2784436312]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded (PG_DEGRADED) 2023-12-16T07:47:06.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:06 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[217525]: 2023-12-16T07:47:06.678+0000 7f4bdccd5700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T07:47:07.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:47:06.890+0000 7f620d308700 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T07:47:07.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:07.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:07.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:47:07.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:47:07.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:47:07.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:07.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='osd.5 [v2:172.21.15.133:6816/2784436312,v1:172.21.15.133:6817/2784436312]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:47:07.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-16T07:47:07.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:06 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded (PG_DEGRADED) 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: pgmap v131: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: Upgrade: Setting container_image for all osd 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: pgmap v132: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T07:47:07.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: osdmap e76: 6 total, 5 up, 6 in 2023-12-16T07:47:07.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: from='osd.5 [v2:172.21.15.133:6816/2784436312,v1:172.21.15.133:6817/2784436312]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:47:07.960 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:07 smithi049 ceph-mon[217548]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:47:08.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: pgmap v131: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:08.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: Upgrade: Setting container_image for all osd 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: pgmap v132: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: osdmap e76: 6 total, 5 up, 6 in 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: from='osd.5 [v2:172.21.15.133:6816/2784436312,v1:172.21.15.133:6817/2784436312]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:47:08.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:07 smithi133 ceph-mon[181557]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-12-16T07:47:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:08 smithi049 ceph-mon[217548]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:47:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:08 smithi049 ceph-mon[217548]: osd.5 [v2:172.21.15.133:6816/2784436312,v1:172.21.15.133:6817/2784436312] boot 2023-12-16T07:47:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:08 smithi049 ceph-mon[217548]: osdmap e77: 6 total, 6 up, 6 in 2023-12-16T07:47:08.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:08 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:47:09.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:08 smithi133 ceph-mon[181557]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-16T07:47:09.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:08 smithi133 ceph-mon[181557]: osd.5 [v2:172.21.15.133:6816/2784436312,v1:172.21.15.133:6817/2784436312] boot 2023-12-16T07:47:09.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:08 smithi133 ceph-mon[181557]: osdmap e77: 6 total, 6 up, 6 in 2023-12-16T07:47:09.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:08 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-16T07:47:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:09 smithi049 ceph-mon[217548]: pgmap v134: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:09 smithi049 ceph-mon[217548]: osdmap e78: 6 total, 6 up, 6 in 2023-12-16T07:47:09.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:09 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:09 smithi133 ceph-mon[181557]: pgmap v134: 65 pgs: 11 active+undersized+degraded, 17 active+undersized, 37 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2023-12-16T07:47:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:09 smithi133 ceph-mon[181557]: osdmap e78: 6 total, 6 up, 6 in 2023-12-16T07:47:10.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:09 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:11 smithi049 ceph-mon[217548]: pgmap v137: 65 pgs: 1 peering, 9 active+undersized+degraded, 15 active+undersized, 40 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:47:11.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:11 smithi049 ceph-mon[217548]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 9 pgs degraded (PG_DEGRADED) 2023-12-16T07:47:12.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:11 smithi133 ceph-mon[181557]: pgmap v137: 65 pgs: 1 peering, 9 active+undersized+degraded, 15 active+undersized, 40 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2023-12-16T07:47:12.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:11 smithi133 ceph-mon[181557]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 9 pgs degraded (PG_DEGRADED) 2023-12-16T07:47:13.959 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:13 smithi049 ceph-mon[217548]: pgmap v138: 65 pgs: 1 peering, 4 active+undersized+degraded, 11 active+undersized, 49 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 10/222 objects degraded (4.505%) 2023-12-16T07:47:14.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:13 smithi133 ceph-mon[181557]: pgmap v138: 65 pgs: 1 peering, 4 active+undersized+degraded, 11 active+undersized, 49 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 10/222 objects degraded (4.505%) 2023-12-16T07:47:15.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:15.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:15.118 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:14 smithi133 ceph-mon[181557]: pgmap v139: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:15.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:15.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:15.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:14 smithi049 ceph-mon[217548]: pgmap v139: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:16.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:15 smithi133 ceph-mon[181557]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/222 objects degraded (4.505%), 4 pgs degraded) 2023-12-16T07:47:16.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:15 smithi049 ceph-mon[217548]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/222 objects degraded (4.505%), 4 pgs degraded) 2023-12-16T07:47:17.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:17 smithi133 ceph-mon[181557]: pgmap v140: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:17.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:17 smithi049 ceph-mon[217548]: pgmap v140: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:19.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:19 smithi133 ceph-mon[181557]: pgmap v141: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:19.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:19 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:19 smithi049 ceph-mon[217548]: pgmap v141: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:19.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:19 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:21.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:21 smithi049 ceph-mon[217548]: pgmap v142: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:21.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:21 smithi133 ceph-mon[181557]: pgmap v142: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 -- 172.21.15.49:0/1620827928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 msgr2=0x7fdd100fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 --2- 172.21.15.49:0/1620827928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd100fbfb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd04004940 tx=0x7fdd04009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 -- 172.21.15.49:0/1620827928 shutdown_connections 2023-12-16T07:47:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 --2- 172.21.15.49:0/1620827928 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd100fbfb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 --2- 172.21.15.49:0/1620827928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd10101b00 0x7fdd10101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:21.834 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 -- 172.21.15.49:0/1620827928 >> 172.21.15.49:0/1620827928 conn(0x7fdd100719b0 msgr2=0x7fdd10071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 -- 172.21.15.49:0/1620827928 shutdown_connections 2023-12-16T07:47:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.833+0000 7fdd163f5700 1 -- 172.21.15.49:0/1620827928 wait complete. 2023-12-16T07:47:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.834+0000 7fdd163f5700 1 Processor -- start 2023-12-16T07:47:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.834+0000 7fdd163f5700 1 -- start start 2023-12-16T07:47:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd163f5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd10112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd163f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd10101b00 0x7fdd10112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd163f5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd101131d0 con 0x7fdd100fbb40 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd163f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1010c4c0 con 0x7fdd10101b00 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd10112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd10112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45838/0 (socket says 172.21.15.49:45838) 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0ffff700 1 -- 172.21.15.49:0/484292331 learned_addr learned my addr 172.21.15.49:0/484292331 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0f7fe700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd10101b00 0x7fdd10112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0ffff700 1 -- 172.21.15.49:0/484292331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd10101b00 msgr2=0x7fdd10112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0ffff700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd10101b00 0x7fdd10112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0ffff700 1 -- 172.21.15.49:0/484292331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04005040 con 0x7fdd100fbb40 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0f7fe700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd10101b00 0x7fdd10112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.835+0000 7fdd0ffff700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd10112640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000fce0 tx=0x7fdd000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.836+0000 7fdd0cff9700 1 -- 172.21.15.49:0/484292331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0000fe90 con 0x7fdd100fbb40 2023-12-16T07:47:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.836+0000 7fdd0cff9700 1 -- 172.21.15.49:0/484292331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd000090d0 con 0x7fdd100fbb40 2023-12-16T07:47:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.836+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1010c740 con 0x7fdd100fbb40 2023-12-16T07:47:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.836+0000 7fdd0cff9700 1 -- 172.21.15.49:0/484292331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd000126a0 con 0x7fdd100fbb40 2023-12-16T07:47:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.836+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1010cc80 con 0x7fdd100fbb40 2023-12-16T07:47:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.837+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd101122f0 con 0x7fdd100fbb40 2023-12-16T07:47:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.838+0000 7fdd0cff9700 1 -- 172.21.15.49:0/484292331 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fdd00009240 con 0x7fdd100fbb40 2023-12-16T07:47:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.838+0000 7fdd0cff9700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdcf806ce60 0x7fdcf806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.838+0000 7fdd0cff9700 1 -- 172.21.15.49:0/484292331 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdd0008ea70 con 0x7fdd100fbb40 2023-12-16T07:47:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.838+0000 7fdd0f7fe700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdcf806ce60 0x7fdcf806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.839+0000 7fdd0f7fe700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdcf806ce60 0x7fdcf806f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd04000c00 tx=0x7fdd04009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:21.843 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:21.843+0000 7fdd0cff9700 1 -- 172.21.15.49:0/484292331 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fdd0005c3e0 con 0x7fdd100fbb40 2023-12-16T07:47:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.063+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd1010dc50 con 0x7fdcf806ce60 2023-12-16T07:47:22.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.065+0000 7fdd0cff9700 1 -- 172.21.15.49:0/484292331 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fdd1010dc50 con 0x7fdcf806ce60 2023-12-16T07:47:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdcf806ce60 msgr2=0x7fdcf806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdcf806ce60 0x7fdcf806f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd04000c00 tx=0x7fdd04009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 msgr2=0x7fdd10112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd10112640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000fce0 tx=0x7fdd000046b0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 shutdown_connections 2023-12-16T07:47:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdcf806ce60 0x7fdcf806f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd100fbb40 0x7fdd10112640 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 --2- 172.21.15.49:0/484292331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd10101b00 0x7fdd10112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 >> 172.21.15.49:0/484292331 conn(0x7fdd100719b0 msgr2=0x7fdd100fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 shutdown_connections 2023-12-16T07:47:22.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.067+0000 7fdd163f5700 1 -- 172.21.15.49:0/484292331 wait complete. 2023-12-16T07:47:22.078 INFO:teuthology.orchestra.run.smithi049.stdout:true 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.172+0000 7f3323b1b700 1 -- 172.21.15.49:0/2720901172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c101b00 msgr2=0x7f331c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.172+0000 7f3323b1b700 1 --2- 172.21.15.49:0/2720901172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c101b00 0x7f331c101ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3318004940 tx=0x7f3318009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.172+0000 7f3323b1b700 1 -- 172.21.15.49:0/2720901172 shutdown_connections 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.172+0000 7f3323b1b700 1 --2- 172.21.15.49:0/2720901172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331c0fbb40 0x7f331c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.172+0000 7f3323b1b700 1 --2- 172.21.15.49:0/2720901172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c101b00 0x7f331c101ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.172+0000 7f3323b1b700 1 -- 172.21.15.49:0/2720901172 >> 172.21.15.49:0/2720901172 conn(0x7f331c0719b0 msgr2=0x7f331c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 -- 172.21.15.49:0/2720901172 shutdown_connections 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 -- 172.21.15.49:0/2720901172 wait complete. 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 Processor -- start 2023-12-16T07:47:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 -- start start 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c0fbb40 0x7f331c1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331c101b00 0x7f331c113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c114230 con 0x7f331c0fbb40 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f3323b1b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c10d520 con 0x7f331c101b00 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f33218b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c0fbb40 0x7f331c1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f33218b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c0fbb40 0x7f331c1136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45864/0 (socket says 172.21.15.49:45864) 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.173+0000 7f33218b7700 1 -- 172.21.15.49:0/1478792168 learned_addr learned my addr 172.21.15.49:0/1478792168 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33210b6700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331c101b00 0x7f331c113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33218b7700 1 -- 172.21.15.49:0/1478792168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331c101b00 msgr2=0x7f331c113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33218b7700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331c101b00 0x7f331c113be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33218b7700 1 -- 172.21.15.49:0/1478792168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318005040 con 0x7f331c0fbb40 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33210b6700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331c101b00 0x7f331c113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33218b7700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c0fbb40 0x7f331c1136a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f331800b3b0 tx=0x7f3318009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33127fc700 1 -- 172.21.15.49:0/1478792168 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f331800e040 con 0x7f331c0fbb40 2023-12-16T07:47:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33127fc700 1 -- 172.21.15.49:0/1478792168 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f331800bc50 con 0x7f331c0fbb40 2023-12-16T07:47:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c10d7a0 con 0x7f331c0fbb40 2023-12-16T07:47:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f33127fc700 1 -- 172.21.15.49:0/1478792168 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3318013420 con 0x7f331c0fbb40 2023-12-16T07:47:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.174+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c10dce0 con 0x7f331c0fbb40 2023-12-16T07:47:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.175+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c113350 con 0x7f331c0fbb40 2023-12-16T07:47:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.176+0000 7f33127fc700 1 -- 172.21.15.49:0/1478792168 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f331801c430 con 0x7f331c0fbb40 2023-12-16T07:47:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.176+0000 7f33127fc700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f330806ce60 0x7f330806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.176+0000 7f33127fc700 1 -- 172.21.15.49:0/1478792168 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f331808cfb0 con 0x7f331c0fbb40 2023-12-16T07:47:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.176+0000 7f33210b6700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f330806ce60 0x7f330806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.177+0000 7f33210b6700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f330806ce60 0x7f330806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f330c007fd0 tx=0x7f330c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.181+0000 7f33127fc700 1 -- 172.21.15.49:0/1478792168 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f331805aaf0 con 0x7f331c0fbb40 2023-12-16T07:47:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.404+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f331c10ec90 con 0x7f330806ce60 2023-12-16T07:47:22.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.405+0000 7f33127fc700 1 -- 172.21.15.49:0/1478792168 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f331c10ec90 con 0x7f330806ce60 2023-12-16T07:47:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f330806ce60 msgr2=0x7f330806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f330806ce60 0x7f330806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f330c007fd0 tx=0x7f330c009040 comp rx=0 tx=0).stop 2023-12-16T07:47:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c0fbb40 msgr2=0x7f331c1136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c0fbb40 0x7f331c1136a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f331800b3b0 tx=0x7f3318009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 shutdown_connections 2023-12-16T07:47:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f330806ce60 0x7f330806f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.408 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f331c0fbb40 0x7f331c1136a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 --2- 172.21.15.49:0/1478792168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331c101b00 0x7f331c113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 >> 172.21.15.49:0/1478792168 conn(0x7f331c0719b0 msgr2=0x7f331c0654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 shutdown_connections 2023-12-16T07:47:22.409 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:22.408+0000 7f3323b1b700 1 -- 172.21.15.49:0/1478792168 wait complete. 2023-12-16T07:47:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-16T07:47:22.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T07:47:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:47:23.358 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:23 smithi049 ceph-mon[217548]: pgmap v143: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:23.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:23 smithi049 ceph-mon[217548]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:23.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:23 smithi049 ceph-mon[217548]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:23.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:23 smithi133 ceph-mon[181557]: pgmap v143: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:23.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:23 smithi133 ceph-mon[181557]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:23.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:23 smithi133 ceph-mon[181557]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:24.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 -- 172.21.15.49:0/2593733670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 msgr2=0x7fb7180fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/2593733670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb7180fbfb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb700004940 tx=0x7fb700009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 -- 172.21.15.49:0/2593733670 shutdown_connections 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/2593733670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb7180fbfb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/2593733670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb718101b00 0x7fb718101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 -- 172.21.15.49:0/2593733670 >> 172.21.15.49:0/2593733670 conn(0x7fb7180719b0 msgr2=0x7fb718071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 -- 172.21.15.49:0/2593733670 shutdown_connections 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.049+0000 7fb71e1e7700 1 -- 172.21.15.49:0/2593733670 wait complete. 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb71e1e7700 1 Processor -- start 2023-12-16T07:47:24.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb71e1e7700 1 -- start start 2023-12-16T07:47:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb71e1e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb718112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb71e1e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb718101b00 0x7fb718112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb71e1e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7181131d0 con 0x7fb7180fbb40 2023-12-16T07:47:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb71e1e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71810c4c0 con 0x7fb718101b00 2023-12-16T07:47:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb7177fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb718112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.050+0000 7fb7177fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb718112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45886/0 (socket says 172.21.15.49:45886) 2023-12-16T07:47:24.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb7177fe700 1 -- 172.21.15.49:0/304169645 learned_addr learned my addr 172.21.15.49:0/304169645 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb716ffd700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb718101b00 0x7fb718112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb7177fe700 1 -- 172.21.15.49:0/304169645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb718101b00 msgr2=0x7fb718112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb7177fe700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb718101b00 0x7fb718112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb7177fe700 1 -- 172.21.15.49:0/304169645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700005040 con 0x7fb7180fbb40 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb7177fe700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb718112640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c8c0 tx=0x7fb7080044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb70ffff700 1 -- 172.21.15.49:0/304169645 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70800a980 con 0x7fb7180fbb40 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71810c7a0 con 0x7fb7180fbb40 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb70ffff700 1 -- 172.21.15.49:0/304169645 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb70800ce60 con 0x7fb7180fbb40 2023-12-16T07:47:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb70ffff700 1 -- 172.21.15.49:0/304169645 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7080113a0 con 0x7fb7180fbb40 2023-12-16T07:47:24.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.051+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71810cce0 con 0x7fb7180fbb40 2023-12-16T07:47:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.052+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7181122f0 con 0x7fb7180fbb40 2023-12-16T07:47:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.053+0000 7fb70ffff700 1 -- 172.21.15.49:0/304169645 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb708012400 con 0x7fb7180fbb40 2023-12-16T07:47:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.053+0000 7fb70ffff700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb70406ce60 0x7fb70406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.053+0000 7fb70ffff700 1 -- 172.21.15.49:0/304169645 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb70808c3e0 con 0x7fb7180fbb40 2023-12-16T07:47:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.053+0000 7fb716ffd700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb70406ce60 0x7fb70406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:24.056 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.054+0000 7fb716ffd700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb70406ce60 0x7fb70406f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb700004f90 tx=0x7fb700009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:24.058 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.058+0000 7fb70ffff700 1 -- 172.21.15.49:0/304169645 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb708059dd0 con 0x7fb7180fbb40 2023-12-16T07:47:24.271 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.271+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb71804bb80 con 0x7fb70406ce60 2023-12-16T07:47:24.281 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.281+0000 7fb70ffff700 1 -- 172.21.15.49:0/304169645 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb71804bb80 con 0x7fb70406ce60 2023-12-16T07:47:24.281 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (4m) 105s ago 12m 28.5M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (3m) 105s ago 12m 7465k - 19.0.0-191-g6d933094 a29c258b5d6f ae149580b967 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (3m) 21s ago 12m 7453k - 19.0.0-191-g6d933094 a29c258b5d6f b4d081b98e26 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (4m) 105s ago 12m 88.2M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (9m) 105s ago 9m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (9m) 105s ago 9m 16.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (9m) 21s ago 9m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (8m) 21s ago 8m 19.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (6m) 105s ago 13m 511M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (5m) 21s ago 12m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (3m) 105s ago 14m 62.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (3m) 21s ago 12m 54.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:47:24.282 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (5m) 105s ago 12m 17.5M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (5m) 21s ago 12m 18.0M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (2m) 105s ago 11m 129M 1568M 19.0.0-191-g6d933094 a29c258b5d6f bb0cb3d699c6 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (2m) 105s ago 11m 130M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ac94960b0db8 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (108s) 105s ago 10m 17.1M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 0eb7426982e8 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (79s) 21s ago 10m 150M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 2b93a8668da2 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (51s) 21s ago 10m 132M 2592M 19.0.0-191-g6d933094 a29c258b5d6f dadd713e3e6a 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (24s) 21s ago 10m 12.3M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 0bc0256e3adc 2023-12-16T07:47:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (5m) 105s ago 12m 60.9M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb70406ce60 msgr2=0x7fb70406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb70406ce60 0x7fb70406f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb700004f90 tx=0x7fb700009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 msgr2=0x7fb718112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb718112640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c8c0 tx=0x7fb7080044c0 comp rx=0 tx=0).stop 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 shutdown_connections 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb70406ce60 0x7fb70406f310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7180fbb40 0x7fb718112640 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 --2- 172.21.15.49:0/304169645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb718101b00 0x7fb718112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.283+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 >> 172.21.15.49:0/304169645 conn(0x7fb7180719b0 msgr2=0x7fb7180fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.284+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 shutdown_connections 2023-12-16T07:47:24.284 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:24.284+0000 7fb71e1e7700 1 -- 172.21.15.49:0/304169645 wait complete. 2023-12-16T07:47:24.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch upgrade status' 2023-12-16T07:47:24.942 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:47:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:25 smithi133 ceph-mon[181557]: pgmap v144: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:25.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:25 smithi133 ceph-mon[181557]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:25.413 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:25 smithi049 ceph-mon[217548]: pgmap v144: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:25.413 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:25 smithi049 ceph-mon[217548]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 -- 172.21.15.49:0/491728600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 msgr2=0x7fa920065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 --2- 172.21.15.49:0/491728600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920065800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa91c004940 tx=0x7fa91c009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 -- 172.21.15.49:0/491728600 shutdown_connections 2023-12-16T07:47:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 --2- 172.21.15.49:0/491728600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920065800 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 --2- 172.21.15.49:0/491728600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa920102c20 0x7fa920102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:25.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 -- 172.21.15.49:0/491728600 >> 172.21.15.49:0/491728600 conn(0x7fa9200719b0 msgr2=0x7fa920071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 -- 172.21.15.49:0/491728600 shutdown_connections 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.958+0000 7fa9275a0700 1 -- 172.21.15.49:0/491728600 wait complete. 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa9275a0700 1 Processor -- start 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa9275a0700 1 -- start start 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa9275a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa9275a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa920102c20 0x7fa920113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa9275a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9201142c0 con 0x7fa920065390 2023-12-16T07:47:25.962 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa9275a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92010d5f0 con 0x7fa920102c20 2023-12-16T07:47:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa92533c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa92533c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45916/0 (socket says 172.21.15.49:45916) 2023-12-16T07:47:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa92533c700 1 -- 172.21.15.49:0/3702910297 learned_addr learned my addr 172.21.15.49:0/3702910297 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:47:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa924b3b700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa920102c20 0x7fa920113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa92533c700 1 -- 172.21.15.49:0/3702910297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa920102c20 msgr2=0x7fa920113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:25.963 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa92533c700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa920102c20 0x7fa920113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.959+0000 7fa92533c700 1 -- 172.21.15.49:0/3702910297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c005040 con 0x7fa920065390 2023-12-16T07:47:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.960+0000 7fa924b3b700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa920102c20 0x7fa920113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:47:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.960+0000 7fa92533c700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920113730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa91400c830 tx=0x7fa914004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.960+0000 7fa911ffb700 1 -- 172.21.15.49:0/3702910297 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa91400a760 con 0x7fa920065390 2023-12-16T07:47:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.960+0000 7fa911ffb700 1 -- 172.21.15.49:0/3702910297 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa91400ad70 con 0x7fa920065390 2023-12-16T07:47:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.960+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92010d8d0 con 0x7fa920065390 2023-12-16T07:47:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.960+0000 7fa911ffb700 1 -- 172.21.15.49:0/3702910297 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9140113a0 con 0x7fa920065390 2023-12-16T07:47:25.965 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.960+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92010de10 con 0x7fa920065390 2023-12-16T07:47:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.961+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9200fff40 con 0x7fa920065390 2023-12-16T07:47:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.962+0000 7fa911ffb700 1 -- 172.21.15.49:0/3702910297 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa914012400 con 0x7fa920065390 2023-12-16T07:47:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.962+0000 7fa911ffb700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa90c06ce70 0x7fa90c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.962+0000 7fa911ffb700 1 -- 172.21.15.49:0/3702910297 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa91408c220 con 0x7fa920065390 2023-12-16T07:47:25.966 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.962+0000 7fa924b3b700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa90c06ce70 0x7fa90c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.963+0000 7fa924b3b700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa90c06ce70 0x7fa90c06f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009fd0 tx=0x7fa91c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:25.967 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:25.967+0000 7fa911ffb700 1 -- 172.21.15.49:0/3702910297 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa914059cb0 con 0x7fa920065390 2023-12-16T07:47:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.191+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa92010ed10 con 0x7fa90c06ce70 2023-12-16T07:47:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.192+0000 7fa911ffb700 1 -- 172.21.15.49:0/3702910297 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fa92010ed10 con 0x7fa90c06ce70 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2829c22c1fdb60b99590a3eef8aa48bb7d6d606e3a4c1627a68d2485fa617e17", 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2023-12-16T07:47:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2023-12-16T07:47:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2023-12-16T07:47:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "12/21 daemons upgraded", 2023-12-16T07:47:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-16T07:47:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": true 2023-12-16T07:47:26.194 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa90c06ce70 msgr2=0x7fa90c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa90c06ce70 0x7fa90c06f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009fd0 tx=0x7fa91c009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 msgr2=0x7fa920113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920113730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa91400c830 tx=0x7fa914004470 comp rx=0 tx=0).stop 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 shutdown_connections 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa90c06ce70 0x7fa90c06f320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa920065390 0x7fa920113730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 --2- 172.21.15.49:0/3702910297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa920102c20 0x7fa920113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 >> 172.21.15.49:0/3702910297 conn(0x7fa9200719b0 msgr2=0x7fa9200fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 shutdown_connections 2023-12-16T07:47:26.195 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:26.195+0000 7fa9275a0700 1 -- 172.21.15.49:0/3702910297 wait complete. 2023-12-16T07:47:26.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph health detail' 2023-12-16T07:47:26.835 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:47:27.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:27 smithi049 ceph-mon[217548]: pgmap v145: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:27.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:27 smithi049 ceph-mon[217548]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:27 smithi133 ceph-mon[181557]: pgmap v145: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:27.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:27 smithi133 ceph-mon[181557]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:47:27.940 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 -- 172.21.15.49:0/2853274968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc301035a0 msgr2=0x7fdc300fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 --2- 172.21.15.49:0/2853274968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc301035a0 0x7fdc300fcc10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc18004940 tx=0x7fdc18009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 -- 172.21.15.49:0/2853274968 shutdown_connections 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 --2- 172.21.15.49:0/2853274968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc301035a0 0x7fdc300fcc10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 --2- 172.21.15.49:0/2853274968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc30102c00 0x7fdc30102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 -- 172.21.15.49:0/2853274968 >> 172.21.15.49:0/2853274968 conn(0x7fdc300f8790 msgr2=0x7fdc300faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 -- 172.21.15.49:0/2853274968 shutdown_connections 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.940+0000 7fdc3674e700 1 -- 172.21.15.49:0/2853274968 wait complete. 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc3674e700 1 Processor -- start 2023-12-16T07:47:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc3674e700 1 -- start start 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc3674e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc30102c00 0x7fdc30113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc3674e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc301035a0 0x7fdc30113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc3674e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc301141e0 con 0x7fdc30102c00 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc3674e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3010d4d0 con 0x7fdc301035a0 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc2ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc30102c00 0x7fdc30113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc2ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc30102c00 0x7fdc30113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58276/0 (socket says 172.21.15.49:58276) 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc2ffff700 1 -- 172.21.15.49:0/418769153 learned_addr learned my addr 172.21.15.49:0/418769153 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc27fff700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc301035a0 0x7fdc30113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc2ffff700 1 -- 172.21.15.49:0/418769153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc301035a0 msgr2=0x7fdc30113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc2ffff700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc301035a0 0x7fdc30113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc2ffff700 1 -- 172.21.15.49:0/418769153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc18005040 con 0x7fdc30102c00 2023-12-16T07:47:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.941+0000 7fdc2ffff700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc30102c00 0x7fdc30113610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc20002a50 tx=0x7fdc200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.942+0000 7fdc2d7fa700 1 -- 172.21.15.49:0/418769153 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc20007cc0 con 0x7fdc30102c00 2023-12-16T07:47:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.942+0000 7fdc2d7fa700 1 -- 172.21.15.49:0/418769153 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc2000f040 con 0x7fdc30102c00 2023-12-16T07:47:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.942+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3010d760 con 0x7fdc30102c00 2023-12-16T07:47:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.942+0000 7fdc2d7fa700 1 -- 172.21.15.49:0/418769153 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2000d9c0 con 0x7fdc30102c00 2023-12-16T07:47:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.942+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3010dca0 con 0x7fdc30102c00 2023-12-16T07:47:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.943+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc301050d0 con 0x7fdc30102c00 2023-12-16T07:47:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.943+0000 7fdc2d7fa700 1 -- 172.21.15.49:0/418769153 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fdc2000db40 con 0x7fdc30102c00 2023-12-16T07:47:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.944+0000 7fdc2d7fa700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdc1c06ce60 0x7fdc1c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.944+0000 7fdc27fff700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdc1c06ce60 0x7fdc1c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.944+0000 7fdc2d7fa700 1 -- 172.21.15.49:0/418769153 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdc2008bf00 con 0x7fdc30102c00 2023-12-16T07:47:27.945 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.944+0000 7fdc27fff700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdc1c06ce60 0x7fdc1c06f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc3010eeb0 tx=0x7fdc18009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:27.949+0000 7fdc2d7fa700 1 -- 172.21.15.49:0/418769153 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fdc200599a0 con 0x7fdc30102c00 2023-12-16T07:47:28.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.238+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdc3010ebf0 con 0x7fdc30102c00 2023-12-16T07:47:28.238 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.238+0000 7fdc2d7fa700 1 -- 172.21.15.49:0/418769153 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+451 (secure 0 0 0) 0x7fdc2000ddf0 con 0x7fdc30102c00 2023-12-16T07:47:28.238 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem with deprecated feature inline_data; Upgrade: failed due to an unexpected exception 2023-12-16T07:47:28.239 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-16T07:47:28.239 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-16T07:47:28.239 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-16T07:47:28.239 INFO:teuthology.orchestra.run.smithi049.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdc1c06ce60 msgr2=0x7fdc1c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdc1c06ce60 0x7fdc1c06f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc3010eeb0 tx=0x7fdc18009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc30102c00 msgr2=0x7fdc30113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc30102c00 0x7fdc30113610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc20002a50 tx=0x7fdc200046b0 comp rx=0 tx=0).stop 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 shutdown_connections 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdc1c06ce60 0x7fdc1c06f310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc30102c00 0x7fdc30113610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 --2- 172.21.15.49:0/418769153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc301035a0 0x7fdc30113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 >> 172.21.15.49:0/418769153 conn(0x7fdc300f8790 msgr2=0x7fdc300fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 shutdown_connections 2023-12-16T07:47:28.241 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:28.240+0000 7fdc3674e700 1 -- 172.21.15.49:0/418769153 wait complete. 2023-12-16T07:47:28.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions' 2023-12-16T07:47:28.897 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:47:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:29 smithi133 ceph-mon[181557]: pgmap v146: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:29 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/418769153' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:47:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:29.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:29.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:29 smithi049 ceph-mon[217548]: pgmap v146: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:29.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:29 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/418769153' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-16T07:47:29.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:47:29.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2442078787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fcee0 msgr2=0x7f2b68109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2442078787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fcee0 0x7f2b68109190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2b64004940 tx=0x7f2b64009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2442078787 shutdown_connections 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2442078787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fcee0 0x7f2b68109190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2442078787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b680fc5d0 0x7f2b680fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2442078787 >> 172.21.15.49:0/2442078787 conn(0x7f2b680719b0 msgr2=0x7f2b68071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2442078787 shutdown_connections 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.894+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2442078787 wait complete. 2023-12-16T07:47:29.896 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6f2e6700 1 Processor -- start 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6f2e6700 1 -- start start 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6f2e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fc5d0 0x7f2b68115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6f2e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b680fcee0 0x7f2b68115e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6f2e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68116540 con 0x7f2b680fc5d0 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6f2e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6810f7e0 con 0x7f2b680fcee0 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6d082700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fc5d0 0x7f2b68115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6d082700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fc5d0 0x7f2b68115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58296/0 (socket says 172.21.15.49:58296) 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6d082700 1 -- 172.21.15.49:0/2979748813 learned_addr learned my addr 172.21.15.49:0/2979748813 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6c881700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b680fcee0 0x7f2b68115e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6d082700 1 -- 172.21.15.49:0/2979748813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b680fcee0 msgr2=0x7f2b68115e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6d082700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b680fcee0 0x7f2b68115e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6d082700 1 -- 172.21.15.49:0/2979748813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b64005040 con 0x7f2b680fc5d0 2023-12-16T07:47:29.897 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.895+0000 7f2b6d082700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fc5d0 0x7f2b68115920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800b790 tx=0x7f2b58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.896+0000 7f2b5dffb700 1 -- 172.21.15.49:0/2979748813 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5800f770 con 0x7f2b680fc5d0 2023-12-16T07:47:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.896+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6810fac0 con 0x7f2b680fc5d0 2023-12-16T07:47:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.896+0000 7f2b5dffb700 1 -- 172.21.15.49:0/2979748813 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b5800fd80 con 0x7f2b680fc5d0 2023-12-16T07:47:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.896+0000 7f2b5dffb700 1 -- 172.21.15.49:0/2979748813 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5800d310 con 0x7f2b680fc5d0 2023-12-16T07:47:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.896+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b68110000 con 0x7f2b680fc5d0 2023-12-16T07:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.897+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b681068c0 con 0x7f2b680fc5d0 2023-12-16T07:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.897+0000 7f2b5dffb700 1 -- 172.21.15.49:0/2979748813 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2b58010420 con 0x7f2b680fc5d0 2023-12-16T07:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.898+0000 7f2b5dffb700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f2b5406ce60 0x7f2b5406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.898+0000 7f2b5dffb700 1 -- 172.21.15.49:0/2979748813 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2b5808c2d0 con 0x7f2b680fc5d0 2023-12-16T07:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.898+0000 7f2b6c881700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f2b5406ce60 0x7f2b5406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:47:29.899 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.898+0000 7f2b6c881700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f2b5406ce60 0x7f2b5406f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b64004f90 tx=0x7f2b64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:47:29.902 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:29.902+0000 7f2b5dffb700 1 -- 172.21.15.49:0/2979748813 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f2b58059c60 con 0x7f2b680fc5d0 2023-12-16T07:47:30.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.193+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2b680734d0 con 0x7f2b680fc5d0 2023-12-16T07:47:30.193 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.193+0000 7f2b5dffb700 1 -- 172.21.15.49:0/2979748813 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f2b580597f0 con 0x7f2b680fc5d0 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 6 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:47:30.194 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:47:30.195 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T07:47:30.195 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 10 2023-12-16T07:47:30.195 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:47:30.195 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f2b5406ce60 msgr2=0x7f2b5406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f2b5406ce60 0x7f2b5406f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b64004f90 tx=0x7f2b64009e30 comp rx=0 tx=0).stop 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fc5d0 msgr2=0x7f2b68115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fc5d0 0x7f2b68115920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800b790 tx=0x7f2b58009250 comp rx=0 tx=0).stop 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 shutdown_connections 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f2b5406ce60 0x7f2b5406f310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680fc5d0 0x7f2b68115920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.195+0000 7f2b6f2e6700 1 --2- 172.21.15.49:0/2979748813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b680fcee0 0x7f2b68115e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.196+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 >> 172.21.15.49:0/2979748813 conn(0x7f2b680719b0 msgr2=0x7f2b680fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.196+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 shutdown_connections 2023-12-16T07:47:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:47:30.196+0000 7f2b6f2e6700 1 -- 172.21.15.49:0/2979748813 wait complete. 2023-12-16T07:47:30.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-16T07:47:30.872 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:47:31.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:31 smithi049 ceph-mon[217548]: pgmap v147: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:31.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:31 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2979748813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:31.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:31 smithi133 ceph-mon[181557]: pgmap v147: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:31.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:31 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2979748813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:47:31.884 INFO:teuthology.orchestra.run.smithi049.stdout:wait for servicemap items w/ changing names to refresh 2023-12-16T07:47:32.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'sleep 60' 2023-12-16T07:47:32.610 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:47:33.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:33 smithi133 ceph-mon[181557]: pgmap v148: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:33.421 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:33 smithi049 ceph-mon[217548]: pgmap v148: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:35.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:35 smithi133 ceph-mon[181557]: pgmap v149: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:35.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:35 smithi049 ceph-mon[217548]: pgmap v149: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:37.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:37 smithi133 ceph-mon[181557]: pgmap v150: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:37.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:37 smithi049 ceph-mon[217548]: pgmap v150: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:39.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:39 smithi133 ceph-mon[181557]: pgmap v151: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:39.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:39 smithi049 ceph-mon[217548]: pgmap v151: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:41.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:41 smithi049 ceph-mon[217548]: pgmap v152: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:41.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:41 smithi133 ceph-mon[181557]: pgmap v152: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:43.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:43 smithi049 ceph-mon[217548]: pgmap v153: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:43 smithi133 ceph-mon[181557]: pgmap v153: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:44.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:44.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:45.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:45 smithi049 ceph-mon[217548]: pgmap v154: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:45.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:45 smithi133 ceph-mon[181557]: pgmap v154: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:47.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:47 smithi049 ceph-mon[217548]: pgmap v155: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:47.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:47 smithi133 ceph-mon[181557]: pgmap v155: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:49.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:49 smithi049 ceph-mon[217548]: pgmap v156: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:49.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:49 smithi133 ceph-mon[181557]: pgmap v156: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:51.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:51 smithi049 ceph-mon[217548]: pgmap v157: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:51.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:51 smithi133 ceph-mon[181557]: pgmap v157: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:53.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:53 smithi049 ceph-mon[217548]: pgmap v158: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:53.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:53 smithi133 ceph-mon[181557]: pgmap v158: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:55.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:55 smithi049 ceph-mon[217548]: pgmap v159: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:55.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:55 smithi133 ceph-mon[181557]: pgmap v159: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:57.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:57 smithi049 ceph-mon[217548]: pgmap v160: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:57.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:57 smithi133 ceph-mon[181557]: pgmap v160: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:59 smithi049 ceph-mon[217548]: pgmap v161: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:59.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:47:59 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:47:59.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:59 smithi133 ceph-mon[181557]: pgmap v161: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:47:59.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:47:59 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:48:01.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:01 smithi049 ceph-mon[217548]: pgmap v162: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:01.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:01 smithi133 ceph-mon[181557]: pgmap v162: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:03.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:03 smithi049 ceph-mon[217548]: pgmap v163: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:03.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:03 smithi133 ceph-mon[181557]: pgmap v163: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:05.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:05 smithi049 ceph-mon[217548]: pgmap v164: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:05.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:05 smithi133 ceph-mon[181557]: pgmap v164: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:06.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:06 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:48:06.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:06 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-16T07:48:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:07 smithi049 ceph-mon[217548]: pgmap v165: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:48:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:48:07.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:07 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:48:07.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:07 smithi133 ceph-mon[181557]: pgmap v165: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:07.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-16T07:48:07.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-16T07:48:07.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:07 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' 2023-12-16T07:48:09.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:09 smithi049 ceph-mon[217548]: pgmap v166: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:09.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:09 smithi133 ceph-mon[181557]: pgmap v166: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:11.209 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:11 smithi049 ceph-mon[217548]: pgmap v167: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:11.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:11 smithi133 ceph-mon[181557]: pgmap v167: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:13.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:13 smithi049 ceph-mon[217548]: pgmap v168: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:13.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:13 smithi133 ceph-mon[181557]: pgmap v168: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:14.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:14 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:48:14.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:14 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:48:15.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:15 smithi049 ceph-mon[217548]: pgmap v169: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:15.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:15 smithi133 ceph-mon[181557]: pgmap v169: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:17.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:17 smithi049 ceph-mon[217548]: pgmap v170: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:17.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:17 smithi133 ceph-mon[181557]: pgmap v170: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:19.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:19 smithi049 ceph-mon[217548]: pgmap v171: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:19.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:19 smithi133 ceph-mon[181557]: pgmap v171: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:21.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:21 smithi049 ceph-mon[217548]: pgmap v172: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:21.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:21 smithi133 ceph-mon[181557]: pgmap v172: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:23.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:23 smithi049 ceph-mon[217548]: pgmap v173: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:23.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:23 smithi133 ceph-mon[181557]: pgmap v173: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:25.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:25 smithi049 ceph-mon[217548]: pgmap v174: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:25.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:25 smithi133 ceph-mon[181557]: pgmap v174: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:27.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:27 smithi049 ceph-mon[217548]: pgmap v175: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:27.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:27 smithi133 ceph-mon[181557]: pgmap v175: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:29 smithi049 ceph-mon[217548]: pgmap v176: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:29.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:29 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:48:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:29 smithi133 ceph-mon[181557]: pgmap v176: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:29.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:29 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:48:31.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:31 smithi049 ceph-mon[217548]: pgmap v177: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:31.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:31 smithi133 ceph-mon[181557]: pgmap v177: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:33.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:33 smithi049 ceph-mon[217548]: pgmap v178: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:33.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:33 smithi133 ceph-mon[181557]: pgmap v178: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:33.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph orch ps' 2023-12-16T07:48:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.170+0000 7f1f6bca5700 1 -- 172.21.15.49:0/1511970358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 msgr2=0x7f1f640fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.170+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/1511970358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fbfb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f58004940 tx=0x7f1f58009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.170+0000 7f1f6bca5700 1 -- 172.21.15.49:0/1511970358 shutdown_connections 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.170+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/1511970358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fbfb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.170+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/1511970358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f64101b00 0x7f1f64101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.170+0000 7f1f6bca5700 1 -- 172.21.15.49:0/1511970358 >> 172.21.15.49:0/1511970358 conn(0x7f1f640719b0 msgr2=0x7f1f64071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 -- 172.21.15.49:0/1511970358 shutdown_connections 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 -- 172.21.15.49:0/1511970358 wait complete. 2023-12-16T07:48:35.173 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 Processor -- start 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 -- start start 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f64101b00 0x7f1f640fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640fe260 con 0x7f1f640fbb40 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f6bca5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640fe3d0 con 0x7f1f64101b00 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f69a41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.171+0000 7f1f69a41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49748/0 (socket says 172.21.15.49:49748) 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f69a41700 1 -- 172.21.15.49:0/2564677859 learned_addr learned my addr 172.21.15.49:0/2564677859 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f69240700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f64101b00 0x7f1f640fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f69a41700 1 -- 172.21.15.49:0/2564677859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f64101b00 msgr2=0x7f1f640fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f69a41700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f64101b00 0x7f1f640fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f69a41700 1 -- 172.21.15.49:0/2564677859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58005040 con 0x7f1f640fbb40 2023-12-16T07:48:35.174 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f69a41700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fd720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000c8c0 tx=0x7f1f600044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f567fc700 1 -- 172.21.15.49:0/2564677859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6000a760 con 0x7f1f640fbb40 2023-12-16T07:48:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f567fc700 1 -- 172.21.15.49:0/2564677859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f6000ad70 con 0x7f1f640fbb40 2023-12-16T07:48:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64119900 con 0x7f1f640fbb40 2023-12-16T07:48:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f567fc700 1 -- 172.21.15.49:0/2564677859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f600113a0 con 0x7f1f640fbb40 2023-12-16T07:48:35.175 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.172+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64119de0 con 0x7f1f640fbb40 2023-12-16T07:48:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.173+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f640734d0 con 0x7f1f640fbb40 2023-12-16T07:48:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.174+0000 7f1f567fc700 1 -- 172.21.15.49:0/2564677859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1f60012400 con 0x7f1f640fbb40 2023-12-16T07:48:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.174+0000 7f1f567fc700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1f5006ce60 0x7f1f5006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.175+0000 7f1f567fc700 1 -- 172.21.15.49:0/2564677859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1f6008cf40 con 0x7f1f640fbb40 2023-12-16T07:48:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.175+0000 7f1f69240700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1f5006ce60 0x7f1f5006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:35.176 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.175+0000 7f1f69240700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1f5006ce60 0x7f1f5006f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f640ff120 tx=0x7f1f58009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:35.178 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.178+0000 7f1f567fc700 1 -- 172.21.15.49:0/2564677859 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f1f60056e80 con 0x7f1f640fbb40 2023-12-16T07:48:35.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.391+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 --> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f64065c60 con 0x7f1f5006ce60 2023-12-16T07:48:35.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.402+0000 7f1f567fc700 1 -- 172.21.15.49:0/2564677859 <== mgr.34104 v2:172.21.15.49:6800/2208418616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f1f64065c60 con 0x7f1f5006ce60 2023-12-16T07:48:35.402 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-16T07:48:35.402 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (6m) 2m ago 14m 28.5M - 0.25.0 c8568f914cd2 08df811d7ee7 2023-12-16T07:48:35.402 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (4m) 2m ago 14m 7465k - 19.0.0-191-g6d933094 a29c258b5d6f ae149580b967 2023-12-16T07:48:35.402 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi133 smithi133 running (4m) 92s ago 13m 7453k - 19.0.0-191-g6d933094 a29c258b5d6f b4d081b98e26 2023-12-16T07:48:35.402 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 2m ago 13m 88.2M - 9.4.12 a0ea5e3c46d9 ef851c0923bc 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ekquzl smithi049 running (10m) 2m ago 10m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 00ce4aa5b21a 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.eyimyr smithi049 running (10m) 2m ago 10m 16.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 3f5818a5c906 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.takfuo smithi133 running (10m) 92s ago 10m 10.1G - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc03a1e01cbd 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi133.uedvhy smithi133 running (10m) 92s ago 10m 19.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 caa7f0745b5c 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rqlvwo smithi049 *:8443,9283,8765 running (7m) 2m ago 15m 511M - 19.0.0-191-g6d933094 a29c258b5d6f 81787003a7d2 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi133.wbiduk smithi133 *:8443,9283,8765 running (6m) 92s ago 13m 449M - 19.0.0-191-g6d933094 a29c258b5d6f 0025824f0ab0 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (4m) 2m ago 15m 62.2M 2048M 19.0.0-191-g6d933094 a29c258b5d6f bf29f39dfd77 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi133 smithi133 running (4m) 92s ago 13m 54.4M 2048M 19.0.0-191-g6d933094 a29c258b5d6f 58bb10f93e97 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 2m ago 14m 17.5M - 1.5.0 0da6a335fe13 14dbd71ff02d 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi133 smithi133 *:9100 running (6m) 92s ago 13m 18.0M - 1.5.0 0da6a335fe13 57202b9c22c6 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 2m ago 12m 129M 1568M 19.0.0-191-g6d933094 a29c258b5d6f bb0cb3d699c6 2023-12-16T07:48:35.403 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (3m) 2m ago 12m 130M 1568M 19.0.0-191-g6d933094 a29c258b5d6f ac94960b0db8 2023-12-16T07:48:35.404 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 2m ago 12m 17.1M 1568M 19.0.0-191-g6d933094 a29c258b5d6f 0eb7426982e8 2023-12-16T07:48:35.404 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi133 running (2m) 92s ago 11m 150M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 2b93a8668da2 2023-12-16T07:48:35.404 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi133 running (2m) 92s ago 11m 132M 2592M 19.0.0-191-g6d933094 a29c258b5d6f dadd713e3e6a 2023-12-16T07:48:35.404 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi133 running (95s) 92s ago 11m 12.3M 2592M 19.0.0-191-g6d933094 a29c258b5d6f 0bc0256e3adc 2023-12-16T07:48:35.404 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (6m) 2m ago 13m 60.9M - 2.43.0 a07b618ecd1d 18554ce12984 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1f5006ce60 msgr2=0x7f1f5006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1f5006ce60 0x7f1f5006f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f640ff120 tx=0x7f1f58009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 msgr2=0x7f1f640fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fd720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000c8c0 tx=0x7f1f600044c0 comp rx=0 tx=0).stop 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 shutdown_connections 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1f5006ce60 0x7f1f5006f310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f640fbb40 0x7f1f640fd720 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 --2- 172.21.15.49:0/2564677859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f64101b00 0x7f1f640fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 >> 172.21.15.49:0/2564677859 conn(0x7f1f640719b0 msgr2=0x7f1f64065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 shutdown_connections 2023-12-16T07:48:35.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:35.404+0000 7f1f6bca5700 1 -- 172.21.15.49:0/2564677859 wait complete. 2023-12-16T07:48:35.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:35 smithi049 ceph-mon[217548]: pgmap v179: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:35.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:35 smithi133 ceph-mon[181557]: pgmap v179: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:35.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions' 2023-12-16T07:48:36.092 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:48:36.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:36 smithi049 ceph-mon[217548]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:48:36.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:36 smithi133 ceph-mon[181557]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-16T07:48:37.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 -- 172.21.15.49:0/1242523823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34540fbb40 msgr2=0x7f34540fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:37.064 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 --2- 172.21.15.49:0/1242523823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34540fbb40 0x7f34540fbfb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3440004940 tx=0x7f3440009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 -- 172.21.15.49:0/1242523823 shutdown_connections 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 --2- 172.21.15.49:0/1242523823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34540fbb40 0x7f34540fbfb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 --2- 172.21.15.49:0/1242523823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454101b00 0x7f3454101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 -- 172.21.15.49:0/1242523823 >> 172.21.15.49:0/1242523823 conn(0x7f34540719b0 msgr2=0x7f3454071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 -- 172.21.15.49:0/1242523823 shutdown_connections 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.062+0000 7f345ab0d700 1 -- 172.21.15.49:0/1242523823 wait complete. 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f345ab0d700 1 Processor -- start 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f345ab0d700 1 -- start start 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f345ab0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540fbb40 0x7f3454112560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f345ab0d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454101b00 0x7f3454112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f345ab0d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3454113180 con 0x7f3454101b00 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f345ab0d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345410c420 con 0x7f34540fbb40 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f3453fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454101b00 0x7f3454112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:37.065 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f3453fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454101b00 0x7f3454112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49766/0 (socket says 172.21.15.49:49766) 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.063+0000 7f3453fff700 1 -- 172.21.15.49:0/2221453578 learned_addr learned my addr 172.21.15.49:0/2221453578 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f34588a9700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540fbb40 0x7f3454112560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f3453fff700 1 -- 172.21.15.49:0/2221453578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540fbb40 msgr2=0x7f3454112560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f3453fff700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540fbb40 0x7f3454112560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f3453fff700 1 -- 172.21.15.49:0/2221453578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440005040 con 0x7f3454101b00 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f34588a9700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540fbb40 0x7f3454112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f3453fff700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454101b00 0x7f3454112aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3440009180 tx=0x7f3440009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f34517fa700 1 -- 172.21.15.49:0/2221453578 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f344000e040 con 0x7f3454101b00 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f34517fa700 1 -- 172.21.15.49:0/2221453578 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3440004290 con 0x7f3454101b00 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345410c6a0 con 0x7f3454101b00 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f34517fa700 1 -- 172.21.15.49:0/2221453578 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3440013770 con 0x7f3454101b00 2023-12-16T07:48:37.066 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.064+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345410cb80 con 0x7f3454101b00 2023-12-16T07:48:37.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.065+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34540734d0 con 0x7f3454101b00 2023-12-16T07:48:37.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.066+0000 7f34517fa700 1 -- 172.21.15.49:0/2221453578 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f344001ead0 con 0x7f3454101b00 2023-12-16T07:48:37.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.066+0000 7f34517fa700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f344406ce60 0x7f344406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:37.067 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.066+0000 7f34517fa700 1 -- 172.21.15.49:0/2221453578 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f34400901a0 con 0x7f3454101b00 2023-12-16T07:48:37.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.066+0000 7f34588a9700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f344406ce60 0x7f344406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:37.068 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.067+0000 7f34588a9700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f344406ce60 0x7f344406f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3448009b10 tx=0x7f3448008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:37.071 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.071+0000 7f34517fa700 1 -- 172.21.15.49:0/2221453578 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f344005db10 con 0x7f3454101b00 2023-12-16T07:48:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.360+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f345410dbd0 con 0x7f3454101b00 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.360+0000 7f34517fa700 1 -- 172.21.15.49:0/2221453578 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f344005d6a0 con 0x7f3454101b00 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 2 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2023-12-16T07:48:37.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 6 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.0.0-191-g6d933094 (6d933094a156ec7587742e5aa25fba5ba27ec678) reef (dev)": 10 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout: } 2023-12-16T07:48:37.362 INFO:teuthology.orchestra.run.smithi049.stdout:} 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f344406ce60 msgr2=0x7f344406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f344406ce60 0x7f344406f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3448009b10 tx=0x7f3448008040 comp rx=0 tx=0).stop 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454101b00 msgr2=0x7f3454112aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454101b00 0x7f3454112aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3440009180 tx=0x7f3440009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 shutdown_connections 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540fbb40 0x7f3454112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f344406ce60 0x7f344406f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.362+0000 7f345ab0d700 1 --2- 172.21.15.49:0/2221453578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3454101b00 0x7f3454112aa0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.363+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 >> 172.21.15.49:0/2221453578 conn(0x7f34540719b0 msgr2=0x7f34540faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.363+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 shutdown_connections 2023-12-16T07:48:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:37.363+0000 7f345ab0d700 1 -- 172.21.15.49:0/2221453578 wait complete. 2023-12-16T07:48:37.518 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:37 smithi049 ceph-mon[217548]: pgmap v180: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:37.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:37 smithi133 ceph-mon[181557]: pgmap v180: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:37.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-16T07:48:38.014 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/mon.smithi049/config 2023-12-16T07:48:38.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:38 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2221453578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:48:38.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:38 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2221453578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 -- 172.21.15.49:0/3994672021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c0fbb40 msgr2=0x7f7d0c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 --2- 172.21.15.49:0/3994672021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c0fbb40 0x7f7d0c0fbfb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc004940 tx=0x7f7cfc009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 -- 172.21.15.49:0/3994672021 shutdown_connections 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 --2- 172.21.15.49:0/3994672021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c0fbb40 0x7f7d0c0fbfb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 --2- 172.21.15.49:0/3994672021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d0c101b00 0x7f7d0c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 -- 172.21.15.49:0/3994672021 >> 172.21.15.49:0/3994672021 conn(0x7f7d0c0719b0 msgr2=0x7f7d0c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 -- 172.21.15.49:0/3994672021 shutdown_connections 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.956+0000 7f7d120d8700 1 -- 172.21.15.49:0/3994672021 wait complete. 2023-12-16T07:48:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d120d8700 1 Processor -- start 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d120d8700 1 -- start start 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d120d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d0c0fbb40 0x7f7d0c1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d120d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c101b00 0x7f7d0c113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d120d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c114270 con 0x7f7d0c101b00 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d120d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c10d560 con 0x7f7d0c0fbb40 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c101b00 0x7f7d0c113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c101b00 0x7f7d0c113c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56620/0 (socket says 172.21.15.49:56620) 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0affd700 1 -- 172.21.15.49:0/2629322225 learned_addr learned my addr 172.21.15.49:0/2629322225 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0affd700 1 -- 172.21.15.49:0/2629322225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d0c0fbb40 msgr2=0x7f7d0c1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0b7fe700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d0c0fbb40 0x7f7d0c1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0affd700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d0c0fbb40 0x7f7d0c1136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0affd700 1 -- 172.21.15.49:0/2629322225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc005040 con 0x7f7d0c101b00 2023-12-16T07:48:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.957+0000 7f7d0b7fe700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d0c0fbb40 0x7f7d0c1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:48:38.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.958+0000 7f7d0affd700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c101b00 0x7f7d0c113c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00b3b0 tx=0x7f7cfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:38.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.958+0000 7f7d03fff700 1 -- 172.21.15.49:0/2629322225 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cfc00e040 con 0x7f7d0c101b00 2023-12-16T07:48:38.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.958+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c10d790 con 0x7f7d0c101b00 2023-12-16T07:48:38.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.958+0000 7f7d03fff700 1 -- 172.21.15.49:0/2629322225 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7cfc00bc50 con 0x7f7d0c101b00 2023-12-16T07:48:38.960 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.958+0000 7f7d03fff700 1 -- 172.21.15.49:0/2629322225 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cfc013420 con 0x7f7d0c101b00 2023-12-16T07:48:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.958+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c10dcd0 con 0x7f7d0c101b00 2023-12-16T07:48:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.959+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c0734d0 con 0x7f7d0c101b00 2023-12-16T07:48:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.959+0000 7f7d03fff700 1 -- 172.21.15.49:0/2629322225 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7cfc01c430 con 0x7f7d0c101b00 2023-12-16T07:48:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.960+0000 7f7d03fff700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f7cf806ce60 0x7f7cf806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.960+0000 7f7d03fff700 1 -- 172.21.15.49:0/2629322225 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7cfc08d110 con 0x7f7d0c101b00 2023-12-16T07:48:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.960+0000 7f7d0b7fe700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f7cf806ce60 0x7f7cf806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:38.961 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.960+0000 7f7d0b7fe700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f7cf806ce60 0x7f7cf806f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40041d0 tx=0x7f7cf4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:38.965+0000 7f7d03fff700 1 -- 172.21.15.49:0/2629322225 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f7cfc05ab10 con 0x7f7d0c101b00 2023-12-16T07:48:39.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.251+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d0c108ad0 con 0x7f7d0c101b00 2023-12-16T07:48:39.251 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.251+0000 7f7d03fff700 1 -- 172.21.15.49:0/2629322225 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f7cfc05a6a0 con 0x7f7d0c101b00 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f7cf806ce60 msgr2=0x7f7cf806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f7cf806ce60 0x7f7cf806f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40041d0 tx=0x7f7cf4009040 comp rx=0 tx=0).stop 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c101b00 msgr2=0x7f7d0c113c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c101b00 0x7f7d0c113c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00b3b0 tx=0x7f7cfc009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 shutdown_connections 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d0c0fbb40 0x7f7d0c1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f7cf806ce60 0x7f7cf806f310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 --2- 172.21.15.49:0/2629322225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d0c101b00 0x7f7d0c113c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 >> 172.21.15.49:0/2629322225 conn(0x7f7d0c0719b0 msgr2=0x7f7d0c065430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 shutdown_connections 2023-12-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.254+0000 7f7d120d8700 1 -- 172.21.15.49:0/2629322225 wait complete. 2023-12-16T07:48:39.264 INFO:teuthology.orchestra.run.smithi049.stdout:false 2023-12-16T07:48:39.562 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:39 smithi049 ceph-mon[217548]: pgmap v181: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:39.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:48:39.613 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi049 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T07:48:39.696 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a3d11575f5e0450dbe5fa0af4322a05a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi049 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-16T07:48:39.699 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-16T07:48:39.714 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-16T07:48:39.714 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:48:39.714 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T07:48:39.722 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:39 smithi133 ceph-mon[181557]: pgmap v181: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:39.743 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2023-12-16T07:48:39.743 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T07:48:39.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T07:48:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 -- 172.21.15.49:0/805243740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101160 msgr2=0x7f90dc101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 --2- 172.21.15.49:0/805243740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101160 0x7f90dc101530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90cc004940 tx=0x7f90cc009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 -- 172.21.15.49:0/805243740 shutdown_connections 2023-12-16T07:48:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 --2- 172.21.15.49:0/805243740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90dc101b00 0x7f90dc0fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 --2- 172.21.15.49:0/805243740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101160 0x7f90dc101530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 -- 172.21.15.49:0/805243740 >> 172.21.15.49:0/805243740 conn(0x7f90dc0710d0 msgr2=0x7f90dc0714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 -- 172.21.15.49:0/805243740 shutdown_connections 2023-12-16T07:48:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.968+0000 7f90e13b6700 1 -- 172.21.15.49:0/805243740 wait complete. 2023-12-16T07:48:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90e13b6700 1 Processor -- start 2023-12-16T07:48:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90e13b6700 1 -- start start 2023-12-16T07:48:39.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90e13b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90dc101160 0x7f90dc10e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:39.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90e13b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101b00 0x7f90dc10e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:39.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90e13b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc10ee50 con 0x7f90dc101b00 2023-12-16T07:48:39.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90e13b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc10ef90 con 0x7f90dc101160 2023-12-16T07:48:39.974 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90da7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101b00 0x7f90dc10e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90da7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101b00 0x7f90dc10e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56642/0 (socket says 172.21.15.49:56642) 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.969+0000 7f90da7fc700 1 -- 172.21.15.49:0/112056435 learned_addr learned my addr 172.21.15.49:0/112056435 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90daffd700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90dc101160 0x7f90dc10e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90da7fc700 1 -- 172.21.15.49:0/112056435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90dc101160 msgr2=0x7f90dc10e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90da7fc700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90dc101160 0x7f90dc10e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90da7fc700 1 -- 172.21.15.49:0/112056435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc005040 con 0x7f90dc101b00 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90da7fc700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101b00 0x7f90dc10e910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f90d0002a80 tx=0x7f90d0004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:39.975 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90c37fe700 1 -- 172.21.15.49:0/112056435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d0004e80 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90c37fe700 1 -- 172.21.15.49:0/112056435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f90d000f040 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90dc117440 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90c37fe700 1 -- 172.21.15.49:0/112056435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d000da00 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.970+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90dc1178c0 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.971+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90dc064b80 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.971+0000 7f90c37fe700 1 -- 172.21.15.49:0/112056435 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f90d0007cc0 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.972+0000 7f90c37fe700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f90c406ce70 0x7f90c406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.972+0000 7f90c37fe700 1 -- 172.21.15.49:0/112056435 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f90d008b910 con 0x7f90dc101b00 2023-12-16T07:48:39.976 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.972+0000 7f90daffd700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f90c406ce70 0x7f90c406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:39.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.972+0000 7f90daffd700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f90c406ce70 0x7f90c406f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00b3b0 tx=0x7f90cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:39.977 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:39.978+0000 7f90c37fe700 1 -- 172.21.15.49:0/112056435 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f90d00557f0 con 0x7f90dc101b00 2023-12-16T07:48:40.177 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.176+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90dc117b50 con 0x7f90dc101b00 2023-12-16T07:48:40.179 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.178+0000 7f90c37fe700 1 -- 172.21.15.49:0/112056435 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16441 (secure 0 0 0) 0x7f90d0058e10 con 0x7f90dc101b00 2023-12-16T07:48:40.179 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:48:40.179 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","created":"2023-12-16T07:33:24.032146+0000","modified":"2023-12-16T07:47:08.870590+0000","last_up_change":"2023-12-16T07:47:07.868794+0000","last_in_change":"2023-12-16T07:37:12.459978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T07:36:35.661056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T07:38:15.937834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T07:38:16.870070+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4530d745-4857-47b4-b774-3b7a5ec0b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6803","nonce":1847908792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6805","nonce":1847908792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6809","nonce":1847908792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6807","nonce":1847908792}]},"public_addr":"172.21.15.49:6803/1847908792","cluster_addr":"172.21.15.49:6805/1847908792","heartbeat_back_addr":"172.21.15.49:6809/1847908792","heartbeat_front_addr":"172.21.15.49:6807/1847908792","state":["exists","up"]},{"osd":1,"uuid":"6f6c48cb-df63-42f1-9637-038a97b80255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6811","nonce":3307407732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6813","nonce":3307407732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6817","nonce":3307407732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6815","nonce":3307407732}]},"public_addr":"172.21.15.49:6811/3307407732","cluster_addr":"172.21.15.49:6813/3307407732","heartbeat_back_addr":"172.21.15.49:6817/3307407732","heartbeat_front_addr":"172.21.15.49:6815/3307407732","state":["exists","up"]},{"osd":2,"uuid":"fc0f86d1-e690-4394-9f3b-45dc882e8df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6819","nonce":4059212532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6821","nonce":4059212532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6825","nonce":4059212532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6823","nonce":4059212532}]},"public_addr":"172.21.15.49:6819/4059212532","cluster_addr":"172.21.15.49:6821/4059212532","heartbeat_back_addr":"172.21.15.49:6825/4059212532","heartbeat_front_addr":"172.21.15.49:6823/4059212532","state":["exists","up"]},{"osd":3,"uuid":"d48037c4-bb53-46d8-ba71-0c726cd8ae95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6801","nonce":2696134742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6803","nonce":2696134742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6807","nonce":2696134742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6805","nonce":2696134742}]},"public_addr":"172.21.15.133:6801/2696134742","cluster_addr":"172.21.15.133:6803/2696134742","heartbeat_back_addr":"172.21.15.133:6807/2696134742","heartbeat_front_addr":"172.21.15.133:6805/2696134742","state":["exists","up"]},{"osd":4,"uuid":"78584567-3240-4b79-b085-ea1b83fa1868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6809","nonce":2539677492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6811","nonce":2539677492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6815","nonce":2539677492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6813","nonce":2539677492}]},"public_addr":"172.21.15.133:6809/2539677492","cluster_addr":"172.21.15.133:6811/2539677492","heartbeat_back_addr":"172.21.15.133:6815/2539677492","heartbeat_front_addr":"172.21.15.133:6813/2539677492","state":["exists","up"]},{"osd":5,"uuid":"ba3d6fef-d56a-4a09-808e-84bb8c5b1b90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6817","nonce":2784436312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6819","nonce":2784436312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6823","nonce":2784436312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6821","nonce":2784436312}]},"public_addr":"172.21.15.133:6817/2784436312","cluster_addr":"172.21.15.133:6819/2784436312","heartbeat_back_addr":"172.21.15.133:6823/2784436312","heartbeat_front_addr":"172.21.15.133:6821/2784436312","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:35:54.616062+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:13.940774+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:33.140071+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:51.066041+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:09.306146+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:27.119927+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/982747889":"2023-12-17T07:43:43.758239+0000","172.21.15.49:6800/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6801/2346374523":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/4193621983":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/598785895":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/4037451623":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/1954956906":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3726699499":"2023-12-17T07:43:43.758239+0000","172.21.15.49:0/4127741167":"2023-12-17T07:43:43.758239+0000","172.21.15.49:0/226482574":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3838333790":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6826/1458998795":"2023-12-17T07:38:25.483273+0000","172.21.15.49:6800/2346374523":"2023-12-17T07:40:12.264689+0000","172.21.15.133:0/88488420":"2023-12-17T07:41:22.034409+0000","172.21.15.133:0/3680143242":"2023-12-17T07:41:22.034409+0000","172.21.15.133:0/2699643412":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6801/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.133:0/4016005683":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6800/2734012715":"2023-12-17T07:43:43.758239+0000","172.21.15.49:6801/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/3034826394":"2023-12-17T07:34:14.965065+0000","172.21.15.133:6828/1992339894":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6827/1458998795":"2023-12-17T07:38:25.483273+0000","172.21.15.49:0/2648683047":"2023-12-17T07:34:14.965065+0000","172.21.15.133:6829/1992339894":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6801/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/1284982982":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/2149050593":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/1476740054":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6800/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.133:0/3745277280":"2023-12-17T07:41:22.034409+0000","172.21.15.49:0/1859081974":"2023-12-17T07:40:12.264689+0000","172.21.15.49:6800/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.133:0/3603300860":"2023-12-17T07:41:22.034409+0000","172.21.15.49:0/3505892537":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/2734012715":"2023-12-17T07:43:43.758239+0000","172.21.15.49:0/1255116902":"2023-12-17T07:43:43.758239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T07:48:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f90c406ce70 msgr2=0x7f90c406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.181 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f90c406ce70 0x7f90c406f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00b3b0 tx=0x7f90cc009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101b00 msgr2=0x7f90dc10e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101b00 0x7f90dc10e910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f90d0002a80 tx=0x7f90d0004630 comp rx=0 tx=0).stop 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 shutdown_connections 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90dc101160 0x7f90dc10e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f90c406ce70 0x7f90c406f320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 --2- 172.21.15.49:0/112056435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90dc101b00 0x7f90dc10e910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 >> 172.21.15.49:0/112056435 conn(0x7f90dc0710d0 msgr2=0x7f90dc0f9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 shutdown_connections 2023-12-16T07:48:40.182 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.180+0000 7f90e13b6700 1 -- 172.21.15.49:0/112056435 wait complete. 2023-12-16T07:48:40.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T07:36:35.661056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T07:38:15.937834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T07:38:16.870070+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T07:48:40.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T07:48:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 -- 172.21.15.49:0/1485605756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 msgr2=0x7f1d200fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 --2- 172.21.15.49:0/1485605756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d200fba60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c004940 tx=0x7f1d0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 -- 172.21.15.49:0/1485605756 shutdown_connections 2023-12-16T07:48:40.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 --2- 172.21.15.49:0/1485605756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d200fba60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 --2- 172.21.15.49:0/1485605756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d20101ac0 0x7f1d20101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 -- 172.21.15.49:0/1485605756 >> 172.21.15.49:0/1485605756 conn(0x7f1d20071970 msgr2=0x7f1d20071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:40.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 -- 172.21.15.49:0/1485605756 shutdown_connections 2023-12-16T07:48:40.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.320+0000 7f1d271c4700 1 -- 172.21.15.49:0/1485605756 wait complete. 2023-12-16T07:48:40.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d271c4700 1 Processor -- start 2023-12-16T07:48:40.322 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d271c4700 1 -- start start 2023-12-16T07:48:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d271c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d20101ac0 0x7f1d20112240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d271c4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d20112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d271c4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20112dd0 con 0x7f1d201023d0 2023-12-16T07:48:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d271c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2010c2f0 con 0x7f1d20101ac0 2023-12-16T07:48:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d20112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d20112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56660/0 (socket says 172.21.15.49:56660) 2023-12-16T07:48:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d1ffff700 1 -- 172.21.15.49:0/949622990 learned_addr learned my addr 172.21.15.49:0/949622990 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d24f60700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d20101ac0 0x7f1d20112240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d1ffff700 1 -- 172.21.15.49:0/949622990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d20101ac0 msgr2=0x7f1d20112240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d1ffff700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d20101ac0 0x7f1d20112240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d1ffff700 1 -- 172.21.15.49:0/949622990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c005040 con 0x7f1d201023d0 2023-12-16T07:48:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.321+0000 7f1d24f60700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d20101ac0 0x7f1d20112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:48:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.322+0000 7f1d1ffff700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d20112780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009fd0 tx=0x7f1d0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.322+0000 7f1d1d7fa700 1 -- 172.21.15.49:0/949622990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0c00e040 con 0x7f1d201023d0 2023-12-16T07:48:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.322+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2010c570 con 0x7f1d201023d0 2023-12-16T07:48:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.322+0000 7f1d1d7fa700 1 -- 172.21.15.49:0/949622990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d0c00bd20 con 0x7f1d201023d0 2023-12-16T07:48:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.322+0000 7f1d1d7fa700 1 -- 172.21.15.49:0/949622990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0c01c630 con 0x7f1d201023d0 2023-12-16T07:48:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.322+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2010cb30 con 0x7f1d201023d0 2023-12-16T07:48:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.323+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d20103f00 con 0x7f1d201023d0 2023-12-16T07:48:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.323+0000 7f1d1d7fa700 1 -- 172.21.15.49:0/949622990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1d0c013420 con 0x7f1d201023d0 2023-12-16T07:48:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.324+0000 7f1d1d7fa700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1d1006ce60 0x7f1d1006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.324+0000 7f1d1d7fa700 1 -- 172.21.15.49:0/949622990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1d0c08d660 con 0x7f1d201023d0 2023-12-16T07:48:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.324+0000 7f1d24f60700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1d1006ce60 0x7f1d1006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:40.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.324+0000 7f1d24f60700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1d1006ce60 0x7f1d1006f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009fd0 tx=0x7f1d14009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:40.329 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.328+0000 7f1d1d7fa700 1 -- 172.21.15.49:0/949622990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f1d0c05b050 con 0x7f1d201023d0 2023-12-16T07:48:40.461 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:40 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2629322225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:48:40.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:40 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/112056435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:48:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.529+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d2010d820 con 0x7f1d201023d0 2023-12-16T07:48:40.529 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.529+0000 7f1d1d7fa700 1 -- 172.21.15.49:0/949622990 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d0c05abe0 con 0x7f1d201023d0 2023-12-16T07:48:40.530 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-16T07:48:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1d1006ce60 msgr2=0x7f1d1006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1d1006ce60 0x7f1d1006f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009fd0 tx=0x7f1d14009ee0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 msgr2=0x7f1d20112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d20112780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009fd0 tx=0x7f1d0c009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 shutdown_connections 2023-12-16T07:48:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d20101ac0 0x7f1d20112240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f1d1006ce60 0x7f1d1006f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 --2- 172.21.15.49:0/949622990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d201023d0 0x7f1d20112780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.531+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 >> 172.21.15.49:0/949622990 conn(0x7f1d20071970 msgr2=0x7f1d200faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.532+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 shutdown_connections 2023-12-16T07:48:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.532+0000 7f1d271c4700 1 -- 172.21.15.49:0/949622990 wait complete. 2023-12-16T07:48:40.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T07:48:40.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:40 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2629322225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-16T07:48:40.728 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:40 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/112056435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:48:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- 172.21.15.49:0/2224424363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3901023d0 msgr2=0x7fa3900fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 --2- 172.21.15.49:0/2224424363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3901023d0 0x7fa3900fba60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa38c004940 tx=0x7fa38c009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- 172.21.15.49:0/2224424363 shutdown_connections 2023-12-16T07:48:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 --2- 172.21.15.49:0/2224424363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3901023d0 0x7fa3900fba60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 --2- 172.21.15.49:0/2224424363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa390101ac0 0x7fa390101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- 172.21.15.49:0/2224424363 >> 172.21.15.49:0/2224424363 conn(0x7fa390071970 msgr2=0x7fa390071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- 172.21.15.49:0/2224424363 shutdown_connections 2023-12-16T07:48:40.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- 172.21.15.49:0/2224424363 wait complete. 2023-12-16T07:48:40.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 Processor -- start 2023-12-16T07:48:40.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- start start 2023-12-16T07:48:40.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101ac0 0x7fa3901121e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:40.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3901023d0 0x7fa390112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:40.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390112d70 con 0x7fa390101ac0 2023-12-16T07:48:40.733 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.669+0000 7fa39771e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39010c290 con 0x7fa3901023d0 2023-12-16T07:48:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa3954ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101ac0 0x7fa3901121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa3954ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101ac0 0x7fa3901121e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56682/0 (socket says 172.21.15.49:56682) 2023-12-16T07:48:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa3954ba700 1 -- 172.21.15.49:0/935943559 learned_addr learned my addr 172.21.15.49:0/935943559 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa394cb9700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3901023d0 0x7fa390112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa3954ba700 1 -- 172.21.15.49:0/935943559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3901023d0 msgr2=0x7fa390112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa3954ba700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3901023d0 0x7fa390112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.734 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa3954ba700 1 -- 172.21.15.49:0/935943559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c005040 con 0x7fa390101ac0 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa394cb9700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3901023d0 0x7fa390112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa3954ba700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101ac0 0x7fa3901121e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa380002a80 tx=0x7fa3800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa385ffb700 1 -- 172.21.15.49:0/935943559 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa380007cc0 con 0x7fa390101ac0 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa385ffb700 1 -- 172.21.15.49:0/935943559 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa38000f040 con 0x7fa390101ac0 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39010c570 con 0x7fa390101ac0 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa385ffb700 1 -- 172.21.15.49:0/935943559 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa380009640 con 0x7fa390101ac0 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.670+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39010cb30 con 0x7fa390101ac0 2023-12-16T07:48:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.671+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa390103f00 con 0x7fa390101ac0 2023-12-16T07:48:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.672+0000 7fa385ffb700 1 -- 172.21.15.49:0/935943559 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa3800097a0 con 0x7fa390101ac0 2023-12-16T07:48:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.672+0000 7fa385ffb700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa37c06ce60 0x7fa37c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.672+0000 7fa385ffb700 1 -- 172.21.15.49:0/935943559 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa38008b9d0 con 0x7fa390101ac0 2023-12-16T07:48:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.672+0000 7fa394cb9700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa37c06ce60 0x7fa37c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.673+0000 7fa394cb9700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa37c06ce60 0x7fa37c06f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00b3b0 tx=0x7fa38c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:40.736 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.677+0000 7fa385ffb700 1 -- 172.21.15.49:0/935943559 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fa3800593c0 con 0x7fa390101ac0 2023-12-16T07:48:40.878 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.877+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa390064730 con 0x7fa390101ac0 2023-12-16T07:48:40.879 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.878+0000 7fa385ffb700 1 -- 172.21.15.49:0/935943559 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa380058f50 con 0x7fa390101ac0 2023-12-16T07:48:40.879 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa37c06ce60 msgr2=0x7fa37c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa37c06ce60 0x7fa37c06f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00b3b0 tx=0x7fa38c009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101ac0 msgr2=0x7fa3901121e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101ac0 0x7fa3901121e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa380002a80 tx=0x7fa3800046b0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 shutdown_connections 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fa37c06ce60 0x7fa37c06f310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa390101ac0 0x7fa3901121e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.883 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 --2- 172.21.15.49:0/935943559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3901023d0 0x7fa390112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:40.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 >> 172.21.15.49:0/935943559 conn(0x7fa390071970 msgr2=0x7fa3900faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:40.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 shutdown_connections 2023-12-16T07:48:40.884 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:40.880+0000 7fa39771e700 1 -- 172.21.15.49:0/935943559 wait complete. 2023-12-16T07:48:40.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T07:48:41.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 -- 172.21.15.49:0/4226329559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370102bb0 msgr2=0x7fb370102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 --2- 172.21.15.49:0/4226329559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370102bb0 0x7fb370102f80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb364004940 tx=0x7fb364009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:41.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 -- 172.21.15.49:0/4226329559 shutdown_connections 2023-12-16T07:48:41.039 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 --2- 172.21.15.49:0/4226329559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb370064bb0 0x7fb370065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 --2- 172.21.15.49:0/4226329559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370102bb0 0x7fb370102f80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 -- 172.21.15.49:0/4226329559 >> 172.21.15.49:0/4226329559 conn(0x7fb370071970 msgr2=0x7fb370071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 -- 172.21.15.49:0/4226329559 shutdown_connections 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.033+0000 7fb37583f700 1 -- 172.21.15.49:0/4226329559 wait complete. 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb37583f700 1 Processor -- start 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb37583f700 1 -- start start 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb37583f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370064bb0 0x7fb370113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:41.040 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb37583f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb370102bb0 0x7fb370113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb37583f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370113ed0 con 0x7fb370064bb0 2023-12-16T07:48:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb37583f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37010d3f0 con 0x7fb370102bb0 2023-12-16T07:48:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370064bb0 0x7fb370113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370064bb0 0x7fb370113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56702/0 (socket says 172.21.15.49:56702) 2023-12-16T07:48:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36effd700 1 -- 172.21.15.49:0/2992355601 learned_addr learned my addr 172.21.15.49:0/2992355601 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb370102bb0 0x7fb370113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36effd700 1 -- 172.21.15.49:0/2992355601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb370102bb0 msgr2=0x7fb370113880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36effd700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb370102bb0 0x7fb370113880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36effd700 1 -- 172.21.15.49:0/2992355601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364005040 con 0x7fb370064bb0 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.034+0000 7fb36effd700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370064bb0 0x7fb370113340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb364009360 tx=0x7fb364009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.035+0000 7fb3577fe700 1 -- 172.21.15.49:0/2992355601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb36400e040 con 0x7fb370064bb0 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.035+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37010d670 con 0x7fb370064bb0 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.035+0000 7fb3577fe700 1 -- 172.21.15.49:0/2992355601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb36400bc50 con 0x7fb370064bb0 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.035+0000 7fb3577fe700 1 -- 172.21.15.49:0/2992355601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb36401c630 con 0x7fb370064bb0 2023-12-16T07:48:41.042 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.035+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37010dc30 con 0x7fb370064bb0 2023-12-16T07:48:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.036+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370064730 con 0x7fb370064bb0 2023-12-16T07:48:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.036+0000 7fb3577fe700 1 -- 172.21.15.49:0/2992355601 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb364013420 con 0x7fb370064bb0 2023-12-16T07:48:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.037+0000 7fb3577fe700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb35806ce70 0x7fb35806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.037+0000 7fb3577fe700 1 -- 172.21.15.49:0/2992355601 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb36408d5d0 con 0x7fb370064bb0 2023-12-16T07:48:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.037+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb35806ce70 0x7fb35806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:41.043 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.037+0000 7fb36e7fc700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb35806ce70 0x7fb35806f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb37010ebe0 tx=0x7fb360009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:41.044 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.041+0000 7fb3577fe700 1 -- 172.21.15.49:0/2992355601 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fb36405afc0 con 0x7fb370064bb0 2023-12-16T07:48:41.242 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.242+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fb370109ab0 con 0x7fb370064bb0 2023-12-16T07:48:41.243 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.242+0000 7fb3577fe700 1 -- 172.21.15.49:0/2992355601 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb36405ab50 con 0x7fb370064bb0 2023-12-16T07:48:41.243 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-16T07:48:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb35806ce70 msgr2=0x7fb35806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.246 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb35806ce70 0x7fb35806f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb37010ebe0 tx=0x7fb360009ee0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370064bb0 msgr2=0x7fb370113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370064bb0 0x7fb370113340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb364009360 tx=0x7fb364009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:41.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 shutdown_connections 2023-12-16T07:48:41.247 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fb35806ce70 0x7fb35806f320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb370064bb0 0x7fb370113340 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 --2- 172.21.15.49:0/2992355601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb370102bb0 0x7fb370113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 >> 172.21.15.49:0/2992355601 conn(0x7fb370071970 msgr2=0x7fb3700faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 shutdown_connections 2023-12-16T07:48:41.248 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.245+0000 7fb37583f700 1 -- 172.21.15.49:0/2992355601 wait complete. 2023-12-16T07:48:41.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T07:48:41.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 -- 172.21.15.49:0/1798904239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b4101ac0 msgr2=0x7f72b4101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.387 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1798904239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b4101ac0 0x7f72b4101e90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72a8004940 tx=0x7f72a8009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:41.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 -- 172.21.15.49:0/1798904239 shutdown_connections 2023-12-16T07:48:41.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1798904239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b41023d0 0x7f72b40fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1798904239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b4101ac0 0x7f72b4101e90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 -- 172.21.15.49:0/1798904239 >> 172.21.15.49:0/1798904239 conn(0x7f72b4071970 msgr2=0x7f72b4071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:41.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 -- 172.21.15.49:0/1798904239 shutdown_connections 2023-12-16T07:48:41.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.382+0000 7f72bac1b700 1 -- 172.21.15.49:0/1798904239 wait complete. 2023-12-16T07:48:41.388 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.383+0000 7f72bac1b700 1 Processor -- start 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.383+0000 7f72bac1b700 1 -- start start 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72bac1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b4101ac0 0x7f72b4112230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72bac1b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b41023d0 0x7f72b4112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72bac1b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4112e50 con 0x7f72b41023d0 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72bac1b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b410c2e0 con 0x7f72b4101ac0 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b41023d0 0x7f72b4112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b41023d0 0x7f72b4112770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56718/0 (socket says 172.21.15.49:56718) 2023-12-16T07:48:41.389 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b3fff700 1 -- 172.21.15.49:0/1805582975 learned_addr learned my addr 172.21.15.49:0/1805582975 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b89b7700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b4101ac0 0x7f72b4112230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b3fff700 1 -- 172.21.15.49:0/1805582975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b4101ac0 msgr2=0x7f72b4112230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b3fff700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b4101ac0 0x7f72b4112230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b3fff700 1 -- 172.21.15.49:0/1805582975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8005040 con 0x7f72b41023d0 2023-12-16T07:48:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b3fff700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b41023d0 0x7f72b4112770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72a000b790 tx=0x7f72a0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b17fa700 1 -- 172.21.15.49:0/1805582975 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a000f6f0 con 0x7f72b41023d0 2023-12-16T07:48:41.390 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b17fa700 1 -- 172.21.15.49:0/1805582975 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f72a000fd00 con 0x7f72b41023d0 2023-12-16T07:48:41.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72b17fa700 1 -- 172.21.15.49:0/1805582975 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a00103a0 con 0x7f72b41023d0 2023-12-16T07:48:41.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b410c560 con 0x7f72b41023d0 2023-12-16T07:48:41.391 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.384+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b410cb20 con 0x7f72b41023d0 2023-12-16T07:48:41.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.385+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4064730 con 0x7f72b41023d0 2023-12-16T07:48:41.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.386+0000 7f72b17fa700 1 -- 172.21.15.49:0/1805582975 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f72a000f850 con 0x7f72b41023d0 2023-12-16T07:48:41.392 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.386+0000 7f72b17fa700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f72a406ce60 0x7f72a406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.387+0000 7f72b89b7700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f72a406ce60 0x7f72a406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.387+0000 7f72b17fa700 1 -- 172.21.15.49:0/1805582975 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f72a008c1a0 con 0x7f72b41023d0 2023-12-16T07:48:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.387+0000 7f72b89b7700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f72a406ce60 0x7f72a406f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72a8004560 tx=0x7f72a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.391+0000 7f72b17fa700 1 -- 172.21.15.49:0/1805582975 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f72a0059b10 con 0x7f72b41023d0 2023-12-16T07:48:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.606+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f72b4108a90 con 0x7f72b41023d0 2023-12-16T07:48:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.607+0000 7f72b17fa700 1 -- 172.21.15.49:0/1805582975 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v78) v1 ==== 81+0+2191 (secure 0 0 0) 0x7f72a00596a0 con 0x7f72b41023d0 2023-12-16T07:48:41.616 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/982747889 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:41.617 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1241362817 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:41.617 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2346374523 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:41.617 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4193621983 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:41.617 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/598785895 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:41.617 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4037451623 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:41.617 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1954956906 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3726699499 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4127741167 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/226482574 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3838333790 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6826/1458998795 2023-12-17T07:38:25.483273+0000 2023-12-16T07:48:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2346374523 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/88488420 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/3680143242 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/2699643412 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1241362817 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/4016005683 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2734012715 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1804466564 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3034826394 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:6828/1992339894 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6827/1458998795 2023-12-17T07:38:25.483273+0000 2023-12-16T07:48:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2648683047 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:6829/1992339894 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/3810957388 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1284982982 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2149050593 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1476740054 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1804466564 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/3745277280 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1859081974 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/3810957388 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/3603300860 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3505892537 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:41.621 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2734012715 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:41.622 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1255116902 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:41.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f72a406ce60 msgr2=0x7f72a406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f72a406ce60 0x7f72a406f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72a8004560 tx=0x7f72a8009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:41.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b41023d0 msgr2=0x7f72b4112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:41.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b41023d0 0x7f72b4112770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72a000b790 tx=0x7f72a0009220 comp rx=0 tx=0).stop 2023-12-16T07:48:41.623 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 shutdown_connections 2023-12-16T07:48:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72b4101ac0 0x7f72b4112230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f72a406ce60 0x7f72a406f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 --2- 172.21.15.49:0/1805582975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72b41023d0 0x7f72b4112770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 >> 172.21.15.49:0/1805582975 conn(0x7f72b4071970 msgr2=0x7f72b40fae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 shutdown_connections 2023-12-16T07:48:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:41.609+0000 7f72bac1b700 1 -- 172.21.15.49:0/1805582975 wait complete. 2023-12-16T07:48:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:listed 37 entries 2023-12-16T07:48:41.625 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:41 smithi049 ceph-mon[217548]: pgmap v182: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:41.625 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:41 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/949622990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:48:41.625 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:41 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/935943559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T07:48:41.626 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T07:48:41.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:41.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T07:48:41.627 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:41 smithi133 ceph-mon[181557]: pgmap v182: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:41.627 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:41 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/949622990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:48:41.627 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:41 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/935943559' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T07:48:41.673 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:48:41.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:41.673 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T07:48:41.780 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:48:41.780 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T07:48:41.880 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-16T07:48:41.880 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T07:48:41.911 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T07:48:42.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- 172.21.15.49:0/3959831006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc40fb970 msgr2=0x7fdfc40fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/3959831006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc40fb970 0x7fdfc40fbde0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4004940 tx=0x7fdfb4009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:42.051 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- 172.21.15.49:0/3959831006 shutdown_connections 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/3959831006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc40fb970 0x7fdfc40fbde0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/3959831006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc41019b0 0x7fdfc4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- 172.21.15.49:0/3959831006 >> 172.21.15.49:0/3959831006 conn(0x7fdfc40756d0 msgr2=0x7fdfc40f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- 172.21.15.49:0/3959831006 shutdown_connections 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- 172.21.15.49:0/3959831006 wait complete. 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 Processor -- start 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- start start 2023-12-16T07:48:42.052 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc40fb970 0x7fdfc410e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc41019b0 0x7fdfc410e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc410edc0 con 0x7fdfc41019b0 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.045+0000 7fdfcb91e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc410ef30 con 0x7fdfc40fb970 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc8eb9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc41019b0 0x7fdfc410e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc8eb9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc41019b0 0x7fdfc410e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56744/0 (socket says 172.21.15.49:56744) 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc8eb9700 1 -- 172.21.15.49:0/1749885660 learned_addr learned my addr 172.21.15.49:0/1749885660 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc96ba700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc40fb970 0x7fdfc410e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc8eb9700 1 -- 172.21.15.49:0/1749885660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc40fb970 msgr2=0x7fdfc410e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.053 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc8eb9700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc40fb970 0x7fdfc410e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc8eb9700 1 -- 172.21.15.49:0/1749885660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4005040 con 0x7fdfc41019b0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfc8eb9700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc41019b0 0x7fdfc410e830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400b3b0 tx=0x7fdfb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfb9ffb700 1 -- 172.21.15.49:0/1749885660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb400e040 con 0x7fdfc41019b0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfb9ffb700 1 -- 172.21.15.49:0/1749885660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfb4004290 con 0x7fdfc41019b0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfb9ffb700 1 -- 172.21.15.49:0/1749885660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb401c3f0 con 0x7fdfc41019b0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4117360 con 0x7fdfc41019b0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.046+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc4117700 con 0x7fdfc41019b0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.047+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4103e30 con 0x7fdfc41019b0 2023-12-16T07:48:42.054 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.048+0000 7fdfb9ffb700 1 -- 172.21.15.49:0/1749885660 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fdfb4013790 con 0x7fdfc41019b0 2023-12-16T07:48:42.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.048+0000 7fdfb9ffb700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdfb006ce60 0x7fdfb006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.048+0000 7fdfb9ffb700 1 -- 172.21.15.49:0/1749885660 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdfb408d570 con 0x7fdfc41019b0 2023-12-16T07:48:42.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.048+0000 7fdfc96ba700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdfb006ce60 0x7fdfb006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.049+0000 7fdfc96ba700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdfb006ce60 0x7fdfb006f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0004f40 tx=0x7fdfc000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:42.055 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.053+0000 7fdfb9ffb700 1 -- 172.21.15.49:0/1749885660 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fdfb40574d0 con 0x7fdfc41019b0 2023-12-16T07:48:42.254 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.254+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfc4103850 con 0x7fdfc41019b0 2023-12-16T07:48:42.256 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.255+0000 7fdfb9ffb700 1 -- 172.21.15.49:0/1749885660 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16441 (secure 0 0 0) 0x7fdfb4013420 con 0x7fdfc41019b0 2023-12-16T07:48:42.256 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-16T07:48:42.256 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"4ed9995e-9be5-11ee-95a5-87774f69a715","created":"2023-12-16T07:33:24.032146+0000","modified":"2023-12-16T07:47:08.870590+0000","last_up_change":"2023-12-16T07:47:07.868794+0000","last_in_change":"2023-12-16T07:37:12.459978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T07:36:35.661056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-16T07:38:15.937834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-16T07:38:16.870070+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4530d745-4857-47b4-b774-3b7a5ec0b1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6803","nonce":1847908792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6805","nonce":1847908792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6809","nonce":1847908792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":1847908792},{"type":"v1","addr":"172.21.15.49:6807","nonce":1847908792}]},"public_addr":"172.21.15.49:6803/1847908792","cluster_addr":"172.21.15.49:6805/1847908792","heartbeat_back_addr":"172.21.15.49:6809/1847908792","heartbeat_front_addr":"172.21.15.49:6807/1847908792","state":["exists","up"]},{"osd":1,"uuid":"6f6c48cb-df63-42f1-9637-038a97b80255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6811","nonce":3307407732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6813","nonce":3307407732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6817","nonce":3307407732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3307407732},{"type":"v1","addr":"172.21.15.49:6815","nonce":3307407732}]},"public_addr":"172.21.15.49:6811/3307407732","cluster_addr":"172.21.15.49:6813/3307407732","heartbeat_back_addr":"172.21.15.49:6817/3307407732","heartbeat_front_addr":"172.21.15.49:6815/3307407732","state":["exists","up"]},{"osd":2,"uuid":"fc0f86d1-e690-4394-9f3b-45dc882e8df6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6819","nonce":4059212532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6821","nonce":4059212532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6825","nonce":4059212532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":4059212532},{"type":"v1","addr":"172.21.15.49:6823","nonce":4059212532}]},"public_addr":"172.21.15.49:6819/4059212532","cluster_addr":"172.21.15.49:6821/4059212532","heartbeat_back_addr":"172.21.15.49:6825/4059212532","heartbeat_front_addr":"172.21.15.49:6823/4059212532","state":["exists","up"]},{"osd":3,"uuid":"d48037c4-bb53-46d8-ba71-0c726cd8ae95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6801","nonce":2696134742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6803","nonce":2696134742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6807","nonce":2696134742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2696134742},{"type":"v1","addr":"172.21.15.133:6805","nonce":2696134742}]},"public_addr":"172.21.15.133:6801/2696134742","cluster_addr":"172.21.15.133:6803/2696134742","heartbeat_back_addr":"172.21.15.133:6807/2696134742","heartbeat_front_addr":"172.21.15.133:6805/2696134742","state":["exists","up"]},{"osd":4,"uuid":"78584567-3240-4b79-b085-ea1b83fa1868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6809","nonce":2539677492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6811","nonce":2539677492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6815","nonce":2539677492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2539677492},{"type":"v1","addr":"172.21.15.133:6813","nonce":2539677492}]},"public_addr":"172.21.15.133:6809/2539677492","cluster_addr":"172.21.15.133:6811/2539677492","heartbeat_back_addr":"172.21.15.133:6815/2539677492","heartbeat_front_addr":"172.21.15.133:6813/2539677492","state":["exists","up"]},{"osd":5,"uuid":"ba3d6fef-d56a-4a09-808e-84bb8c5b1b90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6817","nonce":2784436312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6819","nonce":2784436312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6823","nonce":2784436312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":2784436312},{"type":"v1","addr":"172.21.15.133:6821","nonce":2784436312}]},"public_addr":"172.21.15.133:6817/2784436312","cluster_addr":"172.21.15.133:6819/2784436312","heartbeat_back_addr":"172.21.15.133:6823/2784436312","heartbeat_front_addr":"172.21.15.133:6821/2784436312","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:35:54.616062+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:13.940774+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:33.140071+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:36:51.066041+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:09.306146+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T07:37:27.119927+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/982747889":"2023-12-17T07:43:43.758239+0000","172.21.15.49:6800/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6801/2346374523":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/4193621983":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/598785895":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/4037451623":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/1954956906":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3726699499":"2023-12-17T07:43:43.758239+0000","172.21.15.49:0/4127741167":"2023-12-17T07:43:43.758239+0000","172.21.15.49:0/226482574":"2023-12-17T07:33:48.311036+0000","172.21.15.49:0/3838333790":"2023-12-17T07:33:48.311036+0000","172.21.15.49:6826/1458998795":"2023-12-17T07:38:25.483273+0000","172.21.15.49:6800/2346374523":"2023-12-17T07:40:12.264689+0000","172.21.15.133:0/88488420":"2023-12-17T07:41:22.034409+0000","172.21.15.133:0/3680143242":"2023-12-17T07:41:22.034409+0000","172.21.15.133:0/2699643412":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6801/1241362817":"2023-12-17T07:33:48.311036+0000","172.21.15.133:0/4016005683":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6800/2734012715":"2023-12-17T07:43:43.758239+0000","172.21.15.49:6801/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/3034826394":"2023-12-17T07:34:14.965065+0000","172.21.15.133:6828/1992339894":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6827/1458998795":"2023-12-17T07:38:25.483273+0000","172.21.15.49:0/2648683047":"2023-12-17T07:34:14.965065+0000","172.21.15.133:6829/1992339894":"2023-12-17T07:41:22.034409+0000","172.21.15.49:6801/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.49:0/1284982982":"2023-12-17T07:35:03.164705+0000","172.21.15.49:0/2149050593":"2023-12-17T07:40:12.264689+0000","172.21.15.49:0/1476740054":"2023-12-17T07:34:14.965065+0000","172.21.15.49:6800/1804466564":"2023-12-17T07:35:03.164705+0000","172.21.15.133:0/3745277280":"2023-12-17T07:41:22.034409+0000","172.21.15.49:0/1859081974":"2023-12-17T07:40:12.264689+0000","172.21.15.49:6800/3810957388":"2023-12-17T07:34:14.965065+0000","172.21.15.133:0/3603300860":"2023-12-17T07:41:22.034409+0000","172.21.15.49:0/3505892537":"2023-12-17T07:35:03.164705+0000","172.21.15.49:6801/2734012715":"2023-12-17T07:43:43.758239+0000","172.21.15.49:0/1255116902":"2023-12-17T07:43:43.758239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T07:48:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdfb006ce60 msgr2=0x7fdfb006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdfb006ce60 0x7fdfb006f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0004f40 tx=0x7fdfc000b040 comp rx=0 tx=0).stop 2023-12-16T07:48:42.258 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc41019b0 msgr2=0x7fdfc410e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc41019b0 0x7fdfc410e830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400b3b0 tx=0x7fdfb4009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 shutdown_connections 2023-12-16T07:48:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc40fb970 0x7fdfc410e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fdfb006ce60 0x7fdfb006f310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 --2- 172.21.15.49:0/1749885660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfc41019b0 0x7fdfc410e830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 >> 172.21.15.49:0/1749885660 conn(0x7fdfc40756d0 msgr2=0x7fdfc4072940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:42.259 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 shutdown_connections 2023-12-16T07:48:42.260 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.258+0000 7fdfcb91e700 1 -- 172.21.15.49:0/1749885660 wait complete. 2023-12-16T07:48:42.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T07:36:35.661056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-16T07:38:15.937834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-16T07:38:16.870070+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T07:48:42.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T07:48:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 -- 172.21.15.49:0/3184908361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 msgr2=0x7fc9d0101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 --2- 172.21.15.49:0/3184908361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0101e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc004940 tx=0x7fc9cc009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 -- 172.21.15.49:0/3184908361 shutdown_connections 2023-12-16T07:48:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 --2- 172.21.15.49:0/3184908361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d00fba60 0x7fc9d00fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 --2- 172.21.15.49:0/3184908361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0101e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 -- 172.21.15.49:0/3184908361 >> 172.21.15.49:0/3184908361 conn(0x7fc9d00f7600 msgr2=0x7fc9d00f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 -- 172.21.15.49:0/3184908361 shutdown_connections 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.396+0000 7fc9d87da700 1 -- 172.21.15.49:0/3184908361 wait complete. 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.397+0000 7fc9d87da700 1 Processor -- start 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.397+0000 7fc9d87da700 1 -- start start 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.397+0000 7fc9d87da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d00fba60 0x7fc9d0112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.397+0000 7fc9d87da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.397+0000 7fc9d87da700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0112d90 con 0x7fc9d0101aa0 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.397+0000 7fc9d87da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d010c2b0 con 0x7fc9d00fba60 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d5d75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d5d75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0112740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56756/0 (socket says 172.21.15.49:56756) 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d5d75700 1 -- 172.21.15.49:0/4168223609 learned_addr learned my addr 172.21.15.49:0/4168223609 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d6576700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d00fba60 0x7fc9d0112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d5d75700 1 -- 172.21.15.49:0/4168223609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d00fba60 msgr2=0x7fc9d0112200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d5d75700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d00fba60 0x7fc9d0112200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d5d75700 1 -- 172.21.15.49:0/4168223609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc005040 con 0x7fc9d0101aa0 2023-12-16T07:48:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d5d75700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0112740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400fce0 tx=0x7fc9c40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9c2ffd700 1 -- 172.21.15.49:0/4168223609 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c4007ea0 con 0x7fc9d0101aa0 2023-12-16T07:48:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d010c530 con 0x7fc9d0101aa0 2023-12-16T07:48:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9c2ffd700 1 -- 172.21.15.49:0/4168223609 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc9c400dd80 con 0x7fc9d0101aa0 2023-12-16T07:48:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9c2ffd700 1 -- 172.21.15.49:0/4168223609 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c4012460 con 0x7fc9d0101aa0 2023-12-16T07:48:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.398+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d010caf0 con 0x7fc9d0101aa0 2023-12-16T07:48:42.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.399+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0063ea0 con 0x7fc9d0101aa0 2023-12-16T07:48:42.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.400+0000 7fc9c2ffd700 1 -- 172.21.15.49:0/4168223609 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fc9c4009360 con 0x7fc9d0101aa0 2023-12-16T07:48:42.403 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.400+0000 7fc9c2ffd700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc9bc06ce60 0x7fc9bc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.400+0000 7fc9c2ffd700 1 -- 172.21.15.49:0/4168223609 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc9c408e9a0 con 0x7fc9d0101aa0 2023-12-16T07:48:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.400+0000 7fc9d6576700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc9bc06ce60 0x7fc9bc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.404 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.401+0000 7fc9d6576700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc9bc06ce60 0x7fc9bc06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc004f90 tx=0x7fc9cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:42.405 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.405+0000 7fc9c2ffd700 1 -- 172.21.15.49:0/4168223609 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fc9c405c310 con 0x7fc9d0101aa0 2023-12-16T07:48:42.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.602+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9d010cd10 con 0x7fc9d0101aa0 2023-12-16T07:48:42.603 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.603+0000 7fc9c2ffd700 1 -- 172.21.15.49:0/4168223609 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9c405bea0 con 0x7fc9d0101aa0 2023-12-16T07:48:42.603 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2023-12-16T07:48:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc9bc06ce60 msgr2=0x7fc9bc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc9bc06ce60 0x7fc9bc06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc004f90 tx=0x7fc9cc009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 msgr2=0x7fc9d0112740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0112740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400fce0 tx=0x7fc9c40046b0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 shutdown_connections 2023-12-16T07:48:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d00fba60 0x7fc9d0112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fc9bc06ce60 0x7fc9bc06f310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 --2- 172.21.15.49:0/4168223609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9d0101aa0 0x7fc9d0112740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 >> 172.21.15.49:0/4168223609 conn(0x7fc9d00f7600 msgr2=0x7fc9d00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 shutdown_connections 2023-12-16T07:48:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.605+0000 7fc9d87da700 1 -- 172.21.15.49:0/4168223609 wait complete. 2023-12-16T07:48:42.617 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:42 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/2992355601' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T07:48:42.617 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:42 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/1805582975' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T07:48:42.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:42 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/2992355601' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T07:48:42.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:42 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/1805582975' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T07:48:42.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-16T07:48:42.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.747+0000 7f0e6a435700 1 -- 172.21.15.49:0/2175468337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e64101ac0 msgr2=0x7f0e64101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.747+0000 7f0e6a435700 1 --2- 172.21.15.49:0/2175468337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e64101ac0 0x7f0e64101e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e54004940 tx=0x7f0e54009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:42.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.747+0000 7f0e6a435700 1 -- 172.21.15.49:0/2175468337 shutdown_connections 2023-12-16T07:48:42.750 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.747+0000 7f0e6a435700 1 --2- 172.21.15.49:0/2175468337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e641023d0 0x7f0e640fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.747+0000 7f0e6a435700 1 --2- 172.21.15.49:0/2175468337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e64101ac0 0x7f0e64101e90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.747+0000 7f0e6a435700 1 -- 172.21.15.49:0/2175468337 >> 172.21.15.49:0/2175468337 conn(0x7f0e64071970 msgr2=0x7f0e64071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 -- 172.21.15.49:0/2175468337 shutdown_connections 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 -- 172.21.15.49:0/2175468337 wait complete. 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 Processor -- start 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 -- start start 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e64101ac0 0x7f0e641133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e641023d0 0x7f0e641138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.751 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64113f40 con 0x7f0e641023d0 2023-12-16T07:48:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.748+0000 7f0e6a435700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6410d4a0 con 0x7f0e64101ac0 2023-12-16T07:48:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e5bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e641023d0 0x7f0e641138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e5bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e641023d0 0x7f0e641138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56786/0 (socket says 172.21.15.49:56786) 2023-12-16T07:48:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e5bfff700 1 -- 172.21.15.49:0/4113722863 learned_addr learned my addr 172.21.15.49:0/4113722863 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e63fff700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e64101ac0 0x7f0e641133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e5bfff700 1 -- 172.21.15.49:0/4113722863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e64101ac0 msgr2=0x7f0e641133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.752 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e5bfff700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e64101ac0 0x7f0e641133b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e5bfff700 1 -- 172.21.15.49:0/4113722863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54005040 con 0x7f0e641023d0 2023-12-16T07:48:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e5bfff700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e641023d0 0x7f0e641138f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c890 tx=0x7f0e4c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e617fa700 1 -- 172.21.15.49:0/4113722863 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c00a700 con 0x7f0e641023d0 2023-12-16T07:48:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6410d780 con 0x7f0e641023d0 2023-12-16T07:48:42.753 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e617fa700 1 -- 172.21.15.49:0/4113722863 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e4c00ad10 con 0x7f0e641023d0 2023-12-16T07:48:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e617fa700 1 -- 172.21.15.49:0/4113722863 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c012e70 con 0x7f0e641023d0 2023-12-16T07:48:42.754 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.749+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6410dcc0 con 0x7f0e641023d0 2023-12-16T07:48:42.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.750+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e64064730 con 0x7f0e641023d0 2023-12-16T07:48:42.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.751+0000 7f0e617fa700 1 -- 172.21.15.49:0/4113722863 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0e4c00a860 con 0x7f0e641023d0 2023-12-16T07:48:42.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.751+0000 7f0e617fa700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0e5006ce60 0x7f0e5006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:42.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.751+0000 7f0e617fa700 1 -- 172.21.15.49:0/4113722863 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0e4c08c300 con 0x7f0e641023d0 2023-12-16T07:48:42.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.751+0000 7f0e63fff700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0e5006ce60 0x7f0e5006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:42.755 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.752+0000 7f0e63fff700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0e5006ce60 0x7f0e5006f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e54004890 tx=0x7f0e54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:42.756 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.756+0000 7f0e617fa700 1 -- 172.21.15.49:0/4113722863 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f0e4c056260 con 0x7f0e641023d0 2023-12-16T07:48:42.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.952+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f0e6410ea70 con 0x7f0e641023d0 2023-12-16T07:48:42.953 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.953+0000 7f0e617fa700 1 -- 172.21.15.49:0/4113722863 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0e4c059880 con 0x7f0e641023d0 2023-12-16T07:48:42.954 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0e5006ce60 msgr2=0x7f0e5006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0e5006ce60 0x7f0e5006f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e54004890 tx=0x7f0e54009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e641023d0 msgr2=0x7f0e641138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e641023d0 0x7f0e641138f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c890 tx=0x7f0e4c0044c0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 shutdown_connections 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e64101ac0 0x7f0e641133b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f0e5006ce60 0x7f0e5006f310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.956 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 --2- 172.21.15.49:0/4113722863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e641023d0 0x7f0e641138f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:42.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 >> 172.21.15.49:0/4113722863 conn(0x7f0e64071970 msgr2=0x7f0e64104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:42.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 shutdown_connections 2023-12-16T07:48:42.957 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:42.955+0000 7f0e6a435700 1 -- 172.21.15.49:0/4113722863 wait complete. 2023-12-16T07:48:42.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-16T07:48:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.099+0000 7fde9ea8c700 1 -- 172.21.15.49:0/942196310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde98101a90 msgr2=0x7fde98101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.100 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.099+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/942196310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde98101a90 0x7fde98101e60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde8c004940 tx=0x7fde8c009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 -- 172.21.15.49:0/942196310 shutdown_connections 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/942196310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde980fba50 0x7fde980fbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/942196310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde98101a90 0x7fde98101e60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 -- 172.21.15.49:0/942196310 >> 172.21.15.49:0/942196310 conn(0x7fde980f75f0 msgr2=0x7fde980f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 -- 172.21.15.49:0/942196310 shutdown_connections 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 -- 172.21.15.49:0/942196310 wait complete. 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 Processor -- start 2023-12-16T07:48:43.101 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.100+0000 7fde9ea8c700 1 -- start start 2023-12-16T07:48:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9ea8c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde980fba50 0x7fde981132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9ea8c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde98101a90 0x7fde98113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9ea8c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98113ef0 con 0x7fde980fba50 2023-12-16T07:48:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9ea8c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9810d380 con 0x7fde98101a90 2023-12-16T07:48:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9c828700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde980fba50 0x7fde981132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9c828700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde980fba50 0x7fde981132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56800/0 (socket says 172.21.15.49:56800) 2023-12-16T07:48:43.104 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9c828700 1 -- 172.21.15.49:0/213211094 learned_addr learned my addr 172.21.15.49:0/213211094 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde97fff700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde98101a90 0x7fde98113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9c828700 1 -- 172.21.15.49:0/213211094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde98101a90 msgr2=0x7fde98113810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9c828700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde98101a90 0x7fde98113810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9c828700 1 -- 172.21.15.49:0/213211094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c005040 con 0x7fde980fba50 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde97fff700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde98101a90 0x7fde98113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9c828700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde980fba50 0x7fde981132d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009fd0 tx=0x7fde8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde957fa700 1 -- 172.21.15.49:0/213211094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde8c00e040 con 0x7fde980fba50 2023-12-16T07:48:43.105 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde957fa700 1 -- 172.21.15.49:0/213211094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde8c00bc50 con 0x7fde980fba50 2023-12-16T07:48:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9810d5a0 con 0x7fde980fba50 2023-12-16T07:48:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde957fa700 1 -- 172.21.15.49:0/213211094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde8c013ea0 con 0x7fde980fba50 2023-12-16T07:48:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.101+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9810db60 con 0x7fde980fba50 2023-12-16T07:48:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.102+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde98063ea0 con 0x7fde980fba50 2023-12-16T07:48:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.103+0000 7fde957fa700 1 -- 172.21.15.49:0/213211094 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fde8c013420 con 0x7fde980fba50 2023-12-16T07:48:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.103+0000 7fde957fa700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fde8806ce70 0x7fde8806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:43.106 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.103+0000 7fde957fa700 1 -- 172.21.15.49:0/213211094 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fde8c08d810 con 0x7fde980fba50 2023-12-16T07:48:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.103+0000 7fde97fff700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fde8806ce70 0x7fde8806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:43.107 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.104+0000 7fde97fff700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fde8806ce70 0x7fde8806f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde84006fd0 tx=0x7fde84008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:43.108 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.108+0000 7fde957fa700 1 -- 172.21.15.49:0/213211094 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7fde8c05b180 con 0x7fde980fba50 2023-12-16T07:48:43.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.310+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fde98108a50 con 0x7fde980fba50 2023-12-16T07:48:43.312 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.311+0000 7fde957fa700 1 -- 172.21.15.49:0/213211094 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v78) v1 ==== 107+0+11 (secure 0 0 0) 0x7fde8c05ad10 con 0x7fde980fba50 2023-12-16T07:48:43.312 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2023-12-16T07:48:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fde8806ce70 msgr2=0x7fde8806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fde8806ce70 0x7fde8806f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde84006fd0 tx=0x7fde84008040 comp rx=0 tx=0).stop 2023-12-16T07:48:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde980fba50 msgr2=0x7fde981132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde980fba50 0x7fde981132d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009fd0 tx=0x7fde8c009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:43.314 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 shutdown_connections 2023-12-16T07:48:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7fde8806ce70 0x7fde8806f320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde980fba50 0x7fde981132d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 --2- 172.21.15.49:0/213211094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde98101a90 0x7fde98113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 >> 172.21.15.49:0/213211094 conn(0x7fde980f75f0 msgr2=0x7fde98065870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 shutdown_connections 2023-12-16T07:48:43.315 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.313+0000 7fde9ea8c700 1 -- 172.21.15.49:0/213211094 wait complete. 2023-12-16T07:48:43.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T07:48:43.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/4120285095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d081034e0 msgr2=0x7f9d080fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/4120285095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d081034e0 0x7f9d080fcb50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004940 tx=0x7f9cf0009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:43.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/4120285095 shutdown_connections 2023-12-16T07:48:43.456 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/4120285095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d081034e0 0x7f9d080fcb50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/4120285095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d08102b40 0x7f9d08102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/4120285095 >> 172.21.15.49:0/4120285095 conn(0x7f9d080f86d0 msgr2=0x7f9d080faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/4120285095 shutdown_connections 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.454+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/4120285095 wait complete. 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d0d7f6700 1 Processor -- start 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d0d7f6700 1 -- start start 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d0d7f6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d08102b40 0x7f9d08113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:43.457 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d0d7f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d081034e0 0x7f9d08113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:43.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d0d7f6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08113ed0 con 0x7f9d08102b40 2023-12-16T07:48:43.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d0d7f6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0810d3f0 con 0x7f9d081034e0 2023-12-16T07:48:43.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d06ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d08102b40 0x7f9d08113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:43.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d06ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d08102b40 0x7f9d08113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56812/0 (socket says 172.21.15.49:56812) 2023-12-16T07:48:43.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d06ffd700 1 -- 172.21.15.49:0/3121648454 learned_addr learned my addr 172.21.15.49:0/3121648454 (peer_addr_for_me v2:172.21.15.49:0/0) 2023-12-16T07:48:43.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d067fc700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d081034e0 0x7f9d08113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:43.458 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d06ffd700 1 -- 172.21.15.49:0/3121648454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d081034e0 msgr2=0x7f9d08113880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d06ffd700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d081034e0 0x7f9d08113880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d06ffd700 1 -- 172.21.15.49:0/3121648454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0005040 con 0x7f9d08102b40 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9d06ffd700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d08102b40 0x7f9d08113340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8002a50 tx=0x7f9cf80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.455+0000 7f9cff7fe700 1 -- 172.21.15.49:0/3121648454 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf8007cc0 con 0x7f9d08102b40 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.456+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0810d6d0 con 0x7f9d08102b40 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.456+0000 7f9cff7fe700 1 -- 172.21.15.49:0/3121648454 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9cf800f040 con 0x7f9d08102b40 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.456+0000 7f9cff7fe700 1 -- 172.21.15.49:0/3121648454 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf800da70 con 0x7f9d08102b40 2023-12-16T07:48:43.459 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.456+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0810dc90 con 0x7f9d08102b40 2023-12-16T07:48:43.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.456+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d08105010 con 0x7f9d08102b40 2023-12-16T07:48:43.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.457+0000 7f9cff7fe700 1 -- 172.21.15.49:0/3121648454 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f9cf800dc10 con 0x7f9d08102b40 2023-12-16T07:48:43.460 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.457+0000 7f9cff7fe700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9cf406ce60 0x7f9cf406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T07:48:43.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.458+0000 7f9cff7fe700 1 -- 172.21.15.49:0/3121648454 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9cf808ba90 con 0x7f9d08102b40 2023-12-16T07:48:43.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.458+0000 7f9d067fc700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9cf406ce60 0x7f9cf406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T07:48:43.461 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.458+0000 7f9d067fc700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9cf406ce60 0x7f9cf406f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000b3b0 tx=0x7f9cf0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T07:48:43.462 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.462+0000 7f9cff7fe700 1 -- 172.21.15.49:0/3121648454 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180966 (secure 0 0 0) 0x7f9cf8059360 con 0x7f9d08102b40 2023-12-16T07:48:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:43 smithi133 ceph-mon[181557]: pgmap v183: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:43 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/1749885660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:48:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:43 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/4168223609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:48:43.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:43 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/4113722863' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T07:48:43.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.681+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d08064730 con 0x7f9d08102b40 2023-12-16T07:48:43.681 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.681+0000 7f9cff7fe700 1 -- 172.21.15.49:0/3121648454 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v78) v1 ==== 81+0+2191 (secure 0 0 0) 0x7f9cf8058ef0 con 0x7f9d08102b40 2023-12-16T07:48:43.682 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/982747889 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:43.682 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1241362817 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:43.682 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2346374523 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:43.682 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4193621983 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:43.682 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/598785895 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:43.682 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4037451623 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:43.682 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1954956906 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3726699499 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4127741167 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/226482574 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3838333790 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6826/1458998795 2023-12-17T07:38:25.483273+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2346374523 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/88488420 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/3680143242 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.683 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/2699643412 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1241362817 2023-12-17T07:33:48.311036+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/4016005683 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2734012715 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1804466564 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3034826394 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:6828/1992339894 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6827/1458998795 2023-12-17T07:38:25.483273+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2648683047 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:43.684 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:6829/1992339894 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/3810957388 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1284982982 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2149050593 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1476740054 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1804466564 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/3745277280 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1859081974 2023-12-17T07:40:12.264689+0000 2023-12-16T07:48:43.685 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/3810957388 2023-12-17T07:34:14.965065+0000 2023-12-16T07:48:43.686 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.133:0/3603300860 2023-12-17T07:41:22.034409+0000 2023-12-16T07:48:43.686 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3505892537 2023-12-17T07:35:03.164705+0000 2023-12-16T07:48:43.686 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2734012715 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:43.686 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1255116902 2023-12-17T07:43:43.758239+0000 2023-12-16T07:48:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9cf406ce60 msgr2=0x7f9cf406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9cf406ce60 0x7f9cf406f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000b3b0 tx=0x7f9cf0009e30 comp rx=0 tx=0).stop 2023-12-16T07:48:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d08102b40 msgr2=0x7f9d08113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T07:48:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d08102b40 0x7f9d08113340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8002a50 tx=0x7f9cf80046b0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.687 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 shutdown_connections 2023-12-16T07:48:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:6800/2208418616,v1:172.21.15.49:6801/2208418616] conn(0x7f9cf406ce60 0x7f9cf406f310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d08102b40 0x7f9d08113340 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.683+0000 7f9d0d7f6700 1 --2- 172.21.15.49:0/3121648454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d081034e0 0x7f9d08113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T07:48:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.684+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 >> 172.21.15.49:0/3121648454 conn(0x7f9d080f86d0 msgr2=0x7f9d080fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T07:48:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.684+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 shutdown_connections 2023-12-16T07:48:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:2023-12-16T07:48:43.684+0000 7f9d0d7f6700 1 -- 172.21.15.49:0/3121648454 wait complete. 2023-12-16T07:48:43.688 INFO:teuthology.orchestra.run.smithi049.stderr:listed 37 entries 2023-12-16T07:48:43.695 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:43 smithi049 ceph-mon[217548]: pgmap v183: 65 pgs: 65 active+clean; 196 MiB data, 776 MiB used, 536 GiB / 536 GiB avail 2023-12-16T07:48:43.695 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:43 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/1749885660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-16T07:48:43.695 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:43 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/4168223609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-16T07:48:43.695 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:43 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/4113722863' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-16T07:48:43.696 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T07:48:43.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:43.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T07:48:43.746 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-16T07:48:43.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:43.747 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T07:48:43.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:43.816 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2023-12-16T07:48:43.899 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T07:48:43.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:43.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T07:48:43.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:43.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2023-12-16T07:48:44.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:44.027 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-16T07:48:44.046 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T07:48:44.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:44.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T07:48:44.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T07:48:44.138 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-16T07:48:44.216 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-16T07:48:44.228 INFO:tasks.cephadm:Teardown begin 2023-12-16T07:48:44.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T07:48:44.258 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T07:48:44.287 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-16T07:48:44.287 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T07:48:44.316 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-16T07:48:44.346 INFO:tasks.cephadm:Stopping all daemons... 2023-12-16T07:48:44.346 INFO:tasks.cephadm.mon.smithi049:Stopping mon.smithi049... 2023-12-16T07:48:44.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049 2023-12-16T07:48:44.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:44 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/213211094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T07:48:44.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:44 smithi133 ceph-mon[181557]: from='client.? 172.21.15.49:0/3121648454' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T07:48:44.367 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:44 smithi133 ceph-mon[181557]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:48:44.582 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:44 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/213211094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-16T07:48:44.582 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:44 smithi049 ceph-mon[217548]: from='client.? 172.21.15.49:0/3121648454' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-16T07:48:44.583 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:44 smithi049 ceph-mon[217548]: from='mgr.34104 172.21.15.49:0/293708222' entity='mgr.smithi049.rqlvwo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-16T07:48:44.583 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:44 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:48:44.892 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:44 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[217525]: 2023-12-16T07:48:44.581+0000 7f4bdfcdb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:48:44.892 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:44 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049[217525]: 2023-12-16T07:48:44.581+0000 7f4bdfcdb700 -1 mon.smithi049@0(leader) e3 *** Got Signal Terminated *** 2023-12-16T07:48:45.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Dec 16 07:48:44 smithi049 bash[254283]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi049 2023-12-16T07:48:45.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi049.service' 2023-12-16T07:48:45.282 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:48:45.282 INFO:tasks.cephadm.mon.smithi049:Stopped mon.smithi049 2023-12-16T07:48:45.283 INFO:tasks.cephadm.mon.smithi133:Stopping mon.smithi133... 2023-12-16T07:48:45.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi133 2023-12-16T07:48:45.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:45 smithi133 systemd[1]: Stopping Ceph mon.smithi133 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:48:45.617 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:45 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi133[181534]: 2023-12-16T07:48:45.499+0000 7f781297e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi133 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:48:45.618 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:45 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi133[181534]: 2023-12-16T07:48:45.499+0000 7f781297e700 -1 mon.smithi133@1(peon) e3 *** Got Signal Terminated *** 2023-12-16T07:48:46.117 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Dec 16 07:48:45 smithi133 bash[212586]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-mon-smithi133 2023-12-16T07:48:46.138 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@mon.smithi133.service' 2023-12-16T07:48:46.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:48:46.207 INFO:tasks.cephadm.mon.smithi133:Stopped mon.smithi133 2023-12-16T07:48:46.208 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-16T07:48:46.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.0 2023-12-16T07:48:46.709 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:48:46 smithi049 systemd[1]: Stopping Ceph osd.0 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:48:46.709 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:48:46 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[231121]: 2023-12-16T07:48:46.419+0000 7f2385483700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:48:46.709 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:48:46 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[231121]: 2023-12-16T07:48:46.419+0000 7f2385483700 -1 osd.0 78 *** Got signal Terminated *** 2023-12-16T07:48:46.710 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:48:46 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0[231121]: 2023-12-16T07:48:46.419+0000 7f2385483700 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:48:52.459 INFO:journalctl@ceph.osd.0.smithi049.stdout:Dec 16 07:48:52 smithi049 bash[254439]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-0 2023-12-16T07:48:53.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.0.service' 2023-12-16T07:48:53.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:48:53.331 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-16T07:48:53.332 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-16T07:48:53.332 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.1 2023-12-16T07:48:53.577 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:48:53 smithi049 systemd[1]: Stopping Ceph osd.1 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:48:53.959 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:48:53 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[237731]: 2023-12-16T07:48:53.576+0000 7f2e2d98a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:48:53.959 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:48:53 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[237731]: 2023-12-16T07:48:53.576+0000 7f2e2d98a700 -1 osd.1 78 *** Got signal Terminated *** 2023-12-16T07:48:53.959 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:48:53 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1[237731]: 2023-12-16T07:48:53.576+0000 7f2e2d98a700 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:48:59.708 INFO:journalctl@ceph.osd.1.smithi049.stdout:Dec 16 07:48:59 smithi049 bash[254701]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-1 2023-12-16T07:49:00.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.1.service' 2023-12-16T07:49:00.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:49:00.472 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-16T07:49:00.472 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-16T07:49:00.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.2 2023-12-16T07:49:00.708 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:49:00 smithi049 systemd[1]: Stopping Ceph osd.2 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:49:01.209 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:49:00 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[245159]: 2023-12-16T07:49:00.728+0000 7fdfd911a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:49:01.209 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:49:00 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[245159]: 2023-12-16T07:49:00.728+0000 7fdfd911a700 -1 osd.2 78 *** Got signal Terminated *** 2023-12-16T07:49:01.209 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:49:00 smithi049 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2[245159]: 2023-12-16T07:49:00.728+0000 7fdfd911a700 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:49:06.709 INFO:journalctl@ceph.osd.2.smithi049.stdout:Dec 16 07:49:06 smithi049 bash[254962]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-2 2023-12-16T07:49:07.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.2.service' 2023-12-16T07:49:07.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:49:07.723 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-16T07:49:07.724 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-16T07:49:07.724 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.3 2023-12-16T07:49:08.117 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:49:07 smithi133 systemd[1]: Stopping Ceph osd.3 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:49:08.118 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:49:07 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[193336]: 2023-12-16T07:49:07.937+0000 7f18c29da700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:49:08.118 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:49:07 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[193336]: 2023-12-16T07:49:07.937+0000 7f18c29da700 -1 osd.3 78 *** Got signal Terminated *** 2023-12-16T07:49:08.118 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:49:07 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3[193336]: 2023-12-16T07:49:07.937+0000 7f18c29da700 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:49:13.864 INFO:journalctl@ceph.osd.3.smithi133.stdout:Dec 16 07:49:13 smithi133 bash[212734]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-3 2023-12-16T07:49:14.117 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:13 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:13.864+0000 7f6c83865700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.633269+0000 front 2023-12-16T07:48:48.633402+0000 (oldest deadline 2023-12-16T07:49:13.333339+0000) 2023-12-16T07:49:14.741 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:14 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:14.588+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:14.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.3.service' 2023-12-16T07:49:14.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:49:14.788 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-16T07:49:14.789 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-16T07:49:14.789 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.4 2023-12-16T07:49:15.047 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:14 smithi133 systemd[1]: Stopping Ceph osd.4 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:49:15.048 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:14 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:14.860+0000 7f6c83865700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.633269+0000 front 2023-12-16T07:48:48.633402+0000 (oldest deadline 2023-12-16T07:49:13.333339+0000) 2023-12-16T07:49:15.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:15 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:15.047+0000 7f6c87a6b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:49:15.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:15 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:15.047+0000 7f6c87a6b700 -1 osd.4 78 *** Got signal Terminated *** 2023-12-16T07:49:15.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:15 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:15.047+0000 7f6c87a6b700 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:49:15.867 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:15 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:15.611+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:16.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:15 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:15.904+0000 7f6c83865700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.633269+0000 front 2023-12-16T07:48:48.633402+0000 (oldest deadline 2023-12-16T07:49:13.333339+0000) 2023-12-16T07:49:16.931 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:16 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:16.633+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:17.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:16 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:16.931+0000 7f6c83865700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.633269+0000 front 2023-12-16T07:48:48.633402+0000 (oldest deadline 2023-12-16T07:49:13.333339+0000) 2023-12-16T07:49:17.931 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:17 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:17.664+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:18.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:17 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:17.931+0000 7f6c83865700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.633269+0000 front 2023-12-16T07:48:48.633402+0000 (oldest deadline 2023-12-16T07:49:13.333339+0000) 2023-12-16T07:49:18.939 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:18 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:18.681+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:19.367 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:18 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:18.939+0000 7f6c83865700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.633269+0000 front 2023-12-16T07:48:48.633402+0000 (oldest deadline 2023-12-16T07:49:13.333339+0000) 2023-12-16T07:49:20.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:19 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:19.725+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:20.117 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:19 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4[200215]: 2023-12-16T07:49:19.931+0000 7f6c83865700 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.633269+0000 front 2023-12-16T07:48:48.633402+0000 (oldest deadline 2023-12-16T07:49:13.333339+0000) 2023-12-16T07:49:21.117 INFO:journalctl@ceph.osd.4.smithi133.stdout:Dec 16 07:49:20 smithi133 bash[212996]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-4 2023-12-16T07:49:21.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:20 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:20.764+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:21.118 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:20 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:20.764+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2023-12-16T07:48:55.334032+0000 front 2023-12-16T07:48:55.334039+0000 (oldest deadline 2023-12-16T07:49:20.534397+0000) 2023-12-16T07:49:22.015 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:21 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:21.815+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:22.015 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:21 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:21.815+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2023-12-16T07:48:55.334032+0000 front 2023-12-16T07:48:55.334039+0000 (oldest deadline 2023-12-16T07:49:20.534397+0000) 2023-12-16T07:49:22.023 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.4.service' 2023-12-16T07:49:22.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:49:22.063 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-16T07:49:22.064 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-16T07:49:22.064 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.5 2023-12-16T07:49:22.305 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:22 smithi133 systemd[1]: Stopping Ceph osd.5 for 4ed9995e-9be5-11ee-95a5-87774f69a715... 2023-12-16T07:49:22.305 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:22 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:22.304+0000 7f6212d11700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-16T07:49:22.617 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:22 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:22.304+0000 7f6212d11700 -1 osd.5 78 *** Got signal Terminated *** 2023-12-16T07:49:22.617 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:22 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:22.304+0000 7f6212d11700 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-16T07:49:23.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:22 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:22.789+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:23.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:22 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:22.789+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2023-12-16T07:48:55.334032+0000 front 2023-12-16T07:48:55.334039+0000 (oldest deadline 2023-12-16T07:49:20.534397+0000) 2023-12-16T07:49:24.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:23 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:23.775+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:24.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:23 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:23.775+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2023-12-16T07:48:55.334032+0000 front 2023-12-16T07:48:55.334039+0000 (oldest deadline 2023-12-16T07:49:20.534397+0000) 2023-12-16T07:49:25.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:24 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:24.766+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:25.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:24 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:24.766+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2023-12-16T07:48:55.334032+0000 front 2023-12-16T07:48:55.334039+0000 (oldest deadline 2023-12-16T07:49:20.534397+0000) 2023-12-16T07:49:26.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:25 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:25.813+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:26.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:25 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:25.813+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2023-12-16T07:48:55.334032+0000 front 2023-12-16T07:48:55.334039+0000 (oldest deadline 2023-12-16T07:49:20.534397+0000) 2023-12-16T07:49:27.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:26 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:26.837+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2023-12-16T07:48:48.432848+0000 front 2023-12-16T07:48:48.432709+0000 (oldest deadline 2023-12-16T07:49:14.332738+0000) 2023-12-16T07:49:27.117 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:26 smithi133 ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5[207051]: 2023-12-16T07:49:26.837+0000 7f620eb0b700 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2023-12-16T07:48:55.334032+0000 front 2023-12-16T07:48:55.334039+0000 (oldest deadline 2023-12-16T07:49:20.534397+0000) 2023-12-16T07:49:28.367 INFO:journalctl@ceph.osd.5.smithi133.stdout:Dec 16 07:49:28 smithi133 bash[213258]: ceph-4ed9995e-9be5-11ee-95a5-87774f69a715-osd-5 2023-12-16T07:49:29.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4ed9995e-9be5-11ee-95a5-87774f69a715@osd.5.service' 2023-12-16T07:49:29.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-16T07:49:29.244 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-16T07:49:29.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T07:49:43.167 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-16T07:49:57.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T07:49:57.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-16T07:49:57.801 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-16T07:49:57.803 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744/remote/smithi049/crash 2023-12-16T07:49:57.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/crash -- . 2023-12-16T07:49:57.842 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T07:49:57.842 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now 2023-12-16T07:49:57.844 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744/remote/smithi133/crash 2023-12-16T07:49:57.845 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/crash -- . 2023-12-16T07:49:57.871 INFO:teuthology.orchestra.run.smithi133.stderr:tar: /var/lib/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-16T07:49:57.871 INFO:teuthology.orchestra.run.smithi133.stderr:tar: Error is not recoverable: exiting now 2023-12-16T07:49:57.872 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-16T07:49:57.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-16T07:49:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:grep: /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph.log: No such file or directory 2023-12-16T07:49:57.919 INFO:tasks.cephadm:Compressing logs... 2023-12-16T07:49:57.920 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T07:49:57.962 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T07:49:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T07:49:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:: No such file or directory 2023-12-16T07:49:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi133.takfuo.log 2023-12-16T07:49:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T07:49:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi133.takfuo.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-16T07:49:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi133.uedvhy.log 2023-12-16T07:49:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mon.smithi133.log 2023-12-16T07:49:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi133.uedvhy.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T07:49:57.992 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-16T07:49:57.992 INFO:teuthology.orchestra.run.smithi049.stderr:: No such file or directory 2023-12-16T07:49:57.993 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-16T07:49:57.993 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-16T07:49:57.993 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-16T07:49:57.993 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mon.smithi049.log 2023-12-16T07:49:57.993 INFO:teuthology.orchestra.run.smithi049.stderr:gzip /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mgr.smithi049.rqlvwo.log 2023-12-16T07:49:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mon.smithi133.log: 94.2% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi133.uedvhy.log.gz 2023-12-16T07:49:57.994 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mon.smithi049.log: /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mgr.smithi049.rqlvwo.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi049.ekquzl.log 2023-12-16T07:49:58.000 INFO:teuthology.orchestra.run.smithi133.stderr: 91.0% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T07:49:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-16T07:49:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-16T07:49:58.001 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mgr.smithi133.wbiduk.log 2023-12-16T07:49:58.002 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi049.ekquzl.log: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-16T07:49:58.002 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi049.eyimyr.log 2023-12-16T07:49:58.002 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi049.eyimyr.log: gzip -5 --verbose -- /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-16T07:49:58.006 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi049.eyimyr.log.gz 2023-12-16T07:49:58.006 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-16T07:49:58.006 INFO:teuthology.orchestra.run.smithi049.stderr: 91.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi049.ekquzl.log.gz 2023-12-16T07:49:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.5.log: /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mgr.smithi133.wbiduk.log: 88.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mgr.smithi133.wbiduk.log.gz 2023-12-16T07:49:58.226 INFO:teuthology.orchestra.run.smithi133.stderr: 92.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mon.smithi133.log.gz 2023-12-16T07:49:58.293 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mgr.smithi049.rqlvwo.log.gz 2023-12-16T07:49:58.560 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mon.smithi049.log.gz 2023-12-16T07:50:02.313 INFO:teuthology.orchestra.run.smithi133.stderr: 93.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-16T07:50:02.498 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-16T07:50:03.142 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-16T07:50:03.462 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-16T07:50:03.463 INFO:teuthology.orchestra.run.smithi049.stderr: 2023-12-16T07:50:03.463 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m5.485s 2023-12-16T07:50:03.464 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m15.510s 2023-12-16T07:50:03.464 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m0.520s 2023-12-16T07:50:03.478 INFO:teuthology.orchestra.run.smithi133.stderr: 93.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-16T07:50:04.245 INFO:teuthology.orchestra.run.smithi133.stderr: 93.5% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-16T07:51:19.708 INFO:teuthology.orchestra.run.smithi133.stderr: 92.6% -- replaced with /var/log/ceph/4ed9995e-9be5-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi133.takfuo.log.gz 2023-12-16T07:51:19.710 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-16T07:51:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:real 1m21.731s 2023-12-16T07:51:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:user 1m34.760s 2023-12-16T07:51:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m3.134s 2023-12-16T07:51:19.710 INFO:tasks.cephadm:Archiving logs... 2023-12-16T07:51:19.711 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744/remote/smithi049/log 2023-12-16T07:51:19.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T07:51:22.400 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744/remote/smithi133/log 2023-12-16T07:51:22.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T07:51:38.524 INFO:tasks.cephadm:Removing cluster... 2023-12-16T07:51:38.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 --force 2023-12-16T07:51:39.023 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 --force 2023-12-16T07:51:39.676 INFO:tasks.cephadm:Removing cephadm ... 2023-12-16T07:51:39.676 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T07:51:39.699 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-16T07:51:39.717 INFO:tasks.cephadm:Teardown complete 2023-12-16T07:51:39.718 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T07:51:39.729 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T07:51:39.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T07:51:39.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T07:51:39.834 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T07:51:39.844 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T07:51:39.845 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T07:51:39.847 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T07:51:39.864 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2023-12-16T07:51:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:bash: ntpq: command not found 2023-12-16T07:51:39.868 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T07:51:39.868 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2023-12-16T07:51:39.869 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 +444us[ +444us] +/- 73ms 2023-12-16T07:51:39.869 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -677us[ -655us] +/- 70ms 2023-12-16T07:51:39.869 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +354us[ +354us] +/- 82ms 2023-12-16T07:51:39.869 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:51:39.870 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-16T07:51:39.871 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2023-12-16T07:51:39.871 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +513us[ +510us] +/- 73ms 2023-12-16T07:51:39.871 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv02.front.sepia.ceph.com 3 7 377 7 -575us[ -579us] +/- 70ms 2023-12-16T07:51:39.871 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +433us[ +433us] +/- 82ms 2023-12-16T07:51:39.871 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-16T07:51:39.871 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T07:51:39.903 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T07:51:39.904 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T07:51:39.947 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T07:51:40.058 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-16T07:51:40.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T07:51:40.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:51:40.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-16T07:51:40.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:51:40.222 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T07:51:40.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T07:51:40.256 INFO:teuthology.task.internal:Duration was 1827.869164 seconds 2023-12-16T07:51:40.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T07:51:40.289 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T07:51:40.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T07:51:40.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T07:51:40.337 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T07:51:40.338 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-16T07:51:40.469 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T07:51:40.469 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2023-12-16T07:51:40.470 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T07:51:40.493 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-12-16T07:51:40.493 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T07:51:40.516 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T07:51:40.516 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T07:51:40.535 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T07:51:40.605 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T07:51:40.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T07:51:40.608 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T07:51:40.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T07:51:40.744 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T07:51:40.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T07:51:40.773 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T07:51:40.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T07:51:40.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T07:51:40.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T07:51:40.841 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2023-12-16T07:51:40.867 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-12-16T07:51:40.880 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T07:51:40.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:51:40.911 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T07:51:40.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T07:51:40.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T07:51:40.949 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T07:51:40.953 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744/remote/smithi049 2023-12-16T07:51:40.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T07:51:40.998 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744/remote/smithi133 2023-12-16T07:51:40.998 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T07:51:41.040 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T07:51:41.041 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T07:51:41.043 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T07:51:41.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T07:51:41.105 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T07:51:41.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T07:51:41.132 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T07:51:41.133 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T07:51:41.135 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T07:51:41.150 INFO:teuthology.orchestra.run.smithi049.stdout: 393225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 07:51 /home/ubuntu/cephtest 2023-12-16T07:51:41.152 INFO:teuthology.orchestra.run.smithi133.stdout: 393225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 07:51 /home/ubuntu/cephtest 2023-12-16T07:51:41.153 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T07:51:41.165 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T07:51:41.232 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T07:51:41.260 DEBUG:teuthology.nuke:shortname: smithi049 2023-12-16T07:51:41.260 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T07:51:41.282 DEBUG:teuthology.nuke:shortname: smithi133 2023-12-16T07:51:41.283 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T07:51:41.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 07:11:04.409909', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ4dugy2QJFLobqMO6TzJx/H/ZiQVMh1oiBX+vegqWrwLoDZWu49eUhu0vaduKw3SBjYz5Qxw13A6HFd9kHqMB8='} 2023-12-16T07:51:41.309 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 07:11:04.408307', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4G/G71C6yWsuoEs80x9yOXJCCPS8AgI9qRHKEY88t1Tls6IuPdbk0qC8eDYvKESAyWzhRREDLBZqT/Wld/Q1Y='} 2023-12-16T07:51:41.335 INFO:teuthology.orchestra.console.smithi049:Power off 2023-12-16T07:51:41.335 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T07:51:41.359 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-12-16T07:51:41.359 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T07:51:41.374 INFO:teuthology.orchestra.console.smithi133:Power off 2023-12-16T07:51:41.375 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T07:51:41.386 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-12-16T07:51:41.400 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-12-16T07:51:41.400 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T07:51:41.423 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-16T07:51:45.388 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T07:51:45.423 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T07:51:45.499 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-12-16T07:51:45.535 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-16T07:51:49.501 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T07:51:49.536 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T07:51:49.612 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-12-16T07:51:49.646 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-16T07:51:49.714 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-12-16T07:51:53.650 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T07:51:53.761 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-12-16T07:51:53.862 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-12-16T07:51:53.967 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1827.8691635131836 failure_reason: 'Command failed on smithi049 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ed9995e-9be5-11ee-95a5-87774f69a715 -e sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a3d11575f5e0450dbe5fa0af4322a05a status: fail success: false 2023-12-16T07:51:53.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T07:51:54.050 INFO:teuthology.run:FAIL