Message-ID: <20210817065210.iposihe4yuutfijy@hazard.jcu.cz>
Date:   Tue, 17 Aug 2021 08:52:10 +0200
From:   Jan Marek <jmarek@....cz>
To:     linux-kernel@...r.kernel.org
Cc:     regressions@...ts.linux.dev
Subject: [REGRESSION][BISECTED] Corrupted files on CIFS in 5.x kernels

Hello lkml,

I've did a bisect to find 'bad' commit, and I've found, that problem
commit is:

# first bad commit: [e8506d25f740fd058791cc12a6dfa9386ada6b96] smb3: make default i/o size for smb3 mounts larger

It seems, that problem is somewhere in cifs?

Detailed information about mounting this cifs filesystem:

fstab:

//some.machine/jmarek       /mnt/smb   cifs    _netdev,credentials=/etc/cred_file,forceuid,forcegid,uid=root,gid=root,vers=1.0 3 0

some.machine runs Samba (sorry, I don't know, which version,
server administrator is just now on vacancy).

Questions are welcome.

I can test patches, if you will need.

Sincerely
Jan Marek

Dne Čt, srp 12, 2021 at 08:45:42 CEST napsal Jan Marek:
> Hello lkml,
> 
> I have problem with two "network" filesystems in 5.x kernels.
> 
> I've Debian Buster server with Postfix and Dovecot, users have
> Maildir mailboxes on CEPHfs. Backup of these mailboxes are making
> by the borgbackup to the remote machine, using CIFS.
> 
> Debian Buster have "normal" distro kernel v. 4.19 (in my case
> 4.19.194-3), which works fine. I've tried to use kernel from
> buster-backports, linux-image-5.10.0-0.bpo.8-amd64, which is
> 5.10.46-2~bpo10+1.
> 
> From time of booting this kernel, I've problems with massive corruption
> of dovecot index files on CEPHfs. I've tried to set up dovecot in
> the similar manner, as for NFS filesystem, although mailboxes are not
> sharing by multiple machines, but it not works.
> 
> As the second problem, I've cannot do borg backup of mailboxes to
> CIFS directory - borgbackup had problem with corrupted archives.
> 
> When I reboot back to 4.19.194-3, problems disappeared.
> 
> I've tried to reproduce from my work computer, where I have
> Debian Buster and kernel 5.12.0-19.2-liquorix-amd64, which is
> 5.12-28.1~buster, and there is the same problem with CIFS
> filesystem and borg backup. You can easily reproduce it:
> 
> 1) mount CIFS filesystem
> 2) make directory on it
> 3) try to init borg archive direcory from this directory
> 
> In my case:
> 
> mount /mnt/smb
> cd /mnt/smb/tmp
> mkdir tmp
> borg init -e none tmp
> 
> I've got this (the same problem, as on email machine):
> Inconsistency detected. Please run "borg check /mnt/smb/tmp/tmp" - although likely this is "beyond repair".
> Traceback (most recent call last):
>   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4455, in main
>     exit_code = archiver.run(args)
>   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4387, in run
>     return set_ec(func(args))
>   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 154, in wrapper
>     return method(self, args, repository=repository, **kwargs)
>   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 276, in do_init
>     with Cache(repository, key, manifest, warn_if_unencrypted=False):
>   File "/usr/lib/python3/dist-packages/borg/cache.py", line 380, in __new__
>     return local()
>   File "/usr/lib/python3/dist-packages/borg/cache.py", line 374, in local
>     lock_wait=lock_wait, cache_mode=cache_mode)
>   File "/usr/lib/python3/dist-packages/borg/cache.py", line 467, in __init__
>     self.sync()
>   File "/usr/lib/python3/dist-packages/borg/cache.py", line 851, in sync
>     self.chunks = create_master_idx(self.chunks)
>   File "/usr/lib/python3/dist-packages/borg/cache.py", line 786, in create_master_idx
>     master_index_capacity = int(len(self.repository) / ChunkIndex.MAX_LOAD_FACTOR)
>   File "/usr/lib/python3/dist-packages/borg/repository.py", line 1009, in __len__
>     self.index = self.open_index(self.get_transaction_id())
>   File "/usr/lib/python3/dist-packages/borg/repository.py", line 376, in get_transaction_id
>     self.check_transaction()
>   File "/usr/lib/python3/dist-packages/borg/repository.py", line 365, in check_transaction
>     raise self.CheckNeeded(msg)
> borg.repository.Repository.CheckNeeded: Inconsistency detected. Please run "borg check /mnt/smb/tmp/tmp" - although likely this is "beyond repair".
> 
> Platform: Linux hazard 5.12.0-19.2-liquorix-amd64 #1 ZEN SMP PREEMPT liquorix 5.12-28.1~buster (2021-07-22) x86_64
> Linux: debian 10.10
> Borg: 1.1.9  Python: CPython 3.7.3
> PID: 3320  CWD: /mnt/smb/tmp
> sys.argv: ['/usr/bin/borg', 'init', '-e', 'none', 'tmp']
> SSH_ORIGINAL_COMMAND: None
> 
> You can try repair this archive directory, but it didn't happend:
> 
> borg check tmp
> 
> Data integrity error: Invalid segment entry size 0 - too small [segment 1, offset 17]
> Completed repository check, errors found.
> 
> On local filesystems, there is no problem, everythink works fine
> - tested on ext4, JFS and XFS.
> 
> It seems, there is problem with caching of this filesystems?
> 
> Questions are welcome.
> 
> Sincerely
> Jan Marek
> -- 
> Ing. Jan Marek
> University of South Bohemia
> Academic Computer Centre
> Phone: +420389032080
> http://www.gnu.org/philosophy/no-word-attachments.cs.html



-- 
Ing. Jan Marek
University of South Bohemia
Academic Computer Centre
Phone: +420389032080
http://www.gnu.org/philosophy/no-word-attachments.cs.html

Download attachment "signature.asc" of type "application/pgp-signature" (229 bytes)

Powered by blists - more mailing lists