[rdiff-backup-users] Re: --override-chars-to-quote ?

[Morgan Read]

Andrew Ferguson wrote:
> Morgan Read wrote:
>> When backing up to an ntfs/windows system (from ext3 with acl and ea)
>> what are the (detrimental) consequences of using
>> "--override-chars-to-quote".
> 
> Morgan,
> 
> The detrimental effect is that if you have both 'developer.doc' and
> 'Developer.doc' in the same directory on the ext3 side, then you will be
> in for trouble when you backup to ntfs/windows. Since Windows
Andrew

Thanks for coming back on such a lame question - talk about he bleedin'
obvious, embarrassing - sorry!

But, this leads on to another question and some answers:

Obviously, --override-chars-to-quote is not the best solution.  And, the
problem...
...
>> Maintaining ’Developer.doc’ as ’Developer.doc’ instead of
>> ’;068eveloper.doc’ will significantly cut down the length of some path
>> names which are causing problems with windows/ntfs path name
>> limitations.  (Not to mention keeping a mirror that is more a 'mirror'.)
> 
> Interesting. What are the ntfs path name limitations? Are you running
> into a max length for filenames or a max length for path names?
I have some deep paths, particularly on some old study where I
downloaded some web-sites for reference.  I've seen reference to ntfs
not handling "relative" paths names longer that 255/256/260 (depending
on the reference, though absolute path names seem to allow 32k name
lengths?!).  I noticed rdiff-backup was failing with some sort of "OS
Error" with something about paths being too long  (see bottom).  So, I
turned those deep paths into an archive (I don't reference them much any
more) and rdiff-backup seemed to fail less - so, I figured I'd found at
least one bug.  But, I still get some fails some times with reference to
path lengths and I use both upper and lower case in my file/path names,
(see output bottom for more recent output of failure) so figured
removing quoting of upper case characters would help path/name length
(and as a bonus give a more meaningful 'mirror').

A better solution (than, --override-chars-to-quote)?  It seems possible
to "turn on" case sensitivity on ntfs, see here:
http://cygwin.com/cygwin-ug-net/using-cygwinenv.html
http://support.microsoft.com/kb/817921
http://support.microsoft.com/kb/929110

Cygwin is effectively SFU?  So, turning the win reg key
HKLM\SYSTEM\CurrentControlSet\Control\Session Manager\kernel\
dword:ObCaseInsensitive to 0 would be a better way of achieving cygwin's
"check_case:strict" (which is depreciated).  And then, would
rdiff-backup auto-detect the support of case-sensitivity?  Or, would
then --override-chars-to-quote be appropriate to use?

Regards,
Morgan.

THIS ONE MAY BE CONNECTED?:
address@hidden ~]$ sudo rdiff-backup --include-symbolic-links
--print-statistics --include-globbing-filelist
~/.rdiff-backup_include-list / address@hidden::/cygdrive/c/BU1
address@hidden's password:
UpdateError home/morgan/.thunderbird/p0axlukx.default/Mail/Local
Folders/Junk.msf Updated mirror temp file
/cygdrive/c/BU1/home/morgan/.thunderbird/p0axlukx.default/;077ail/;076ocal
;070olders/rdiff-backup.tmp.9230 does not match source
Read from remote host MOZSMACHINE: Connection reset by peer
Fatal Error: Lost connection to the remote system
address@hidden ~]$

THIS ONE SHOWS NAME LENGTH PROBLEMS:
address@hidden ~
$ rdiff-backup /cygdrive/c/"Documents and Settings"/morgan/
/cygdrive/c/"Docume
nts and Settings"/"All Users"/Documents/rdiff-backupTest
Exception '[Errno 91] File name too long: '/cygdrive/c/Documents and
Settings/Al
l Users/Documents/rdiff-backupTest/My
Documents/rdiff-backup_morgansmachine/home
/.;059084rash-root/testbackup
(copy)/home/olwyn/.gconf/system/networking/wireles
s/networks/19;059067larke;059082oad_dd-wrt/rdiff-backup.tmp.7952''
raised of cla
ss '<type 'exceptions.OSError'>':
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
299, in err
or_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
319, in Mai
n
    take_action(rps)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
275, in tak
e_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
341, in Bac
kup
    backup.Mirror(rpin, rpout)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
38, in Mi
rror
    DestS.patch(dest_rpath, source_diffiter)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
218, in p
atch
    ITR(diff.index, diff)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rorpiter.py", line
281, in
 __call__
    last_branch.fast_process(*args)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
514, in f
ast_process
    tf = TempFile.new(mirror_rp)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/TempFile.py", line
36, in
new
    return new_in_dir(rp_base.get_parent_rp())
  File "/usr/lib/python2.5/site-packages/rdiff_backup/TempFile.py", line
46, in
new_in_dir
    tf = dir_rp.append('rdiff-backup.tmp.%d' % _tfindex)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rpath.py", line
1007, in a
ppend
    return self.__class__(self.conn, self.base, self.index + (ext,))
  File
"/usr/lib/python2.5/site-packages/rdiff_backup/FilenameMapping.py", line
126, in __init__
    rpath.RPath.__init__(self, connection, base, self.quoted_index, data)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rpath.py", line
747, in __
init__
    else: self.setdata()
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rpath.py", line
771, in se
tdata
    self.data = self.conn.C.make_file_dict(self.path)

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 23, in <module>
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
299, in err
or_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
319, in Mai
n
    take_action(rps)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
275, in tak
e_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
341, in Bac
kup
    backup.Mirror(rpin, rpout)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
38, in Mi
rror
    DestS.patch(dest_rpath, source_diffiter)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
218, in p
atch
    ITR(diff.index, diff)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rorpiter.py", line
281, in
 __call__
    last_branch.fast_process(*args)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
514, in f
ast_process
    tf = TempFile.new(mirror_rp)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/TempFile.py", line
36, in
new
    return new_in_dir(rp_base.get_parent_rp())
  File "/usr/lib/python2.5/site-packages/rdiff_backup/TempFile.py", line
46, in
new_in_dir
    tf = dir_rp.append('rdiff-backup.tmp.%d' % _tfindex)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rpath.py", line
1007, in a
ppend
    return self.__class__(self.conn, self.base, self.index + (ext,))
  File
"/usr/lib/python2.5/site-packages/rdiff_backup/FilenameMapping.py", line
126, in __init__
    rpath.RPath.__init__(self, connection, base, self.quoted_index, data)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rpath.py", line
747, in __
init__
    else: self.setdata()
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rpath.py", line
771, in se
tdata
    self.data = self.conn.C.make_file_dict(self.path)
OSError: [Errno 91] File name too long: '/cygdrive/c/Documents and
Settings/All
Users/Documents/rdiff-backupTest/My
Documents/rdiff-backup_morgansmachine/home/.
;059084rash-root/testbackup
(copy)/home/olwyn/.gconf/system/networking/wireless/
networks/19;059067larke;059082oad_dd-wrt/rdiff-backup.tmp.7952'

address@hidden ~
$
-- 
Morgan Read
NEW ZEALAND
<mailto:mstuffATreadDOTorgDOTnz>

fedora: Freedom Forever!
http://fedoraproject.org/wiki/Overview

"By choosing not to ship any proprietary or binary drivers, Fedora does
differ from other distributions. ..."
Quote: Max Spevik
       http://interviews.slashdot.org/article.pl?sid=06/08/17/177220

RMS on fedora:
       http://fedoraproject.org/wiki/FreeSoftwareAnalysis/FSF

signature.asc
Description: OpenPGP digital signature