Bug report: Restore Backup issue with file names in cyrillic (non ascii)

[wattie]

When I restore backup which contains file names that include non-ascii symbols, here is what happens (they get replaced with ?'s):

-rw-r--r-- 1 73360 Jul 29 2015 ?????-730x350.jpg
-rw-r--r-- 1 86048 Jul 29 2015 ?????-800x350.jpg
-rw-r--r-- 1 95080 Jul 29 2015 ?????-800x380.jpg
-rw-r--r-- 1 93484 Jul 29 2015 ?????-8?4-?-GR.I181-730x350.jpg
-rw-r--r-- 1 115505 Jul 29 2015 ?????-8?4-?-GR.I181-800x350.jpg
-rw-r--r-- 1 123860 Jul 29 2015 ?????-8?4-?-GR.I181-800x380.jpg
-rw-r--r-- 1 190122 Jul 29 2015 ?????-8?4-?-GR.I181.jpg
-rw-r--r-- 1 65183 Jul 29 2015 ?????-?-??-????-??-??????????????-2-730x350.jpg
-rw-r--r-- 1 81395 Jul 29 2015 ?????-?-??-????-??-??????????????-2-800x350.jpg
-rw-r--r-- 1 87069 Jul 29 2015 ?????-?-??-????-??-??????????????-2-800x380.jpg
-rw-r--r-- 1 116691 Jul 29 2015 ?????-?-??-????-??-??????????????-2.jpg
-rw-r--r-- 1 83771 Jul 29 2015 ?????-?-??-????-??-??????????????-730x350.jpg
-rw-r--r-- 1 105007 Jul 29 2015 ?????-?-??-????-??-??????????????-800x350.jpg
-rw-r--r-- 1 113192 Jul 29 2015 ?????-?-??-????-??-??????????????-800x380.jpg
-rw-r--r-- 1 164987 Jul 29 2015 ?????-?-??-????-??-??????????????.jpg
-rw-r--r-- 1 89611 Jul 29 2015 ?????-?-??-?????????-730x350.jpg
-rw-r--r-- 1 113556 Jul 29 2015 ?????-?-??-?????????-800x350.jpg
-rw-r--r-- 1 121807 Jul 29 2015 ?????-?-??-?????????-800x380.jpg
-rw-r--r-- 1 163647 Jul 29 2015 ?????-?-??-?????????.jpg
-rw-r--r-- 1 67669 Jul 29 2015 ?????-?-?VC-????-??-??????????????-730x350.jpg
-rw-r--r-- 1 82894 Jul 29 2015 ?????-?-?VC-????-??-??????????????-800x350.jpg
-rw-r--r-- 1 91028 Jul 29 2015 ?????-?-?VC-????-??-??????????????-800x380.jpg
...

It looks like it is a bug with the Restore function, not with the backup one, because... screenshot attached.

I am using FreeBSD 11, DA version 1.51.1.

P.S. The letters on the screenshot are not cyrillic either, they are shown in some weird encoding - that's a bug with the archiver program that I am using to open the file... but at least the filenames are not ???-s.

 

[zEitEr]

Hello,

Did you backup and restore files on the same server? Or moved to another server?

If you move backups between server, what if you backup the files manually with tar on a source server and unpack them in a target server. Will they unpack with correct names?

What cyrillic sets do you use: koi8-r, windows-1251, or utf-8?

 

[wattie]

It's a restore on another server; however the DA versions are the same. Older is FreeBSD 9.1, newer is FreeBSD 11.

I did move the files through FTP and it worked. I'll test it with tar.gz later today too.

Regarding your question about the encoding of the filenames - I actually have no idea and I am unsure how to find that. It's not the encoding of the file data, it's the encoding of the filename.

 

[zEitEr]

Your console should support the charset in order to display the filenames correct. If the old server is using koi8-r and new is configured to use utf-8 then you might see the issue with filenames.

 

[wattie]

After quick search, the FreeBSD console is not UTF8 by default so no matter if the files are correct (when I transfer them from FTP they are working fine) or not, they will always show in the console as ???s.

P.S. Now I added:

me:\
:charset=UTF-8:\
:lang=en_US.UTF-8:\
:setenv=LC_COLLATE=C:

in ~/.login_conf and I can see the filenames in the console fine. So they are indeed UTF8 encoded (on both servers). They are packed correctly in the .tar.gz file and are (for some reason) not unpacked correctly.

 

[wattie]

Now I did backup and immediately restore on the same (FreeBSD 11) server and the filenames are not messed up - they are fine.

I next did backup from the old server and restored again on the new one - they are broken.

I guess it's a matter of some differences between 9 and 11...