-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
External file scanning error #28181
Comments
Most likely a duplicate of #28031 . That one is still open but was solved by the OP by setting the correct permissions. |
I saw that but as I said i ran the Strong Perm script, every files are www-datat owned... |
Just keep in mind that if this is an external mounted storage (like NTFS) the permission script won't help here and might break more stuff then it solves. |
I see. However my data folder is on the same server on the same part just in another folder. I have a clue : The file where the script fail are files with UTF8 character like "é à ê" etc Maybe the buffer isn't made to handle very large strings due to UTF8 characters ? |
I performed a short test. |
In my case it works for SFTP with OC 10.0.3RC1 :
|
I'm using SFTP with OC 10.0.3.2 and am getting the same error (Undefined index: size) when it tries to scan a folder named "Rīgas Doma zēnu koris". Also:
The scan was able to proceed after renaming these files. -- The scan also produced the same error when it hit a dead symlink in the SFTP directory. Fixing the symlink let the scan complete. |
@IljaN didn't you observe something similar ? |
@stuporglue However - the issue with the filenames is not yet addressed @IljaN |
@stuporglue / @yakuraku Could you please provide the sshfs line which is used to mount the directory? |
Unless OwnCloud sets up sshfs automatically, I don't think I'm using sshfs. I think it's just using sftp. I enabled External Storage and set up the shares as the admin. Users aren't allowed to mount external storage. I chose "SFTP" as the storage type, and used "RSA public key" as the auth method. I created an "owncloud_sftp" user on my remote machine. I let OwnCloud generate the SSH key, then added the generated key to |
@stuporglue Seems SFTP + keypair mode currently doesn't work at all according to #28669 and https://doc.owncloud.org/server/latest/admin_manual/release_notes.html#changes-in-10-0-3 |
Yes, i applied the temp fix in this comment
#28669 (comment)
And it's working for me, except for files with certain characters. I've
renamed my files though so this isn't affecting me anymore at the moment.
…--
Michael
On Sunday, October 1, 2017, kdslkdsaldsal ***@***.***> wrote:
@stuporglue <https://github.com/stuporglue> Seems SFTP + keypair mode
currently doesn't work at all according to #28669
<#28669> and
https://doc.owncloud.org/server/latest/admin_manual/
release_notes.html#changes-in-10-0-3
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#28181 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AABAwIBiDwZx2-Zw7JvNIgT2UNRsKIsyks5sn6-EgaJpZM4OA3FJ>
.
|
Can you tell me, if you have php-intl installed/enabled? If it is missing - could you try installing / enabling php-intl and check if the error would still occur? |
@patrickjahns Sorry for the delay responding here. I do have php-intl installed.
And here's the relevant part of
|
Can you guys check the database collations ? DB collation, table and column collations. They all should say something like utf8. |
Thanks for looking into this. I'm using Postgres. Default collation is UTF-8...
And there aren't any tables which override that.
|
Assigning to @patrickjahns who was trying to reproduce this, with no success so far. |
PR to bring back the warning: #29845 |
I have the same problem, i.e. the file scanner crashes, and the "problem" files which exist on the smb external storage, dosen't appear on the owncloud side. From what I read above enabling the Mac compatibility in the external storage should have resolved the issue(? did I understand wrong?) Here is the owncloud.log content:
And here is a zip with a file with a name that issued the error message: |
Hey, this issue has been closed because the label (This is an automated comment from GitMate.io.) |
Short Braindump of my analysis: `sudo -uwww-data ./occ files:scan --repair OCLogonUser +---------+-------+--------------+
` +---------+-------+--------------+ please reformat anybody my post. i have no clue how to do that! |
Please apply the patch from #30302 to make the "Undefined index" error disappear. Maybe a more useful message will appear. Please also try setting the options for the external storage to use the encoding compatibility mode. You likely have files which names are encoded with UTF-8 NFD. |
I had the same issue with owncloud-10.0.7 with external storage hooked up using SFTP. What did the trick for me was mass converting my files using a linux package named convmv: |
no time to finish this, moving to planned for next |
The error will be gone and scanning will go forward. However the NFD error message is still missing. |
@PVince81 It is a bit tricky to add a message because on a low-level php can`t read the metadata (size) of the file, AFAIR there are different conditions which can lead to this so we would need some reliable way to detect NFD-Filenames beforehand. But need to dig deeper again to have the proper context for this problem. |
Hi, I've made a temporary fix for this issue in /var/www/owncloud/lib/private/Files/Cache/Scanner.php and before Line 424, added a line as: It is fixed the error and scanning continue.. |
The line numbers look out-of-date compared to current PR https://github.com/owncloud/core/pull/32408/files did some changes there in 2018. @COArikan what version of ownCloud are you running? Can you make a PR to |
This issue has been automatically closed. |
Hi ! Just having this error : I tried to fix perms with the strong perm script. I also tried to use update perms but it didn't change anything.
Thank you
Steps to reproduce
Expected behaviour
Scan should complete
Actual behaviour
Server configuration
Operating system:
Debian 8
Web server:
Apache 2.4.10
Database:
mysql Ver 14.14 Distrib 5.5.55, for debian-linux-gnu (x86_64) using readline 6.3
PHP version:
PHP 5.6.30-0+deb8u1
ownCloud version: (see ownCloud admin page)
10.0.2.1
Updated from an older ownCloud or fresh install:
Upgrade from OC 9 (latest one)
Where did you install ownCloud from:
Package
Signing status (ownCloud 9.0 and above):
No error
The content of config/config.php:
List of activated apps:
Enabled:
Disabled:
Are you using external storage, if yes which one: local/smb/sftp/...
Are you using encryption: no
a) The javascript console log
b) The network log
c) ...
The text was updated successfully, but these errors were encountered: