-
-
Notifications
You must be signed in to change notification settings - Fork 4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HDFS remote fails to copy file with " Received error: unexpected EOF" #7827
Comments
Ah
|
My guess would be that rclone is connecting to that node and being immediately rejected due to some firewalling/auth/other problem. Perhaps you can wireshark it to get some insight? It would be worth trying the latest beta - I don't think it will behave any differently but it is worth a try. |
Hi, I don't think it is a firewall issue, in principle the ports are open. I can get a tcpdump dump, but I'm unable to analyze it. I'm not very experienced in Wireshark and it all seems garbage to me :/ Is there a docker image with kerberos that I can test? |
The library that rclone uses has a command line client - maybe you could give that a try? Also it says this
Now that doesn't mean a lot to me, but it might be worth trying with rclone.
The docker image we use for testing rclone/test-hdfs supports kerboros |
I works with the command line client :(
|
Hi,
I've configured the latest version of rclone to interface with our Hadoop cluster.
Running on one of the nodes of the cluster I can ls, mkdir and rmdir, but I cannot upload files to HDFS.
I'm using Kerberos.
The config:
The tests:
But...
If I increase the verbosity:
I can upload the file using the native client:
When looking at the namenode logs, I don't see anything strange:
Any idea what is going on here?
I'm happy to provide more debugging info :)
The text was updated successfully, but these errors were encountered: