Slow copying to Vero attached HDD

Hello everyone,

can someone tell me why transferring files to the Vero connected HDD maxes out at 2,60mb/s?

1- using USB 3.0 Hub
2- HDD mounted as SMB Share
3- no VPN connection active
4- happens with files from the Smartphone and PC

A 5 Gb file takes over 30 Minutes to copy :confused:

Thanx

How is the hard drive formatted?
Avoid using NTFS if you can.

How is the plain network throughput?
How long does copying from the Vero4k emmc to the USB drive take?

THX for the replies

I think it came pre formatted in NTFSā€¦ What Format should i use? I need to copy big files, so FAT32 is out of question.

I have a 20mbit upload connection

Donā€™t know how the Speed from emmc to HDD is since emmc is not accessible to meā€¦

Emmc properties has 4 Folders (movies, musicā€¦) and properties/size says ā€œN/Aā€ :confused:

If you only want to use it connected to the Vero (and shared via SMB to other devices) than use ext4 as format.
If you from time to time also physically want to connect it to a windows machine than use exFAT.

I assume that is your internet connection and not the Wifi speed in your LAN, or? If it is your wifi speed than that would explain the slow speed.

The /home/osmc/ folder is on the emmc and is shared and accesiable via samba.
But to test the speed from the emmc to the USB drive directly you would need to ssh into the Vero and transfer the file manually.

Yes, i need it also to be connected to a Windows machine.

I have a 150 down/ 20 up connection at home. Tests on Speedtest confirm even more (156/22), so the connection Speed is not the issue here.

Yes, i am able to acess the home folder but canā€™t to anything with it. Even checking the Size of the emmc says N/A.

Btw, backups fail saying that there is not enough space, even tho i have over 2 TB free on my HDD

THX for the help so far

These internet connection speeds have nothing to do with the speed between two devices that are in the same location. The speed between your devices on the local LAN is what is important. You can check speeds on the LAN with something like iperf3 (forum search will be useful to find examples.)

THX for the answer.

I will try that iperf3 thing if i manage to find a decent guide, iā€™m a Linux noob.

But i really donā€™t think that is the issue here. I have a rpi3 and updates on it are blazing fast.
On the Vero updates over SSH take 2/3 minutes.

So somehow connecivity to the Vero is really slow.

Also the internal memory of the Vero is hidden, have to do ā€œls -aā€ to See the drive structure, and my backups also fail to the HDD saying there is not enough space (over 2Tb free).

So my guess it has something to do with permissions.

Cheers

Iā€™ve read this thread from top to bottom and I canā€™t even figure out if youā€™re using WiFi or wired or if this is a Vero 4K or a 4K plus. To provide a bit more clarity can you please run grab-logs -A from the command line (with the HDD attached) and let us know the URL.

Hello dillthedog

The Vero 4K+ i have is cable connected. Sorry for not mentioning that.

Here is the log:

https://paste.osmc.tv/odutiqazum

Cheers

4K + devices pass: revision=4kplus on kernel cmdline from bootloader.

Hey Sam

Was that directed at me? That sounded like chinese to me :see_no_evil: could you please explain what i should do?

Thank you

The log shows that your Vero4K+ tries twice to connect to the router and succeeds only on the second try. After that it seems to be ok.

I see that you have already installed iperf3 on the Vero, so you need to check network performance between it and your PC. See [How To] Check Network Performance with iperf3

You also need to see how the disk performs locally. A simple command should give us an idea of the write speed:

time dd if=/dev/urandom of="/media/Seagate Backup Plus Drive/zzz.tmp" bs=8M count=100 oflag=direct

This will write 800 MB of random data to a single file on the USB drive. You can then remove the file.

thx dillthedog for looking into that enormous log file :pensive:

what might be the issue to cause the vero to connect 2 times to the router? i have a static ip address for the vero

i will look into the iperf3 thing, and let you know later

as for the 800MB file, i did what you asked and this was the result:

100+0 records in
100+0 records out
838860800 bytes (839 MB, 800 MiB) copied, 181.388 s, 4.6 MB/s

real 3m5.427s
user 0m0.000s
sys 2m55.550s

when i connect the HDD directly to the usb 3.0 port on my PC i get speeds of over 100Mb/s.

EDIT: the iperf3 test does not work. i installed iperf3 on my android phone, enabled the server, but the vero says it canā€™t connect to the server.

canā€™t install it on my windows PC since there are only 2 files inside the downloaded folder, that donā€™t to anything. i double click on iperf3.exe and try to connect but get the response: canā€™t connect to server. connection timed out

any advice here?

cheers

Mario Pedro

I made a mistake with the command I gave and overestimated the speed of /dev/urandom.

Try it again with /dev/zero:

time dd if=/dev/zero of="/media/Seagate Backup Plus Drive/zzz.tmp" bs=8M count=100 oflag=direct

If youā€™re having iperf3 problems, Iā€™d suggest that you try using OSMC as the iperf3 server and the PC, which I assume is running a version of Windows, as the client.

OK dillthedog,

will try the new command and using the Vero as the Server once i get home.

Any clue on why the Vero has to connect 2 times to the Router or why it says that there is no space for a Backup (over 2Tb still available on the HDD)?

Thank you

Mario Pedro

@dillthedog

i tried both iperf3 commands today and now they work :slight_smile:

result from iperf3 -R -c :

[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 18.0 MBytes 151 Mbits/sec
[ 4] 1.00-2.00 sec 29.8 MBytes 250 Mbits/sec
[ 4] 2.00-3.00 sec 29.9 MBytes 250 Mbits/sec
[ 4] 3.00-4.00 sec 28.7 MBytes 241 Mbits/sec
[ 4] 4.00-5.00 sec 27.6 MBytes 231 Mbits/sec
[ 4] 5.00-6.00 sec 29.0 MBytes 244 Mbits/sec
[ 4] 6.00-7.00 sec 29.2 MBytes 245 Mbits/sec
[ 4] 7.00-8.00 sec 29.7 MBytes 249 Mbits/sec
[ 4] 8.00-9.00 sec 28.7 MBytes 241 Mbits/sec
[ 4] 9.00-10.00 sec 28.7 MBytes 241 Mbits/sec


[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 280 MBytes 235 Mbits/sec sender
[ 4] 0.00-10.00 sec 280 MBytes 235 Mbits/sec receiver

iperf Done.

Results from iperf3 -c :

[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 4.93 MBytes 41.3 Mbits/sec 2 206 KBytes
[ 4] 1.00-2.00 sec 6.96 MBytes 58.4 Mbits/sec 2 269 KBytes
[ 4] 2.00-3.01 sec 8.74 MBytes 72.9 Mbits/sec 5 267 KBytes
[ 4] 3.01-4.00 sec 20.0 MBytes 168 Mbits/sec 0 301 KBytes
[ 4] 4.00-5.00 sec 25.0 MBytes 210 Mbits/sec 0 322 KBytes
[ 4] 5.00-6.00 sec 23.3 MBytes 195 Mbits/sec 0 332 KBytes
[ 4] 6.00-7.01 sec 25.3 MBytes 211 Mbits/sec 0 337 KBytes
[ 4] 7.01-8.00 sec 25.1 MBytes 211 Mbits/sec 0 338 KBytes
[ 4] 8.00-9.00 sec 24.9 MBytes 209 Mbits/sec 0 356 KBytes
[ 4] 9.00-10.00 sec 25.7 MBytes 215 Mbits/sec 0 370 KBytes


[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 190 MBytes 159 Mbits/sec 9 sender
[ 4] 0.00-10.00 sec 188 MBytes 158 Mbits/sec receiver

iperf Done.

here again the 800MB file log with the new command:

100+0 records in
100+0 records out
838860800 bytes (839 MB, 800 MiB) copied, 20.6513 s, 40.6 MB/s

real 0m20.680s
user 0m0.030s
sys 0m0.810s

hope this is ok.

cheers

Mario Pedro

Before I comment on the iperf3 figures, could you confirm that they are with the Vero4K+ as the server? And what was the client: a wired Windows PC, or something else?

The disk write is faster than I was expecting, so I donā€™t think the NTFS overhead is an issue in this case.

You also mention a space problem with a backup. Unfortunately, I can see no details of the backup mentioned in this thread but I would assume that it is being written to a location with little space.

Edit: fixed typo.

@dillthedog,

thank you again for looking into this.

I can confirm that the Vero ist connected to the Router with a cable. The device to test iperf3 was my Android phone.

Why?

First because the supposed Installation files for iperf3 on Windows are an exe file which does nothing when i double click on it, and a DLL file.

And second because on my Phone i can also only transfer files at 2,90mb/s max to my vero, as it happens on the windows PC.

I can also confirm that i did both commands as told in the instruction link you send me: one Vero as Server, the other the Phone.

As for the backup:

I specified my backup folder on the HDD which has 2Tb space available. Space is really not the issue hereā€¦ I could execute a manual backup for you to See the error on the log.

Is that OK?

Cheers

Mario Pedro

You need to run it from the terminal / command line (cmd.exe). Make sure the exe and dll are in the same directory, cd to that directory and run it like you would in Linux.

Iā€™ll see if I can see anything in the log about the backup problem.