# Migrate 1 tera data

**URL:** <https://help.nextcloud.com/t/migrate-1-tera-data/102648>\
**Category:** ℹ️ Support\
**Created:** [December 29, 2020, 1:36pm UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648 "2020-12-29T13:36:02Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![jtdoank](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jtdoank/32/31994_2.png) [@jtdoank](https://help.nextcloud.com/u/jtdoank)\
**Post date:** [December 29, 2020, 1:36pm UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/1 "2020-12-29T13:36:02Z")

</div>

Hi all,  
i have and letsay consider 1 tera data from my nextcloud server, now i am migrate to another server.

i am using rsync

`rsync -a -P -e "ssh -T -c aes128-ctr -o Compression=no -x" source/ user@x.x.x.x:/destination`

it seems that takes more than 2 days not finish it yet  
any suggestion from all you  
i am open and welcome for any suggestion

thanks all

---

<div class="post-metadata">

**Author:** ![jtdoank](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jtdoank/32/31994_2.png) [@jtdoank](https://help.nextcloud.com/u/jtdoank)\
**Post date:** [December 30, 2020, 2:37am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/2 "2020-12-30T02:37:51Z")

</div>

anyone perhaps got other idea?

---

<div class="post-metadata">

**Author:** ![wwe](https://help.nextcloud.com/user_avatar/help.nextcloud.com/wwe/32/72963_2.png) [@wwe](https://help.nextcloud.com/u/wwe)\
**Post date:** [December 30, 2020, 8:58am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/3 "2020-12-30T08:58:42Z")

</div>

raw copy of 1TB takes 22 hours at **constant** speed of 100MBit/s [https://calculators.io/bandwidth/](https://calculators.io/bandwidth/) Depending on your hardware and bandwidth 2 days sounds not really bad. I would expect big files like archives or media to transfer at maximum speed. small files like text or thumbnails are much slower.

If you have physical access to both hosts you could ship the data by external USB drive - this _may_ happen faster… depending on the kind of your data this could take long time as well and you need to copy the data twice (from original host to the drive and from the drive to destination host). If you got the data replicated to you local client you could upload this to new host from there - again subject to hardware and bandwidth limits.

---

<div class="post-metadata">

**Author:** ![tflidd](https://help.nextcloud.com/letter_avatar/tflidd/32/6_22734026db12803ebb3e059622ac3534.png) [@tflidd](https://help.nextcloud.com/u/tflidd)\
**Post date:** [December 30, 2020, 9:11am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/4 "2020-12-30T09:11:29Z")

</div>

Why don’t you use compression? Except for already compressed file formats, this can speed up the transfer: [https://unix.stackexchange.com/questions/188737/does-compression-option-z-with-rsync-speed-up-backup](https://unix.stackexchange.com/questions/188737/does-compression-option-z-with-rsync-speed-up-backup)

---

<div class="post-metadata">

**Author:** ![jtdoank](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jtdoank/32/31994_2.png) [@jtdoank](https://help.nextcloud.com/u/jtdoank)\
**Post date:** [December 30, 2020, 9:49am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/5 "2020-12-30T09:49:39Z")

</div>

Glad to hear from you @wwe  
thanks buddy  
finally after 3,5 days the file transfer finish

for replicate, ehm…i think is possibble but i serve nextcloud services to my client  
so is not possible asking them to re-upload, hehehe…seem not quite profesional isn’t 😁✌

anyway glad to hear somebody help me

---

<div class="post-metadata">

**Author:** ![jtdoank](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jtdoank/32/31994_2.png) [@jtdoank](https://help.nextcloud.com/u/jtdoank)\
**Post date:** [December 30, 2020, 9:52am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/6 "2020-12-30T09:52:56Z")

</div>

I’ve been reading around if using compression will takes more time  
but correct me if i am wrong

so i dont use compression, the command above is the one that i made it through

from lithuania server goes to 2 places

1. las vegas
2. singapore

the data is 900+ gigabyte  
finish 3,5 days 😁

Thanks for your help @tflidd

---

<div class="post-metadata">

**Author:** ![jtdoank](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jtdoank/32/31994_2.png) [@jtdoank](https://help.nextcloud.com/u/jtdoank)\
**Post date:** [December 30, 2020, 9:56am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/7 "2020-12-30T09:56:20Z")

</div>

I think this is the speed and calculation

> **[Bandwidth Calculator (Data Transfer Calculator) - Calculators.io](https://calculators.io/bandwidth/#size=950!gigabyte&speed=25!megabit/s&time=!hour_!min)**
>
> If you use your internet frequently for browsing, downloading, and live streaming, this bandwidth calculator will prove very useful.

i just wondering  
btw nice source buddy

---

<div class="post-metadata">

**Author:** ![tflidd](https://help.nextcloud.com/letter_avatar/tflidd/32/6_22734026db12803ebb3e059622ac3534.png) [@tflidd](https://help.nextcloud.com/u/tflidd)\
**Post date:** [December 30, 2020, 10:22am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/8 "2020-12-30T10:22:26Z")

</div>

> [@jtdoank](#):
>
> I’ve been reading around if using compression will takes more time  
> but correct me if i am wrong

It depends on the type of data. If these are all zip archives, then you won’t gain anything, if there are a lot of text files, then yes. In the linked question, they mention an article with tests on mixed data and the increase of the effective bandwidth due to compression.

---

<div class="post-metadata">

**Author:** ![jtdoank](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jtdoank/32/31994_2.png) [@jtdoank](https://help.nextcloud.com/u/jtdoank)\
**Post date:** [December 30, 2020, 10:37am UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/9 "2020-12-30T10:37:08Z")

</div>

aaa i see…understand buddy, so sorry my linux knowledge is limited

thanks alot @tflidd

---

<div class="post-metadata">

**Author:** ![wwe](https://help.nextcloud.com/user_avatar/help.nextcloud.com/wwe/32/72963_2.png) [@wwe](https://help.nextcloud.com/u/wwe)\
**Post date:** [December 30, 2020, 8:31pm UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/10 "2020-12-30T20:31:54Z")

</div>

@jtdoank please mark the thread as solved and share and learnings (if you had any) so others can see the solution.

- you transferred data to 2 destination (at same time? = twice amount of data)
- both transfers are across the globe - especially Singapore is from my experience slow/unstable for data transfers from Europe
- your result of 3.5 days gives an **average** of 25MBit/s for 900GB and **avg** 50MBit/s for 2\*900GB

not such bad, I would say…

---

<div class="post-metadata">

**Author:** ![jtdoank](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jtdoank/32/31994_2.png) [@jtdoank](https://help.nextcloud.com/u/jtdoank)\
**Post date:** [December 30, 2020, 9:06pm UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/11 "2020-12-30T21:06:44Z")

</div>

Yes will do @wwe  
thanks for reminding me

- yups, i transfer the data to 2 destination at the same time with the same data using rsync command above
- both mean from lithuania to las vegas and singapore

Great if it not to bad  
thanks all

---

<div class="post-metadata">

**Author:** ![wwe](https://help.nextcloud.com/user_avatar/help.nextcloud.com/wwe/32/72963_2.png) [@wwe](https://help.nextcloud.com/u/wwe)\
**Post date:** [November 27, 2024, 8:24pm UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/12 "2024-11-27T20:24:45Z")

</div>



---

<div class="post-metadata">

**Author:** ![wwe](https://help.nextcloud.com/user_avatar/help.nextcloud.com/wwe/32/72963_2.png) [@wwe](https://help.nextcloud.com/u/wwe)\
**Post date:** [December 12, 2024, 9:46pm UTC](https://help.nextcloud.com/t/migrate-1-tera-data/102648/13 "2024-12-12T21:46:25Z")

</div>


