🚚 The Great Data Transfer

What happens when you click

Choose a method.
🏒On-prem data centre
5 PB on SAN
☁️Cloud region
S3 / Blob
🚚
Results appear here with the formula used.

Flow & timeline

Source SAN5 PB
➜
Copywire or appliance
➜
Transitfibre or road
➜
Ingest & verifychecksums
➜
Delta syncover wire
Click a node to learn what it does.

    Deep dive

    How

    • Convert: 1 PB = 1,024 TB = 8,388,608 Gb. 10 Gbps at 70% β‰ˆ 7 Gbps β‰ˆ 75 TB/day.
    • 5 PB Γ· 75 TB/day β‰ˆ 68 days β€” misses a 60-day target even with perfect uptime.
    • Truck: order β†’ 3-day local ingest β†’ ship β†’ cloud ingest β‰ˆ 18 days.

    Why

    • Bandwidth is shared with production replication and users.
    • Shipping 100 PB in a truck is still faster than most networks (β€œnever underestimate the bandwidth of a truck”).

    When

    • Bulk historic data, backups, media archives β†’ truck.
    • Active databases with constant change β†’ wire, with continuous replication.

    Pitfalls

    • Ignoring the lead time to provision Direct Connect/ExpressRoute (weeks).
    • Forgetting that data keeps changing while the truck drives β€” plan the delta.
    • Not validating checksums before wiping the source.

    Key ideas

    Hybrid is the real answer

    Truck for the 5 PB bulk, wire for the final delta. The cutover page assumes exactly this: a last block sync at Saturday 2 AM.

    Constraints

    Snowmobile requires site survey, power and security escort. Data Box Heavy requires 2 Γ— 40 GbE and a pallet jack. Both need a loading dock booking β€” logistics, not technology.

    Gbps β†’ TB/daySnowmobileData Box HeavyChain of custodyDelta sync

    🐍 Python executed on the server (transfer)
    loading…