Challenge of quick data transmission Puzzle involving rapid file movement
Challenge of quick data transmission Puzzle involving rapid file movement
if both devices have dual NICs, simply ask the IT team politely to link the two machines directly using a good quality cable, and (assuming you lack the required permissions) set both NICs to static IP addresses on that device. the other NIC can remain just a standard network interface. also, any approach that doesn’t work is clearly problematic—ask IT to handle it properly. if they refuse, just accept the situation while data transfers continue. if managing those file sizes and handling them isn’t feasible for you, then don’t attempt it effectively. -- this scenario closely resembles a challenge I faced recently with a client (keeping details confidential). essentially, they were generating large volumes of data daily, management repeatedly misinterpreted the volume, leading to inaccurate estimates. as a result, they resorted to a temporary server that held data for over a year while they resolved the main storage issue... but the numbers were off by about ten times, causing the server to run out of space after just a month. eventually, they needed a PhD-level role just to swap LTO5 tapes, since upgrading to LTO8 was too costly and time-consuming. it became a repetitive cycle of constant data migration and delays.
You can obtain a Cat6a cable and link the computers directly—network cards will recognize the wire arrangement automatically and establish a connection. If this doesn’t function, you can craft your own crossover cable supporting 1Gbps or above; standard cables only handle 4 of the 8 wires used by 100Mbps adapters, which miss the automatic ordering feature. Refer to pages 5 or 6 in the provided guide: https://illustracameras.com/lifecycle-pr...dge_en.pdf. Generally, only one connector stays identical, but the wire sequence flips at the other end. This is designed to be future-proof for 10G, meaning all wires may be rearranged rather than just a few. See the alternative option: https://www.amazon.com/Ethernet-Crossove...017KG2OKU/. Assign each computer a distinct IP address—for instance, one gets 192.168.0.101 and another 192.168.0.102 with a subnet mask of 255.255.255.0. When the cable is no longer needed, revert it to auto or its prior configuration. This step can be challenging for network staff; they might need to adjust settings. If manual setup isn’t possible, contact administrators to set secondary IPs per device so the connection works seamlessly. As a backup, consider using an external NVMe drive via USB 3.0/10G—connect it to one computer, transfer files, and move the drive between machines. USB 10G offers rapid transfers if supported, otherwise USB 5G remains a viable choice. For example, the WD SN570 is budget-friendly and supports fast writes, though its SLC cache can degrade after heavy use. A solid option is the WD SN770, which handles large capacities and high speeds. Alternatively, the Samsung 980 delivers impressive write speeds in SLC mode, making it suitable for demanding workloads.
Thanks for the help! IT was clear that they aren't going to help with this, so I'm on my own. I do have a small budget to see if I can solve this problem. Currently exploring two options inspired by the helpful suggestions of both mariushm and manikyath: Get a fast external SSD. Connect the machines directly using a Thunderbolt 3 optical cable (b&h sells some long enough which claim speeds of up to the native Thunderbolt 3 speed of 40gbps). Alternatively, I may just be sitting around waiting for files to transfer and for management to get a clue!
bring this up with leadership, or allow the issue to continue. I understand this isn’t a fix for your situation, but discovering your own path around <what is basically company policy> fosters a mindset of “it wasn’t necessary” at the top.