Before making a decision, there are to clarify and consider from different perspective.
1 size of the file? 5K? 5G 5T?
2. Frequency? one time? once a day? or more?
3. If more than one time, how different between those files? incremental change or completely different?
4. Any expectation? as fast as possible? or intrusively to other applications?
5. how reliable?
Technical questions:
- bottleneck: network topology&bandwidth, disk speed, memory size,
- failure handling. retry,, version conflict
what to optimization, time or others?
break into pieces to reduce wait time?
integrity and consistency?