High-speed file transfer tool 'CDC File Transfer' developed by Google is now available for free



The cloud game service `` Stadia '' provided by Google was attracting attention as a service that allows you to enjoy high-quality games via the Internet even on PCs and smartphones with low specifications, but the end of the service was

announced in 2022. I was. The file transfer tool `` CDC File Transfer '' created in the development process of Stadia is open source.

GitHub - google/cdc-file-transfer: Tools for syncing and streaming files from Windows to Linux
https://github.com/google/cdc-file-transfer

According to the CDC File Transfer development team, a Linux machine was used to develop Stadia. However, since most of the PC games on the market are developed for Windows, it was necessary to build a system to access files managed by Windows from Linux.

It is common to use commands such as ' scp ' to transfer files in a Linux environment. However, due to the pandemic of the new coronavirus infection around 2020, the development environment moved to a remote location, making it difficult to work with large file transfers. Therefore, the development team developed CDC File Transfer as a tool to transfer only the changed parts of files.

CDC File Transfer has two functions: 'CDC RSync' for synchronous processing and 'CDC Stream' for one-way streaming. Click the image below to play the CDC RSync demo animation.



CDC RSync skips the transfer when a file with the same file size and timestamp exists at the transfer destination, and by adopting the file splitting algorithm 'Content Defined Chunking (CDC)', it is 30 times faster than '

rsync '. It provides twice the speed of transfer.

Below is a graph comparing the transfer time when a Cygwin environment is built on Windows and file synchronization is performed using rsync (blue) and when CDC RSync is used (red). CDC RSync consistently transfers files faster than rsync.



CDC Stream is a one-way continuous transfer of file changes in Windows to Linux. The graph below is a measurement of the 'time from startup to menu display' when accessing a game on Windows from Linux using

SSHFS (blue) and CDC Stream (red). You can see that CDC Stream can display the menu 2 to 5 times faster than SSHFS.



CDC File Transfer has its source code released for free, and also has a binary file for Linux.

Related Posts:

in Software, Posted by log1o_hf