File System and File Storage
Applications often need to store files such as users uploads or runtime temporary files for instance. The file system located on the disk alongside your app on the platform is temporary. It means that each time your application is restarted or redeployed, it gets a new file system. Files stored previously on it won’t be present anymore.
Where you can write temporary files
Two directories are writable by your application:
The application directory
/appwhere it can read and write as wished (e.g. Ruby on Rails storing upload in the
tmpdirectory inside the project, so it will write in
The global temporary directory
In both these directories you can store temporary files, but keep in mind they will be lost when the app is restarted.
External storage service
If you need to store files in a persistent manner, the good practice is to use an external storage service solution like:
- Outscale OOS (S3 compatible API)
- Amazon S3
- Google Cloud Storage
- Azure Blob Storage
- OVH Public Cloud Storage
Then the workflow, already implemented in numerous frameworks and libraries is the following:
- Client upload file to your application
- File is stored temporarily in the app file system
- Application send the temp file to the storage service
- Display URL to the remote file to the client in the rendered HTML/JSON
Large size upload
You may need to upload large files (≥ 50MB for instance), in this case the workflow previously explained won’t work so well because each step will be slow, because of network transfers.
All the previous third-party providers offer a mechanism of Signed URL, it let your app generates a temporary authenticated URL your users can use to upload a file. With this system, no file needs to uploaded through the platform infrastructure, it will be directly uploaded to the storage service which is much more efficient.
The workflow becomes:
- The client asks to upload a file to the app
- The application generates a signed URL for this client and returns it
- The client uses this URL to upload its file directly
- Once done, the client notifies the application the file has been uploaded
As a result, no file operation alongside your app, you delegate everything to the storage provider.