Why use Filestore for Genomics processing?

[nick-youngblut]

A use case of GCP Filestore is Genomics processing

However, Filestore doesn't seem to be compatible with either dsub or Nextflow, so why would a bioinformatician actually want to use GCP Filestore for Genomics processing?

[christianpaula]

Hi @nick-youngblut,

Welcome to Google Cloud Community!

For a range of genomics processing activities, Filestore offers a high-performance, scalable, and reliable file storage solution. It is a fantastic option for bioinformaticians looking for a manageable, integrated, and affordable file storage solution.

Although Filestore is incompatible with dsub or Nextflow, there are still other methods to use it for processing genomic data, such as orchestrating your genomics workflows with a programme like Airflow or Prefect.

The following are some potential advantages of utilizing Filestore for processing genomics processing:

• Performance: Filestore can deliver up to 100 GB/s of throughput.
• Scalability: Filestore is scalable to petabytes of data.
• Durability: Filestore replicates data across multiple zones, so it is highly resistant to data loss.
• Security: Filestore uses encryption at rest and in transit to protect data from unauthorized access.
• Ease of use: Filestore is easy to set up and use, and it can be integrated with a variety of genomics tools and workflows.
• Cost: Filestore is a cost-effective file storage solution.
• Integration with other GCP services: Filestore can be easily integrated with other GCP services, which can simplify your genomics workflows.
• Managed service: Filestore is a managed service, so you don't have to worry about managing the underlying infrastructure.

Thanks

[nick-youngblut]

Thanks @christianpaula for the information! 

Are there plans to add support for Nextflow, given that it is the most popular bioinformatics workflow software (much more commonly used than either Airflow or Prefect)?

[christianpaula]

As of the moment there's no update for that. I would highly suggest to file a feature request for this. However, there's no ETA for it but rest assured that the Product Team will look into this kind of feature request. 

You may also check for updates on the Google Release Notes.