BD2KGenomics / conductor
Efficient, distributed downloads of large files from S3 to HDFS using Spark.
☆17Updated 7 years ago
Alternatives and similar repositories for conductor:
Users that are interested in conductor are comparing it to the libraries listed below
- A Variant Caller, Distributed. Apache 2 licensed.☆71Updated 5 years ago
- An example of bioinformatics and bigdata tools can playing nicely together☆14Updated 8 years ago
- Spark-based variant calling, with experimental support for multi-sample somatic calling (including RNA) and local assembly☆84Updated 7 years ago
- Open source formats for scalable genomic processing systems using Avro. Apache 2 licensed.☆39Updated 2 months ago
- Bioinformatics for the Scala programming language☆109Updated 11 months ago
- Ready-to-go Parquet-formatted public 'omics datasets☆30Updated 9 years ago
- Apache Spark jobs such as Principal Coordinate Analysis.☆74Updated 7 years ago
- This repository implements converters and tools for working with NGS data in HPC or Hadoop cluster☆17Updated 6 years ago
- Miscellaneous functionality for manipulating Apache Spark RDDs.☆22Updated 6 years ago
- A scala based DSL and framework for writing and executing bioinformatics pipelines as Directed Acyclic GRaphs☆69Updated 2 years ago
- Load genomic BAM files using Apache Spark☆21Updated 6 years ago
- Hadoop-BAM is a Java library for the manipulation of files in common bioinformatics formats using the Hadoop MapReduce framework☆70Updated 2 years ago
- A fast, parallel, streaming multipart uploader for S3☆13Updated 7 years ago
- Population Stratification Analysis on Genomics Data Using Deep Learning☆26Updated 8 years ago
- Integrate the GA4GH schemas and probably a scala impl of the service.☆14Updated 8 years ago
- New url: https://github.com/biointec/halvade☆19Updated 7 years ago
- General utility code used across BDG products. Apache 2 licensed.☆18Updated last year
- Parallel Genomic Analysis Toolkit☆14Updated 5 years ago
- ☆31Updated this week
- A genomics pipeline build on top of the GATK Queue framework. Main repository: https://github.com/NationalGenomicsInfrastructure/piper (m…☆21Updated 8 years ago
- VariantSpark is a framework for applying Spark-based Machine Learning methods to whole-genome variant information☆33Updated 7 years ago
- MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.☆14Updated 2 years ago
- An implementation of Nextflow.io with Language Workbench Technology. The project helps create computational pipelines that run with the N…☆22Updated 8 years ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 11 years ago
- Example Spark project using Parquet as a columnar store with Thrift objects.☆48Updated 10 years ago
- Introduction to predictive modeling in Spark with applications in pharmaceutical bioinformatics☆39Updated 8 years ago
- Finding a scalable alternative to the VCF File for genomics analysis☆14Updated 8 years ago
- Benchmarking toolkit for variant calling☆47Updated 4 years ago