Technologies: Golang, Scala, Python, Bash, Apache Spark, Kafka, ElasticSearch, Hadoop/HDFS, Docker, K8s, Git, Mysql, Databricks, AWS. Have experience in building a 4PB DataLakehouse, managing ingestion of 20TB worth of data every single day. Written Golang services can handle 100k qps. Written Data pipeline crunching > 10TB data per day.
Remote: Yes
Willing to relocate: Yes
Technologies: Golang, Scala, Python, Bash, Apache Spark, Kafka, ElasticSearch, Hadoop/HDFS, Docker, K8s, Git, Mysql, Databricks, AWS. Have experience in building a 4PB DataLakehouse, managing ingestion of 20TB worth of data every single day. Written Golang services can handle 100k qps. Written Data pipeline crunching > 10TB data per day.
Résumé/CV: https://www.linkedin.com/in/shubhampateliitm/
Email: [email protected]