Job title: Senior/Staff Software Engineer- ML Platform
Job type: Permanent
Emp type: Full-time
Salary type: Annual
Salary: USD $180,000.00
Location: San Francisco, United States
Job published: 2020-04-30
Job ID: 32760

Job Description

Key responsibilities:

  • Design, development, and implementation of Spark pipelines using Scala
  • Produce unit and system tests for all code
  • Participate in design discussions to improve our existing data processing, storage, querying, and machine learning frameworks
  • Use modern infrastructure tools to set up and improve our deployment processes
  • Maintain, debug, tune and monitor our Redshift warehouse, data/ML pipelines, and internal tools

The most important capabilities for this role are:

    • Superior knowledge with at least two of the following: Spark, MapReduce, HDFS, RDBMS
    • Exceptional Scala (preferred) or Java programming skills
    • Demonstrated aptitude at building large-scale distributed systems (typically at least 3 years of hands on work experience)
    • Experience using modern DevOps tools (Jenkins, Docker, Kubernetes, etc.) for setting up performant scalable service deployments 
 

Additional capabilities we'll consider:

  • Experience working with Hadoop, HBase, Hive and similar large scale DB Technologies
  • Previous experience working experience in Agile development processes
  • 1+ years of experience with Machine Learning concepts
  • Experience working with cloud infrastructure and AWS Big Data/Cloud compute/Data Warehousing technologies, as well as excellent SQL and scripting abilities 
Apply with indeed Apply with linkedin
File types (doc, docx, pdf, rtf, png, jpeg, jpg, bmp, jng, ppt, pptx, csv, gif) size up to 5MB
File types (doc, docx, pdf, rtf, png, jpeg, jpg, bmp, jng, ppt, pptx, csv, gif) size up to 5MB