Job title: Senior/Staff Software Engineer- ML Platform
Job type: Permanent
Emp type: Full-time
Salary type: Annual
Salary: USD $180,000.00
Location: San Francisco, United States
Job published: 2020-04-30
Job ID: 32760

Job Description

Key responsibilities:

  • Design, development, and implementation of Spark pipelines using Scala
  • Produce unit and system tests for all code
  • Participate in design discussions to improve our existing data processing, storage, querying, and machine learning frameworks
  • Use modern infrastructure tools to set up and improve our deployment processes
  • Maintain, debug, tune and monitor our Redshift warehouse, data/ML pipelines, and internal tools

The most important capabilities for this role are:

    • Superior knowledge with at least two of the following: Spark, MapReduce, HDFS, RDBMS
    • Exceptional Scala (preferred) or Java programming skills
    • Demonstrated aptitude at building large-scale distributed systems (typically at least 3 years of hands on work experience)
    • Experience using modern DevOps tools (Jenkins, Docker, Kubernetes, etc.) for setting up performant scalable service deployments 

Additional capabilities we'll consider:

  • Experience working with Hadoop, HBase, Hive and similar large scale DB Technologies
  • Previous experience working experience in Agile development processes
  • 1+ years of experience with Machine Learning concepts
  • Experience working with cloud infrastructure and AWS Big Data/Cloud compute/Data Warehousing technologies, as well as excellent SQL and scripting abilities