Machine Learning Platform Engineer

Palo Alto / USALINE EAEngineeringData/AIFull-timeJan 22, 2021 ~ Until filled

Our team is developing and operating an integrated machine learning platform used by various global organizations of LINE. This platform helps provide an environment in which users can conveniently experiment machine learning models by being provided with as many resources as they need, and supports them to create services through automated pipelines upon their needs. We are trying our best to solve the machine learning related requirements occurring in various domains. In addition, we provide the tools and functions that are necessary for each service team to build MLOps, and strive to develop into MLaaS (Machine Learning as a Service).

 

Responsibilities

  • Improve and manage Jupyter Notebook based environment that works in conjunction with Workspace and Dataset
  • Develop extensible tools and services to handle Machine Learning Workflow
  • Develop and manage components for smooth connection with LINE's data platform
  • Integrate and manage existing platform by building a large-scale distributed training system using the latest open source
  • Co-work with external engineers across functions to solve complex distributed training problems
  • Co-work closely with external platform teams, platform users, system designers, and software engineers

 

Basic Requirements

  • Platform engineer, machine learning engineer, or data engineer (or equivalent) who has experience building an End-to-End Machine Learning System
  • Experience with containers and Kubernetes in a cloud computing environment
  • Continuously interested in machine learning methodologies or various examples
  • Paying attention to Deep Learning Framework (PyTorch, TensorFlow, PyTorch Lighting, etc) 
  • Taking initiatives in finding and leading a role with a strong ownership in his/her job
  • Familiar with documenting and discussing the progress or design plans on wiki
  • Able to see the big pictures while paying attention to details
  • Able to perform well under the full-time remote work condition
  • Able to travel overseas
  • Strong written and verbal communication skills in Korean and English

 

Preferred Requirements

  • Able to take the role of Technical Lead capable of understanding business requirements, software design and implementation, and communicating clearly about the entire platform
  • Experience with Scalable Data Processing Framewo rk (Spark, ElasticSearch, Presto, Ray, etc)
  • Experience with Hadoop Ecosystem (Hive, HBase, Kafka Delta Table, etc)
  • Experience with Workflow Orchestration Framework (Airflow, KubeFlow, Prefect, etc)
  • Experience in open source development and collaboration with open source communities

 

More about the position

 

Location

  • Our office is located in Palo Alto, CA, but this is a remote position.

 

How to Apply

Relevant Jobs