Senior Data Engineer

over 3 years ago
Full time role
Newark, CA, US... more
Newark, CA, US... more

Job Description

Leading the future of luxury mobility
Lucid’s mission is to inspire the adoption of sustainable energy by creating the most captivating luxury electric vehicles, centered around the human experience. Working at Lucid Motors means having a shared vision to power the future in revolutionary ways. Be part of a once-in-a-lifetime opportunity to transform the automotive industry.
We are looking for a Data Engineer, Streaming who is looking for a challenge, enjoys thinking big and looking to make their mark on an extremely fast growing company. If building large and building fast, working with a very talented team of engineers and collaborating with the brightest mind in the Automotive industry is what you like, Lucid is the best to experience it. 

The Role

  • Hands-on design and develop streaming and IoT data pipelines.  
  • Developing a streaming pipeline using MQTT, Kafka, Spark Structure Streaming 
  • Develop Scala Spark applications to build a data pipeline.  
  • Orchestrate and monitor pipelines using Kubernetes  
  • Develop, Deploy and maintain applications with CI/CD and relevant tools. 
  • Python scripting for automation and application development  
  • Design and implement batch processing jobs, dependency enforcement using scheduling tools. 
  • Hands-on data modeling and data warehousing   
  • Deploy solution using AWS, S3 and Docker/Kubernetes  
  • Develop a storage and retrieval system using Presto and Parquet

Qualifications

  • Bachelor or Masters in Software Engineering or Computer Science 
  • +4 years of experience in Data Engineering and Software Development.  
  • Experienced in Scala streaming application development.
  • Proficient in tools such as MQTT, Kafka, Scala Spark, Presto, Parquet 
  • Experience with AWS, S3, VPC, load balancers, API 
  • Ability to POC and Deploy production-quality tools and applications.
  • Experience with Timeseries Databases such as Influx or Prometheus.
  • Proficient with Apache Spark with Scala and data frame. 
  • Experienced in containerization, including Docker and Kubernetes 
  • Expert in tools such as Apache Airflow, Presto, Elasticsearch 
  • Expert in design and implement reliable, scalable, and performant distributed systems and data pipelines 
  • Extensive programming and software engineering experience, especially in Scala, Python, 
  • Experience with Columnar database such as Redshift, Vertica and Parquet files 
  • Great verbal and written communication skills.  
Be part of something amazing
Come work alongside some of the most accomplished minds in the industry. Beyond providing competitive salaries, we’re providing a community for innovators who want to make an immediate and significant impact. If you are driven to create a better, more sustainable future, then this is the right place for you.
At Lucid, we don’t just welcome diversity - we celebrate it! Lucid Motors is proud to be an equal opportunity workplace and is an affirmative action employer.  We are committed to equal employment opportunity regardless of race, color, national or ethnic origin, age, religion, disability, sexual orientation, gender, gender identity and expression, marital status, and any other characteristic protected under applicable State or Federal laws and regulations.
To all recruitment agencies: Lucid Motors does not accept agency resumes. Please do not forward resumes to our careers alias or other Lucid Motors employees. Lucid Motors is not responsible for any fees related to unsolicited resumes. 

Similar jobs