Data Infrastructure Engineer

  • Sofar Ocean Technologies
  • San Francisco, CA
  • Oct 01, 2021

Job Description

The Company

At Sofar we connect the world’s oceans. We build the technology to create global awareness of ocean weather, climate, and ocean health. Our unique ocean data provides insights to science and society, and our products make ocean industries more sustainable. As a mission-driven team we combine the best in ocean science and Bay Area innovation to capture the canvas of our oceans and drive the new Blue Economy.

The Position

We are looking for an experienced data engineer to refine and scale our weather forecast data pipeline. This pipeline combines realtime sensor readings from our worldwide fleet of ocean buoys, publicly available weather data sources, and our own proprietary forecast model into a variety of data products suitable for visualization and scientific analysis. In this role, you would be responsible for building out extensions to our current pipeline to scale and bring on board new data sources, as well as improve the reliability or existing pipeline where it supports mission-critical applications in production.

In this role, you would work alongside our software engineering team building out APIs and frontend applications that use our data, as well as domain experts in ocean science and other data scientists performing analysis on weather data. You will quickly learn that “the forecast” is a lot more complicated than it seems at first glance; our team works with multiple forecast models that each produce gigabytes of data every hour, at every location on the globe. Most of the industry-standard tools and data formats are optimized for an era of supercomputers, not cloud computing. We are looking for the right person who is up for the challenge of turning this data into something that can be indexed, filtered and queried efficiently across space and time.

Currently our stack is built with Apache Airflow, Docker & Kubernetes, Postgres/PostGIS, and AWS S3.

About You

  • Passionate about building a product with a positive impact on the world
  • 5+ years professional experience as a software engineer or data engineer
  • Strong working knowledge of Python, Docker, Airflow (or a similar data workflow tool), and cloud computing concepts
  • Willing to learn new tools, languages, and patterns as needed to build a great product
  • A solid communicator who enjoys collaborating with other engineers, designers, PMs, and scientists
  • Excited to be be a part of a small but growing startup team

Employee Conduct

It is the responsibility of every employee to contribute to a positive work environment through cooperative and professional interactions with co-workers, customers, and vendors.

Equal Employment Opportunity

All qualified applicants will receive consideration for employment without discrimination on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other factors prohibited by law.

Organization Type

Company

Organization Size

11-50

Sectors

Transportation

Drawdown solutions

Efficient Ocean Shipping