At Sofar we connect the world’s oceans. We build the technology to create global awareness of ocean weather, climate, and ocean health. Our unique ocean data provides insights to science and society, and our products make ocean industries more sustainable. As a mission-driven team we combine the best in ocean science and Bay Area innovation to capture the canvas of our oceans and drive the new Blue Economy.
We are looking for an experienced data engineer to refine and scale our weather forecast data pipeline. This pipeline combines realtime sensor readings from our worldwide fleet of ocean buoys, publicly available weather data sources, and our own proprietary forecast model into a variety of data products suitable for visualization and scientific analysis. In this role, you would be responsible for building out extensions to our current pipeline to scale and bring on board new data sources, as well as improve the reliability or existing pipeline where it supports mission-critical applications in production.
In this role, you would work alongside our software engineering team building out APIs and frontend applications that use our data, as well as domain experts in ocean science and other data scientists performing analysis on weather data. You will quickly learn that “the forecast” is a lot more complicated than it seems at first glance; our team works with multiple forecast models that each produce gigabytes of data every hour, at every location on the globe. Most of the industry-standard tools and data formats are optimized for an era of supercomputers, not cloud computing. We are looking for the right person who is up for the challenge of turning this data into something that can be indexed, filtered and queried efficiently across space and time.
Currently our stack is built with Apache Airflow, Docker & Kubernetes, Postgres/PostGIS, and AWS S3.
It is the responsibility of every employee to contribute to a positive work environment through cooperative and professional interactions with co-workers, customers, and vendors.
All qualified applicants will receive consideration for employment without discrimination on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other factors prohibited by law.