Data Engineer

over 2 years ago
Full time role
... more
... more

Job Description

The Opportunity

We are hiring enterprising and motivated software engineers and computer scientists with excellent development and coding skills. These team members will contribute to our SeaState Dashboard, bridging the gap between ocean sensors, data infrastructure, and user experience for our aquaculture customers. 

The Scoot Science Team

Our team is distributed and we practice remote work. We all communicate daily through formal and informal means to foster a collaborative work environment. When not limited by social distancing, we participate in quarterly in-person meetings to focus on team building and strategy. We also strongly encourage all of our team members to engage in conferences and trade shows, and to diversify their skills through professional development. 

Desired Skills

  • BS or graduate degree in Computer Science or related technical field, or equivalent experience
  • Extensive hands-on experience developing and scaling web-based applications, preferably in a SaaS environment
  • Deep knowledge of some of our tech stack, like Python, Postgres, GraphQL, Airflow, Github, K8s, Jenkins, serverless computing frameworks (e.g., AWS Lambda), and RESTful APIs
  • Cloud DevOps experience, especially in AWS infrastructure
  • Experience with geospatial data pipelines or relevant tools (e.g., netcdf, zarr, xarray, dask, PostGIS, GDAL, etc.).
  • Comfort working from the command line 
  • Ability to weigh relative costs and benefits of development time, computational resources, etc, of various technical approaches
  • Creativity and the ability to solve complex problems without a roadmap
  • Emphasis in writing clear, well documented, and modular code
  • Proven experience working in a collaborative, remote team environment
  • Recognition that work is a marathon and that quality of work time is more important than quantity

What you’ll do

As a Data Engineer at Scoot, you’ll be a generalist first and foremost working within a small team of experienced people. In this position you'll be responsible for helping build all components of data ingress and egress for production and internal systems. This includes everything from designing and evaluating system architectures to writing tests and identifying edge cases. Your work will support and scale existing products and contribute to the research and development of new products.  With the rest of the engineering team, you’ll have a great deal of freedom and responsibility to define how the product works and how it is developed.

Within 1 month you’ll:

  • Onboard and learn our internal communication and project management workflows
  • Set up your remote work environment and access all of our tools and resources
  • Learn the landscape of our existing dashboard architecture, data warehouse, and toolboxes

Within 3 months you’ll:

  • Be comfortable maintaining our data ingestion infrastructure 
  • Build new ETL processes for oceanographic and proprietary data sets
  • Work with the engineering team to develop scalable ETL and CI/CD pipelines

Within 6 months you’ll:

  • Support analysis environments and internal tools for Scoot’s data analysis and ocean science team
  • Assist in operationalizing novel modeling techniques
  • Be responsible for developing and maintaining large parts of the data warehouse 
  • Constantly research new engineering techniques and advocate for novel solutions to connect an understanding of ocean change to customer needs

Similar jobs