MLOps Engineer
MLOps Engineer
About this position:
Context Labs is seeking an MLOps Engineer to provide technical expertise to support the progression of our Immutably™ Data Fabric technology. As a vital member of the data and ops teams, the engineer will be involved in all aspects of developing our data processing and management capabilities and support the delivery of critical data processing pipelines for the business units and the customers. This position will report to the Senior Director of Platform Systems.
In this role you will:
- Assemble large and complex datasets that meet both functional and non-functional business requirements.
- Independently work with subject matter experts to obtain data from various sources, automate data cleanup, and build a data dictionary.
- Deploy and maintain an optimal data pipeline architecture, focusing on the reliability, validity, and completeness of data.
- Integrate backend data storage, including relational databases, graph databases, key-value stores, and versioned object stores.
- Explore and design pragmatic solutions for data architecture to support complex analytics and data provenance.
- Identify, design, and implement internal process improvements: automate manual processes, optimize data delivery, redesign infrastructure for greater scalability, etc.
- Collaborate with data analytics experts to enhance the functionality of our data systems.
- Participate as a member of an agile team to develop and complete products with best-in-class data management practices.
- Perform any other tasks as may reasonably be required by the company.
Experience:
- 4+ years of relevant experience in data engineering.
- Experience with key components of the modern data engineering stack, including Spark, Airbyte, Trino, Airflow, Dagster, DBT, or equivalent technologies.
- Advanced proficiency in SQL, with extensive working knowledge.
- Strong proficiency in Python and/or Scala, including a thorough understanding of the ecosystems and related tools.
- Solid experience in supporting data transformation, understanding data structures, and managing metadata, dependencies, and workloads.
- Experience managing key component technologies from deployment to ongoing maintenance and monitoring.
- In-depth understanding of lakehouse architectures, such as LakeFS or Databricks.
- Professional experience with leading cloud computing platforms, with a preference for Azure.
- Demonstrated expertise in implementing fundamental design patterns and principles for creating optimized and scalable data processing solutions.
- Ability to understand complex concepts, assess trade-offs, and critically analyze scenarios with multiple and potentially competing requirements.
- Excellent communication skills.
- Exceptional attention to detail with a focus on delivering high-quality results.
Preferred Experience:
- Oil & Gas industry experience in data modeling, data management, or data science is desirable.
- Bachelor's degree in Computer Science or related field
- Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets is strongly preferred.
- Experience with Docker-based architectures is preferred.
Why you’ll like it here:
- Context Labs is collaborative at its core. You’ll work within your team and across the organization allowing for continuous learning and discovery.
- We set goals that matter and provide value in all that we do, from building meaningful products to positively impacting carbon reduction and climate change.
- Context Labs’ mission is to transform complex data into continuously proven information. Powered by Immutably™, an innovative, trusted data fabric platform, our integrated solutions deliver context-driven insights that enable human networks to spot patterns, correlate trends - and reveal the ground truth hidden inside the world’s most complicated, persistent problems.
We understand that applying for a job can be intimidating. Applicants rarely meet every single job requirement, and we know there are many skills and backgrounds that will contribute to success in this role. If you’re interested in applying, please do so.
Context Labs embraces diversity and equal opportunity. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills. We believe the more inclusive we are, the better our products will be. Context Labs will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. If you require accommodation, please contact Human Resources at HR@contextlabs.com.
Who we are:
Context Labs is dedicated to sourcing, organizing, and contextualizing the world’s climate information. The company enables data to become trusted, shared, and utilized as Asset Grade Data (AGD™), providing insights and solutions to inform markets. Context Labs mission is to provide the world’s trusted data fabric platform, delivering Asset Grade Data to customers using the Immutably™ Enterprise Data Fabric platform, deploying machine learning, Artificial Intelligence, and cryptographic blockchain technologies, for context-driven insights.
Building on the Immutably™ Enterprise Data Fabric platform, the company has deployed customer service layers (1) Decarbonization-as-a-Service™ (DaaS™), tailored to accelerate the Global Energy Transition, and its (2) CLEAR Path™ platform to enable customers to optimize value creation with the highest quality carbon credits. The company was formed out of MIT (Massachusetts Institute of Technology) research and is comprised of a leadership team that has been instrumental in the at-scale growth of the Internet, in prior companies. The company has offices in Amsterdam, Cambridge, Mass., and Houston.
We are a team that is hiring and growing! Learn more about Context Labs here: