Design, develop, and maintain scalable data management systems and integration solutions, ensuring uninterrupted data flow and high availability.
Implement InfluxDB upgrade and links to SK Azure environment
Implement and optimise ETL processes using Python and other relevant tools to handle large volumes of data from various sources.
Manage and improve database structures, including MySQL and time-series databases, for efficient storage and fast querying.
Develop and maintain APIs for timeseries data retrieval from online platforms, automating data preparation and delivery processes.
Ensure data quality control measures are in place and meet the Solar Performance Analysis team's reporting requirements (Solar and BESS)
Collaborate with IT teams to maintain system security, including firewall management, SSL certificate renewals, and implementation of cybersecurity best practices.
Create and maintain clear documentation for all data processes and infrastructure.
Continuously assess and implement state-of-the-art methodologies and technologies to improve efficiency and performance.