Data Engineer

DevOps Batch engineer:

• Develop and maintain batch processing pipelines using Airflow

• Work with data engineers to design and implement data processing solutions

• Troubleshoot and debug batch processing pipelines

• Automate data processing tasks

• Monitor and report on the performance of batch-processing pipelines

• Work with stakeholders to gather requirements and define project scope

• Stay up-to-date on the latest trends in data engineering and Airflow
  

DevOps Devops + Infra:

• Design, implement, and maintain our company’s infrastructure, including servers, storage, and networking resources.

• Work with the development team to ensure that our applications are deployed in a secure and scalable manner.

• Work with the operations team to ensure that our infrastructure is reliable and performant.

• Automate as much of our infrastructure and DevOps processes as possible.

• Stay up-to-date on the latest trends in infrastructure and DevOps.

• Proactively identify and resolve infrastructure and DevOps issues.

• Work with other engineers to improve our company’s infrastructure and DevOps processes.