Data Engineers & Architects

**Were hiring Data Engineers & Architects** Do you want to design, implement data pipelines, and dashboards along with working on some of the latest Data Engineering technologies and tools? This is not just an opportunity to build something new and innovative, but also to be at the centre of our transformation to a data-driven, smart platform for travellers, travel managers of corporate travel. The engineers should know that data engineering is an evolving field, so continuous learning and adaptation to new tools and technologies are essential. They should also stay updated on best practices and emerging trends in the data engineering space. **What youll do:** - Design, build and maintain data processing ETL pipelines & data products in a multi-cloud, multi-region, distributed processing context choosing the right technologies. - Drive data investigations to deliver a resolution of technical, procedural, and operational issues. - Solve complex business problems by utilizing disciplined development methodology, producing scalable, flexible, efficient and supportable solutions using appropriate technologies. **Skills:** - Data engineering patterns: Sound knowledge of the different data engineering patterns to determine what to use and when - Data architecture: Understanding of data architecture and frameworks like Data mesh, data fabric etc. - Big Data Technologies: Proficiency in big data technologies such as data lake, EMR, Glue for analysing large datasets. Knowledge on CLoudera will be an added advantage. - Programming Languages: Proficiency in programming language Python - Data Warehousing: Strong knowledge of data warehousing solutions preferably Amazon Redshift. - ETL/ELT Tools: Familiarity with orchestration tools - Database Systems: Expertise in both relational and NoSQL databases. - Data Modelling: Skill in designing efficient data models, both for OLAP and OLTP systems. - Streaming Data: Knowledge of streaming data technologies. - Version Control: Experience with version control systems: Git. - Containerization and Orchestration: Understanding of containerization technologies (Docker) and container orchestration platforms (Kubernetes). - Data Security: Knowledge of data encryption, access control, and compliance with data privacy regulations. - Monitoring and Logging: Proficiency in setting up monitoring and logging solutions for data pipelines using different tools **Requirement details:** A Data Engineer who can work on developing python framework with extended OOP knowledge working with micro services/EKS. - Experience : 6-13 years - Work Location : Cochin, Trivandrum, Chennai, Bangalore - Notice Period : Immediate or within 30 days. - An ideal candidate would be someone who has application development experience with Java or Python previously and who has switched to data engineering or vice versa. - Data engineers with strong Python programming knowledge are mandatory. Note: This is a third party job (Aggregated by careeruplift.ai). Shortlisting and Final hiring decision & process is handled by the company.