Exp: 4yrs – 9yrs
Location: Bangalore
NP: Immediate Joiner
Responsibilities
- Design and develop scalable data pipelines using AWS services.
- Integrate diverse data sources and ensure data consistency and reliability.
- Collaborate with data scientists and other stakeholders to understand data requirements.
- Implement data security measures and maintain data integrity.
- Monitor and troubleshoot data pipelines to ensure optimal performance.
- Optimize and maintain data warehouse and data lake architectures.
- Create and maintain comprehensive documentation for data engineering processes.
Qualifications
- Bachelor’s degree in computer science, Information Technology, or related field.
- Proven experience as a Data Engineer with a focus on AWS.
- Strong understanding of data modeling, ETL processes, and data warehousing.
- Experience with SQL and NoSQL databases.
- Experience with Python and Pypsark
- Familiarity with data governance and data security best practices.