×

Senior Data Engineer

  • Job Context

    We're hiring a Senior Data Engineer with 5+ years of experience in data architecture and pipeline development. Ideal candidates have expertise in cloud platforms (GCP, AWS), infrastructure as code (Terraform), and microservices with Java. Proficiency in ETL processes, data governance, and performance optimization is essential. You’ll work with tools like Airflow, Snowflake, and GitLab, collaborating closely with data analysts, scientists, and stakeholders to support data-driven decisions.

  • Job Responsibility

    Good Understanding of Cloud platforms like GCP (VPC, GCS, Stackdriver, Apigee), and AWS (S3, Cloud Watch). 


    Good Understanding of IAAC – Terraform, Gitlab 


    Strong knowledge of Java 7+, Spring Boot, Maven, and Junits to build sustainable, reusable APIs on microservices patterns 


    Good Understanding of Products like Airflow (Python), and Snowflake (Data warehouse). Should be able to create pipelines in Snowflake and have a good understanding of ETL (SQL-based) processes and optimizations. 


    Data Pipeline Development: Design, develop, and optimize data pipelines and ETL processes to support data integration from multiple sources into a centralized data warehouse or data lake. 


    Data Architecture & Infrastructure: Build and maintain scalable, reliable, and high-performance data architectures; drive data modeling, schema design, and optimization of data storage. 


    Data Quality & Governance: Implement data quality checks, validation frameworks, and data governance policies to ensure data accuracy, consistency, and reliability. 


    Performance Optimization: Analyze and improve data system performance to handle large-scale, high-velocity data streams. 


    Collaboration & Stakeholder Engagement: Collaborate closely with data analysts, data scientists, and business stakeholders to understand data needs, provide technical expertise, and enable data

    driven solutions. 


    Documentation & Best Practices: Create documentation, establish best practices, and conduct code reviews to uphold data engineering standards and support team growth.

  • Educational Requirement

    Bachelor’s degree in computer science, Information Technology, or a related field.

  • Experience Requirement

     5+ Years of experience.

Dead Line Expired

Jobs Information

  • Company Name

    Keel Info Solution

  • Job Category

    Software Engineer

  • Job Position

    Data Engineer

  • Job Type

    full time

  • Salary

    ₹9L - ₹12L

  • Job Location

    Chennai

  • Deadline

    30 Nov 2024

Search

Job Categories

Recent Jobs Post