1. Senior AWS Engineer Role Overview Lead the design and development of our AWS-based data architecture. The role involves hands-on engineering, team leadership, and client interaction, ensuring seamless data ingestion, transformation, and processing across our cloud ecosystem. Key Responsibilities • Lead the design and implementation of AWS Data Lakehouse solutions, ensuring scalability and performance. • Develop and maintain AWS CDK-based infrastructure for automated provisioning and deployment. • Build and optimize data pipelines using AWS Glue, Lambda, and Athena. • Drive best practices for serverless computing and event-driven architecture. • Manage a team of offshore AWS developers, ensuring quality and efficiency in project delivery. • Engage with clients and stakeholders, providing technical expertise and aligning solutions to business needs. • Exposure to DevOps practices & CI/CD pipelines • Knowledge of data security & governance in AWS • Implement and manage Apache Iceberg for high-performance table management within the AWS Lakehouse. • Collaborate with cross-functional teams to optimize DynamoDB, Firehose, Kinesis, and Kafka data flows. • Must-Have Skills • AWS Cloud Services (Glue, Lambda, Athena, Lakehouse, Iceberg) • AWS CDK for Infrastructure-as-Code (IaC) • Data pipeline development & orchestration using AWS Glue • Strong programming skills in Python, Pyspark, Spark SQL, Typescript, Scala, or Java • Client-facing and team leadership experience Should-Have Skills • Real-time data streaming (Firehose, Kinesis, Kafka) Nice-to-Have Skills • Hands-on experience with Apache Iceberg for data lake management • Experience with NoSQL databases (DynamoDB)
SCALAR INFOTECH GLOBAL is an Indian Entity specializing in Information Technology and Consulting. Headquartered in Bangalore. Scalar in partner wit Recruiterz.com to fill the gaps in recruitment process to our clients. Read More
is an Indian employment website which.
