As a Software Team Lead , you will be responsible for managing 5-10 engineers developing software frameworks, drivers, and tools that accelerate open-source big data processing frameworks on custom hardware accelerators. Your work will focus on tasks prioritization, and hand On enabling and optimizing large-scale data processing workloads in tailor-made cloud environments, ensuring seamless integration with AWS-based data processing services. You will develop and optimize software stacks, implement benchmarking, debugging, and performance analysis tools, and evaluate acceleration gains to enhance efficiency and performance in cloud-based data platforms.

Qualifications & Skills

Required Qualifications:

• Bachelor's degree in Computer Science, Electrical Engineering, or a related field from a leading university.
• C++ or Java.
• 5+ years of experience in software Team Leadership, focusing on high-performance computing.

Preferred Qualifications:

• Proficiency in Python or Scala for data processing and system development.
• Experience in runtime system development and low-level performance optimization.
• Hands-on experience with big data processing frameworks, such as Apache Spark.
• Solid understanding of columnar storage formats (e.g., Parquet) and their impact on query performance.
• Familiarity with AWS cloud services, including AWS EMR, S3, and EC2.