Senior Cloud Infrastructure Engineer
Groq
Other Engineering
Palo Alto, CA, USA
USD 223,600-263k / year + Equity
Posted on Nov 7, 2025
Senior Cloud Infrastructure Engineer
Palo Alto, CA
Cloud Infrastructure
Hybrid
Full-time
About Groq
Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. From our Bay Area roots to our growing global presence, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.
Senior Cloud Infrastructure Engineer
Mission:
Design, build, and operate large-scale cloud systems to deliver the fastest inference engine in the world.
Responsibilities & opportunities in this role:
- Infrastructure Development: Design and automate cloud infrastructure using Terraform to support a wide variety of needs.
- Global Footprint: Implement global load balancing with traffic steering, failover, and data locality requirements.
- System Optimization: Diagnose and resolve performance issues, eliminating latency to ensure efficiency across all systems.
- Dynamic Adaptability: Navigate all layers of the software stack–from TCP packet inspection at the edge to the Linux kernel scheduler–adapting swiftly to changing priorities and needs.
- Attention to Detail: Uphold a high standard for code quality and system performance, taking pride in delivering impeccable work.
Ideal candidates have/can:
- Experience: a proven track-record developing and operating global infrastructure at scale on at least one major cloud provider.
- Automation Mindset: boost team velocity by building the right tools (Golang, Python, Bash) and integrating AI into everyday workflows.
- Ownership: be self-directed and accountable; deliver projects end-to-end.
- Curiosity: dive deep into complex systems to perform RCA on functionality, reliability, and latency issues.
Attributes of a Groqster:
- Humility - Egos are checked at the door
- Collaborative & Team Savvy - We make up the smartest person in the room, together
- Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
- Curious & Innovative - Take a creative approach to projects, problems, and design
- Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking
Compensation: At Groq, a competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, the base salary range is $223,600 - $263,000, determined by your skills, qualifications, experience and internal benchmarks.
This position may require access to technology and/or information subject to U.S. export control laws and regulations, including the Export Administration Regulations (EAR). To comply with these requirements, candidates for this role must meet certain citizenship or residency criteria. Specifically, they must qualify as U.S. Persons for export control purposes (i.e., U.S. citizen, U.S. lawful permanent resident (Green Card holder), or a protected individual under 8 U.S.C. § 1324b(a)(3) such as a refugee or asylee), or otherwise be eligible for an applicable export license.
Groq is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex (including gender identity, sexual orientation, and pregnancy), age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.
Groq complies with all applicable federal, state, and local laws governing nondiscrimination in employment. We do not tolerate discrimination or harassment based on any protected characteristic.
Groq is committed to working with and providing reasonable accommodations to qualified individuals with physical or mental disabilities. If you require a reasonable accommodation to complete an application or to participate in the hiring process, please contact us at talent@groq.com. This contact is for accommodation requests only, which will be considered on a case-by-case basis.
All offers of employment are contingent upon verification of the applicant’s identity and employment authorization in accordance with federal law.
Groq encourages people with criminal record histories to apply for employment, and values diverse experiences, including prior contact with the criminal legal system. To that end, Groq welcomes such applicants in accordance with the California Fair Chance Act, Los Angeles City Fair Chance Act Ordinance, Los Angeles County Fair Chance Act Ordinance, and San Francisco Fair Chance Act Ordinance. Philadelphia applicants can review information pertaining to Philadelphia’s Fair Criminal Record Screening Standards Ordinance here: https://www.phila.gov/documents/fair-chance-hiring-law-poster.
Req ID: R679