Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. From our Bay Area roots to our growing global presence, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Senior Staff Compiler Engineer

Mission:

As Senior Staff Compiler Engineer, you will be responsible for defining and developing compiler optimizations for our state-of-the-art compiler, targeting Groq's revolutionary LPU, the Language Processing Unit.

In this role you will drive the future of Groq's LPU compiler technology. You will be in charge of architecting new passes, developing innovative scheduling techniques, and developing new front-end language dialects to support the rapidly evolving ML space. You will also be required to benchmark and monitor key performance metrics to ensure that the compiler is producing efficient mappings of neural network graphs to the Groq LPU.

Ideal candidates have experience with LLVM and MLIR, and knowledge with functional programming languages an asset. Also, knowledge with ML frameworks such as TensorFlow and PyTorch, and portable graph models such as ONNX desired.

Responsibilities & opportunities in this role:

Compiler Architecture & Optimization: Lead the design, development, and maintenance of Groq’s optimizing compiler, building new passes and techniques that push the performance envelope on the LPU.
IR Expansion & ML Enablement: Extend Groq’s intermediate representation dialects to capture emerging ML constructs, portable graph models (e.g., ONNX), and evolving deep learning frameworks.
Performance & Benchmarking: Benchmark compiler outputs, diagnose inefficiencies, and drive enhancements to maximize quality-of-results on LPU hardware.
Cross-Disciplinary Collaboration: Partner with hardware architects and software leads to co-design compiler and system improvements that deliver measurable acceleration gains.
Leadership & Mentorship: Mentor junior engineers, review contributions, and guide large-scale, multi-geo compiler projects to completion.
Innovation & Impact: Publish novel compilation techniques and contribute thought leadership to top-tier ML, compiler, and computer architecture conferences.

Ideal candidates have/are:

8+ years of experience in the area of computer science/engineering or related
5+ years of direct experience with C/C++ and LLVM or compiler frameworks
Knowledge of spatial architectures such as FPGA or CGRAs an asset
Knowledge of functional programming an asset
Experience with ML frameworks such as TensorFlow or PyTorch desired
Knowledge of ML IR representations such as ONNX and Deep Learning

Additionally nice to have:

Strong initiative and personal drive, able to self-motivate and drive projects to closure
Keen attention to detail and high levels of conscientiousness
Strong written and oral communication; ability to write clear and concise technical documentation
Team first attitude, no egos
Leadership skills and ability to motivate peers
Optimistic Outlook, Coaching and mentoring ability

Attributes of a Groqster:

Humility - Egos are checked at the door
Collaborative & Team Savvy - We make up the smartest person in the room, together
Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
Curious & Innovative - Take a creative approach to projects, problems, and design
Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking

Compensation: At Groq, a competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, salary range is determined by your location, skills, qualifications, experience and internal benchmarks. Compensation for candidates outside the USA will be dependent on the local market.

This position may require access to technology and/or information subject to U.S. export control laws and regulations, as well as applicable local laws and regulations, including the Export Administration Regulations (EAR). To comply with these requirements, candidates for this role must meet all relevant export control eligibility criteria.

Groq is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex (including gender identity, sexual orientation, and pregnancy), age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.

Groq complies with all applicable federal, state, and local laws governing nondiscrimination in employment. We do not tolerate discrimination or harassment based on any protected characteristic.

Groq is committed to working with and providing reasonable accommodations to qualified individuals with physical or mental disabilities. If you require a reasonable accommodation to complete an application or to participate in the hiring process, please contact us at talent@groq.com. This contact is for accommodation requests only, which will be considered on a case-by-case basis.

All offers of employment are contingent upon verification of the applicant’s identity and employment authorization in accordance with federal law.

Groq encourages people with criminal record histories to apply for employment, and values diverse experiences, including prior contact with the criminal legal system. To that end, Groq welcomes such applicants in accordance with the California Fair Chance Act, Los Angeles City Fair Chance Act Ordinance, Los Angeles County Fair Chance Act Ordinance, and San Francisco Fair Chance Act Ordinance. Philadelphia applicants can review information pertaining to Philadelphia’s Fair Criminal Record Screening Standards Ordinance here: https://www.phila.gov/documents/fair-chance-hiring-law-poster.

Req ID: R576

Apply now

See more open positions at Groq

Privacy policy Cookie policy