Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. From our Bay Area roots to our growing global presence, we are on a mission to make high performance AI compute more accessible and affordable. When real-time AI is within reach, anything is possible. Build fast.

Staff Datacenter Network Engineer

Mission:

As a Datacenter Network Engineer at Groq, you will design, build, and deploy Groq’s global datacenter network fabric to meet the highest standards of availability, efficiency, and automation. Your work will ensure a robust, scalable, and future-ready infrastructure that directly supports Groq’s mission to deliver fast, cost-efficient inference services.

Responsibilities & opportunities in this role:

Network Fabric Architecture and Design: Design end‑to‑end network topologies for new and existing data centers, covering IPv4/IPv6, BGP, OSPF, MPLS, and high‑availability fabric. Provide a scalable, fault‑tolerant foundation that keeps inference pipelines running 24/7.
Hardware Deployment & Optimization: Deploy, configure, and tune Cisco, Juniper, and Arista switches, routers, and firewalls at massive scale. Ensure optimal throughput, low jitter, and predictable performance for ML workloads.
Documentation and Bill‑of‑Materials (BOM) Management: Create and maintain accurate BOMs for all fabric components (switches, line cards, transceivers, cables, racks). Validate BOMs against design specifications and update them as hardware revisions or new models are introduced.
Cross functional collaboration: Partner with Data Center Engineering (power, cabling, floor layouts) teams to understand traffic profiles and future scaling needs.

Ideal candidates have/are:

Hardware Proficiency – Hands‑on experience with Cisco Nexus, Juniper QFX, and Arista 7500/7800 series switches, including line‑card and transceiver management.
GPU Clusters – RoCEv2 –
BOM & Procurement Skills – Experience creating and maintaining BOMs, coordinating with procurement, and managing inventory.
Automation & Scripting – Strong background in Ansible, Terraform, Python, and vendor APIs for configuration management.
Monitoring & Telemetry – Familiarity with Prometheus and OpenTelemetry for port‑level visibility.
Soft Skills – Excellent analytical, communication, and collaboration abilities; comfortable mentoring and documenting complex designs.
Bonus – Experience with ML traffic patterns, SD‑WAN, or contributions to open‑source fabric projects.

Attributes of a Groqster:

Humility – Egos are checked at the door
Collaborative & Team Savvy – We make up the smartest person in the room, together
Growth & Giver Mindset – Learn it all versus know it all, we share knowledge generously
Curious & Innovative – Take a creative approach to projects, problems, and design
Passion, Grit, & Boldness – No-limit thinking, fueling informed risk taking

Compensation:At Groq, a competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, the base salary range is $203,200 to $239,100, determined by your location, skills, qualifications, experience and internal benchmarks. This range is specific to roles in the United States, compensation for candidates outside the USA will be dependent on the local market.

#LI-Remote, #LI-Hybrid, #LI-Onsite

Groq is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex (including gender identity, sexual orientation, and pregnancy), age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.

Groq complies with all applicable federal, state, and local laws governing nondiscrimination in employment. We do not tolerate discrimination or harassment based on any protected characteristic.

Groq is committed to working with and providing reasonable accommodations to qualified individuals with physical or mental disabilities. If you require a reasonable accommodation to complete an application or to participate in the hiring process, please contact us at talent@groq.com. This contact is for accommodation requests only, which will be considered on a case-by-case basis.

All offers of employment are contingent upon verification of the applicant’s identity and employment authorization in accordance with federal law.

Groq encourages people with criminal record histories to apply for employment, and values diverse experiences, including prior contact with the criminal legal system. To that end, Groq welcomes such applicants in accordance with the California Fair Chance Act, Los Angeles City Fair Chance Act Ordinance, Los Angeles County Fair Chance Act Ordinance, and San Francisco Fair Chance Act Ordinance. Philadelphia applicants can review information pertaining to Philadelphia’s Fair Criminal Record Screening Standards Ordinance here: https://www.phila.gov/documents/fair-chance-hiring-law-poster.

Req ID: R669

Apply now

See more open positions at Groq

Privacy policy Cookie policy