Engineering & Technology
Senior
New York, NY; New Jersey

Senior/Lead GCP DevOps Engineer (ML/AI)

About the role

You'll join a cloud engineering team responsible for designing and operating GCP infrastructure and AI-powered workloads for high-profile, security-conscious clients.

Our client delivers secure, large-scale cloud and AI infrastructure for the enterprise and banking sectors, helping them modernize legacy systems and safely adopt AI/ML technologies.

This is a US-based role (New York City, Jersey City, Lake Mary, FL, or Pittsburgh) with an anticipated base salary range of $144,000–$168,000 annually.

Responsibilities

  • Design, deploy, and maintain GCP infrastructure, including secure Landing Zones (VPC, IAM, VPC Service Controls, Cloud KMS)
  • Lead deployment and operations of AI/ML infrastructure, including GPU-accelerated workloads and LLM inference platforms (NVIDIA NIM, Vertex AI)
  • Build and maintain CI/CD pipelines and infrastructure-as-code (Terraform, Jenkins/GitLab)
  • Implement cost optimization strategies across production and non-production environments
  • Ensure compliance and security best practices for handling sensitive data in regulated industries
  • Mentor engineers and act as a technical point of contact for client engagements

Requirements

  • 5+ years of experience in DevOps/Cloud Engineering, with a strong focus on Google Cloud Platform
  • Proven experience with Kubernetes, Docker, and container orchestration at scale
  • Strong scripting/automation skills (Python, Bash, Terraform)
  • Experience with IAM, network security, and compliance frameworks in regulated industries (banking/finance preferred)
  • Familiarity with AI/ML infrastructure and LLM deployment tooling is a strong plus
  • GCP Professional certifications (Cloud Architect, Cloud Engineer, Network Engineer) are a plus

SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.

#LI-DNI

#LI-Onsite

Role Summary

Location

New York, NY, New Jersey

Work type

Office

Direction

Engineering & Technology

Subdirection

Clouds & DevOps

Tech level

Senior

Personal recruiter:

Maria Zuno

Personal recruiter

Apply Now

Fill out the form, and we'll be in touch shortly.

CV/Resume in English will speed up its processing time
Upload file

About us

We are a digital engineering and technology consulting company where expertise grows alongside people. For more than 30 years, we have been elevating technology: helping organizations navigate complex business challenges by combining deep engineering knowledge with thoughtful, research-backed innovation. Our teams work across key areas: digital engineering, data and analytics, Сloud, and AI/ML. In each, we deliver practical, scalable solutions rooted in real business needs and measurable human impact.

You bring your perspective and ambition. We create an environment where your work meets clarity, confidence, and purpose.

About us

We offer

Flexible work model

Work from home, from the office, or in a hybrid format that supports focus and collaboration.

Compensation & Benefits

Competitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.

People-first Leadership

Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.

Advanced tech communities

Stay close to AI/ML, Cloud, Quantum Computing, IoT, and Robotics communities, with projects built on modern frameworks.

More opportunities available

Browse all open positions to find the best fit for your experience.

Browse all positions
101984