Flexible work model
Work from home, from the office, or in a hybrid format that supports focus and collaboration.
About the role
Our client builds and operates hybrid infrastructure, spanning on-premises GPU clusters and multi-cloud environments, for enterprise banking clients. You'll join a delivery team managing large-scale Kubernetes and cloud infrastructure for demanding, security-critical AI/ML and business workloads.
This is a US-based role (New York City, Jersey City, Lake Mary, FL, or Pittsburgh) with an anticipated base salary range of $144,000–$168,000 annually.
Responsibilities
- Plan, build, and maintain on-premises Kubernetes clusters with GPU acceleration (Rancher/BCM/Vanilla)
- Design and deploy secure multi-cloud landing zones (GCP and Azure) using Terraform/Terragrunt
- Set up and manage CI/CD pipelines (Jenkins, GitLab) for infrastructure and application delivery
- Implement identity and access management solutions (Keycloak, Azure AD, SAML/OIDC)
- Configure networking, firewalls, VPNs, and load balancing across hybrid environments
- Ensure infrastructure meets banking-grade compliance and security standards
- Collaborate directly with client stakeholders and lead small delivery teams
Requirements
- 5+ years of experience in DevOps/Cloud Engineering, with exposure to both cloud and on-premises environments
- Strong hands-on Kubernetes experience, including GPU cluster management
- Proficiency with Terraform, Terragrunt, Packer, and Ansible
- Experience with IAM/SSO integration and security systems in enterprise or banking environments
- Solid networking fundamentals (firewalls, VPNs, load balancing, peering)
- Experience working directly with banking or other regulated industry clients
SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.
Role Summary
Location
New York, NY, New Jersey
Work type
Office
Direction
Engineering & Technology
Subdirection
Clouds & DevOps
Tech level
Senior
Apply Now
Fill out the form, and we'll be in touch shortly.
About us
We are a digital engineering and technology consulting company where expertise grows alongside people. For more than 30 years, we have been elevating technology: helping organizations navigate complex business challenges by combining deep engineering knowledge with thoughtful, research-backed innovation. Our teams work across key areas: digital engineering, data and analytics, Сloud, and AI/ML. In each, we deliver practical, scalable solutions rooted in real business needs and measurable human impact.
You bring your perspective and ambition. We create an environment where your work meets clarity, confidence, and purpose.
We offer
Compensation & Benefits
Competitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.
People-first Leadership
Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.
Advanced tech communities
Stay close to AI/ML, Cloud, Quantum Computing, IoT, and Robotics communities, with projects built on modern frameworks.