Engineering & Technology
Senior
Ukraine

Senior Big Data Engineer (Scala, Kafka)

ABOUT THE ROLE

In this role, you will contribute to a geospatial IoT telemetry platform that ingests, parses, enriches, and stores telemetry from a global fleet of agricultural and construction machinery. You will work with streaming and batch data pipelines, processing telemetry from multiple on-board protocols and vendor formats using technologies such as Apache Flink, Spark, Delta Lake, and Databricks, while contributing to the architecture and development of scalable data solutions.

RESPONSIBILITIES

  • Lead architecture discovery and design for new telemetry-enrichment mechanisms, including requirements gathering, mapping existing data flows and cross-service dependencies, and proposing target architecture
  • Design and implement telemetry parsers for vendor IoT protocols, converting raw device payloads into a unified telemetry domain model
  • Extend streaming Apache Flink pipelines with new IoT domain features, signal-catalog updates, and production hot-fixes
  • Maintain and extend signal catalogs used by parsers to map vendor signal codes into the unified data model
  • Work across streaming (Apache Flink) and batch (Apache Spark and Delta Lake) data pipelines, including HBase and GeoMesa geo-indexed persistence
  • Develop comprehensive unit and pipeline-level tests using ScalaTest and local Flink/Spark test environments
  • Use Databricks to query and analyze telemetry data from Delta Lake for investigations, data quality checks, and feature validation
  • Participate in code reviews and PR-based delivery using Azure DevOps, collaborating with downstream API and application teams

REQUIREMENTS

  • Strong hands-on experience with Scala for production software or data engineering solutions
  • Experience building and maintaining large-scale data processing pipelines using Apache Flink and/or Apache Spark
  • Solid experience with event-driven and streaming technologies such as Azure Event Hubs or Apache Kafka
  • Understanding of both streaming and batch data processing concepts and architectures
  • Experience working with Delta Lake and Databricks for data processing and analytics workloads
  • Experience working with data storage technologies such as HBase, GeoMesa, or similar distributed data stores
  • Strong understanding of software engineering practices, including automated testing, code reviews, and CI/CD workflows
  • Upper-intermediate or higher level of English
  • Experience with Apache Pekko or similar backend/microservice technologies (is a plus)

SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.

#LI-Remote

Role Summary

Location

Ukraine

Work type

Remote/Office

Direction

Engineering & Technology

Subdirection

Data & Analytics

Tech level

Senior

Personal recruiter:

Iryna Klimashenko

Personal recruiter

Apply Now

Fill out the form, and we'll be in touch shortly.

CV/Resume in English will speed up its processing time
Upload file

About us

We are a digital engineering and technology consulting company where expertise grows alongside people. For more than 30 years, we have been elevating technology: helping organizations navigate complex business challenges by combining deep engineering knowledge with thoughtful, research-backed innovation. Our teams work across key areas: digital engineering, data and analytics, Сloud, and AI/ML. In each, we deliver practical, scalable solutions rooted in real business needs and measurable human impact.

You bring your perspective and ambition. We create an environment where your work meets clarity, confidence, and purpose.

About us

We offer

Flexible work model

Work from home, from the office, or in a hybrid format that supports focus and collaboration.

Compensation & Benefits

Competitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.

People-first Leadership

Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.

Advanced tech communities

Stay close to AI/ML, Cloud, Quantum Computing, IoT, and Robotics communities, with projects built on modern frameworks.

More opportunities available

Browse all open positions to find the best fit for your experience.

Browse all positions
102602