Engineering & Technology
Leader
Poland; Ukraine

Lead Big Data Software Engineer (Databricks + AWS)

ABOUT THE ROLE

In this role, you will lead the design and development of scalable data platforms on AWS, with a strong focus on the Databricks ecosystem. You will guide a team of engineers, shape architectural decisions, and ensure high-quality delivery of both batch and streaming data solutions. You will work closely with business and technical stakeholders, contributing across the full project lifecycle, from discovery and design to production implementation, within a collaborative and innovation-driven environment.

RESPONSIBILITIES

  • Design and implement scalable data solutions using Databricks on AWS, including Lakehouse architectures based on Delta Lake and Unity Catalog
  • Lead the development of batch and streaming data pipelines using technologies such as Apache Spark or Flink
  • Define and own source-to-target mappings, supporting data ingestion and integration from multiple sources
  • Drive architecture decisions and contribute to scaling the data platform and data models
  • Collaborate with stakeholders to gather requirements and translate them into technical solutions and implementation plans
  • Guide and support a team of data engineers, defining scope, priorities, and best practices
  • Develop and manage workflows using orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA
  • Work with streaming platforms such as Apache Kafka, Amazon MSK, or Kinesis for real-time data processing
  • Leverage data storage and analytics solutions such as Snowflake or Amazon Redshift
  • Ensure proper documentation of data models, schemas, and architecture decisions
  • Participate in the full project lifecycle, from PoC and MVP to full-scale implementation
  • Explore new technologies, build prototypes, and contribute to knowledge sharing within the engineering community

REQUIREMENTS

  • Proven experience as a Lead Data Engineer with a strong focus on data pipeline design
  • Hands-on experience with both batch and streaming data processing
  • Strong expertise in AWS cloud platform and Databricks (including Delta Lake, Unity Catalog, Workflows, and Jobs)
  • Proficiency in Python (preferred), Scala, or Java, along with strong SQL skills
  • Solid knowledge of big data technologies such as Apache Spark or Flink
  • Experience with workflow orchestration tools such as Databricks Workflows, Apache Airflow, or MWAA
  • Practical experience with streaming platforms such as Apache Kafka, Amazon MSK, or Kinesis
  • Familiarity with data warehousing solutions such as Snowflake or Amazon Redshift
  • Experience working with data formats and tools such as Avro, GitHub, and SQL-based systems
  • Ability to translate business requirements into technical solutions and guide teams toward delivery
  • Strong leadership and communication skills, with experience working with cross-functional stakeholders
  • Upper-intermediate or higher level of English

SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe.

#LI-Remote

Role Summary

Location

Poland, Ukraine

Work type

Remote/Office

Direction

Engineering & Technology

Tech level

Leader

Personal recruiter:

Paulina Przybylska-Pilch

Personal recruiter

Apply Now

Fill out the form, and we'll be in touch shortly.

CV/Resume in English will speed up its processing time
Upload file

About us

We are a digital engineering and technology consulting company where expertise grows alongside people. For more than 30 years, we have been elevating technology: helping organizations navigate complex business challenges by combining deep engineering knowledge with thoughtful, research-backed innovation. Our teams work across key areas: digital engineering, data and analytics, Сloud, and AI/ML. In each, we deliver practical, scalable solutions rooted in real business needs and measurable human impact.

You bring your perspective and ambition. We create an environment where your work meets clarity, confidence, and purpose.

About us

We offer

Flexible Work Model

Work from home, from the office, or in a hybrid format that supports focus and collaboration.

Compensation & Benefits

Competitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.

People-first Leadership

Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.

Advanced tech communities

Stay close to AI/ML, Cloud, Quantum Computing, IoT, and Robotics communities, with projects built on modern frameworks.

More opportunities available

Browse all open positions to find the best fit for your experience.

Browse all positions
100865