Flexible work model
Work from home, from the office, or in a hybrid format that supports focus and collaboration.
ABOUT THE ROLE
In this role you will be responsible for building and maintaining automated data validation to ensure consistency and accuracy across cloud migration environments. It owns the validation of data integrity across processing layers, storage systems, and orchestration workflows to guarantee reliable outcomes. The role integrates quality checks into automated pipelines and produces evidence to support migration readiness and sign-off. It ensures trusted data and enables a successful, reliable cloud migration across complex systems.
RESPONSIBILITIES
- Design and implementation of automated data validation pipelines comparing AWS and GCP outputs using Python and Databricks
- Development and maintenance of data parity checks across ETL processing layers
- Validation of message integrity across Kafka clusters and downstream processing stages
- Execution of object parity, replication-lag, and stored-procedure validation for migrated data stores
- Validation of DAG execution, scheduling, retry logic, and alerting parity following Cloud Composer and Airflow migration
- Execution of bronze, silver, and gold layer parity validation during parallel operations
- Verification of pipeline telemetry and data-quality alerting as operational readiness evidence
- Creation of automated data quality gates integrated into Jenkins CI pipelines
- Collaboration with engineering teams on migration-wave acceptance criteria and validation scope
- Adoption of AI-assisted and agentic workflows for validation, test authoring, and defect analysis
- Production of data validation evidence packs supporting migration acceptance and sign-off
REQUIREMENTS
- 4+ years of experience in data quality engineering and automated data validation for distributed systems
- Proficiency in Python for development of data validation frameworks and automated data quality checks
- Strong Databricks experience for data comparison, SQL-based validation, and notebook-driven analysis
- Advanced SQL knowledge for complex validation and reconciliation queries
- Experience with Kafka for message integrity validation and data flow verification
- Experience with Redis validation, including key/value parity, TTL behavior, and identity or control-state consistency checks
- Expertise in object parity validation across data stores such as S3 and GCS, including counts, sizes, checksums, retention, and delta synchronization
- Experience with replication-lag validation and stored-procedure parity testing on Cloud SQL
- Experience with CI/CD processes and Jenkins-based test orchestration
- Strong analytical and detail-oriented approach to identifying data discrepancies across ETL layers and processing stages
- Familiarity with data quality monitoring and observability practices
- Experience leveraging AI-assisted workflows and AI coding agents for validation, automation, and data analysis
- Strong communication skills with the ability to collaborate effectively with English-speaking client-side engineering teams
SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe.
Role Summary
Location
Bulgaria, Poland, Romania
Work type
Remote/Office
Direction
Software Testing
Tech level
Senior
Apply Now
Fill out the form, and we'll be in touch shortly.
About us
We are a digital engineering and technology consulting company where expertise grows alongside people. For more than 30 years, we have been elevating technology: helping organizations navigate complex business challenges by combining deep engineering knowledge with thoughtful, research-backed innovation. Our teams work across key areas: digital engineering, data and analytics, Сloud, and AI/ML. In each, we deliver practical, scalable solutions rooted in real business needs and measurable human impact.
You bring your perspective and ambition. We create an environment where your work meets clarity, confidence, and purpose.
We offer
Compensation & Benefits
Competitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.
People-first Leadership
Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.
Advanced tech communities
Stay close to AI/ML, Cloud, Quantum Computing, IoT, and Robotics communities, with projects built on modern frameworks.