Back icon

Data Quality Engineer (Big Data)

Data Quality Engineer (Big Data)

We are currently looking for Automation Engineers in India for our offices in multiple locations.

We are looking for experienced Test Automation Engineer to work on critical application & product development. You'll be a part of a modern, lean, self-governing engineering teams.


  • Work with Data Engineers and Data Product Managers to develop functional and regression tests to ensure the quality of data
    • Work in a focused and nimble team that collaborates on common problems across products and focus areas
      • Involved in all phases of product development, starting from requirements to validation and deployment
        • Own components, processes, and workflows that demand professionalism, excellent communication, teamwork, and documentation skills
          • Create, maintain, and improve automation test suites and frameworks
            • Monitor and maintain CI/CD pipelines
              • Effectively communicate and report issues to project teams


                • Hands on experience with MapReduce or other Hadoop implementations including a deep understanding of Hive or Pig to query and process data in Hadoop
                  • Proficiency in Java or a similar Object-Oriented language along with strong scripting skills (Java/bash/Python)
                    • Expert level experience with SQL, TSQL or HQL to validate ETL jobs
                      • Experience with at least one mainstream Data Warehousing system (Snowflake, Vertica, Oracle) along with expert knowledge of Data Warehouse concepts
                        • Familiarity with high-volume low latency data platform and technology stacks such as Spark, Kafka, Druid and etc
                          • Experience in testing of the data ingestion pipelines and data quality
                            • Excellent troubleshooting skills to triage complex issues
                              • Experience working within a CI/CD environment along with familiarity of Jenkins
                                • Experience with automation tools such as TestNG, JUnit
                                  • Passion for software test development and proven ability to test enterprise distributed systems
                                    • Strong quality and automation mindset


                                      • Core Java
                                        • Selenium
                                          • Strong in SQL TSQL
                                            • CI CD
                                              • REST API
                                                Apache Hadoop
                                                Apache Spark
                                                Big Data
                                                BI Development



                                                For you

                                                • Insurance Coverage 
                                                • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                                • Financial assistance for medical crisis 
                                                • Retiral Benefits – VPF and NPS 
                                                • Customized Mindfulness and Wellness programs 
                                                • EPAM Hobby Clubs

                                                For your comfortable work

                                                • Hybrid Work Model 
                                                • Soft loans to set up workspace at home 
                                                • Stable workload 
                                                • Relocation opportunities with ‘EPAM without Borders’ program


                                                For your growth

                                                • Certification trainings for technical and soft skills 
                                                • Access to unlimited LinkedIn Learning platform 
                                                • Access to internal learning programs set up by world class trainers 
                                                • Community networking and idea creation platforms 
                                                • Mentorship programs 
                                                • Self-driven career progression tool


                                                Bangalore, Chennai, Gurgaon, Hyderabad, Pune

                                                Cities eligible for the position