Back icon

Lead Software Engineer - Big Data

Lead Software Engineer - Big Data

We are currently looking for Lead Data Engineer in India for our offices in multiple locations.

We are looking for experienced Data Engineers to work on critical application & product development. You'll be a part of a modern, lean, self-governing engineering teams.

Requirements

  • 8 to 13 Years of in Big Data & Data related technology experience
    • Expert level understanding of distributed computing principles
      • Expert level knowledge and experience in Apache Spark
        • Hands on programing with Python / Java / Scala
          • Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
            • Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
              • Experience with messaging systems, such as Kafka or RabbitMQ
                • Good understanding of Big Data querying tools, such as Hive, and Impala
                  • Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
                    • Good understanding of SQL queries, joins, stored procedures, relational schemas
                      • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
                        • Knowledge of ETL techniques and frameworks
                          • Performance tuning of Spark Jobs
                            • Experience with native Cloud data services AWS or AZURE or GCP (Preferred)
                              • Ability to lead a team efficiently
                                • Experience with designing and implementing Big data solutions
                                  • Practitioner of AGILE methodology

                                    Technologies

                                    • Big Data
                                      • Spark
                                        • AWS
                                          • Python
                                            • Scala
                                              • Hive
                                                • Data Engineering
                                                  Big Data
                                                  Apache Spark
                                                  Python
                                                  Scala
                                                  Amazon Web Services

                                                  Benefits

                                                  ImageImage

                                                  For you

                                                  • Insurance Coverage 
                                                  • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                                  • Financial assistance for medical crisis 
                                                  • Retiral Benefits – VPF and NPS 
                                                  • Customized Mindfulness and Wellness programs 
                                                  • EPAM Hobby Clubs
                                                  ImageImage

                                                  For your comfortable work

                                                  • Hybrid Work Model 
                                                  • Soft loans to set up workspace at home 
                                                  • Stable workload 
                                                  • Relocation opportunities with ‘EPAM without Borders’ program

                                                  ImageImage

                                                  For your growth

                                                  • Certification trainings for technical and soft skills 
                                                  • Access to unlimited LinkedIn Learning platform 
                                                  • Access to internal learning programs set up by world class trainers 
                                                  • Community networking and idea creation platforms 
                                                  • Mentorship programs 
                                                  • Self-driven career progression tool

                                                  hot

                                                  Bangalore, Chennai, Gurgaon, Hyderabad, Pune

                                                  Cities eligible for the position