Lead Big Data Engineer
Back icon

Lead Big Data Engineer

Lead Big Data Engineer

We are currently looking for Lead Big Data Software Engineers in India for our offices in multiple locations.

We are looking for an experienced Big Data Engineers to work on critical application & product development. You'll be a part of a modern, lean, self-governing engineering team.

Requirements

  • 9 to 14 Years of IT & Big Data technologies experience
    • Expert level understanding of distributed computing principles
      • Expert level knowledge and experience in Apache Spark
        • Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
          • Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
            • Experience with messaging systems, such as Kafka or RabbitMQ
              • Good understanding of Big Data querying tools, such as Hive, and Impala
                • Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
                  • Good understanding of SQL queries, joins, stored procedures, relational schemas
                    • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
                      • Knowledge of ETL techniques and frameworks
                        • Performance tuning of Spark Jobs
                          • Experience with native Cloud data services AWS or AZURE or GCP (Preferred)
                            • Ability to lead a team efficiently
                              • Experience with designing and implementing Big data solutions
                                • Practitioner of AGILE methodology

                                  Technologies

                                  • hadoop
                                    • HDFS
                                      • Map Reduce
                                        • NoSQL
                                          • AWS
                                            • Azure
                                              • GCP
                                                • Hive
                                                  • Impala
                                                    • Sqoop
                                                      • Apache Spark
                                                        • Mapreduce
                                                          • HBase
                                                            • Cassandra
                                                              • MongoDB
                                                                Apache Spark
                                                                Apache Hadoop
                                                                Python
                                                                Apache Hive
                                                                Apache Impala
                                                                Scala
                                                                Apache MapReduce

                                                                Benefits

                                                                ImageImage

                                                                For you

                                                                • Insurance Coverage 
                                                                • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                                                • Financial assistance for medical crisis 
                                                                • Retiral Benefits – VPF and NPS 
                                                                • Customized Mindfulness and Wellness programs 
                                                                • EPAM Hobby Clubs
                                                                ImageImage

                                                                For your comfortable work

                                                                • Hybrid Work Model 
                                                                • Soft loans to set up workspace at home 
                                                                • Stable workload 
                                                                • Relocation opportunities with ‘EPAM without Borders’ program

                                                                ImageImage

                                                                For your growth

                                                                • Certification trainings for technical and soft skills 
                                                                • Access to unlimited LinkedIn Learning platform 
                                                                • Access to internal learning programs set up by world class trainers 
                                                                • Community networking and idea creation platforms 
                                                                • Mentorship programs 
                                                                • Self-driven career progression tool

                                                                hot

                                                                Bangalore, Chennai, Gurgaon, Hyderabad, Pune

                                                                Cities eligible for the position