Software Engineer (Big Data)
Back icon

Software Engineer (Big Data)

Software Engineer (Big Data)

We are currently looking for Big Data Engineers in India for our offices in multiple locations & Remote working.

We are looking for an experienced Big Data Engineers to work on critical application & product development. You'll be a part of a modern, lean, self-governing engineering team.

Requirements

  • 3 to 5 Years of IT & Big Data technologies experience
    • Expert level understanding of distributed computing principles
      • Expert level knowledge and experience in Apache Spark
        • Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
          • Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
            • Experience with messaging systems, such as Kafka or RabbitMQ
              • Good understanding of Big Data querying tools, such as Hive, and Impala
                • Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
                  • Good understanding of SQL queries, joins, stored procedures, relational schemas
                    • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
                      • Knowledge of ETL techniques and frameworks
                        • Performance tuning of Spark Jobs
                          • Experience with native Cloud data services AWS or AZURE or GCP (Preferred)
                            • Ability to lead a team efficiently
                              • Experience with designing and implementing Big data solutions
                                • Practitioner of AGILE methodology

                                  Technologies

                                  • Big Data
                                    • Spark
                                      • Hadoop
                                        • Hive
                                          • Python
                                            • Mapreduce
                                              • Scala

                                                We offer

                                                • Opportunity to work on technical challenges that may impact across geographies
                                                  • Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
                                                    • Opportunity to share your ideas on international platforms
                                                      • Sponsored Tech Talks & Hackathons
                                                        • Unlimited access to LinkedIn learning solutions
                                                          • Possibility to relocate to any EPAM office for short and long-term projects
                                                            • Focused individual development
                                                              • Benefit package: Health benefits, Retirement benefits, Paid time off, Flexible benefits
                                                                • Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
                                                                  Apache Spark
                                                                  Big Data
                                                                  Python
                                                                  Scala
                                                                  Apache Hive
                                                                  Apache MapReduce
                                                                  Apache Hadoop
                                                                  hot

                                                                  Office

                                                                  Vacancy type

                                                                  Bangalore, Chennai, Gurgaon, Hyderabad, Pune

                                                                  Cities eligible for the position