Lead Data Software Engineer
EPAM Systems
Lead Data Software Engineer Description
We are seeking an experienced and skilled Lead Data Software Engineer to spearhead the development of robust data solutions, drive stakeholder engagement, and lead a high-performing team in creating scalable applications using cutting-edge technologies.
As a pivotal member, you will combine strong technical expertise with leadership capabilities to deliver impactful solutions in a dynamic US timezone environment.
#LI-DNI
Responsibilities
- Design and develop scalable data pipelines using Python and SQL
- Lead by example in application development using microservices architecture, CI/CD, and unit testing frameworks
- Implement and maintain cloud-based solutions leveraging AWS components like EC2, S3, Lambda, and RDS
- Manage and optimize data processing workflows with tools such as Hive and Spark
- Oversee system design, ensuring compliance with data structures, algorithms, and best practices
- Collaborate with stakeholders to gather requirements and translate them into technical solutions
- Explore database solutions such as DynamoDB and Elasticsearch to enhance performance
- Guide the team in building test-driven development strategies, ensuring high-quality code integrity
- Support data orchestration efforts using tools like Airflow and data warehousing techniques
- Drive the creation, automation, and troubleshooting of CI/CD pipelines for seamless delivery
- Mentor and work with teams of 5-10 developers, encouraging professional growth
- Implement documentation standards and facilitate well-organized technical writing across the team
Requirements
- 5+ years of working experience in software engineering or data engineering roles
- Must have proficiency in Python and SQL for application and data development
- Background in cloud technologies including AWS (EC2, S3, Lambda, DynamoDB, SQS)
- Expertise in creating unit testing cases using mock frameworks, ensuring robust CI/CD processes
- Showcase of knowledge in data processing frameworks such as Spark and Hive
- Competency in data structures, algorithms, and system design
- Familiarity with Flask, microservices, and pipeline automation processes
- Understanding of data modeling principles and orchestration tools such as Airflow
- Flexibility to engage with stakeholders and manage communications effectively
- Qualifications in test-driven development approaches and constructing scalable data pipelines
Nice to have
- Familiarity with Elasticsearch for enhancing data retrieval and management
- Background in DynamoDB database usage within application designs
- Experience with advanced data modeling and schema optimization techniques
We offer
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice and Policy.