Senior Data Software Engineer (AWS, Databricks)
EPAM Systems
Senior Data Software Engineer (AWS, Databricks) Description
We are looking for Senior Data Software Engineers to join our growing Data Practice and make our team even stronger. Our projects and technologies are very diverse and cover all technologies currently on the market and are represented by open-source communities.
We are providing our service to Clients in different domains: Financial, Health Care, Insurance and many others, so you will have a chance to develop yourself in any direction you want.
#LI-DNI#EasyApply
Responsibilities
- Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP
- Research and utilize Big Data technologies for effective data ingestion
- Process and transform data using tools such as Spark and various Cloud Services
- Understand and execute project-specific business logic through programming languages supported by the primary data platform
- Optimize data retrieval, develop dashboards, and perform data validation
- Collaborate with diverse teams including data scientists, analysts, and IT professionals
- Provide thought leadership on Big Data best practices and technology trends
- Maintain and ensure integrity and security of big data sources and platforms
- Perform troubleshooting, debugging, and upgrading of big data systems and applications
Requirements
- 5+ years experience in software development with Big Data technologies
- Advanced knowledge of Python
- Vast experience with AWS
- Proficiency with Spark and Databricks
- Demonstrated experience with big data models, databases, and tools
- Strong understanding of different data file formats like JSON, Parquet, Avro
- Hands-on experience with SQL and NoSQL databases, including Cassandra and MongoDB
- Proficiency in data warehousing solutions, ETL processes
- Proven ability to work within a fast-paced, team-oriented environment
- Detail-oriented with excellent analytical and problem-solving skills
- Knowledge of software development methodologies and best practices
- Exceptional oral and written communication skills in English (B2+)
- Bachelor’s degree in Computer Science, Mathematics or related technical field
Nice to have
- Proficiency in Hadoop, Oozie, Airflow, HDFS, YARN
- Experience with message queues, especially Kafka
- Production experience in search technologies such as Solr, OpenSearch, or Lucene
We offer
- We gather like-minded people:
- Engineering community of industry professionals
- Friendly team and enjoyable working environment
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Relocation within our 50+ offices
- We provide growth opportunities:
- Outstanding career roadmap
- Leadership development, career advising, soft skills, and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning, Get Abstract, O’Reilly, Cloud Guru
- Language classes in English and Polish for foreigners
- We cover it all:
- Stable income (Employment Contract or B2B)
- Participation in the Employee Stock Purchase Plan
- Benefits package (health insurance, multisport, shopping vouchers)
- Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
- Referral bonuses
- Corporate, social and well-being events
- Please, note:
- The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview
- We will reach out to selected candidates exclusively
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.