Your Role
Design and Implementation of Data Pipelines:
- Design and implement data pipelines to collect, transform, and integrate data from various sources (databases, files, APIs, etc.).
- Develop and design integration solutions for both cloud and on-premise platforms.
- Develop and maintain database management systems and data warehouses for efficient data storage and organization.
- Collaborate with IT teams to ensure the correct application of business rules and compliance with regulations during data collection and transformation.
- Identify data needs and enhance the data foundation as part of Data projects.
Data Quality and System Maintenance:
- Ensure data quality, integrity, and security by implementing appropriate controls and processes.
- Optimize the performance of data systems to meet real-time analysis and reporting needs.
- Clearly document processes, methods, and results to facilitate knowledge transfer and replication by others.
- Develop and maintain incident recovery plans to ensure constant data availability.
- Participate in evaluating and adopting new technologies and tools related to data engineering.
Your Team
You will be part of the Data Lab team at Effyis.
Your Qualifications
- Engineering, business degree, or equivalent with over 3 years of experience in similar projects.
- Proficiency in the Jira tool and Scrum methodology.
- Mastery of programming languages such as Python, Java, Scala, or others.
- Experience with data processing frameworks like Apache Spark for complex transformations and managing large datasets.
- Experience implementing solutions on cloud platforms such as AWS, Azure, or Google Cloud.
- Strong communication and organizational skills.
Benefits
- Health insurance coverage
- Additional retirement benefits
- Monthly mission bonus
- Personalized training path
Recruitment Process
- Phone Interview
- HR Interview
- Technical Interview
- Courtesy Interview