Senior Data Engineer – REMOTE

Astek
  • Post Date: January 3, 2025
    • 39180
  • Applications 0
  • Views 1
Job Overview

logoHow about joining ASTEK Polska’s community of Data Engineers?

Salary: up to 1100 PLN net + VAT/MD (B2B) depending on your professional experience

Work model: Remote (NALA TIME ZONE)

About the project:We are seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. The ideal candidate will have a strong background in developing data pipelines, implementing data models, and executing best practices for developing data products. This role requires expertise in AWS, GitLab CI/CD, dbt, Snowflake, SQL, Python, Git, and DevOps, as well as hands-on experience with orchestrators such as Airflow and AutoMateNow, and data governance technologies like Monte Carlo and Collibra.

Your day-to-day responsibilities include:Develop Data Pipelines: Design, develop, and maintain robust, scalable, and efficient ETL/ELT pipelines to support diverse data sources and large-scale data processing.Data Modeling: Create and maintain data models and data architecture to ensure data integrity and optimum performance.Best Practices Implementation: Apply industry best practices in data warehousing, data governance, and data lifecycle management.Collaboration: Work closely with data scientists, analysts, and other stakeholders to gather requirements and deliver high-quality data products.Automation and CI/CD: Implement CI/CD pipelines using GitLab for automated testing, deployment, and integration of data workflows.Database Management: Manage and optimize Snowflake databases for performance, scalability, and cost-effectiveness.Coding and Scripting: Write efficient SQL queries and Python scripts to extract, load, and transform data.Version Control: Utilize Git for version control, ensuring traceable and manageable code changes.Orchestration: Utilize orchestration tools like Airflow and AutoMateNow to manage and automate data workflows.Data Governance: Implement and manage data governance and data observability solutions using technologies like Monte Carlo and Collibra.Monitoring and Optimization: Monitor data pipeline performance and troubleshoot issues to ensure reliability and efficiency.Documentation: Maintain comprehensive documentation for data pipelines, models, and processes.

You’re ideal for this role if you have:Minimum 5 years of experience in data engineering or a similar role.Proven experience with AWS cloud services related to data processing, such as S3, Redshift, Lambda, Glue, and Data Pipeline.Proficiency in designing and implementing CI/CD pipelines with GitLab.Experience with dbt (data build tool) for transforming data within the warehouse.Strong knowledge of Snowflake with hands-on experience in data warehousing solutions.Expertise in SQL for data querying, manipulation, and optimization.Proficiency in Python for scripting and automation tasks.Familiarity with DevOps practices and tools.Experience with orchestrators like Airflow and AutoMateNow.Knowledge of data governance and observability tools such as Monte Carlo and Collibra.Strong working knowledge of Git for version control.

It would be great if you also have:AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect.Experience with real-time data processing and streaming technologies (e.g., Kafka, Kinesis).

Your personality:You are a team playerYou are focused on long-term cooperationYou easily adopt to changes

Added value for you: Long-term cooperationPossibility to choose preferred type of cooperation (regular job contract with all benefits or flexible B2B contract)Technical trainings, certificates and upskillingCompetence Center mentoring- you will be a member of CC community from the first day of your work. You’ll have a chance to develop your skills, participate in various conferences and share your knowledge and experience with people who face the same challenges in their daily workClear career pathEmployee benefits packageFriendly work atmosphere, social events and team-building meetings

Need more information? Contact me: katarzyna.jaroszewska@astek.netIt’s not about you? Recommend us your friend and get a bonus up to 7,000 PLNNo ref: AO143860

Job Detail
Shortlist Never pay anyone for job application test or interview.

Related Jobs (1349)

Safety Information

  • Tips For Candidate

    DYOR.

  • Tips For Candidate

    Always check the employer\'s offer.