GCP Infrastructure and Data Engineer (Java and Data flow with Apache Beam)

Job Overview

logoWho We Are

Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.

Job Description

Job Title : GCP Infrastructure and Data Engineer (Java and Data flow with Apache Beam)

Job Type : W2 / C2C / 1099

Experience : 7-10 Years

Location : Remote

Responsibilities

Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. Use Pub/Sub for real-time data ingestion and streaming analytics. Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed. Optimize data storage and retrieval processes to enhance performance and reduce costs. Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services. Ensure data quality and integrity through robust testing and validation processes. Stay updated with the latest GCP features and best practices, integrating them into existing workflows. Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing.

Requirements

Proven experience as a Data Engineer with a focus on GCP services. Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub. Hands-on experience with Terraform for provisioning and managing GCP infrastructure. Proficiency in SQL and Python for data manipulation and analysis. Solid understanding of data warehousing concepts and ETL processes. Experience with real-time data processing and streaming analytics. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills.

Preferred Qualifications

Google Cloud Professional Data Engineer certification. Experience with other GCP services like Cloud Storage, Cloud Functions, and Cloud Composer. Familiarity with other IaC tools such as Ansible or Cloud Deployment Manager. Experience with containerization technologies like Docker and Kubernetes. Knowledge of data security and governance practices.

Qualification

Bachelor’s degree or equivalent combination of education and experience.

Job Detail
Shortlist Never pay anyone for job application test or interview.

Related Jobs (1415)

Safety Information

  • Safety Tips for Candidate

    Do Your Own Research.

  • Safety Tips for candidate

    Call the number provided in the ad.

  • Safety Tips for candidate

    Call the number provided in the ad.