Search by job, company or skills

GCP Data Engineer

GCP Data Engineer

Tata Consultancy Services
6-10 Years
Not Disclosed
  • Posted 5 hours ago
  • Be among the first 10 applicants

Job Description

Job description

Job Description

Role: Google Data Engineer

Experience: 6-10 Years

Location: Chennai, Bengaluru, Hyderabad, Pune, Kochi, Kolkata, NCR, Delhi

Virtual Interview: 10th Oct

Required Technical Skill Set:

SQL + GCP (BigQuery, Pub/Sub, Dataflow, Composer DAGs, Airflow)

Key Requirements:

  • Experience in BigQuery, Pub/Sub, Dataflow, Composer DAGs, and Airflow.
  • Strong SQL knowledge with the ability to translate complex business scenarios into efficient queries.
  • Experience in data modeling and data mapping.
  • Hands-on experience with Google Cloud SDK and API scripting.
  • Strong programming experience in Python.
  • Experience working in Agile processes and DevOps methodologies.
  • Retail domain experience will be an added advantage.

Responsibilities:

  • Create and maintain optimal data pipeline architecture, replicating existing processes.
  • Analyze, explore, and select appropriate tools for data migration and transformation.
  • Assemble large, complex datasets that meet functional and non-functional business requirements.
  • Ensure data security through masking and encryption techniques.
  • Work with data and analytics experts to improve data system functionality.
  • Identify, design, and implement process improvements by automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.

Note: Please apply only if your experience and skill set align with the requirements mentioned above.

We are not looking for immediate joiners. We are specifically seeking candidates who have a 90-day notice period.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

API scripting

DAGs

GCP BigQuery

Google Cloud SDK

Similar Jobs

7-9 yrs
Bengaluru, India
Skills:
BigQuery, Gcp, Dataproc, DataFlow, Sql, Python, PUB SUB
6-8 yrs
Bengaluru, India
Skills:
BigQuery, Sql, Gcp, Rest Apis, Python, Airflow, Cloud Functions, Pub Sub, Cloud Composer, Cloud Run, Eventarc, GCS, DataForm
7-9 yrs
Bengaluru, India
Skills:
Java, BigQuery, Dataproc, Sql, ELT, Devops, Cloud Storage, Compute Engine, Spark, Apache Beam, DataFlow, Data Analytics, Kubernetes, Python, Etl, Air Flow, Colab, cloud security best practices, Looker, Data Lake Engineering, Pub Sub, Vertex AI
5-8 yrs
Bengaluru, India
Skills:
BigQuery, Pyspark, Dataproc, Data Modeling, Sql, ELT, Git, Python, Etl, GCP data services, Cloud Dataflow, Pub Sub, Cloud Composer, CI CD tools, performance optimization, partitioning, GCS
8-12 yrs
Bengaluru, India
Skills:
Github, Cloud Storage, Docker, Python, AWS, Java, BigQuery, Hadoop, Scala, Sql, Jenkins, Gcp, Spark, Apache Kafka, Apache Beam, DataFlow, Azure, Kubernetes, Go, Flink, Pub Sub, Cloud Composer, GCP Data Products, Spinnaker