Kafka, Linux Commands, Shell scripting, Python, Spark SQL, Java, BigQuery, Scala, Spark, Databricks, Flink SQL, Metric iteration, Streaming ETL pipelines, Flink, Data quality monitoring, Real-time data ingestion, Cloud data environments, Pipeline orchestration, Incident review mechanisms, Binlog CDC, Data warehouse modelling, Real-time data SLA governance, Alert configuration, dbt, Relational Databases, Dashboard development

snowflake , Azure Data Factory (ADF), Power Bi, Azure Synapse Analytics, Databricks, Microsoft Azure, Python, Sql, Etl, ELT

Docker, Pyspark, Spark, Python, Sql, Kubernetes, AWS

Technical Documentation, Unix, Exception Handling, Database Management, Configuration management, Etl Development, Data Warehousing, Sql, Git, Pandas, Linux, Shell scripting, Gitlab, Python, Testing, Logging, Polars, Modular design, Command-line tools, CI/CD pipelines

Servicenow, Silicon.da, test data production data pipelines, SiliconDash, STDF, OptimalPlus, data quality management, Mes

Orchestration, Cloud Security, Pyspark, Apache Spark, Kafka, Sql, Databricks, Data Governance, Python, Platform Operations, Retrieval mechanisms, Performance optimisation, Knowledge Base and RAG solutions, Batch and streaming pipelines, Access Management, Troubleshooting, Embeddings, Vectorisation, GenAI applications, Delta Lake, CI/CD, Microsoft Fabric, Monitoring

Unix, Orchestration, Shell Scripting, Data Integration, Sql, Technical Documentation, Configuration Management, Linux, Exception Handling, Python, Testing, Etl, Logging, Modular Design, Command-line Tools, Cloud Platforms, Data Pipeline Architecture