Developer programmer

Designation / Job title : Developer programmer

Primary or Mandatory skills :-

Advanced proficiency in Google Cloud Platform (GCP): BigQuery, Dataflow, Cloud Functions, Cloud Storage, Composer, Cloud Run, Pub/Sub, Firestore, Cloud Build

Experience in AI/ML integration using Vertex AI, BigQuery ML, Agent Builder, and Streamline

Expertise in Site Reliability Engineering (SRE) practices: SLIs/SLOs/SLAs, error budgets, incident response, postmortems

• Hands-on experience with IBM Databand for data observability: real-time alerts, predictive monitoring, data lineage tracking

• Proficient in Python, Pyspark, Unix/Shell scripting, and Google Apps Script for automation and alerting

• Advanced SQL skills with BigQuery, Vertica, and Oracle

• Strong understanding of Apache Airflow for DAG orchestration and pipeline scheduling

Good to have skills :

Familiarity with Agile methodologies, Jira, and ServiceNow

Experience with Looker Pro and Tableau for advanced BI and reporting

Exposure to cloud migration strategies and cross-platform data integration

Experience with Atlan for data governance: metadata cataloging, lineage tracking, access control, and collaboration across data teams

Knowledge of Profisee for reference data management: mastering business-critical entities, hierarchy management, and golden record creation

Detailed Job description :

Lead the development, deployment, and support of scalable data pipelines on Google Cloud Platform, using services such as Dataflow, BigQuery, Cloud Functions, Firestore, Composer, Cloud Storage, Cloud Run, and Pub/Sub.

· Architect and optimize complex SQL queries in BigQuery and Vertica to improve performance and reduce query costs.

· Design and orchestrate workflows using Apache Airflow, including DAG creation, scheduling, and monitoring.

· Implement platform-wide cost and resource optimization strategies:

· Archive historical and cold data to lower-cost storage tiers

· Delete unused datasets and files from Cloud Storage

· Monitor service usage across projects and decommission idle or redundant resources

· Set up new GCP projects with cost-efficient architecture

· Maintain GitHub repositories for CI/CD pipelines and deployment automation

· Automate operational workflows and alerting systems using Python, Unix/Shell scripting, and Google Apps Script, enabling real-time notifications for pipeline failures and anomalies.

· Integrate AI/ML capabilities into operations using Vertex AI, Agent Builder, BigQuery ML, and Streamlit to detect anomalies, predict failures, and reduce recurring incidents.

· Apply SRE principles to improve system reliability, scalability, and operational efficiency:

· Define and monitor SLIs/SLOs/SLAs for critical services

· Conduct post-incident reviews and prepare RCA documentation

· Manage error budgets and balance feature velocity with system stability

· Automate incident detection and resolution workflows to reduce MTTR

· Deploy and manage IBM Databand for advanced data observability:

· Configure real-time alerts for pipeline delays, schema changes, and data freshness

· Enable predictive monitoring and data lineage tracking

· Improve operational resilience and data reliability across critical workloads

· Perform Google Cloud administration tasks:

· Manage IAM roles and access policies

· Perform Composer upgrades and environment tuning

· Configure VPC networks, firewall rules, and service accounts

· Provision and monitor Compute Engine instances and Kubernetes clusters (GKE)

· Use Terraform for infrastructure-as-code deployments

· Collaborate with business and technical teams for Finance month-end and year-end closures, including data loads and issue resolution.

· Provide SME-level support for Finance, Subscription, AdSales, and Consumer data domains.

· Manage sprint planning and change control processes using Jira and ServiceNow.

· Investigate and resolve data issues raised by business users in BigQuery, Looker reports, and other platforms; prepare RCA documentation.

· Conduct stakeholder meetings for requirement gathering, technical mapping, and production deployment planning.

· Mentor junior engineers and support team development through training and documentation.

Skill – As mentioned above

Experience Range – 7+ years

Job Type: Full-time

Pay: $80,000.00 – $100,000.00 per year

Work Location: In person