{"id":1229,"date":"2025-12-22T07:51:36","date_gmt":"2025-12-22T07:51:36","guid":{"rendered":"https:\/\/www.hardwinsoftware.com\/blog\/?post_type=jobpost&#038;p=1229"},"modified":"2025-12-22T07:51:36","modified_gmt":"2025-12-22T07:51:36","slug":"azure-data-engineer-business-intelligence-operations-lead-avp","status":"publish","type":"jobpost","link":"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp","title":{"rendered":"Azure Data Engineer \u2013 Business Intelligence Operations Lead (AVP)"},"content":{"rendered":"\n<p>The Azure Data Engineer \u2013 BI Operations Lead will be responsible for driving the design, development, and oversight of large-scale data engineering and BI solutions across the organization. This role involves working closely with CXOs and business stakeholders to translate requirements into scalable technical implementations using Azure Databricks, Synapse, and ADF. The position ensures operational excellence across ETL\/ELT pipelines, data governance, visualization platforms, and BI audits while leading and mentoring a high-performing team.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Key Responsibilities:<\/strong><\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Collaborate with stakeholders and CXOs to understand source systems and translate business requirements into technical solutions using Databricks, Azure Synapse, and Azure Data Factory.<br><\/li>\n\n\n\n<li>Design, implement, and manage end-to-end ETL\/ELT pipelines for MIS automation, system integrations, and streaming ingestion using Delta Live Tables.<br><\/li>\n\n\n\n<li>Lead cloud cost estimation, optimization strategies, and cost controls for new and existing data engineering solutions.<br><\/li>\n\n\n\n<li>Define and implement Datalake governance policies including data purging, archival, and retention strategies.<br><\/li>\n\n\n\n<li>Guide teams on advanced analytics requirements in Qlik and Power BI, including time series, forecasting, correlation, bucketing, hierarchical data, and What-If analysis.<br><\/li>\n\n\n\n<li>Oversee change management processes, including reviewing existing pipelines, SQL\/Python code, and visualizations; ensure proper approval workflows through the Change Approval Board.<br><\/li>\n\n\n\n<li>Estimate, deliver, and optimize high-volume data processing pipelines (structured &amp; unstructured).<br><\/li>\n\n\n\n<li>Supervise and ensure accurate delivery of all adhoc data requirements.<br><\/li>\n\n\n\n<li>Set up proactive ETL monitoring and lead troubleshooting and resolution of ETL issues.<br><\/li>\n\n\n\n<li>Ensure adherence to data governance, security standards, and masking policies.<br><\/li>\n\n\n\n<li>Plan and oversee Disaster Recovery (DR) drills for the BI data platform.<br><\/li>\n\n\n\n<li>Ensure all developments follow standard coding practices and maintain audit-ready documentation.<br><\/li>\n\n\n\n<li>Coordinate and execute BI platform audits with internal audit teams.<br><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Qualifications<\/strong><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Must-Have:<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>10+ years of experience in Azure Data &amp; Analytics engineering.<br><\/li>\n\n\n\n<li>Proven expertise in Databricks, PySpark, Spark SQL, Delta Live Tables, Kafka, Azure Synapse, Azure SQL DB, Azure Data Factory, ADLS, Azure Logic Apps.<br><\/li>\n\n\n\n<li>Strong hands-on skills in Python, PySpark, Azure DevOps, CI\/CD pipelines, ETL\/ELT design, SSIS, and data ingestion into Azure storage.<br><\/li>\n\n\n\n<li>Experience in data warehouse concepts including denormalization, fact\/dimension modeling, and conformance.<br><\/li>\n\n\n\n<li>Deep understanding of Power BI and\/or QlikSense with advanced analytics capabilities (Time Intelligence, Time Series, Forecasting, What-If, etc.).<br><\/li>\n\n\n\n<li>Strong SQL development and performance tuning skills for large-scale workloads.<br><\/li>\n\n\n\n<li>Excellent communication skills (written and verbal).<br><\/li>\n\n\n\n<li>Experience leading technical teams and managing BI operations.<br><\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Good-to-Have:<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Experience functioning as a BI Technical Project Manager.<br><\/li>\n\n\n\n<li>Knowledge of NBFC\/Banking domain functions (Sales, Credit, Collections, Finance, Accounts).<br><\/li>\n\n\n\n<li>Exposure to large enterprise data governance frameworks and audit processes.<br><\/li>\n\n\n\n<li>Certifications in Azure Data Engineering, Databricks, or related cloud technologies.<br><\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>In Brief:<\/strong><\/h2>\n\n\n\n<p><strong>Title:<\/strong> Azure Data Engineer \u2013 Business Intelligence Operations Lead (AVP)<br><strong>Qualification:<\/strong> Experienced Azure Data &amp; Analytics professional skilled in Databricks, Synapse, ADF, and BI platforms. Responsible for leading BI operations, managing data platforms, designing ETL\/ELT solutions, and driving governance and audits.<br><strong>Experience Needed:<\/strong> 10+ Years<br><strong>No. of Openings:<\/strong> 2<br><strong>Joining Type:<\/strong> Immediate \/ Within 15 Days<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Azure Data Engineer \u2013 BI Operations Lead will be responsible for driving the design, development, and oversight of large-scale data engineering and BI solutions across the organization. This role involves working closely with CXOs and business stakeholders&#8230; <\/p>\n","protected":false},"author":1,"featured_media":0,"menu_order":0,"template":"","jobpost_category":[],"jobpost_job_type":[],"jobpost_location":[283],"jobpost_tag":[284],"class_list":["post-1229","jobpost","type-jobpost","status-publish","hentry","jobpost_location-pune","jobpost_tag-azure-data-engineer"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Azure Data Engineer - 10+ years<\/title>\n<meta name=\"description\" content=\"Azure Data Engineer leading BI operations, ETL pipelines, Databricks, Azure Synapse, and data governance for enterprise-scale analytics.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Azure Data Engineer - 10+ years\" \/>\n<meta property=\"og:description\" content=\"Azure Data Engineer leading BI operations, ETL pipelines, Databricks, Azure Synapse, and data governance for enterprise-scale analytics.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp\" \/>\n<meta property=\"og:site_name\" content=\"Blog\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp\",\"url\":\"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp\",\"name\":\"Azure Data Engineer - 10+ years\",\"isPartOf\":{\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/#website\"},\"datePublished\":\"2025-12-22T07:51:36+00:00\",\"description\":\"Azure Data Engineer leading BI operations, ETL pipelines, Databricks, Azure Synapse, and data governance for enterprise-scale analytics.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp#breadcrumb\"},\"inLanguage\":\"en\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.hardwinsoftware.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Jobs\",\"item\":\"https:\/\/www.hardwinsoftware.com\/blog\/?post_type=jobpost\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Azure Data Engineer \u2013 Business Intelligence Operations Lead (AVP)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/#website\",\"url\":\"https:\/\/www.hardwinsoftware.com\/blog\/\",\"name\":\"Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.hardwinsoftware.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/#organization\",\"name\":\"Blog\",\"url\":\"https:\/\/www.hardwinsoftware.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en\",\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.hardwinsoftware.com\/blog\/wp-content\/uploads\/2025\/01\/HSS-logo-for-social-media-copy.png\",\"contentUrl\":\"https:\/\/www.hardwinsoftware.com\/blog\/wp-content\/uploads\/2025\/01\/HSS-logo-for-social-media-copy.png\",\"width\":1080,\"height\":1080,\"caption\":\"Blog\"},\"image\":{\"@id\":\"https:\/\/www.hardwinsoftware.com\/blog\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Azure Data Engineer - 10+ years","description":"Azure Data Engineer leading BI operations, ETL pipelines, Databricks, Azure Synapse, and data governance for enterprise-scale analytics.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp","og_locale":"en_US","og_type":"article","og_title":"Azure Data Engineer - 10+ years","og_description":"Azure Data Engineer leading BI operations, ETL pipelines, Databricks, Azure Synapse, and data governance for enterprise-scale analytics.","og_url":"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp","og_site_name":"Blog","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp","url":"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp","name":"Azure Data Engineer - 10+ years","isPartOf":{"@id":"https:\/\/www.hardwinsoftware.com\/blog\/#website"},"datePublished":"2025-12-22T07:51:36+00:00","description":"Azure Data Engineer leading BI operations, ETL pipelines, Databricks, Azure Synapse, and data governance for enterprise-scale analytics.","breadcrumb":{"@id":"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp#breadcrumb"},"inLanguage":"en","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.hardwinsoftware.com\/blog\/?jobpost=azure-data-engineer-business-intelligence-operations-lead-avp#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.hardwinsoftware.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Jobs","item":"https:\/\/www.hardwinsoftware.com\/blog\/?post_type=jobpost"},{"@type":"ListItem","position":3,"name":"Azure Data Engineer \u2013 Business Intelligence Operations Lead (AVP)"}]},{"@type":"WebSite","@id":"https:\/\/www.hardwinsoftware.com\/blog\/#website","url":"https:\/\/www.hardwinsoftware.com\/blog\/","name":"Blog","description":"","publisher":{"@id":"https:\/\/www.hardwinsoftware.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.hardwinsoftware.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en"},{"@type":"Organization","@id":"https:\/\/www.hardwinsoftware.com\/blog\/#organization","name":"Blog","url":"https:\/\/www.hardwinsoftware.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en","@id":"https:\/\/www.hardwinsoftware.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.hardwinsoftware.com\/blog\/wp-content\/uploads\/2025\/01\/HSS-logo-for-social-media-copy.png","contentUrl":"https:\/\/www.hardwinsoftware.com\/blog\/wp-content\/uploads\/2025\/01\/HSS-logo-for-social-media-copy.png","width":1080,"height":1080,"caption":"Blog"},"image":{"@id":"https:\/\/www.hardwinsoftware.com\/blog\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=\/wp\/v2\/jobpost\/1229","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=\/wp\/v2\/jobpost"}],"about":[{"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/jobpost"}],"author":[{"embeddable":true,"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"wp:attachment":[{"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1229"}],"wp:term":[{"taxonomy":"jobpost_category","embeddable":true,"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fjobpost_category&post=1229"},{"taxonomy":"jobpost_job_type","embeddable":true,"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fjobpost_job_type&post=1229"},{"taxonomy":"jobpost_location","embeddable":true,"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fjobpost_location&post=1229"},{"taxonomy":"jobpost_tag","embeddable":true,"href":"https:\/\/www.hardwinsoftware.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fjobpost_tag&post=1229"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}