Estrada Consulting Incorporated
Lead Data Engineer / Microsoft Fabric Consultant (Ref: 5656)
Remote•United States•Contract
About the Job
Senior Data Engineer – Microsoft Fabric / Data Factory (Ref: 5656)
Location: Remote but prefers Texas location
Duration: 9-12 months
Rate: DOE and education
Location: Remote but prefers Texas location
Duration: 9-12 months
Rate: DOE and education
Estrada Consulting, Inc. is seeking a Senior Lead Data Engineer with deep experience designing, building, monitoring, and optimizing enterprise data pipelines and modern analytics platforms. The ideal candidate will have strong hands-on experience with Microsoft Fabric, Data Factory / Azure Data Factory, Microsoft data engineering services, SQL-based data platforms, cloud data integration, and enterprise reporting/analytics environments.
This role requires a senior-level data engineering professional who can support complex public-sector and enterprise data environments, translate business and technical requirements into scalable data solutions, and deliver reliable pipelines, data models, and analytics-ready datasets.
Responsibilities
The Senior Data Engineer will be responsible for:
- Designing, developing, and maintaining scalable data pipelines using Microsoft Fabric Data Factory, Azure Data Factory, and related Microsoft data engineering tools.
- Building and managing data integration workflows across cloud, on-premises, and hybrid environments.
- Developing ETL/ELT processes to ingest, transform, validate, and load data from multiple structured and semi-structured sources.
- Supporting modern data platform architecture using Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Dataflows Gen2, Pipelines, Notebooks, and related services.
- Designing and implementing data models for enterprise reporting, analytics, dashboards, and downstream business intelligence use cases.
- Writing and optimizing complex SQL queries, stored procedures, views, and scripts using SQL Server, T-SQL, Azure SQL, and related platforms.
- Monitoring pipeline performance, troubleshooting failures, resolving data quality issues, and improving reliability of automated data processes.
- Creating and maintaining technical documentation, data flow diagrams, source-to-target mappings, data dictionaries, and operational runbooks.
- Working with business analysts, BI developers, application teams, architects, QA teams, and project managers to support end-to-end data delivery.
- Supporting data governance, metadata management, lineage, access controls, security, and compliance requirements.
- Participating in performance tuning, capacity planning, data warehouse optimization, and production support activities.
- Supporting migration or modernization efforts from legacy ETL/data warehouse platforms to Microsoft Fabric and Azure-based data services.
- Providing technical leadership, mentoring, and guidance to junior data engineers and project team members.
Required Qualifications
- 12–15 years of overall IT experience, including substantial experience in data engineering, data warehousing, ETL/ELT development, database development, or analytics platform implementation.
- 7+ years of hands-on data engineering experience designing, building, and supporting enterprise data pipelines.
- 3+ years of hands-on experience with Azure Data Factory and/or Microsoft Fabric Data Factory, including pipeline development, orchestration, triggers, linked services/connections, parameterization, monitoring, and troubleshooting.
- Demonstrated experience with Microsoft Fabric or closely related Microsoft analytics platform services, such as:
- Fabric Data Factory
- OneLake
- Lakehouse
- Warehouse
- Dataflows Gen2
- Pipelines
- Notebooks
- Power BI integration
- Data Activator or Real-Time Intelligence, where applicable
- Strong experience with SQL Server, T-SQL, Azure SQL Database, Azure Synapse, or Microsoft Fabric Warehouse.
- Experience designing and implementing data warehouses, data marts, dimensional models, normalized models, and analytics-ready datasets.
- Experience integrating data from multiple source systems, including APIs, flat files, relational databases, SaaS platforms, cloud storage, and enterprise applications.
- Experience with data quality validation, reconciliation, exception handling, audit logging, and error handling within data pipelines.
- Experience supporting production data pipelines, including monitoring, troubleshooting, root-cause analysis, and performance optimization.
- Strong understanding of cloud data architecture, data security, role-based access controls, data privacy, and compliance requirements.
- Experience preparing technical documentation, data mapping documents, ERDs, data flow diagrams, and deployment/support documentation.
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, Engineering, Mathematics, or a related field. Equivalent qualifying experience may be considered depending on client requirements.
Highly Preferred Qualifications
- Prior experience supporting government, public-sector, healthcare, education, transportation, utilities, or other highly regulated environments.
- Experience with State, county, city, or federal government data systems.
- Experience with public-sector procurement, reporting, compliance, eligibility, case management, licensing, permitting, financial, healthcare, or regulatory systems.
- Experience migrating legacy SSIS, SQL Server, or on-premises data warehouse environments to Microsoft Fabric or Azure data services.
- Experience with Power BI semantic models, DAX, reporting datasets, and BI/reporting integration.
- Experience with Python, PySpark, Spark SQL, or Fabric Notebooks.
- Experience with Azure DevOps, Git, CI/CD pipelines, release management, and deployment automation.
- Experience with Azure Data Lake Storage, Databricks, Synapse, Event Hubs, Logic Apps, Functions, Key Vault, Purview, or Microsoft Defender for Cloud.
- Experience with data governance, metadata management, data lineage, and cataloging tools such as Microsoft Purview.
- Experience with Agile, Scrum, Hybrid Agile, or Waterfall delivery environments.
- Experience mentoring technical teams or serving as a lead data engineer.
Preferred Certifications
One or more of the following certifications is highly preferred:
- Microsoft Certified: Fabric Analytics Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Power BI Data Analyst Associate
- Microsoft Certified: Azure Database Administrator Associate
- Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Azure Developer Associate
- Microsoft Certified: Azure Administrator Associate
- Microsoft Applied Skills credentials related to Microsoft Fabric, Data Factory, Lakehouse, Data Warehouse, or Power BI
Desired Technical Skills
- Microsoft Fabric Data Factory
- Azure Data Factory
- Microsoft Fabric Lakehouse / Warehouse / OneLake
- Dataflows Gen2
- Fabric Pipelines
- Fabric Notebooks
- SQL Server / T-SQL
- Azure SQL Database
- Azure Synapse Analytics
- SSIS / SSRS / SSAS
- Power BI
- Python / PySpark / Spark SQL
- Data Lake / Lakehouse architecture
- ETL / ELT
- Data warehousing and dimensional modeling
- API and file-based data integration
- Data quality and validation
- Metadata, lineage, and governance
- Azure DevOps / Git / CI/CD
- Microsoft Purview
- Cloud security and access control
Ideal Candidate Profile
The ideal candidate is a senior, hands-on Microsoft data engineering professional who has delivered enterprise-scale data pipelines and analytics platforms, preferably in government or other regulated environments. This person should be able to design and build pipelines independently, troubleshoot production issues, document technical solutions, work directly with business and technical stakeholders, and guide teams through modern Microsoft data platform implementations.
They should not be only a reporting developer or database administrator. This role requires someone who can perform hands-on data engineering work using Microsoft Fabric Data Factory, Azure Data Factory, SQL, cloud data services, and modern data warehouse/lakehouse patterns.
About Estrada Consulting Incorporated
Estrada Consulting, Inc. (ECI) delivers technology-enabled services and solutions to clients all over the USA and British Columbia. We provide system integration, custom application development, data warehouse and business intelligence, project management, custom reporting solutions and consulting services to mid-size and large enterprises in all major industries. The Company headquarters is in Sacramento, California, and was established in year 2000. Visit http://www.estradaci.com/ to learn about our projects, managed services, awards and certifications delivering value for a range of businesses and government agencies.