IT Business Intelligence Engineer, Sr.

Primary Purpose:

The IT Senior Business Intelligence Engineer (Senior Data Lakehouse Engineer) is responsible for leading the design, implementation, and optimization of the company’s data lakehouse infrastructure. This role requires a highly skilled and experienced professional with 8-10 years of hands-on experience in data management and project planning, particularly within the Microsoft technology stack. The position focuses on leveraging Microsoft Fabric, Azure Machine Learning, and Power BI report development, while also incorporating knowledge of Oracle Analytics and Snowflake, to effectively shape and maintain the organization’s data landscape.
 

Essential duties and responsibilities:

Architect and Design: 

• Lead design and implementation of a modern data lakehouse using Microsoft Fabric and medallion architecture. 
• Design scalable solutions leveraging Fabric's unified platform (Lakehouses, Data Warehouses, Data Engineering).
• Collaborate cross-functionally teams to align architecture with bronze, silver, and gold data layer standards.

Infrastructure Implementation:

• Integrate cloud-based storage solutions (Azure Data Lake Storage) to ensure seamless scalability and durability.
• Bronze Layer: Implement raw data ingestion via Fabric Data Factory pipelines and Event Streams for real-time data capture from multiple sources.
• Silver Layer: Design and deploy data transformation processes and pipelines for clean, validated datasets.
• Gold Layer: Develop business-ready data models and semantic layers optimized for Power BI.

Data Ingestion and Processing:

• Implement change data capture (CDC) and incremental load patterns for efficient data pipeline operations
• Design and implement multi-source data ingestion strategies, including batch and streaming pipelines. 
• Implement data processing frameworks to transform and cleanse data for downstream analytics and reporting.
• Optimize data processing frameworks to transform and cleanse data for downstream analytics and reporting.

Metadata Management:

• Establish and maintain robust metadata management using Microsoft Purview to track lineage, quality, and data governance.
• Implement and manage metadata catalogs to enhance data discoverability and usability.

Security and Compliance:

• Enforce security measures to protect sensitive data within the lakehouse.
• Ensure compliance with data governance policies and industry regulations.

Performance Optimization:

• Monitor and optimize lakehouse performance across all medallion layers.
• Optimize Fabric Warehouse queries, Spark jobs, and Power BI report performance through query tuning and semantic model refinement. 

Collaboration and Documentation:

• Collaborate with analysts and other stakeholders to meet their data needs.
• Create documentation for Fabric data lakehouse architecture, medallion layer design, and data integration processes. 

Troubleshooting and Support:

• Support and troubleshoot data issues to maintain data integrity and availability.
• Provide after-hours support as part of the team.

Other Duties:

• Collaborate with users and vendors on issues and application upgrades.
• Mentor junior team members. 
• Oversee installation of hardware and software.
• Maintain professionalism and effective communication.
• Maintain a regular, dependable attendance and a consistently high level of performance.

Minimum requirements:

Education:

• Bachelor's or master's degree from an accredited institution in Computer Science, Management, Information Systems, Business Management, or a related discipline.
• A minimum of eight (8) years of direct work experience in IT or a related discipline may be considered as a substitute for a degree.

Experience/Specific Knowledge:

• Minimum of eight (8) years overall IT experience.
• Minimum of six (6) years of recent experience in data engineering, big data, data management, Microsoft Fabric, and project planning.
• Minimum three (3) years hands-on Microsoft Fabric experience or equivalent Azure data platform technologies. 
• Proven experience in data engineering and designing data Lakehouse architectures using medallion architecture patterns. 
• Proven experience with Fabric Data Engineering, Pipelines, Notebooks, Lakehouse technologies and cloud-based storage solutions.
• Strong understanding of data governance, security, and compliance.
• Experience in the full product development life cycle.
• Established SQL skills in MS SQL and/or Oracle databases.
• Experience developing and maintaining Power BI reports.
• Experience in effectively communicating business and technical issues to both technical and non-technical audiences.
• Experience managing multiple assignments simultaneously, prioritizing tasks effectively.
• Advanced proficiency in MS Office applications (Excel, Word, Access, PowerPoint, Outlook).

Certifications, Licenses & Registrations:

• Microsoft Fabric Analytics Engineer Associate - Highly Preferred
• Power BI Data Analyst Associate - Highly Preferred
• Microsoft Certified: Azure Data Engineer Associate - Preferred
• Must possess and maintain a valid driver’s license and a driving record satisfactory to the company and its insurers (for travel).

Competencies, Skills & Abilities:

• Analytical thinker with ability to apply functional and technical knowledge to resolve problems efficiently.
• Expertise in medallion architecture: designing and implementing bronze, silver, and gold data layers with appropriate transformation logic and data governance.
• Mastery of Microsoft Fabric platform components: Lakehouse, Data Factory, Notebooks, Data Warehouse, Event Streams, and integration patterns.
• Advanced Power BI Development skills: creating performant, user-friendly reports with complex DAX and optimized data models.
• Strong knowledge of data engineering best practices including data quality, testing, performance optimization, and modern data pipeline patterns.
• Excellent organizational, time management, and communication skills across all company levels.
• Ability to work independently with minimal supervision and collaboratively in a team environment emphasizing knowledge sharing.
• Customer service oriented with excellent problem-solving skills in dynamic collaborative settings.
• Effective multitasking and deadline management skills.
• Strong interpersonal skills with clear verbal and written communication of system requirements.
• Must be able to perform all essential and marginal functions of the job.
• Ability to follow management direction, work with a team, adhere to schedules, focus on details, and comply with work rules.
• Skilled in organizing and prioritizing daily work to meet strict deadlines.

Physical Demands:

All the physical requirements listed below may be necessary for an employee to perform the essential functions of this job successfully.  Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.

• Minimal safety hazards; general office working conditions.
• Must be able to sit for prolonged periods of time.
• The employee is regularly required to use hands to type, touch, handle, or feel.  The employee is required to talk and hear.  The employee is frequently required to stand and reach with hands and arms.  The employee is occasionally required to walk and climb or balance.  The employee must regularly lift and /or move up to 10 pounds and occasionally lift and/or move up to 25 pounds.

Working Conditions:

• Required to carry a cell phone and be available to respond during working and non-working hours.
• The successful candidate will be required to clear a drug screen and a complete background check, including a credit report for certain positions, after an offer has been extended and prior to being employed.

Supervisory Responsibility:

• Formal lead role

PREFERRED EDUCATION, EXPERIENCE, CERTIFICATIONS, COMPETENCIES, SKILLS, & ABILITIES:

Above the minimum requirements; not required but advantageous in this position:

• MBA or MIS highly preferred.
• Microsoft Azure and/or Fabric certifications are a plus.
• Familiarity with modern DevOps practices and tools is a plus.

Compensation

The salary range for this role is $125,000-$145,000/yr.