Join our innovation team as a Data Engineer with the Department of Information Technology! Under the leadership of Chief Director of Innovation, you'll drive county-wide data-informed decision making, boost organizational transparency, and enhance operational efficiency by building robust data pipelines, managing advanced database architectures, ensuring top-tier data quality, governance, and security, and partnering closely with Analytics/AI teams to deliver scalable, reliable data solutions.
Key Responsibilities
- Designs, builds, and maintains ETL (Extract, Transform, Load) pipelines using orchestration tools (e.g., Apache Airflow, Azure Data Factory) and big data frameworks (e.g., Spark, Hadoop) to transport raw data from multiple sources into centralized repositories like data warehouses and data lakes.
- Manages database and data architecture by designing, implementing, and optimizing storage solutions (e.g., PostgreSQL, SQL Server, MongoDB, Cassandra, AWS S3, Google BigQuery), including schemas, partitioning, indexing, and data modeling to balance performance, scalability, and cost for transactional and analytical workloads.
- Ensures data quality, governance, and security through validation rules, anomaly monitoring, metadata/lineage management, compliance frameworks (e.g., GDPR, HIPAA), encryption, access controls, and auditing in partnership with security teams.
- Collaborates with business analysts, data scientists, and developers to provide optimized datasets, improve query performance, integrate APIs, and support data projects for decision-making and innovation.
- Builds and manages Snowflake data environments, including initial environment setup, warehouse configuration, role-based access controls, data ingestion pipelines, and performance optimization to support scalable, secure, and cost-efficient analytics.
- Performs other duties as required to support business intelligence and data efforts.