Sr. Data Engineer

Our client is seeking a Senior Data Engineer with a robust background in data engineering to join their team. The ideal candidate will be pivotal in designing, developing, and maintaining their data infrastructure. This role emphasizes not on building machine learning models but on integrating and deploying these models into data pipelines to enhance capabilities in advanced analytics and machine learning processes. The successful candidate will contribute expertise to modernize, improve and scale data engineering practices, ensuring the seamless incorporation of machine learning models into our clients operational workflows.

Our Client’s data processing pipelines, ingest vast amounts of data from a large number of data sources, along with their own data to deliver data products offered to thousands of customers nationwide. The data products your team supports span nationwide consumer, business, student/young adult, new mover/new homeowner, and other data assets for use in analytics, sales, marketing and AI applications.

Key Responsibilities:

Data Pipeline Development:

• Design, implement, and maintain scalable data pipelines to collect, process, and store data from various sources.

• Ensure data quality, accuracy, and consistency throughout the pipeline.

Data Modeling Integration:

• Design and implement existing data models for predictive analytics, machine learning, and data exploration.

• Optimize data structures and storage to support predictive analytics/machine learning processes.

Data Integration:

• Work closely with cross-functional teams to integrate data from diverse sources, including databases, APIs, and external data providers.

• Develop and maintain ETL processes to transform and enrich raw data into actionable insights.

Performance Tuning:

• Monitor and optimize the performance of data pipelines and databases to meet business requirements.

• Identify and resolve bottlenecks and performance issues.

Continuous Learning and mentoring:

• Stay up-to-date with the latest advancements in data engineering and data science technologies.

• Share knowledge and mentor junior team members.

Requirements

Experience:

• Required: Experience transforming traditional ETL with SSIS to modern Data Engineering tech stack

• Technical leadership driving projects

• 5+ years experience in SQL Query Design, SQL Performance Tuning and Query Optimization

• 5+ years of relevant experience in Data Warehouse Design, Data Warehouse Technical Architectures, Development and Implementation

• 5+ years of relevant experience in ETL Development, ETL Implementation, Unit Testing, Troubleshooting and Support of ETL Processes

• End to end data pipeline build experience

Knowledge and Skills:

• Proficiency in SQL Query Design and Implementation

• Strong Experience with Relational Data Warehouse Systems

• Data Warehouse Management Systems

• Optimization by Indexing, Partitioning and Denormalization

• Strong ability to build and optimize data sets end to end, ‘big data’ data pipelines and architecture

• Experience with data security

• Programming languages: Python, SQL

  • BONUS: C# / .NET or Java or JavaScript

• Strong analytical and problem-solving skills

• Tech Stack:

  • Cloud Provider Experience: AWS

  • Data Storage and Warehousing Analytics Engine

    • Snowflake

  • Amazon Services

    • AWS Glue

    • AWS Elastic MapReduce (EMR)

    • AWS Lambda

  • Data Processing and Computation

    • Apache Spark

  • Workflow & DataOps

    • Apache Airflow® DAGs (Directed Acyclic Graph) for orchestration

  • SQL Services Experience

    • SSIS (SQL Server Integration Services)

    • BONUS: SSAS (SQL Server Analysis Services)

    • BONUS: SSRS (SQL Server Reporting Services

Location:

• Hybrid to Kirkland, WA ( Tu-Th in office)

Benefits:

• Flexible Time Off and Paid Holidays

• Salary $130,000 - $160,000, commensurate with experience and expertise.

• Medical/Vision/Dental Insurance, Voluntary Life & AD&D Insurance, Short-Term & Long-Term Disability, Critical Illness & Accident Insurance

• 401(k) with employer matching

• Applicants must be authorized to work for ANY employer in the U.S. Our client is unable to sponsor or take over sponsorship of an employment Visa at this time.

Salary Description

$130,000-160,000