Lead Data Engineer

 

Location: Addison, TX

Employment Type: Direct Hire

Work Arrangement: Hybrid

Pay: $175k + 25% bonus

Visa Status: The client cannot provide visa sponsorship or engage in corp-to-corp (C2C) arrangements.

Interview: Onsite interview required

 

Position Overview:

Wheeler Staffing Partners is seeking a highly skilled Lead Data Engineer for our client in Addison, TX. The ideal candidate will play a critical role in designing, building, and managing data infrastructure and pipelines to support the organization’s data initiatives. This leadership position requires a deep technical background and the ability to guide a team, ensuring scalable, efficient, and secure data solutions that align with business needs.

 

Key Responsibilities:

 

Data Architecture and Design:

• Design and implement scalable data pipelines and infrastructure.
• Optimize data architecture for real-time and batch processing and analytics.
• Integrate appropriate tools and frameworks to enhance data workflows.

 

Data Pipeline Development and Maintenance:

• Develop, maintain, and optimize pipelines for data ingestion, transformation, and storage.
• Ensure data quality and reliability throughout the data lifecycle.
• Implement monitoring tools for real-time issue detection and resolution.

 

Collaboration and Stakeholder Engagement:

• Work with data scientists, analysts, and business stakeholders to provide tailored data solutions.
• Collaborate with product managers and engineering teams to align data projects with business goals.

 

Team Leadership and Mentorship:

• Lead and mentor a team of data engineers, ensuring best practices and fostering professional growth.
• Promote a collaborative and innovative team environment.

 

Data Governance and Security:

• Implement data governance policies and ensure data security.
• Maintain compliance with data privacy regulations and industry standards.

 

Technology Evaluation and Innovation:

• Stay updated on industry trends and emerging technologies.
• Evaluate and recommend new tools to improve data infrastructure.

 

Requirements:

 

Education: Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field.

 

Experience: 8+ years in data engineering, including 2+ years in a senior or leadership role.

 

Technical Skills:

• Proficiency with data lake/warehousing solutions (e.g., Snowflake, Databricks). Snowflake certification is a plus.
• Experience with big data processing frameworks (e.g., Hadoop, Spark).
• Expertise in cloud platforms (e.g., AWS, Azure) and data orchestration tools (e.g., Airflow, Dagster).
• Strong SQL skills and familiarity with various database technologies (e.g., Postgres, Oracle, SQL Server).
• Understanding of ETL processes and tools (e.g., Talend, Informatica, Fivetran).
• Knowledge of data governance, security standards, and compliance regulations.
• Proficiency in programming languages like Python, Java, or Scala.
• MLOps experience and familiarity with machine learning infrastructure are preferred.
• Experience with BI tools (e.g., Tableau, Power BI).

 

Soft Skills:

• Strong leadership, communication, and interpersonal abilities.
• Problem-solving skills, attention to detail, and a commitment to delivering high-quality results.
• Ability to manage multiple projects in a fast-paced environment.