Job Details

Job Title
Sr. Data Engineer - Databricks

Position Overview

We are looking for a data engineer to join our enterprise analytics team! This individual will partner with data scientists, analysts and product owners to support data science projects and initiatives across the enterprise - including in our manufacturing, planning/forecasting and customer service areas.

Applicant must be an experienced data pipeline builder who enjoys building solutions from the ground up. We are looking for someone who is self-directed and comfortable supporting the data needs of multiple teams and projects.

Responsibilities:

• Partner with data scientists, data analysts, data stewards and product owners to understand data needs and develop solutions
• Design, build, launch and maintain efficient and reliable data pipelines to support data analysis and machine learning models
• Define and manage standards, guidelines and processes to ensure data quality
• Assemble large, complex datasets based on business requirements
• Identify and deploy various methods and techniques for optimal extraction, transformation and loading of data from a wide variety of data sources
• Help build and maintain best practices for our data engineering strategy - identifying and addressing gaps in existing processes and solutions

Minimum Qualifications:

• Bachelor's degree in a quantitative field (e.g., Computer Science, Engineering) or a related quantitative field or equivalent work experience is required.
• At least 4-6 years of work experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.
• Expert SQL programming skills
• Expertise in at least one relevant object-oriented programming language (e.g., Python, Scala)
• Experience building and optimizing data pipelines, architectures and data sets
• Experience with big data tools (Spark, Kafka, etc.)
• Experience in data warehousing and data modeling
• Good knowledge of data management, data integration, and database development techniques with a good understanding of data architecture principles
• Strong analytical and problem solving skills
• Ability to communicate across all levels of the organization and work with diverse project teams
• Experience using cloud-based infrastructure such as Azure and AWS
• Experience in DevOps best practices including CI/CD, process automation and optimization

Preferred Qualifications:

• Experience with designing and implementing real-time pipelines
• Experience with data quality and validation
• Experience working in an Agile environment

Required Competencies:

• Make Effective Decisions
• Drive Results
• Demonstrate Strategic Influence
• Demonstrate Customer Orientation

The position may be filled as a data engineer or senior data engineer based on experience.

Work Shift
8 Hr non-rotating shift, Hrs fall to in punch day, Observed Calendar, shift starts AM

Shaw Industries is an equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities.