Sr. Data Engineer

Acts in a lead role in the design, development, implementation, maintenance, and enhancement of full cycle of data services – integration/transport, processing and/or visualization – and associated systems to support the analytics needs of data/business analysts or data scientists.

Consults with and provides technical guidance to business partners, IT peer teams, regarding data requirements, design, processes and technical solutions.

Leads analytics project workstreams and/or smaller integration or visualization projects.

Works with multiple business subject areas/data domains, and applies expertise in multiple technology stacks and data services capabilities (integration, storage/processing, visualization).

* Lead efforts to design, build, maintain, and troubleshoot data pipelines and processing systems to analytics applications.

Lead small data analytics projects or initiatives.

Manage the data catalog, metadata repository and any associated data management efforts.

Work with vendor partners and/or coach junior IT staff to ensure data analytics solutions are designed and developed in a way that complies with architectural standards and established methodologies and practices.* Solution development and support; Compile data requirements, perform data analysis and logical data modeling, define data and object elements.

Build and scale data ingestion and transformation processes, to include batch (ETL, ELT), streaming, and/or virtualization.

Build datasets, tools and documentation to enable analysts in all parts of the company to build their own analytics and reports.

Design, build and implement applications to visualize performance data to enable actionable operational improvements.

Provide after-hours support on a rotation basis.* Collaboration/Continuous Improvement: Expand and continuously improve knowledge of business subject areas/data domain.

Monitor and report to management on the status of project efforts, anticipating and identifying issues that inhibit the attainment of project goals and implementing corrective actions.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Lead and/or participate with IT staff, business/vendor partners, and other stakeholders in new product reviews, tests, and pilots.

Foster and maintain good relationships with business partners, IT colleagues and vendor partners.

Develop business knowledge and relationships to integrate activities with other IT departments to ensure successful implementation and support project efforts.Requirements: * Bachelor’s Degree In Computer Science, Information Systems, Statistics or another quantitative field or equivalent experience and/or training Required.* Master’s Degree Preferred* 6+ years Professional experience as a data engineer or equivalent .

Required* Experience building and optimizing ‘big data’ pipelines, architectures and data sets.

Preferred* Experience with Object-oriented programming or scripting languages desired (e.g., Python, Java, C++, Scala).

Preferred* Experience working in an agile/scrum environment.

Required* Proven experience acting as a technical lead with ability to mentor and lead data engineers.

Required* Experience dealing with competing priorities in a fast-paced environment.

Required* Proven track record of translating technical objectives into engineering reality.

RequiredKnowledge, Skills and Abilities: * Expertise in several toolsets required such as big data tools: Hadoop, Spark, and Kafka.

Advanced* Expertise in Data integration tools such as SAP Data Services, Informatica, and MS SSIS.

Advanced* Proficient knowledge of data modeling, data architecture, data security and data governance practices.

Intermediate* Working knowledge of SQL and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases tools.

Intermediate* Fundamental technical knowledge of infrastructure concepts, including configuration setup on servers, routers, switches, firewalls etc.

Intermediate* Knowledge of Data Virtualization tools such as PowerBI, Business Objects, SAP Analytics Cloud, Cloud Services and Metadata Management tools.

Intermediate* Strong analytic skills related to working with structured and unstructured datasets.

Advanced* Solid teamwork and interpersonal skills; ability to work well on cross-functional project teams and with vendor partners.

Advanced* Self-directed and comfortable supporting the data needs of multiple teams, systems and products* Strong verbal and written communications skills, with an ability to express complex technical concepts in business terms.

Advanced* Strong attention to detail with excellent analytical, problem-solving, and communication skills.

Advanced* Strong project management and organizational skills desired, operating as part of a team scoping, organizing, planning, and executing projects from the envisioning stage through implementation.

Advanced* Strong organizational and mentoring skills with experience in leading projects.

AdvancedEqual Opportunity Employer Minorities/Women/Protected Veterans/Disabled

Related Post

Senior ProgrammerSenior Programmer

Technical Expertise 10+ years hands-on experience in software design and development, database design and development, and system integration Hands-on experience with Microsoft technologies, specifically .NETASP.NET MVC, Web API, C, SQL