SoCalGas: Sr. Data Engineer

Acts in a lead role in the design, development, implementation, maintenance, and enhancement of full cycle of data services – integration/transport, processing and/or visualization – and associated systems to support the analytics needs of data/business analysts or data scientists.

Consults with and provides technical guidance to business partners, IT peer teams, regarding data requirements, design, processes and technical solutions.

Leads analytics project workstreams and/or smaller integration or visualization projects.

Works with multiple business subject areas/data domains, and applies expertise in multiple technology stacks and data services capabilities (integration, storage/processing, visualization).Lead efforts to design, build, maintain, and troubleshoot data pipelines and processing systems to analytics applications.

Lead small data analytics projects or initiatives.

Manage the data catalog, metadata repository and any associated data management efforts.

Work with vendor partners and/or coach junior IT staff to ensure data analytics solutions are designed and developed in a way that complies with architectural standards and established methodologies and practices.Solution development and support; Compile data requirements, perform data analysis and logical data modeling, define data and object elements.

Build and scale data ingestion and transformation processes, to include batch (ETL, ELT), streaming, and/or virtualization.

Build datasets, tools and documentation to enable analysts in all parts of the company to build their own analytics and reports.

Design, build and implement applications to visualize performance data to enable actionable operational improvements.

Provide after-hours support on a rotation basis.Collaboration/Continuous Improvement: Expand and continuously improve knowledge of business subject areas/data domain.

Monitor and report to management on the status of project efforts, anticipating and identifying issues that inhibit the attainment of project goals and implementing corrective actions.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Lead and/or participate with IT staff, business/vendor partners, and other stakeholders in new product reviews, tests, and pilots.

Foster and maintain good relationships with business partners, IT colleagues and vendor partners.

Develop business knowledge and relationships to integrate activities with other IT departments to ensure successful implementation and support project efforts.Requirements:Bachelor’s Degree In Computer Science, Information Systems, Statistics or another quantitative field or equivalent experience and/or training Required.Master’s Degree Preferred6+ years Professional experience as a data engineer or equivalent.

RequiredCloud Platform experience, Azure or AWS.

PreferredExperience building and optimizing ‘big data’ pipelines, architectures and data sets.

PreferredExperience with Object-oriented programming or scripting languages desired (e.G., Python, Java, C++, Scala).

PreferredExperience working in an agile/scrum environment.

RequiredProven experience acting as a technical lead with ability to mentor and lead data engineers.

RequiredExperience dealing with competing priorities in a fast-paced environment.

RequiredProven track record of translating technical objectives into engineering reality.

RequiredKnowledge, Skills and Abilities:Expertise in several toolsets required such as big data tools: Hadoop, Spark, and Kafka.

AdvancedExpertise in Data integration tools such as SAP Data Services, Informatica, and MS SSIS.

AdvancedProficient knowledge of data modeling, data architecture, data security and data governance practices.

IntermediateWorking knowledge of SQL and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases tools.

IntermediateFundamental technical knowledge of infrastructure concepts, including configuration setup on servers, routers, switches, firewalls etc.

IntermediateKnowledge of Data Virtualization tools such as PowerBI, Business Objects, SAP Analytics Cloud, Cloud Services and Metadata Management tools.

IntermediateStrong analytic skills related to working with structured and unstructured datasets.

AdvancedSolid teamwork and interpersonal skills; ability to work well oncross-functional project teams and with vendor partners.

AdvancedSelf-directed and comfortable supporting the data needs of multiple teams, systems and productsStrong verbal and written communications skills, with an ability to express complex technical concepts in business terms.

AdvancedStrong attention to detail with excellent analytical, problem-solving, and communication skills.

AdvancedStrong project management and organizational skills desired, operating as part of a team scoping, organizing, planning, and executing projects from the envisioning stage through implementation.

AdvancedStrong organizational and mentoring skills with experience in leading projects.

AdvancedNOTE: This position can be filled at a different level based on the final scope of job responsibilities and job requirements.There is a Preparing For Management (PFM) Requirement: Associate/Technical and Union employees interested in applying for a Management position must take the PFM exam and meet the minimum passing requirements prior to applying for the position via My Info.PFM requirements and FAQs can be found at https://sempra.Sharepoint.Com/sites/sempranet/HR/universal/SitePages/PFM%20-%20Home.AspxIf you are a represented employee applying to a non-represented position, please note that there might be significant changes to your medical and retirement benefits.

This can include changes to your monthly costs for medical benefits and/or potential return on some of your retirement benefits.

You may contact your Staffing Advisor or HR Consultant for further information.Southern California Gas Company is an EEO/AA EmployerEqual Opportunity Employer Minorities/Women/Protected Veterans/Disabled

Related Post

Software EngineerSoftware Engineer

Responsible for research, design, and development of computer software systems, in conjunction with hardware product development. Primarily responsible for the design and development of software products for a variety software