Senior Data Engineer

COMPANY Summary

As a combined organization, Franklin Energy and AM Conservation Group is undertaking what is perhaps the central challenge of our times – to help drive the transition to net-zero carbon economies while ensuring that no working families, businesses, or local communities are left behind. To do that, we are the utility industry’s top provider of turn-key energy efficiency and grid optimization programs and products, all of which contribute to reducing carbon and waste and, at the same time, free-up resources for creating more innovation investment and jobs. With over 26 years in business, we have more than 1,300 experts across the United States and Canada, with warehouses on both coasts. The organization’s integrated in-house services provide deep personalization and insights, helping energy partners achieve their carbon-reduction and energy productivity goals. 

We believe the organization’s most “precious resources” are its people.  We pledge a relentless pursuit to embody a culture that acknowledges, recognizes, and infinitely seeks to understand the unique differences of its people.  We are committed to creating employee experiences that continually attract and embrace a multiracial, multicultural, and multigenerational workforce that promotes outstanding performance and mirrors our diverse partnerships, clients and communities we serve.

Position Summary

We are looking for a Senior Data Engineer who can work on a wide range of activities ensuring high levels of data integrity, availability, and accessibility. The primary focus will be developing and maintaining databases that directly support data science, data analytics, and reporting work streams within the Technology group. This will include ETL, data munging, establishing best practices, and helping define data governance.

Essential Duties and Responsibilities

This list of duties and responsibilities is not all-inclusive and may be expanded to include other duties and responsibilities, as management may deem necessary from time to time.

  • Manage standardization, migration, transformation, validation, and quality assurance of data within multi-database platform
  • Lead database design and optimization
  • Work with internal and external clients to define data needs and create supporting data tools
  • Develop and optimize database routines, functions, and stored procedures
  • Diagnose and resolve database access and performance issues
  • Work with development and data architects to plan and coordinate data migrations between systems
  • Keep data separated and secure across national boundaries through multiple data centers and regions
  • Creation and maintenance of technical documentation

Position Requirements

Education and Experience

  • Bachelor’s degree from an accredited college or university in Engineering, Computer Science, Information Systems, or similar field (or equivalent work experience)
  • Graduate degree from an accredited college or university in Engineering, Computer Science, Information Systems, or similar field (preferred)
  • 7+ years as a Data Engineer or similar role
  • Strong SQL experience, e.g., MySQL, with the ability to build and tune complex queries/views
  • Strong no-SQL experience, e.g., Cassandra
  • Comfortable working in Linux environment
  • Demonstrated experience in
    • designing and optimizing relational databases
    • developing and optimizing automated ETL pipelines (e.g. Data Factory, Airflow, etc.)
    • accessing and creating datasets from API and FTP data sources
    • building and analyzing data models
    • working comfortably with unstructured data or big data sets
    • identifying and addressing technical debt on existing systems
    • working within enterprise platforms, e.g., Confluence, JIRA, AWS, Databricks

Preferred Qualifications

  • Large scale data validation strategies (millions of records, billions of data points)
  • Data encryption strategies
  • Data warehouse and data lake experience
  • Large scale database management such as sharding and partitioning
  • Programming experience in a modern programming language such as go, Java, Python, Scala, or C++
  • Distributed processing with Hadoop or Spark
  • Shell scripting
  • Management of time-series data, specifically AMI smart-meter data

Required Skills, Knowledge, and Abilities

  • Highly detail oriented
  • Maintain confidentiality
  • Think critically and demonstrate problem-solving skills
  • Communicate clearly on complex topics to technical and non-technical audiences
  • Demonstrate versatility and willingness to learn new technologies on the job
  • Demonstrate proficiency in English (written and verbal)
  • Collaborate effectively with cross-functional teams
  • Committed to diversity and inclusion
  • Reliable transportation

Licenses & Certifications

  • Valid driver’s license

Travel Requirements

  • Willingness to travel up to 5%

Physical Demands and Work Environment

  • Required to sit, stand, walk; talk and hear; and ability to touch and handle tools and/or controls
  • Ability to lift up to 10 pounds
  • Noise Level is typically moderate
  • Employee could be exposed to fumes and/or airborne particles and risk of potential shock

Note: Reasonable accommodations may be made for individuals with disabilities to perform the essential functions of this position.

The above information describes the general duties and requirements necessary to perform the principle functions of the position. This shall not be construed as a detailed description of all the duties and requirements that may be necessary in this position.

An Equal Opportunity Employer

Related Post

Sr. Software EngineerSr. Software Engineer

Splunk ’s Cloud Infrastructure organization builds robust and resilient auto-scaling platform solutions for hosting Splunk ‘s enterprise software . The teams are fast-paced, high-velocity, and use state-of-the-art technology. The focus