Staff Software Engineer, Data Engineering

What Makes Us a Great Place to Work

We are proud to be consistently recognized as one of the worlds best places to work, a champion of diversity and a model of social responsibility.

We are currently ranked the #1 consulting firm on Glassdoor’s Best Places to Work list, and we have maintained a spot in the top four on Glassdoors list for the last 12 years.

We believe that diversity, inclusion and collaboration is key to building extraordinary teams.

We hire people with exceptional talents, abilities and potential, then create an environment where you can become the best version of yourself and thrive both professionally and personally.

We are publicly recognized by external parties such as Fortune, Vault, Mogul, Working Mother, Glassdoor and the Human Rights Campaign for being a great place to work for diversity and inclusion, women, LGBTQ and parents.

Who Youll Work With

Bain’s Global Engineering leads the firm’s software development efforts and defines engineering standards for Bain globally.

The team ships software solutions to address client and internal needs, ranging from iterative prototypes to enterprise-grade production software.

You will solve cutting-edge problems for a variety of industries as a data engineer.

As a member of a diverse engineering team, you will participate in the full engineering life cycle designing, developing, optimizing, and deploying new data engineering solutions and infrastructure at the production scale of the world’s largest companies.

What You’ll Do:

  • Develop software solutions tackling enterprise scale challenges for Bain’s clients, as the data engineer and expert within a cross functional team
  • Develop and champion modern data engineering concepts to technical audience and business stakeholders
  • Build large scale data engineering solutions with automation
  • Translate business requirements into technical requirements and implementation details
  • Participate in the full software development life cycle including designing, writing documentation and unit/integration tests, and conducting code reviews for data engineering solutions.
  • Provide technical guidance to external clients and internal stakeholders in Bain
  • This role requires approximately 20% travelling to clients as needed
    – (post-pandemic)

Architect, design, develop, build, and release robust and scalable Data Engineering solutions.

(50%)

  • Enable data and technology for data science, analytics, and other application use cases via data engineering
  • Data ingestion at scale for batch and near real-time use cases from polyglot sources
  • Transformations at scale including cleaning, enriching, de-duping, joining and correlated on structured, semi-structured or unstructured data
  • Serve data on polyglot mediums (data lake, distributed file systems, database/data-warehouse, API, stream) in use-case specific formats (Parquet, Avro, Json, ORC, SQL)
  • Enable data with governance layer including discoverability, observability, security, privacy & compliance and metadata & taxonomy
  • Enable engineers and data scientists to productionize workloads with engineering best practices at scale

Build scalable data engineering infrastructure and tooling (20%)

  • Participate in the full software development life cycle including reviewing distributed system designs, writing documentation and unit/integration tests, and conducting code reviews
  • Design and develop frameworks to automate data ingestion, analysis, visualization, and integration of structured and unstructured data from a variety of data sources 

Provide technical guidance to external clients and internal stakeholders in Bain (30%)

  • Scoping data engineering and data platform architecture initiatives
  • Develop work plans with insights on data engineering capability roadmap and feature prioritization
  • Assess current data engineering capabilities and recommend maturity roadmap for use case
  • Advise on tools and technology decision making for data engineering capabilities

About You

We are looking for someone who has:

  • Bachelor’s in Computer Science or a related technical field.
  • 4+ years of experience programming with Python, Scala, Java, C++, or Go
  • 4+ years of experience with cloud-based data engineering technologies (EMR, Glue, ADF, Dataflow, Databricks, Snowflake, Kafka, Kinesis, Pulsar etc)
  • 2+ years of experience with data engineering frameworks like Spark, Flink, Airflow, Atlas, Beam

Ideal candidates will also have experience in:

  • Advanced degree in Computer Science or a related technical field.
  • Open-source distributed computing and database frameworks such as Apache Flink, Ignite, Presto, Apex, Cassandra and HBase
  • Experience deploying machine learning models at scale for training and inference
  • Application engineering experience including developing backend services at scale and front end
  • Deployment best practices using CI/CD tools and infrastructure as code (Jenkins, Docker, Kubernetes, and Terraform).
  • Strong interpersonal and communication skills, including the ability to explain and discuss technical concepts and methodologies with colleagues and clients from other disciplines
  • Agile development methodology
  • Engineering distributed systems and database internals (including handling consensus, availability, distributed query processing etc.).
  • Deploying end-to-end logging solutions such as the EFK stack.
  • Experience with designing and building large scale application or data platforms
  • Experience with administering and managing Kubernetes clusters (EKS, GCP, or AKS) and Helm

About Us

Bain & Company is a global consultancy that helps the world’s most ambitious change makers define the future.

Across 59 offices in 37 countries, we work alongside our clients as one team with a shared ambition to achieve extraordinary results, outperform the competition and redefine industries.

We complement our tailored, integrated expertise with a vibrant ecosystem of digital innovators to deliver better, faster and more enduring outcomes.

Our 10-year commitment to invest over $1 billion in pro bono services brings our talent, expertise and insight to organizations tackling today’s urgent challenges in education, racial equity and social justice, economic development and the environment.

Since our founding in 1973, we have measured our success by the success of our clients, and we proudly maintain the highest level of client advocacy in the industry.

Related Post

Cloud EngineerCloud Engineer

It’s fun to work in a company where people truly believe in what they’re doing! At Blackline, we’re committed to bringing passion and customer focus to the business of enterprise