Data Engineer II

Data Engineer II – 2 roles open(12873417)
Duration: 12 months+

Locations: Need candidates local in the area preferred near Burbank, California

Additional Information

-Manage back end for movies anywhere-application to purchase movies
-Team does a lot of tracking, analytics
-work closely to send data to studios.

Important to have:
Must be familiar with AWS Cloud Environment
Kubernetes experience
Scala programming
5+ years experience minimum

What you will do:
* Leverage your data engineering skills to impact our business by taking ownership of key projects requiring coding and data pipelines
* Collaborate with product managers, software engineers and data engineers to design, implement, and deliver successful data solutions
* Define technical requirements and implementation details for data solutions
* Design, build and optimize performant databases, data models, integrations and ETL pipelines
* Maintain detailed documentation of your work and changes to support data quality and governance
* Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to the customers
* Be an active participant and advocate of agile/scrum practices to ensure health and process improvements for your team

Basic Qualifications
* 5+ years of experience designing and delivering large scale, 24/7, mission-critical data pipelines and features using modern big data architectures
* 3+ years of Scala
* 3+ years of Spark
* 2+ years of experience with AWS data ecosystem (S3, EMR, Glue, Athena, lambdas, EKS, etc)
* 1+ years of experience in ElasticSearch
* Deep knowledge in various ETL/ELT tools and concepts, data modeling, SQL, query performance optimization
* Experience with building stream processing applications using Kafka
* Experience with workflow management tools (Airflow, Oozie, Azkaban, Luigi, etc.)
* Comfortable working in K8s/EKS based environments
* Comfortable working in Linux environments

Preferred Qualifications

Required Education
Bachelor in Computer Science or equiv exp
Preferred Education
* BS in computer science, engineering, mathematics or p

Responsibilities:
Run data pipelines

Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.

Company Profile:

Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies’ dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers’ technical and business needs.

Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.

Learn more about Beacon Hill Staffing Group and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.beaconhillstaffing.com.

We look forward to working with you.

Beacon Hill. Employing the Future™

Related Post

Software EngineerSoftware Engineer

As a Software Engineer, you will be responsible for creating HTML mockups, website theme development, interactive development and enhancements to existing websites within our client portfolio. You will be accountable