Job posting has expired

Big Data Engineer

Apple, Inc.
United States, California, Cupertino
July 06, 2022
Summary Posted: Mar 11, 2022 Weekly Hours: 40 Role Number: 200305706 Apple's MediaTech Data Engineering team plays a critical role in supporting the concept of data driven analytics by providing data collection, warehousing and analytics at big data scale. As a Big Data Engineer, you will be developing and maintaining services to support our data driven analytics framework. Key Qualifications Experience in building large scale distributed systems in Java/Scala or other object-oriented languages with processing systems like Spark/Kafka Hands-on experience with managing and monitoring large scale data collection and analytics pipelines at the application level Experience in tuning and scaling Apache Kafka producer/consumer and Spark Structured Streaming applications Ability to conduct performance analysis and troubleshoot large scale distributed systems Description Apple's MediaTech Data Engineering team is looking for a motivated Big Data Engineer to - Develop/enhance and maintain our streaming data pipeline and analytic components - Work closely with developers, data scientists and first level support teams - Provide occasional after hours on-call support to handle urgent critical issues by working with first level support teams Education & Experience BA/BS in CS or equivalent work history Additional Requirements Desired but not required: Should be able to understand complex architectures and be comfortable working with multiple teams Proficient with SQL Hands-on experience with Docker/Kubernetes Experience with managing applications running under YARN/Hadoop with HDFS Working knowledge of Trino Experience with Log mining frameworks like Splunk, Prometheus, etc Experience with deploying and managing CI pipeline with Jenkins or similar tools