Associate Principal, Data Analytics Engineering
The Options Clearing Corporation | |
United States, Illinois, Chicago | |
125 South Franklin Street (Show on map) | |
Dec 03, 2024 | |
Name of Employer: Job Title: Associate Principal, Data Analytics Engineering Location: Duties: Design and deliver scalable and resilient hybrid and Cloud-based applications and data solutions that support critical financial market clearing and risk activities. Drive the strategy of transforming the enterprise into a data-driven organization. Lead through innovative strategic thinking in building data solutions. Craft and build cloud-based applications and data systems that will serve as the backbone for the enterprise data management and analytics capabilities. Develop stream ETL applications to ingest data from multiple Kafka topics, including trading engine and market data topics in Google Protobuf format, to various data storage systems such as data lake based on AWS S3 storage. Apply Docker to containerize all applications into Docker image and set up quick local test environments using Docker Compose, and build and maintain continuous integration pipelines using Jenkins to automate the Docker images build process. Deploy containerized applications using Helm and Kubernetes to achieve high availability, fault tolerance and auto scalable functionality, and build Kubernetes pods log and health status monitoring stacks based on AWS EC2 Linux instances. Design and implement streaming applications using Flink to aggregate and store financial market data, write SQLs to analyze data in various databases, and utilize Git to review code and maintain version control. Work closely with internal and external business and technology partners. Take on unique technical challenges associated with handling large datasets and managing streaming data in public cloud and hybrid environments. Build large and complex data pipelines and integrate data coming from diverse sources in different formats. Implement continuous integration/continuous delivery pipelines, and be a part of API-first design principle implementation. Up to 40% telecommuting permitted. *This position qualifies for The Options Clearing Corporation's Employee Referral Program.* Education & Experience Required: Master's degree in CS, computer systems engineering, mathematics or related and two (2) years of experience as a software developer, software development intern or related. Special Skills Required: Must have work experience with each of the following: 1) Develop stream ETL applications to ingest data from multiple Kafka topics, including trading engine and market data topics in Google Protobuf format, to various data storage systems such as data lake based on AWS S3 storage; 2) Apply Docker to containerize all applications into Docker image and set up quick local test environments using Docker Compose, and build and maintain continuous integration pipelines using Jenkins to automate the Docker images build process; 3) Deploy containerized applications using Helm and Kubernetes to achieve high availability, fault tolerance and auto scalable functionality, and build Kubernetes pods log and health status monitoring stacks based on AWS EC2 Linux instances; 4) Design and implement streaming applications using Flink to aggregate and store financial market data, write SQLs to analyze data in various databases, and utilize Git to review code and maintain version control. Up to 40% telecommuting permitted. Salary: $136,700 - $174,100 Apply: Salary Range 99,300.00 - 136,700.00 - 174,100.00 USD AnnualIncentive Range Step 1 Step 2 Step 3 For more information about OCC, please click here. OCC is an Equal Opportunity Employer |