Data Engineer III
Children's Hospital of Philadelphia | |
United States, Pennsylvania, Philadelphia | |
Nov 07, 2024 | |
SHIFT: Day (United States of America)Data Engineer III - Children's Hospital of Philadelphia (Philadelphia, PA): Execute data engineering projects from inception to completion, utilizing real-time streaming data platforms and cloud services for efficient data extraction and ingestion, performing code development, and creating actionable dashboards to provide insightful analytics to support ongoing business operations. Duties include: Collaborate with product managers and development teams to translate end-user needs into detailed product specifications; contribute to the design, implementation, and adoption of a robust real-time stream data platform by extracting and ingesting real-time streaming data into Amazon Web Services (AWS) and Snowflake platforms using cloud services such as Elastic File System (EFS), Elastic Container Service (ECS), Amazon Kinesis, Apache Flink and Snowpark, and monitoring contributions to the real-time streaming datasets; develop code changes for data pipeline ingestion processes for Snowflake using Python, Airflow, Kubernetes, dbt, and SQL; administer data engineering projects from inception to completion, including project planning and milestone tracking, defining project requirements, prioritizing tasks, and monitoring project progress to ensure timely delivery of solutions; design and develop dashboards using QlikSense, QlikView, and Power BI to provide actionable insights related to issues such as cost consumptions and metadata; educate and mentor junior data engineers by imparting industry best practices and providing guidance on technical challenges; and implement streamlined orchestration workflows within Airflow, leveraging Python to optimize QlikSense and QlikView processes for enhanced platform services management, and improve platform support and release management by implementing CI/CD pipelines using GitHub Actions and Jenkins. Requires a Bachelor's degree in Computer Science or a related field and 6 years of related experience, or alternatively a Master's degree in same and 4 years of related experience. Experience must include working with IBM Netezza, dbt, SQL, Python, Apache Airflow, Informatica PowerCenter, SOS Job Scheduler, GoAnywhere, and the Epic Electronic Health Record (EHR) system. Telecommuters considered. Apply online at chop.edu/careers. To carry out its mission, CHOP is committed to supporting the health of our patients, families, workforce, and global community. As a condition of employment, CHOP employees who work in patient care buildings or who have patient facing responsibilities must be fully vaccinated against COVID-19 and receive an annual influenza vaccine. Learn more. |