Data Engineer

BigBear.ai
United States, D.C., Washington
Jan 09, 2025
Overview BigBear.ai is seeking a Data Engineer to join our team and help us build and maintain scalable and reliable data pipelines for our clients. You will be responsible for developing and designing data pipelines to support an end-to-end solution, integrating data pipelines with AWS cloud services to extract meaningful insights, and providing Tier 3 technical support for deployed applications and dataflows. What you will do Develop and design data pipelines to support an end-to-end solution Develop and maintain artifacts i.e., schemas, data dictionaries, and transforms related to ETL processes Integrate data pipelines with AWS cloud services to extract meaningful insights Manage production data within multiple datasets ensuring fault tolerance and redundancy Design and develop robust and functional dataflows to support raw data and expected data Provide Tier 3 technical support for deployed applications and dataflows Collaborate with the rest of data engineering team to design and launch new features. Includes coordination and documentation of dataflows, capabilities, etc. What you need to have Must maintain an active Top Secret with SCI eligibility clearance and be able to work in a fast-paced and collaborative environment. You will also need to have a Bachelor's Degree and 2+ years of experience; or 8 to 10 years of relevant experience with no degree. Proficiency in data engineering, ETL architecture and development, and end-to-end processes Experience in working with AWS cloud services, such as S3, EC2, Lambda, Glue, Athena, etc. Experience in database administration and API development Knowledge of data pipeline tools and frameworks, such as Airflow, Spark, Kafka, etc. Ability to design and develop robust and functional dataflows to support raw data and expected data Ability to develop and maintain artifacts, such as schemas, data dictionaries, and transforms related to ETL processes Ability to collaborate with the rest of data engineering team to design and launch new features, including coordination and documentation of dataflows, capabilities, etc. Ability to troubleshoot and resolve complex technical issues What we'd like you to have Experience with cloud message APIs and usage of push notifications will be a plus for consideration Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security About BigBear.ai BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on BigBear.ai's predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in Columbia, Maryland, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit https://bigbear.ai/ and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai. BigBear.ai is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation gender identity, national origin, disability or veteran status, age or any other federally protected class.