Big Data/Machine Learning Engineer - Lead

Genesis10
life insurance, 401(k)
United States, Virginia, Richmond
Nov 11, 2024
Genesis10 is currently seeking a Data Engineer with our client in their Richmond, VA location. This is a 5 month contract and hybrid remote position. Overview: We are looking for an experienced and highly skilled Data Engineer Lead to join our team. This role is ideal for a data engineer with strong technical expertise and leadership abilities, ready to guide a team in building robust data solutions. The Data Engineer Lead will be responsible for architecting, implementing, and optimizing data pipelines, as well as ensuring data availability, reliability, and performance. You will work closely with cross-functional teams to support analytics, data science, and data-driven decision-making across the organization. Responsibilities: Lead the design, development, and maintenance of scalable ETL pipelines to support data processing and transformation. Optimize data solutions on AWS, leveraging services like Fargate, and deploy containerized applications using Docker. Collaborate with cross functional teams to understand data requirements and translate them into efficient data models and pipelines. Develop and maintain APIs for data access and integrations with other systems, enabling seamless data flow across platforms. Ensure data quality, governance, and best practices throughout the data engineering process. Oversee the management and use of Snowflake, building efficient, secure, and scalable data warehouse solutions. Implement continuous integration/continuous deployment (CI/CD) practices using Jenkins to automate pipeline deployments and updates. Requirements: Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field. 5+ years of experience in data engineering, with a focus on building data pipelines, ETL processes, and data warehouses. Strong proficiency with AWS services, especially Fargate, and experience with Docker for containerized applications. Proficient in Python for scripting, data manipulation, and automation. Extensive experience with SQL for data querying, transformation, and database management. Experience with Snowflake or similar cloud-based data warehousing platforms. Hands-on experience with API development and integration. Familiarity with Jenkins for CI/CD pipeline automation. Preferred Qualifications: Knowledge of big data technologies such as Spark or Hadoop. Familiarity with additional programming languages (e.g., Java, Scala) is a plus. Experience with monitoring and logging tools (e.g., CloudWatch, Splunk). Strong understanding of data security, data governance, and compliance practices. Pay rate range: $70- $80 hourly If you have the described qualifications and are interested in this exciting opportunity, please apply! Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals. For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years. The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years. Access to an experienced, caring recruiting team (more than 7 years of experience, on average.) Behavioral Health Platform Medical, Dental, Vision Health Savings Account Voluntary Hospital Indemnity (Critical Illness & Accident) Voluntary Term Life Insurance 401K Sick Pay (for applicable states/municipalities) Commuter Benefits (Dallas, NYC, SF) Remote opportunities available For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website. Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.