Senior Data Engineer

Location: All Locations in the United States

Work Arrangement: Remote, In-office or Hybrid

A Day in the Life

The Senior Data Engineer role is responsible for contributing to the progression and enhancing of Eide Bailly's Data Analytics environment. They work closely with program managers and application developers to architect and build databases, data warehouses, data models, and other data assets needed to provide Eide Bailly's service areas with timely, complete and accurate information. The Senior Data Engineer is a key role developing and designing data for AI Readiness and Adoption especially through executing the data governance strategy to ensure proper use and dissemination of data in agentic solutions.

A typical day as a Senior Data Engineer might include the following:

• Builds ETL processes to extract data from multiple sources to build and maintain the data lake.
• Builds and maintains data orchestration pipelines with scalable connections and robust flexibility that minimizes failures, consumption costs, time to execute, and fail points.
• Sets up and maintains data connections, integrations, and gateways leveraging non-human IDs and service principals ensuring proper Zero-Trust security and PIM/PAM design standards.
• Works with service areas to transform data through applying business use cases, auditing and staging data.
• Review code notebooks and processing data tools for optimal performance and efficiency.
• Creates data models including but not limited to fact and dimension tables to support reporting technologies such as OLAP cubes, Tableau, Power BI and Alteryx.
• Collaborates with AI Engineers and Solution Architects to provide data pipelines that support model training and inference.
• Uses problem solving and creativity to apply appropriate techniques in the creation of robust, scalable, and reproducible data processing assets.
• Leverages source control and pipeline tools such as Github, GitLab, or Git for ADO to maintain documentation and controls of what is delivered to the target data engineering environment providing a full description of how the information is delivered and to what environment and stage of development.
• Works with OST team members to ensure that all data needs are being supplied by internal systems and applications.
• Provides guidance and recommendations for system security and governance.
• Monitors platform and application stability and initiates incident and escalations to both internal teams and external vendors.
• Troubleshooting, root cause analysis, implementation, and retrospective activities to overcome break-fix incidents and harden data pipelines to be more robust, stable, and scalable.
• Ensures timely and accurate performance on assigned projects.
• Maintains compliance with project budgets, turnaround times, and deadlines.

Who You Are

• You have Bachelor's degree in Information Systems, Computer Science or related field and minor in mathematics, statistics, accounting, finance or other quantitative discipline, preferred. Knowledge of Accounting and Professional Services business models and industry is a plus.
• You have 5+ years work experience on data architecture and model design, specifically for Medallion Data Architecture and Star Schema relational Databases.
• You have 5+ years work experience coding and scripting data workflows in both PySpark (Python) and SQL-based programming.
• You have 5+ years work experience in a CI/CD DevOps environment leveraging and maintaining parameterized development techniques to scale and deliver data assets at a high frequency.
• You have 5+ years work experience on cloud-based data and analytics platforms such as Microsoft Fabric (preferred), Microsoft Power Platform (preferred, especially Dataverse), AWS, Snowflake, or Google.
• You have 2-5 years experience cloud platform administration such as MS Purview, Dataverse (Power Platform), and MS Fabric.
• You have Demonstrated understanding of AI-assisted coding and code-review process best practices.
• You also have knowledge of:
  • ETL processes and tools. Data orchestration and preparation best practices.
  • MPP systems such as MS Data Factory & Synapse, Dataverse, and Delta Lake storage. MS Fabric and Azure DataLake Gen 2 preferred.
  • Streaming technologies, such as Microsoft, Kafka, Kinesis, Lambda and Spark.
  • SDLC Lifecycle.
  • Performance Tuning, Query Optimization, and indexing best practices on database creation and updating.
  • Operational Data Stores (ODS, esp. MS Dataverse) and the use cases of Real-time vs. batch analytics processing and what toolset and designs are best for each.
  • Medallion Lakehouse concept data warehousing model (Bronze > Silver > Gold).
  • Cloud Platform Data Governance and Monitoring (MS Purview preferred).
  • Both structured and unstructured data processing.
  • LLMs, RAG, Knowledge Base, and other Artificial Intelligence concepts that greatly influence data governance, design, and security standards in cloud data platforms.
• You also have the desire to adopt Artificial Intelligence both as a consumer of it to assist with code development and design and as a developer of it for deployment of agentic solutions.
• You can work independently and motivated to take on projects proactively.
• You can work with different departments and teams to gather complete dataset information and communicate findings and practices company wide.
• You have strong interpersonal skills and can maintain effective working relationships with staff, partners, public and external agencies.
• You understand the project management lifecycle while working with program managers, business analysts and data scientists.
• You must possess intellectual and analytical curiosity and take the initiative to dig into the "why" of various results and a desire to grow responsibility and become a domain expert and strategic thought leader.

Must be authorized to work in the United States now or in the future without visa sponsorship.

Making an Impact Together

People join Eide Bailly for the opportunities and stay because of the culture. At Eide Bailly, we've built a collaborative workplace based on integrity, authenticity, and support for one another. You'll find opportunities for education and career growth, a team dedicated to your success, and benefits that put your family's needs first. Hear what our employees have to say about working at Eide Bailly.

Compensation

$115,000-$150,000. Our compensation philosophy emphasizes competitive and equitable pay. Eide Bailly complies with all local/state regulations regarding displaying ranges. Final compensation decisions are dependent upon factors such as geography, experience, education, skills, and internal equity.

Benefits

Beyond base compensation, Eide Bailly provides benefits such as: generous paid time off, comprehensive medical, dental, and vision insurance, 401(k) profit sharing, life and disability insurance, lifestyle spending account, certification incentives, education assistance, and a referral program.

Next Steps

We'll be in touch! If you look like the right fit for our position, one of our recruiters will be reaching out to schedule a phone interview with you to learn more about your career interests and goals. In the meantime, we encourage you to learn more about us onFacebook,Twitter,Instagram,LinkedInor ourAbout Uspage.

For extra assistance in your job search journey, explore EB Career Resources-a complimentary external tool that offers career exploration, resume workshops, interview prep and other professional development options.

Eide Bailly LLP is proud to be an affirmative action/equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, veteran status, or any other status protected under local, state or federal laws.

#LI-KP1

#LI-REMOTE