Splunk Engineer/Cloud Logging Engineer (CLS Support)

Pyramid Systems is seeking an Cloud Logging Engineer (Splunk & AWS) who is responsible for ensuring the availability, performance, and security.

Advise on cost efficiency for future usage and cost optimization for current infrastructure.
• Automate the management and enforcement of policies.
• Create and maintain documentation related to architecture and operational processes for CLS (Centralized Logging Solution).
• Develop a set of best practices and architecture patterns.
• Help maintain regulatory compliance of the CLS (Centralized Logging Solution) infrastructure.
• Help monitor and maintain CLS performance, availability, and capacity.
• Help maintain application container images.
• Offer solutions for ingestion of logs to Splunk via cloud native solutions.
• Maintain all infrastructure as code.
• Provide operations monitoring of CLS platform to enable proactive issue identification, response, and resolution.
• Recommend and execute improvements to the existing CLS architecture and design with growth and scalability in mind to optimize performance, stability, reliability, and agility.
• Responsible for reporting on current infrastructure status, and planning for future usage.
• Responsible for Beats agent deployments and container infrastructure analysis, optimization, and capacity planning.
• Maintain CI/CD pipelines for configuration deployments to applications.
• Support large-scale deployments with data feeds from multiple on premise and cloud data centers.
• Upgrade, install, configure monitoring solution for AWS for Windows and Linux servers.
• Utilize automation tool such as Terraform, Ansible, AWS Cloud Formation, Azure Resource Manager, or similar.
• Participate in a rotating on call schedule and weekly off hours maintenance.

• Splunk certification required***
• Candidate background eligibility requirements are United States citizen or be a Permanent Resident and have lived in the United States for at least 3 years, clean criminal background and able to obtain a Public Trust (High-Risk) Position.

• Bachelor's degree in computer science, electronics engineering or other engineering or technical discipline OR AWS/Azure Certification (AWS Professional / Specialty Cert. OR Azure Expert / Advanced Cert.) OR 4 years of relevant experience in one of the VAECOT suite of tools (Science Logic, Dynatrace, Turbot, AppDynamics)

• Minimum of three (3) years of experience in leading technical teams to achieve objectives and outcomes.

• Minimum of six (6) years setting up, configuring, and using AWS cloud operational tools to ensure service level agreements and performance targets are met, and continued compliance with policies, standards and guidelines.

• Minimum of three (3) years specific to monitoring Centralized Logging Solution (CLS)/Splunk

• Subject matter expertise with ALL VAEC Cloud Service Providers which currently includes Microsoft Azure and Amazon Web Services (AWS).

• Experience with programming with Splunk language (SPL) or equivalent (e.g., Python, Powershell, AWS or Azure CLI).

• One or more of these Splunk certifications: Splunk Core Certified Power User, Splunk Core Certified Advanced Power User, Splunk Enterprise Certified Admin, Splunk Enterprise Certified Architect, Splunk Enterprise Security Certified Admin, Splunk IT Service Intelligence Certified Admin.

• Knowledge of enterprise logging, with a focus on security event logging.

• Solid understanding of cloud concepts, either using Azure or AWS semantics.

• Experience in one or more of the VAECOT suite of tools, shown below:

VAEC Operational Tools (VAECOT)

Some experience in one or more of the following tools:

Third party tools

* Application Performance Monitoring: Dynatrace, AppDynamics

* Cloud Security: Nessus, NetSkope, Enterprise Security External Change Council, Identity and Assessment Management, Continuous Monitoring as a Service, McAfee, eMASS, Centrify

* Cloud Governance: Turbot

* DevOps/Configuration Management/Help Desk: Ansible, Service Desk, ScienceLogic, ServiceNow, SPLUNK, Jira ServiceDesk, Cloudockit, GitHub

* Containerization: Red Hat OpenShift

* Migration: CloudKey, Version One

* Reporting: Apptio

Cloud Service Provider (CSP) Operational Tools Tools/Services

* AWS Security: System Manager (Explorer and OpsCenter), CloudWatch, Config, CloudTrail, Elasticsearch (Kinesis DataStreams), GuardDuty, Inspector, Key Management Service (KMS), Security Hub, Directory Service, Identity and Access Management, Resource Access Manager, Cognito, Secrets Manager, Certificate Manager, Artifact

* Aws Monitoring and Logging: QuickSight, Eventbridge (AWS Kinesis DataStreams), Simple Notification Service (SMS), Elasticsearch (AWS Kinesis DataStreams), CloudTrail, CloudWatch

* Aws Networking: Virtual Private Cloud (VPC), Route S3, API Gateway, Direct Connect, AppStream 2.0, Transit Gateway, Elastic Loadbalancer, Firewall Manager, WAF & Shield

* AWS Storage: Cloud Tiering Services to S3 from On-Prem, Simple Storage Services (S3), S3 Glacier, Storage Gateway, Elastic File System (EFS), Backup

* Azure Security: Monitor (Log Analytics and ASC), Event Hubs, Security Center (ASC), Information Protection (AIP) , Key Vault, PowerBI, Network Watcher (Performance Monitor), Monitor (Log Analytics and ASC)

* Azure Monitoring and Logging: Information Protection (AIP), Advance Threat Protection, Security Center (ASC), Information Protection (AIP), Key Vault, Active Directory, Role Based Access Control (RBAC), Resource Manager (ARM), Resource Graph (ARG), Active Directory B2C, Key Vault, App Service, Service Trust Portal

* Azure Networking: Virtual Network, Traffic Manager, DNS, Application Gateway, Express Route, Web Apps, FrontDoor, VPN Gateway, Loadbalancer, Firewall

* Azure Storage: NetApp File Service, Storage (Blobs, Disks, Files, Queues, Tables), Storage Archive Access Tier, StorSimple, Files, Backup