IT Analyst III Specialized
(ECC Level 2 – Senior Engineer for Incident Triage & Monitoring)
KEY JOB FUNCTIONS
1. Manage IT production incidents to resolution in a 24/7/365 environment using the Fannie Mae incident management processes and communicate management of incident status, impact and resolution actions.
2. Effectively lead and guide Incident triage calls from a technical perspective analyzing different components of the infrastructure and application environment via the use of a variety of monitoring tools and processes.
3. Troubleshoot the incidents and identify root cause quickly using operations, wire data analytics, application performance management and event correlation monitoring tools.
4. Perform analysis of data, evaluating multiple application protocols including web, database, storage, and supporting infrastructure such as AWS, UNIX, DNS, LDAP, SSL, SMTP, and FTP.
5. Troubleshooting and resolving incidents on the AWS cloud infrastructure.
6. Hands on experience managing and monitoring applications deployed on Amazon Web Services (AWS) using tools like EC2, ELB, RDS, Redshift, DynamoDB, Aurora, Route53, ECS, Lambada, S3, Batch, CloudWatch, CloudTrail, WAF etc.
7. Experience with building tools for monitoring and troubleshooting of system resources in an AWS environment. Ability to triage AWS related incidents using monitoring tools on AWS Cloud.
8. Experience with performance engineering of AWS Cloud applications.
9. Hands on experience with transaction level monitoring using Dynatrace, OpenTelemetry and Splunk.
10. Ability to perform transaction level monitoring and troubleshooting in AWS cloud platform.
11. Eyes on glass monitoring of the health of applications as well as the underlying infrastructure.
12. Monitoring experience with tools like Extrahop, SolarWinds, Netcool suite, Catchpoint, MoogSoft.
13. Ability to analyze dashboards and reporting/monitoring tools to look at trends and patterns in application health and performance.
14. Proactively looking for hardware, software, and environmental alerts or malfunctions.
15. Influence other technical teams on the calls and articulate troubleshooting steps effectively.
16. Lead required technical follow-up calls for critical incidents.
17. Assist with documentation of Root Cause Analysis (RCA) or Correction of Errors (COE) and data quality for all ECC communicated incidents.
18. Ensure appropriate functional and management escalation takes place as per the standards and procedures.
19. Follow up on items that could potentially negatively impact production operations, assist with postmortem related activities, and support various efforts related to operational improvements.
20. Based on recommendations from management, implement new and improved processes, change processes, perform new tasks, create reports and address ad-hoc requests.
21. Participate in on-call rotation. Ability to work on any shifts as needed including weekends and night shifts.
22. Ability to report incident details and metrics to senior leadership.
EDUCATION
Bachelor's Degree or equivalent required.
MINIMUM EXPERIENCE
6+ years of related experience
SPECIALIZED KNOWLEDGE & SKILLS
1. 6+ years of working experience with different IT Infrastructure components such as AWS, Unix/ Linux Servers, Wintel Servers, AWS, networks, firewalls, routers, load balancers, VPN, Apache, web logic, LDAP, Active Directory, Exchange, Oracle/MS SQL databases, SAN, Virtualization, Email systems, Enterprise monitoring and access management solutions for single sign on. Subject matter expertise is not required and experience with at least eight of the above is preferred.
2. Senior level hands-on working experience with Amazon Web Services (AWS).
3. Proven methodical approach to problem identification, monitoring, problem solving and resolution.
4. Ability to analyze different components of the infrastructure and application environments during Incident triage calls.
5. Aptitude to influence other technical teams on the incident calls and articulate troubleshooting steps effectively.
6. Experience and confidence working with all levels of management; excellent written and verbal skills.
7. Able to quickly and concisely communicate with senior management on technical issues in non-technical terms and to run large conference calls during Incident calls with a wide range of personnel and management levels.
8. Strong relationship management skills and aptitude to multi-task and work well in a high stress environment, both within teams and independently.
9. AWS Solution Architect Associate or higher certification
Preferred Qualifications:
1. Understanding of tools like CloudFormation or Terraform
2. Management and troubleshooting of Middleware products on UNIX and Linux environments. Knowledge of Service Oriented Architecture (SOA), Java etc.
3. Understanding of Azure or Google Cloud.
4. Prior Fannie Mae or Financial industry experience.
