Skip to main content

?
Helpdesk
Click here to connect with our resourcing helpdesk team

Principal Engineer, Resilience Engineering

New York, United States

Apply for job

Key information

Date live: 11/14/2025

Business Area: GTIS

Area of Expertise: Technology

Contract: Permanent

Reference Code: JR-0000079923

Apply for job

It’s happening at Barclays.

Be a part of a place where challenges are measured in billions, qubits and nanoseconds. Build your career in an environment where we’re advancing machine learning, leveraging blockchains, and harnessing FinTech. Working in Barclays technology, you’ll reimagine possibilities: learning and innovating to solve the challenges ahead, delivering for millions of customers.
We are shaping the future of financial technology.
Why not join us and make it happen here?

Where will you be located?

Explore locations

Position Summary

We are seeking an accomplished technology leader to spearhead a critical initiative in Resilience Engineering. There are limitations of current component and infrastructure reliability strategy. This role will drive a fundamental shift in approach, moving from a presumption of reliability to an expectation of failure to drive resilience patterns in both technology and human processes.

You will lead the effort to institutionalize modern techniques redundancy, graceful degradation, monitoring, chaos engineering, adaptation, preparedness, and modularity.  This is to treat resilience as a systemic challenge, not just a technology problem. This position requires a leader who can not only architect and implement technical solutions but also foster the necessary cultural change across engineering, infrastructure, and cybersecurity teams. You will act as a skilled facilitator and principal engineer, guiding teams to build assurances of failure tolerance into the daily operation of our most critical payment systems.

Key Responsibilities

  • Lead and Facilitate: Guide cross-functional teams through a multi-phase program to enhance systemic resilience. Foster a culture of collaboration and shared responsibility for the end-to-end payments flow.
  • System Discovery and Mapping: Initially direct the exploration and documentation of our complex, multi-layered payments applications to develop techniques for broad technology discovery and mapping. Leverage experience simplifying legacy technology stacks to map all component interactions, dependencies, potential failure modes.
  • Instrumentation and Observability: Architect a comprehensive instrumentation strategy to make the entire system observable.  This will leverage current work to build and enhance the Observe platform. Apply your expertise in enhancing system stability and performance Open Telemetry to ensure all dependencies are empirically validated and changes can be detected and analyzed.
  • Controlled Experimentation: Design and oversee a program of controlled experiments to validate failure mode assumptions. Lead teams in injecting faults into lower environments to gather evidence needed for architectural adjustments and optimize systemic resilience.
  • Production Chaos Engineering: Drawing on a strong empirical basis, develop and implement a strategy for safely introducing deliberate faults into the production environment (e.g., restarting services, degrading network connectivity) to continuously validate resilience.
  • Institutionalize Best Practices: Drive the institutionalization of a "design for failure" mindset. Develop and evangelize new patterns, tools, and processes that make resilient failure a core part of our system design and engineering culture.

Qualifications and Skills

  • Leadership Experience: Significant experience leading technology initiatives in a demanding financial environment, with a proven ability to manage and influence large teams.
  • Technical Expertise: Deep expertise in technologies used for high-volume financial transactions. Experience scaling infrastructure capacity to handle billions of daily transactions.
  • System Modernization: Demonstrated success in modernizing and simplifying complex technology stacks, including decommissioning legacy components to improve efficiency, maintainability, discoverability, and risk reduction.
  • Financial & Regulatory Systems: Extensive experience with core finance technology, including accounting, payments, settlements, client data, and the implementation of technology for a regulated business.
  • Problem-Solving: A proven ability to tackle complex technical challenges, architect innovative solutions, and consolidate disparate systems into unified, efficient platforms.
  • Communication: Excellent written and verbal communication skills, necessary for facilitating cross-functional teams and driving cultural change across the enterprise.

Purpose of the role

To drive technical excellence and innovation by leading the design and implementation of robust software solutions, providing mentorship to engineering teams, fostering cross-functional collaboration, and contributing to strategic planning to ensure the delivery of high-quality solutions aligned with business objectives. 

Accountabilities

  • Provision of guidance and expertise to engineering teams to ensure alignment with best practices and foster a culture of technical excellence.
  • Contribution to strategic planning by aligning technical decisions with business goals, anticipating future technology trends, and providing insights to optimize product roadmaps.
  • Design and implementation of complex, scalable, and maintainable software solutions, considering long-term viability and business objectives.
  • Mentoring and coaching to junior and mid-level engineers to foster professional growth and knowledge sharing, elevating the overall skillset and capabilities of the organization.
  • Collaboration with business partners, product managers, designers, and other stakeholders to translate business requirements into technical solutions and ensure a cohesive approach to product development.
  • Innovation within the organization by identifying and incorporating new technologies, methodologies, and industry practices into the engineering process.

Director Expectations

  • To manage a business function, providing significant input to function wide strategic initiatives. Contribute to and influence policy and procedures for the function and plan, manage and consult on multiple complex and critical strategic projects, which may be business wide..
  • They manage the direction of a large team or sub-function, leading other people managers and embedding a performance culture aligned to the values of the business. Or for an individual contributor, they lead organisation wide projects and act as deep technical expert and thought leader, identifying new ways of working and collaborating cross functionally. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions..
  • Provide expert advice to senior functional management and committees to influence decisions made outside of own function, offering significant input to function wide strategic initiatives.
  • Manage, coordinate and enable resourcing, budgeting and policy creation for a significant sub-function.
  • Escalates breaches of policies / procedure appropriately.
  • Foster and guide compliance, ensure regulations are observed that relevant processes in place to facilitate adherence.
  • Focus on the external environment, regulators, or advocacy groups to both monitor and influence on behalf of Barclays, when appropriate.
  • Demonstrate extensive knowledge of how the function integrates with the business division / Group to achieve the overall business objectives.
  • Maintain broad and comprehensive knowledge of industry theories and practices within own discipline alongside up-to-date relevant sector / functional knowledge, and insight into external market developments / initiatives.
  • Use interpretative thinking and advanced analytical skills to solve problems and design solutions in often complex/ sensitive situations.
  • Exercise management authority to make significant decisions and certain strategic decisions or recommendations within own area.
  • Negotiate with and influence stakeholders at a senior level both internally and externally.
  • Act as principal contact point for key clients and counterparts in other functions/ businesses divisions.
  • Mandated as a spokesperson for the function and business division.

All Senior Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.

Barclays welcomes applications from all candidates and is committed to ensuring reasonable adjustments (accommodations) are put in place to allow for a fair and inclusive recruitment process. For more information and how to request one, please review Adjustments to the recruitment process.

We’re a global, vital and highly respected financial organisation with an inspiring Purpose. Operating in 39 countries and employing around 100,000 people across the world, we help communities, individuals and businesses thrive. And we’ve created financial solutions and technology that the world now takes for granted. A career with us can offer incredible variety, depth and breadth of experience, and the chance to learn from some of the best minds in technology and finance.

To find out more about Barclays' strategy please click here.

We are an equal opportunity employer and opposed to discrimination on any grounds. It is the policy of Barclays to ensure equal employment opportunity without discrimination or harassment on the basis of race, colour, creed, religion, national origin, alienage or citizenship status, age, sex, sexual orientation, gender identity or expression, marital or domestic/civil partnership status, disability, veteran status, genetic information, or any other basis protected by law.

Barclays is required by law to confirm that you have the Legal Right to Work in any role that you apply for. If you currently hold a work visa sponsored by Barclays, or you would require sponsorship from Barclays, you must declare this as part of your application. Sponsored visas are role and entity specific and any changes must be reviewed. It is important that you ensure you are working on the correct visa at all times. Failure to accurately disclose your visa status or Legal Right to Work may result in your application or any employment offer being withdrawn at any time.

Who succeeds in
Tech at Barclays?

For a career with us, you need to be prepared to take big steps forward, curious to face the challenges ahead, and driven to focus on the outcomes. We need people with the Barclays mindset to make it happen here.

Qualities we look for:motivator, supporter, connector, driver, communicator, transformer, maker, observer

What you'll get in return

Competitive holiday allowance
Life assurance
Private medical care
Pension contribution

Our technology

Supporting our 48 million customers and clients worldwide takes a lot of forward thinking. It means harnessing technology to support the economy. It means making a difference to people’s lives. And it requires the maintenance and development of a global, technological infrastructure. At Barclays, technology helps us keep transactions moving, manages data, and protects our customers. Join a world where your work creates unique moments of impact. Make it happen here.

This is Barclays New York

New York is home to Barclays’ US headquarters. The Americas hub for our Corporate and Investment Bank: a community of over 4,500 dedicated colleagues who create opportunities and solve challenges for some of the world’s most important companies.

Located in the heart of Manhattan, gives you a convenient location for commuting with access to everything New York can offer.

Our wellness center is equipped with modern amenities, including fitness centres offering a variety of classes and services.

Our health center provides a range of services, including primary and urgent care, wellness exams, health coaching, and vaccinations.

Our office features a variety of sophisticated dining options, including a colleague restaurant and a private executive dining room.

This is Barclays New York

New York is home to Barclays’ US headquarters. The Americas hub for our Corporate and Investment Bank: a community of over 4,500 dedicated colleagues who create opportunities and solve challenges for some of the world’s most important companies.

Excellent location

Located in the heart of Manhattan, gives you a convenient location for commuting with access to everything New York can offer.

Focused on fitness

Our wellness center is equipped with modern amenities, including fitness centres offering a variety of classes and services.

Caring for your health

Our health center provides a range of services, including primary and urgent care, wellness exams, health coaching, and vaccinations.

Great places to eat

Our office features a variety of sophisticated dining options, including a colleague restaurant and a private executive dining room.

Barclays

Working flexibly

We’re committed to providing a supportive and inclusive culture and environment for you to work in. This environment recognises and supports your personal needs, alongside the professional needs of our business. If you'd like to explore flexible working arrangements, please discuss this with the hiring manager. Your request will be reviewed in-line with the requirements of the role/business needs of the team.

Hybrid working

We have a structured approach to hybrid working, where colleagues work at an onsite location on fixed, ‘anchor’, days, as set by the business area. Please discuss the working pattern requirements for the role you are applying for with the hiring manager. Please note that working arrangements may be subject to change on reasonable notice to ensure we meet the needs of our business.

Barclays is built on an international scale.

Our geographic reach, our wide variety of functions, businesses, roles and locations reflect the rich diversity of our worldwide customer base. All of which means we offer incredible variety, depth and breadth of experience. And the chance to learn from a globally diverse mix of colleagues, including some of the very best minds in banking, finance, technology and business. Throughout, we’ll encourage you to embrace mobility, exploring every part of our operations as you build your career.

Find more information

Related content

Related Jobs


Equity Derivatives Sr. Java Developer

New York (United States)

14 Nov
IB Rates US Algo Support

New York (United States)

29 Oct
Senior Rates Algo Support Engineer

New York (United States)

16 Sep
EQ Electronic Reliability Engineer

New York (United States)

18 Sep
Senior Extranet Networking Engineer

Whippany (United States), New York (United States)

17 Oct