About this role:

Wells Fargo is seeking a Senior Software Engineer – LLM Inferencing & AI Gateway to join our Digital Technology – AI Capability Engineering team. In this role, you will design, build, and operate the GPU‑based GenAI platform and the serving infrastructure for LLM/SLM workloads. Your work will span the full stack—from GPU cluster configuration and Run:AI/OpenShift AI orchestration to optimizing vLLM/Triton runtimes and hardening these systems for production use.

Key focus areas include H100/H200 GPU clusters, NVLink/NVSwitch, MIG, CUDA/NVML, GPU scheduling, and disaggregated inferencing patterns (prefill/decode). You will also drive observability best practices and deliver reliable, scalable model endpoints through an API Gateway–based production architecture.

In this role, you will:

Lead complex Generative AI initiatives and deliverables within technical domain environments

Contribute to large scale planning of strategies

Design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments

Review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures

Resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements

Collaborate and consult with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals

Lead projects and act as an escalation point, provide guidance and direction to less experienced staff

Engineer GPUs clusters and node pools; configure NVLink/NVSwitch, NVIDIA GPU Operator, MIG profiles, container runtime, and kernel/driver baselines for high‑throughput LLM/SLM workloads.

Required Qualifications:

4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

Desired Qualifications:

1+ years of experience with GPU Inference including NVIDIA CUDA, cuDNN, NVLink/NVSwitch, MIG, NIXL, GPU profiling, and performance tuning on H100/H200 architectures

1+ years of experience with GPU orchestration platforms, such as RunAI (collections, queues, quotas, preemption, fair-share scheduling), OpenShift AI (RHOAI), and cluster administration on OCP or GKE

1+ years of experience with LLM/SLM serving frameworks, including vLLM, Triton, TensorRT‑LLM/MII, KV‑cache optimization strategies, and FP8/INT4 quantization techniques (AWQ/GPTQ)

1+ years of experience working with LLM API gateways, including OAuth2/mTLS authentication, rate‑limiting and quota management, OpenAPI/SDK integration, SLAs, and versioning/deprecation practices

2+ years of experience in Generative AI engineering, including LLM/SLM operations, fine‑tuning, evaluation pipelines, and developing model‑specific performance optimization recipes

4+ years of experience in Python, including scripting, automation, and model/inference‑related development

Job Expectations:

Hybrid onsite at required locations

No visa sponsorship available

No relocation assistance for this position

Pay Range
 

Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to demonstrated examples of prior performance, skills, experience, or work location. Employees may also be eligible for incentive opportunities.

$100,000.00 - $196,000.00

Benefits

Wells Fargo provides eligible employees with a comprehensive set of benefits, many of which are listed below. Visit Benefits - Wells Fargo Jobs for an overview of the following benefit plans and programs offered to employees.

Health benefits401(k) PlanPaid time offDisability benefitsLife insurance, critical illness insurance, and accident insuranceParental leaveCritical caregiving leaveDiscounts and savingsCommuter benefitsTuition reimbursementScholarships for dependent childrenAdoption reimbursement

Posting End Date:

26 Jan 2026

*Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit’s risk appetite and all risk and compliance program requirements.

Applicants with Disabilities

To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo.

Drug and Alcohol Policy

 

Wells Fargo maintains a drug free workplace.  Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment and Hiring Requirements:

a. Third-Party recordings are prohibited unless authorized by Wells Fargo.

b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.