Logo
Tata Consultancy Services

GEN AI Engineer

Tata Consultancy Services, Charlotte, North Carolina, United States, 28245

Save Job

Must Have Technical/Functional Skills o Bachelors or Masters degree in Data Science, Computer Science, MIS ,related field, or equivalanet experience o 10+ yrs of experience designing and developing AI solution architecture to scale o Proven Hands-on experience in GenAI Ops-Operationalizing LLM and RAG applications in production o Strong hands-on experience with the Langchain framework o Experience specifically with the Open AI API, chat completions, embeddings,etc o Have a solid awareness on TensorRT and VLLM implementation. o Strong proficiency in python and data Science libraries(NumPy,Pandas,scikit-learn,PyTorch/TensorFlow) o Proven experience applying guardrails and observability to LLM or RAG-powered applications. o Experience with LLMs as Judges and SMLs for evaluation (attribution,adherence, bias, PII, etc) o Hands-on experience with OpenShift(or Kubernetes) for containerized AL workloads. o Experience measuring and optimizing inference latency. Roles & Responsibilities o Implement Guardrails and observability across RAG and LLM applications o Setup GenAI Ops workflows to continuously monitor inference latency, throughput, quality and safety metrics. o Define,track,and analyze RAG guardrail metrics using LLMs as Judges and SMLs(e.g. attribution, grounding,prompt injection,tone,PII leekage) o Implement annotation,structured feedback loops,fine-tuning, and alignment methods to calibrate judge models o Use langchain to orchestrate guardrail checks, manage prompt versioning and integrate judge model scoring workflows. o Work with Openshift to deploy,scale and monitor containerized genAI services. o Build observability dashboards and alerts(Grafana or equivalent) for AI reliability. o Contribute to emerging evaluation and guardrails as autonomous AI workflows expand.

Salary : 100,000-125,000/ Per Annum

TCS Employee Benefits Summary:

Discretionary Annual Incentive. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans. Family Support: Maternal & Parental Leaves. Insurance Options: Auto & Home Insurance, Identity Theft Protection. Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement. Time Off: Vacation, Time Off, Sick Leave & Holidays. Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.