Customer-facing chatbots in Pakistani banks
پاکستانی بینکوں میں گاہک سے بات کرنے والے چیٹ بوٹ
35 min read
Three ways to see it
Customer-facing LLM chatbots in banking introduce four risk vectors that older rule-based bots did not. Hallucination: the model can fabricate a policy that does not exist. Prompt injection: a customer can manipulate the bot into bypassing guardrails. Channel mismatch: a casually written WhatsApp answer can be quoted as a formal commitment. Compliance leakage: the bot can disclose information the human agent would not. Each requires a specific control.
Way one to control: ground every response in your retrieved policy. A retrieval-augmented generation setup, where the model can only respond using passages fetched from your approved policy library, dramatically reduces hallucination. Bank Alfalah and HBL have moved in this direction; smaller banks lag. The investment is a vector database and an indexing pipeline, not a new headcount.
Way two: human-in-the-loop for anything financial. Any chatbot response that recommends an action with money, that quotes a rate, fee, or limit, or that confirms a commitment should be routed to a human within 60 seconds before going to the customer. Customers tolerate a 60-second delay much better than they tolerate being misinformed about their own money. This is the simplest, cheapest control with the biggest impact.
Quick check
Quick check: what makes modern AI different from a rule-based program?
The why-tree
Why-tree level one: why are LLM chatbots different from older bots? Because they generate language rather than retrieve canned answers. Generation is powerful and intrinsically uncertain.
Try this with Claude
AI-edge prompt to try: 'Acting as a Pakistani banking customer experience auditor, write 10 adversarial prompts in Roman Urdu and Urdu that I should use to stress test a bank chatbot, covering prompt injection, hallucination, and rude customer scenarios.' Use as a red-team starter pack.
Sources
Sources and further reading. OWASP, Top 10 for LLM Applications. NIST Generative AI Profile (NIST AI 600-1). Microsoft Responsible AI Standard. Anthropic Acceptable Use and safety guidance. State Bank of Pakistan Digital Banking Regulations. CGAP, Responsible AI in customer-facing finance. Bank Alfalah, HBL Konnect public product announcements 2024 to 2026.