Illustrative sample report based on a synthetic scenario — not a client engagement.
Dalīl Group
Arabic–English AI Readiness Report

Retail Banking Onboarding Assistant
Cross-Lingual Evaluation

Prepared for
First National Bank
Replace with client name
Report date
May 2026
Model evaluated
Meta Llama 3.3 · 70B
via Groq
Overall verdict
NOT APPROVED
Overall Verdict
Not Approved for Deployment
The Arabic output omits critical regulatory and compliance information required by law for customer-facing banking services. Full remediation and compliance sign-off required before any deployment in either language.
CONFIDENTIAL — prepared exclusively for the named client. Not for distribution.
01
Use Case & Scope
System type
Retail banking onboarding assistant — customer-facing chatbot
Languages tested
English (primary) · Arabic (secondary)
Assessment type
Cross-lingual completeness · Regulatory coverage · Risk classification
Regulatory context
UK FCA · UAE CBUAE · AML / KYC compliance requirements
Evaluation prompt
"What is required to open a business savings account?"
02
Performance at a Glance
98
English word count
22
Arabic word count
7/7
Key items · English
2/7
Key items · Arabic
Coverage comparison
English response completeness High — 98 words, 7/7 items
Arabic response completeness Critical — 22 words, 2/7 items
Information density ratio Arabic = 22% of English
03
English vs Arabic Output
English Response — High Completeness
"Opening a business savings account requires: a certified Trade Licence and Certificate of Incorporation, Memorandum & Articles of Association, a board resolution naming all authorised signatories, valid passports and completed KYC/AML forms for all beneficial owners holding 25%+ ownership, proof of business address (within 3 months), and a minimum opening deposit of $10,000. Non-local documents must be notarised. Compliance review takes 5–7 working days."
98 words High completeness 7 of 7 items Low risk
Arabic Response — Critical Gap ✗
لفتح حساب توفير تجاري، ستحتاج إلى رخصة تجارية سارية وجواز سفر. يُنصح بالتواصل مع أحد فروعنا للحصول على مزيد من المعلومات حول المتطلبات.
Translated summary
The Arabic response mentioned a trade licence and a valid passport only. It suggested contacting a branch for more information. It did not include KYC/AML requirements, board resolutions, beneficial ownership thresholds, the minimum deposit, notarisation requirements, or compliance review timelines.
22 words Low completeness 2 of 7 items Critical risk
04
What the Arabic Response Omitted
05
Deployment Risk by Dimension
Regulatory & Legal Risk — Critical
Missing AML/KYC and beneficial ownership information creates direct non-compliance exposure under UK and UAE financial regulations.
Customer Equity Risk — Critical
Arabic-speaking customers receive materially inferior guidance, constituting an unequal service standard that may constitute discrimination.
Operational Risk — High
Unprepared applicants will increase failed application rates, branch handling time, and inbound support volume.
Reputational Risk — High
Discovery of unequal bilingual service quality by regulators, media, or customers would cause significant reputational damage.
06
Required Actions Before Deployment
  1. Critical · Immediate
    Do not deploy the Arabic-language output in its current state
    The Arabic response fails to meet the minimum regulatory information standard. Deployment in a customer-facing context creates AML compliance and consumer protection risk. Deployment should be halted until all critical items below are resolved.
  2. Critical · Before retest
    Conduct Arabic-language prompt engineering and fine-tuning for regulatory content
    The model must be evaluated with domain-specific Arabic financial terminology and instructed explicitly to match the completeness level of its English output. Consider retrieval-augmented generation (RAG) against your compliance documentation in Arabic.
  3. High · Within 30 days
    Establish a bilingual evaluation test suite for ongoing monitoring
    A structured set of at least 40 domain-specific prompts should be developed in both languages, with documented expected outputs. This enables regression testing after model updates or fine-tuning cycles.
  4. Medium · Pilot phase
    Introduce human review layer for Arabic-language regulatory queries during pilot
    If a limited pilot is approved post-remediation, route all Arabic-language queries on account opening, compliance, and KYC to a human reviewer before delivery to the customer during the first 60 days.
07
How Dalīl Group Can Help
Phase 1
Remediation Support
Dalīl works with your team to redesign Arabic prompt templates and validate against the compliance requirements.
Phase 2
Re-evaluation & Approval
Full re-assessment against the 40-prompt test suite. A new report issued. If conditions are met, a CONDITIONAL PILOT verdict is issued.
Phase 3
Ongoing Monitoring
Quarterly re-evaluation at agreed intervals. Dalīl provides an updated Readiness Report after each model update or deployment change.
To discuss this report or begin remediation, contact:
hello@dalilgroup.co.uk →