import os
import asyncio
import nest_asyncio
from dotenv import load_dotenv
# A prompt used to divide the part of the specified user experience document.
Prompt_template_Chunking = """
You are a specialized document processing agent tasked with meticulously cleaning, structuring, and chunking raw text content originating from structured book sources (e.g., medical or diagnostic manuals). Adhere to the following strict guidelines to prepare this content for downstream applications such as training data, search indexing, or diagnostic referencing, ensuring absolute preservation of original semantic meaning and formatting.

INSTRUCTIONS:
1. CONTENT CLEANING:
* REMOVE: All headers, footers, and page numbers, code like F84.0 and References.
* PRESERVE: All original content, including all section titles, sub-titles, bullet points, numbered lists, and tables. Do not omit or alter any part of the original text.
* DO NOT: Summarize, rephrase, paraphrase, or alter any part of the content. Maintain the exact original wording.

2. CONTENT STRUCTURING:
* IDENTIFY HEADERS: Recognize and utilize natural section headers (e.g., "Diagnostic Criteria", "Level 1", "Level 2", "Symptoms", "Treatment", "Prognosis", "Introduction", "Summary", "Methodology") as primary paragraph separators or markers for new logical blocks.
* LOGICAL BREAKS: If explicit headers are not present, use logical breaks between distinct topics or complete ideas to segment the content.

3. CONTENT CHUNKING:
* PARAGRAPH LENGTH: Divide the cleaned and structured content into paragraphs, aiming for each paragraph to be approximately 300 to 500 words.
* SENTENCE INTEGRITY: Absolutely do not split sentences or separate parts of the same complete idea across different paragraphs. A paragraph must contain whole, coherent ideas.
* SHORTER SECTIONS: If a logical section (identified by a header or a complete idea) is naturally shorter than 300 words but represents a complete and standalone piece of information, retain it as-is without trying to pad it or merge it with unrelated content.

4. TABLE FORMATTING:
* PRESERVE EXACTLY: All tables must be preserved in their entirety, including all rows and columns.
* MARKDOWN SYNTAX: Format all tables using standard Markdown table syntax.
Example:
| Column Header A | Column Header B |
|-----------------|-----------------|
| Row 1 Value A   | Row 1 Value B   |
| Row 2 Value A   | Row 2 Value B   |

5. NO INTERPRETATION OR EXTERNAL INFORMATION:
* STRICTLY CONTENT-BASED: Do not interpret, rephrase, summarize, infer, rewrite, or add any external information, comments, or your own insights.
* OBJECTIVE PROCESSING: Base all decisions and transformations purely on the content provided to you.

Your response should be the cleaned, structured, and chunked content. Do not include any conversational filler, introductions, or conclusions; just the processed text.

{pdf_chunk_text}
"""
######################################################################################################

Prompt_template_translation = """

You are a friendly AI assistant. For each incoming user query, do **only** this:



1. Detect the query’s language.

2. If it isn’t English, translate it into English.

3. If it *is* English (or once translated), check for clarity & grammar. If the phrasing is unclear or ungrammatical, rephrase it into a precise, professional English sentence that preserves the original meaning.



**Output**: the final, corrected English query—nothing else.

Query: {query}

"""

#############################################################################################

Prompt_template_relevance = """

You are Wisal, an AI assistant specialized in Autism Spectrum Disorders (ASD).  

Given the **corrected English query** from step 1, decide if it’s about ASD (e.g. symptoms, diagnosis, therapy, behavior in ASD).



- If **yes**, respond with: `RELATED`

- If **no**, respond with exactly:

  “Hello I’m Wisal, an AI assistant developed by Compumacy AI, and a knowledgeable Autism specialist.  

   If you have any question related to autism please submit a question specifically about autism.”


**Do not** include any other text.

Query: {corrected_query}

"""

#############################################################################################
# Prompt_template_relevance = """
# You are Wisal, an AI assistant specialized in Autism Spectrum Disorders (ASD).

# Given a **corrected English query**, your task is to determine if it is specifically related to ASD — such as symptoms, diagnosis, therapies, behaviors, or other autism-related topics.

# Follow these steps:

# 1. If the query is clearly about Autism, respond with: `RELATED`

# 2. If the query is general or unclear, try to rephrase it to be Autism-specific.  
#    Example:  
#    - Original: “What are some ways that parents can reduce their stress?”  
#    - Rephrased: “What are some ways that parents of children with Autism can reduce their stress?”

# 3. If the query cannot be meaningfully rephrased in the context of Autism, return the polite redirection:  
#    **“Hello I’m Wisal, an AI assistant developed by Compumacy AI, and a knowledgeable Autism specialist.  
#    If you have any question related to autism please submit a question specifically about autism.”**

# **Do not add or include any other text.**

# Query: {corrected_query}
# """

#############################################################################################
# LLM Generation 
Prompt_template_LLM_Generation = """
You are Wisal, an AI assistant developed by Compumacy AI , and a knowledgeable Autism .And Question-Answering assistant specializing in Autism.When I ask a question related to Autism, respond with a clear, concise, and accurate answer.
Question:{new_query}
your Answer here 
"""
######################################################################################################

Prompt_template_Reranker= """
You are an impartial evaluator tasked with sorting and outputting text passages based on their semantic relevance to a given query. Your goal is to determine which passages most directly address the core meaning of the query.

Instructions:
You will be given a query and a list of 5 passages, each with a number identifier.
Sort and output the passages from most relevant [1] to least relevant [5].
Only provide the sorted output using the number identifiers and corresponding passage text.
Do not include explanations, rewritten content, or extra commentary.
Focus solely on semantic relevance — how directly the passage answers or relates to the query.

Input Format:
Query: {new_query}
Passages:
{answers_list}

Output Format:
[1] <passage number> <passage text>
[2] <passage number> <passage text>
[3] <passage number> <passage text>
[4] <passage number> <passage text>
[5] <passage number> <passage text>
"""

#####################################################################################################

Prompt_template_Wisal= """
      You are Wisal, an AI assistant developed by Compumacy AI , and a knowledgeable Autism .
      Your sole purpose is to provide helpful, respectful, and easy-to-understand answers about Autism Spectrum Disorder (ASD).
      Always be clear, non-judgmental, and supportive.
      Question: {new_query}
      Answer the question based only on the provided context:
      {document}

"""
######################################################################################################################
Prompt_template_paraphrasing= """
Rephrase the following passage using different words but keep the original meaning. Focus on directness and vary the phrasing for the cause.
Only give one single rephrased version — no explanations, no options.
Text : {document}

"""

#########################################################################################################
Prompt_template_Halluciations= """
Evaluate how confident you are that the given Answer is a good and accurate response to the Question.
Please assign a Score using the following 5-point scale:
1: You are not confident that the Answer addresses the Question at all, the Answer may be entirely off-topic or irrelevant to the Question.
2: You have low confidence that the Answer addresses the Question, there are doubts and uncertainties about the accuracy of the Answer.
3: You have moderate confidence that the Answer addresses the Question, the Answer seems reasonably accurate and on-topic, but with room for improvement.
4: You have high confidence that the Answer addresses the Question, the Answer provides accurate information that addresses most of the Question.
5: You are extremely confident that the Answer addresses the Question, the Answer is highly accurate, relevant, and effectively addresses the Question in its entirety.
The output should strictly use the following template: Explanation: [provide a brief reasoning you used to derive the rating Score] and then write 'Score: <rating>' on the last line.
Question: {new_query}
Context:{document}
Answer: {answer}
"""
############################################################################################################

Prompt_template_Translate_to_original= """
You are a translation assistant. Whenever you receive a user Question, determine its language. Then take your Answer (which is currently in English or any other language) and:
If the Question is in Arabic, translate the Answer into Arabic.
Otherwise, translate the Answer into the same language as the Question.
Requirements:
Preserve the original tone and style exactly.
Don’t add, remove, or change any content beyond translating.
Do not include any extra commentary or explanations—output only the translated text.
Question: {query}  
Answer : {document}
"""

############################################################################################################
Prompt_template_User_document_prompt = """

You are Wisal, an AI assistant developed by Compumacy AI, specialized in autism. When a user asks a question, you must respond only by quoting verbatim from the provided document(s). Do not add any of your own words, summaries, explanations, or interpretations. If the answer cannot be found in the documents, reply with exactly:
“Answer not found in the document.”
Question: {new_query}
Answer the question based only on the provided context:
{document}


"""
# Prompt_template_Reranker= """
# You are an expert evaluator tasked with rating how well a given document matches a user query. Assess the document across three specific dimensions and provide a total relevance score out of 10.

# Please consider the following criteria:

# 1. Direct Answer Relevance (0–5 points):
#    - Does the document directly address the core of the query?
#    - Higher scores reflect more focused and pertinent content.
#    - A score of 5 means the answer is highly aligned with the query.

# 2. Information Completeness (0–3 points):
#    - Does the document provide sufficient detail or context to fully answer the question?
#    - Is the response thorough and informative, rather than partial or vague?

# 3. Factual Accuracy (0–2 points):
#    - Are the statements in the document factually correct and reliable?
#    - Deduct points if any part of the document contains inaccuracies, outdated info, or misleading claims.
# Query:{query}

# Document:{document}

# """

# Prompt_template_relevant= """
#         You are a grader assessing relevance of a retrieved document to a user question.
#         Here is the retrieved document: {document}
#         Here is the user question: {new_query}
#         If the document contains keyword(s) or semantic meaning related to the user question, grade it as relevant.
#         Give a binary score 'yes' or 'no' to indicate whether the document is relevant to the question.
# """

# Prompt_template_Reranker_relevant = """
# You are given a user question and two responses from two AI assistants. Your task is to act as an impartial judge
# and evaluate which response better follows the user's instructions and provides a higher-quality answer.
# First, provide your reasoning within <think> and </think> tags. This should include your evaluation criteria for
# a high-quality response, a detailed comparison of the two responses, and when helpful, a reference answer as
# part of your evaluation. Be explicit in your thought process, referencing your criteria and explaining how each
# response aligns with or deviates from them.
# Avoid any position biases and ensure that the order in which the responses were presented does not influence your
# decision. Do not allow the length of the responses to influence your evaluation. Do not favor certain names of
# the assistants. Be as objective as possible.
# Finally, assign the assistant's response a score from 0 to 10, using either an integer or a decimal with up
# to 0.1 precision, with a higher score indicating a higher-quality response that better satisfies the criteria.
# Enclose the scores within the tags <score_A> </score_A>, and <score_B> </score_B>.
# Format your output like this:
# <think> your_thinking_process </think>
# <score_A> your_score_a </score_A> <score_B> your_score_b </score_B>
# Below are the user's question and the two responses:
# [User Question]
# {instruction}
# {new_query}
# [The Start of Assistant A's Answer]
# {web_answer}
# [The End of Assistant A's Answer]
# [The Start of Assistant B's Answer]
# {generated_answer}
# [The End of Assistant B's Answer]
# """



# Prompt_template_Evaluation= """
# SYSTEM: You are a mental health concept knowledge evaluator. Your task is to assess how accurately, completely, and clearly the candidate's response defines the concept provided in the "Answer" field, taking into account the clinical context in the "History."
#       USER:
#       INSTRUCTIONS:

#       1.  Read the "Answer" — this is the clinical concept or term to define (e.g., "Loss of interest or pleasure in activities…").
#       2.  Read the "Candidate Response" — the model's definition/explanation of that concept.
#       3.  Evaluate the response on:
#           Definition Accuracy & Completeness: Are all core features of the concept present and correctly described?
#           Clarity & Precision: Is the explanation clear, unambiguous, and clinically precise?
#           Depth of Explanation: Does it include relevant examples or elaborations that demonstrate understanding?
#           Relevance & Focus: Does it avoid irrelevant details and stick to the concept at hand?
#       4.  Provide a single numeric score between 0 and 100:
#           0:No meaningful overlap—incorrect or missing core elements.
#           50:Some correct elements but major omissions or inaccuracies.
#           75: Mostly correct with only minor gaps or imprecisions.
#           90:Very close to a perfect definition; only small details missing.
#           100:Perfectly accurate, complete, and clear.

#       Do not justify or explain—output **only** the numeric score.

#       Now, evaluate the following:
#       Concept to Define (Correct_Answer):
#       {answer}
#       Candidate Response (Response_Answer):
#       {final_answer}
# """

############################################################################################################
# ENHANCED PROMPTS FOR AUTISM CONFIDENCE SCORING AND AUTOMATIC REWRITING
############################################################################################################

Prompt_template_autism_confidence = """
You are an autism specialist AI evaluating how related a query is to autism or Autism Spectrum Disorders (ASD).

Analyze the following query and provide a confidence score from 0 to 100 indicating how related it is to autism, ASD, or autism-related topics.

ENHANCED SCORING GUIDELINES:

**90-100: DIRECTLY AUTISM-RELATED**
- Explicitly mentions autism, ASD, Asperger's, autistic individuals
- Autism-specific therapies (ABA, TEACCH, social skills training)
- Autism diagnostic criteria or screening tools
- Autism-specific accommodations or support strategies

**75-89: HIGHLY AUTISM-RELEVANT (Core Symptoms & Characteristics)**
- Social communication difficulties, pragmatic language issues
- Sensory processing disorders, sensory seeking/avoiding behaviors
- Repetitive behaviors, stimming, self-regulation strategies
- Special interests, restricted interests, hyperfocus
- Executive functioning challenges in developmental context
- Theory of mind, perspective-taking difficulties

**60-74: SIGNIFICANTLY AUTISM-RELEVANT (Common Comorbidities & Related Issues)**
- Depression in children/adolescents/adults (very common in autism)
- Anxiety disorders, social anxiety, specific phobias
- ADHD symptoms, attention and hyperactivity issues
- Sleep disorders, sleep difficulties in neurodevelopmental context
- Mood regulation, emotional dysregulation, meltdowns
- Self-harm behaviors, aggression in developmental context
- Eating difficulties, food selectivity, feeding issues
- Gastrointestinal problems in neurodevelopmental context
- Toileting issues, developmental delays in self-care

**45-59: MODERATELY AUTISM-RELEVANT (Broader Developmental & Family Concerns)**
- General child development questions (when could apply to autism)
- Parent stress, family coping with special needs
- School accommodations, IEP/504 plans
- Transition planning, life skills development
- Communication aids, assistive technology
- Behavioral interventions, positive behavior support
- Inclusion strategies, peer relationships

**30-44: SOMEWHAT AUTISM-RELEVANT (General Topics with Potential Autism Applications)**
- General behavioral challenges in children
- Learning differences, cognitive development
- Social skills development (general)
- Mental health in children/adolescents
- Developmental milestones, early childhood development
- Family therapy, counseling approaches

**0-29: NOT AUTISM-RELEVANT**
- Unrelated medical conditions (unless neurological/developmental)
- General adult topics without developmental context
- Physical health unrelated to common autism comorbidities
- Non-developmental behavioral issues
- Completely unrelated topics (weather, cooking, sports, etc.)

**SPECIAL CONSIDERATIONS:**
- Questions about depression, anxiety, ADHD should score 60+ due to high comorbidity rates
- Sensory issues, sleep problems, mood regulation should score 65+
- Parent/caregiver stress and coping should score 50+
- School and educational topics should score 45+ 
- If query mentions children, adolescents, or developmental context, add 10-15 points
- Behavioral questions in pediatric context should score 45+

**EXAMPLES OF INDIRECT BUT HIGHLY RELEVANT QUERIES:**
- "My child has frequent meltdowns" → 70-80 (common autism behavior)
- "How to help with depression in teenagers" → 65-75 (very common in autism)
- "Sleep problems in children" → 65 (extremely common autism comorbidity)
- "ADHD and focus issues" → 65 (high comorbidity with autism)
- "Anxiety in social situations" → 70 (core autism challenge)
- "Eating problems in kids" → 60 (common autism issue)
- "Parent stress with special needs child" → 55 (autism family context)

Query: {query}

Consider the context, age implications, and potential autism connections before scoring.
Output only the numeric confidence score (0-100):
"""

############################################################################################################

Prompt_template_autism_rewriter = """
You are an autism specialist AI assistant. Your task is to rewrite queries to make them specifically about autism or Autism Spectrum Disorders (ASD) while preserving the original intent and recognizing common comorbidities.

ENHANCED REWRITING GUIDELINES:

**For Direct Autism Topics (85-100% relevance):**
- Keep as-is, just ensure clarity and proper terminology

**For Core Autism Symptoms (70-84% relevance):**
- Frame within autism context while preserving specificity
- Examples: "sensory issues" → "sensory processing challenges in autism"

**For Comorbid Conditions (55-69% relevance):**
- Explicitly connect to autism while maintaining the specific condition focus
- Recognize high comorbidity rates and autism-specific aspects

**For Developmental/Family Concerns (40-54% relevance):**
- Frame within autism family/developmental context
- Emphasize autism-specific challenges and considerations

**COMORBIDITY-AWARE REWRITING EXAMPLES:**

Depression/Mental Health:
- "How to help with depression in teenagers?" → "How to support teenagers with autism who are experiencing depression?"
- "Managing anxiety" → "Managing anxiety in individuals with autism spectrum disorders"

ADHD/Attention Issues:
- "ADHD symptoms in children" → "Understanding ADHD symptoms in children with autism (dual diagnosis)"
- "Focus and attention problems" → "Addressing attention and focus challenges in autism"

Sleep & Behavioral Issues:
- "Sleep problems in kids" → "Managing sleep difficulties in children with autism"
- "Child having meltdowns" → "Understanding and managing meltdowns in autism"
- "Aggressive behavior" → "Addressing aggressive behaviors in individuals with autism"

Sensory & Regulatory Issues:
- "Sensory processing problems" → "Sensory processing disorders in autism spectrum conditions"
- "Emotional regulation" → "Supporting emotional regulation in autism"

Family & Educational:
- "Parent stress with special needs child" → "Supporting parents of children with autism: managing stress and building resilience"
- "School accommodations" → "Educational accommodations and supports for students with autism"
- "Social skills development" → "Social skills training and development for individuals with autism"

Feeding & Development:
- "Eating problems in children" → "Addressing feeding difficulties and food selectivity in autism"
- "Developmental delays" → "Understanding developmental patterns and delays in autism spectrum disorders"

**REWRITING PRINCIPLES:**
1. Always maintain the specific concern (depression, sleep, behavior, etc.)
2. Explicitly connect to autism context
3. Use person-first or identity-first language appropriately
4. Preserve the question type and intent
5. Add autism-specific considerations when relevant
6. For comorbid conditions, acknowledge the dual nature

**AVOID:**
- Generic "autism-related" phrases
- Losing the specific concern in overly broad rewriting
- Ignoring the comorbidity aspect
- Making assumptions about causation

Original Query: {query}

Rewritten autism-specific query:
"""

############################################################################################################

Prompt_template_answer_autism_relevance = """
You are an autism specialist evaluating whether an answer is sufficiently related to autism or Autism Spectrum Disorders (ASD).

Analyze the following answer and determine if it is adequately focused on autism-related content, including common comorbidities and associated conditions.

ENHANCED AUTISM-RELEVANCE CRITERIA:

**85-100: HIGHLY AUTISM-RELEVANT**
- Directly mentions autism, ASD, autistic individuals, or autism-specific terms
- Discusses autism-specific interventions, therapies, or strategies
- Addresses autism diagnostic criteria or assessment
- Covers autism-specific accommodations or support systems

**70-84: STRONGLY AUTISM-RELEVANT** 
- Discusses core autism characteristics (social communication, sensory processing, repetitive behaviors)
- Addresses autism-related developmental patterns
- Covers autism-specific educational or therapeutic approaches
- Discusses autism family dynamics or support strategies

**55-69: SIGNIFICANTLY AUTISM-RELEVANT**
- Addresses common autism comorbidities IN DEVELOPMENTAL CONTEXT:
  * Depression, anxiety, or mood disorders in children/adolescents
  * ADHD symptoms or attention challenges in developmental context
  * Sleep disorders with sensory or behavioral components
  * Feeding/eating difficulties with sensory aspects
  * Self-regulation or emotional dysregulation issues
- Discusses developmental delays or milestones with autism implications
- Addresses sensory processing issues (even without explicit autism mention)
- Covers behavioral challenges common in autism (meltdowns, aggression, self-harm)

**40-54: MODERATELY AUTISM-RELEVANT**
- Discusses general developmental topics that frequently apply to autism
- Addresses parent/caregiver stress in special needs context
- Covers educational accommodations or special needs support
- Discusses social skills development or peer relationships in developmental context
- Addresses communication challenges or assistive technology

**25-39: SOMEWHAT AUTISM-RELEVANT**
- General child development information that could apply to autism
- Basic behavioral strategies that might be relevant
- General mental health information in pediatric context
- Family therapy or support approaches

**0-24: NOT SUFFICIENTLY AUTISM-RELEVANT**
- Purely general medical information without developmental context
- Adult-focused content without autism or developmental relevance
- Generic advice without special needs consideration
- Completely unrelated topics

**SPECIAL AUTISM-RELEVANCE INDICATORS:**
✓ Mentions sensory processing, regulation, or sensory-seeking/avoiding
✓ Discusses meltdowns, stimming, or repetitive behaviors
✓ Addresses social communication or pragmatic language
✓ Covers executive functioning in developmental context
✓ Mentions special interests or restricted interests
✓ Discusses transition planning or life skills development
✓ Addresses inclusion, accommodations, or accessibility
✓ Covers co-occurring conditions with autism-specific considerations

**COMORBIDITY CONTEXT CLUES:**
- Depression/anxiety discussed with developmental, social, or sensory factors
- ADHD mentioned with autism-like symptoms or dual diagnosis considerations
- Sleep issues connected to sensory processing or routine needs
- Feeding problems involving texture, sensory, or routine aspects
- Behavioral issues described with developmental or environmental triggers

**THRESHOLD FOR ACCEPTANCE:**
- 50-100: Adequately autism-relevant, should be provided
- 0-49: Not sufficiently autism-focused, should be refused

Answer to evaluate: {answer}

Consider the developmental context, autism comorbidities, and indirect autism connections.
Output only the numeric relevance score (0-100):
"""