common/prompt_v1.txt

Task: Accurately extract structured information from receipt images and return it in a standardized JSON format. Ensure high accuracy even when receipts vary in format, language (including non-Latin scripts), and layout. Handle challenges like text noise, multiple lines for item names, and potential gaps in information.

Receipts: May be in various languages (Latin and non-Latin scripts), in diverse formats, and may contain noise like logos, faded text, or watermarks.

Output Format: Return the output as a JSON object with the following structure:

{
    "store_name": string,  -- Exact name of the store as found on the receipt. It`s not always the bigger text. Find the correct name of the shop/restaurant
    "country": string,  -- Define country if available; otherwise, "unknown". Identify country by details on the receipt. Use receipt address or language if explicit country info is lacking.
    "receipt_type": string,  -- Define receipt type (e.g. Restaurant/Shop/Other) if available; otherwise, "unknown"
    "address": string,  -- Full address, if available; otherwise, "unknown"
    "datetime": "YYYY.MM.DD HH:MM:SS",  -- Convert all date formats to this standard
    "currency": string,  -- Currency code (e.g., "EUR", "USD", "UAH") based on the detected currency symbol. Don`t put here currency symbol, only code.
    "sub_total_amount": 0.00,  -- This represents the total cost of all items and services on the receipt before any tips, or additional charges are applied. If sub_total_amount is not present on the receipt, set "unknown"
    "total_price": 0.00,  -- The final total amount from the receipt (in the majority of situations this one is bigger then other values + it could be as bold font). The total amount may not always be the largest number; ensure the context is understood from surrounding text.
    "total_discount": 0.00,  -- Total discount applied based on individual item discounts or explicit discount information
    "all_items_price_with_tax": True/False -- Indicates whether taxes are included in the prices of items. Set to True if taxes are included, False if they are not included. If it cannot be determined, set to "unknown".
    "payment_method": "card", "cash", or "unknown",  -- Detect payment method based on keywords like "card", "cash", "master card", "visa", e.t. or if missing, use "unknown"
    "rounding": 0.00,  -- If rounding is not specified on the receipt, use 0.0
    "tax": 0.00,  -- If tax is not found or mentioned, use 0.0
    "taxes_not_included_sum": 0.0 -- Represents the total amount of taxes that are not included in the final total on the receipt. This is applicable in situations where taxes are itemized separately, such as in the United States. If there are no separate taxes, set to 0.0.
    "tips": 0.00,  -- If tips is not found or mentioned, use 0.0
    "items": [
        {
            "name": string,  -- Full item name (even if it spans multiple lines)
            "quantity": 0.000,  -- Quantity of the item, default 1.0 if it wasn`t written
            "measurement_unit": string,  -- Use the format "ks", "kg", etc. If not specified, default to "ks"
            "total_price_without_discount": 0.00, -- price without any discount for a single item. Always extract this value directly from the receipt
            "unit_price": 0.00,  -- Price per unit without any discount, if available. If not, write here the same value as for total_price_without_discount. Can be negative
            "total_price_with_discount": 0.00 - -- This is the full price for a single item after considering all applicable discounts.
            "discount": 0.00,  -- If discount isn't listed, assume 0.00
            "category": string  -- Category choose fromlist:Food,Beverages,Personal Care, Beauty & Health,Household Items,Electronics & Appliances,Clothing & Accessories,Home & Furniture,Entertainment & Media,Sports & Outdoors,Car,Baby Products,Stationery,Pet Supplies,Health & Fitness Services,Travel & Transportation,Insurance & Financial Services,Utilities,Gifts & Specialty Items,Services,Other options
            "item_price_with_tax": string  -- "True"/"False". Indicating whether the item prices include tax.
        }
    ]
    "taxs_items": [
        {
            "tax_name": string -- The name of the tax or tax rate.
            "percentage": 0.00 --The tax percentage.
            "tax_from_amount": 0.00 -- The amount before tax.
            "tax": 0.00 -- The tax amount itself.
            "total": 0.00 -- The total amount including tax.
            "tax_included": string  -- "True"/"False" indicating whether taxes are included in the item prices. Set to True if there is no separate line for tax on the receipt, or if it explicitly states that taxes are included. Otherwise, set to False
        }
    ]
}

#Additional Notes:
1. If no receipt is detected: Return "Receipt not found."
2. Handle various languages (including non-Latin scripts) and keep text in the original script unless translation is explicitly required.
3. If information is missing or unclear, return "unknown" or "not available" for that field.
4. Extract the full name of each item. Some items may have names split across multiple lines; in this case, concatenate the lines until you encounter a quantity or unit of measurement (e.g., "2ks"), which marks the end of the item name.
5. Some receipts could be, for example, from McDonald`s restaurant, where in receipts under menu name could be written components of this menu. In this case you should extract only menu name.
6. The total amount may not always be the largest number; ensure the context is understood from surrounding text.
7. Tips and Charity Donations: Extract and sum tips and charity donations, storing the total under the tips field.
8. Convert datetime to the "YYYY.MM.DD HH:MM:SS" format, regardless of how they appear on the receipt (e.g., MM/DD/YY, DD-MM-YYYY).
9. Handle ambiguous data consistently. If there's ambiguity about price, quantity, or any other information, make the best effort to extract it, or return "unknown."
10. Be flexible in handling varied receipt layouts, item name formats, and currencies.
11. The unit_price/price/total_price/total_price_without_discount for an item can be negative
12. After the total amount may be information about taxes, in separate tax items. Define them in taxs_items