# ============================================================ # Aladdin Scientific - robots.txt # https://www.aladdinsci.com/ # ============================================================ User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no # ============================================================ # 1. Magento private / customer / transactional pages # ============================================================ Disallow: /checkout/ Disallow: /customer/ Disallow: /sales/ Disallow: /wishlist/ Disallow: /newsletter/ Disallow: /sendfriend/ Disallow: /downloadable/customer/ # Product comparison / review controller pages Disallow: /catalog/product_compare/ Disallow: /review/ # Magento store switch controller Disallow: /stores/store/redirect/ # ============================================================ # 2. Internal search pages # ============================================================ Disallow: /catalogsearch/ Disallow: /search/ Disallow: /advancedsearch/ # ============================================================ # 3. Magento internal controller URLs # # Friendly rewritten product/category URLs remain crawlable. # ============================================================ Disallow: /catalog/product/view/ Disallow: /catalog/category/view/ # ============================================================ # 4. Magento internal/system directories # ============================================================ Disallow: /app/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /var/ Disallow: /index.php/ # Direct PHP URLs Disallow: /*.php$ # ============================================================ # 5. Magento session parameters # ============================================================ Disallow: /*?SID= Disallow: /*&SID= Disallow: /*?___SID= Disallow: /*&___SID= # ============================================================ # 6. Store / language switching parameters # # Aladdin has multiple US/EU store views. # Search engines should use canonical store URLs instead # of store-switch query parameters. # ============================================================ Disallow: /*?___store= Disallow: /*&___store= Disallow: /*?___from_store= Disallow: /*&___from_store= # ============================================================ # 7. Sorting / display parameters # # IMPORTANT: # Pagination ?p= is intentionally NOT blocked. # ============================================================ # Custom / legacy parameters Disallow: /*?dir= Disallow: /*&dir= Disallow: /*?order= Disallow: /*&order= Disallow: /*?mode= Disallow: /*&mode= Disallow: /*?limit= Disallow: /*&limit= # Magento 2 standard product list parameters Disallow: /*?product_list_order= Disallow: /*&product_list_order= Disallow: /*?product_list_dir= Disallow: /*&product_list_dir= Disallow: /*?product_list_mode= Disallow: /*&product_list_mode= Disallow: /*?product_list_limit= Disallow: /*&product_list_limit= # ============================================================ # 8. Layered navigation / filter parameters # ============================================================ # Price filters Disallow: /*?price= Disallow: /*&price= # Aladdin custom query filters Disallow: /*?x_filter_ Disallow: /*&x_filter_ Disallow: /*/x_filter_ Disallow: /stores/store/switch/ Disallow: /data/index Disallow: /data/details Disallow: /target/targetlist # ============================================================ # 9. Currency switching parameters # ============================================================ Disallow: /*?currency= Disallow: /*¤cy= # ============================================================ # 10. Common advertising / tracking parameters # ============================================================ Disallow: /*?utm_source= Disallow: /*&utm_source= Disallow: /*?utm_medium= Disallow: /*&utm_medium= Disallow: /*?utm_campaign= Disallow: /*&utm_campaign= Disallow: /*?utm_term= Disallow: /*&utm_term= Disallow: /*?utm_content= Disallow: /*&utm_content= Disallow: /*?gclid= Disallow: /*&gclid= Disallow: /*?fbclid= Disallow: /*&fbclid= # ============================================================ # 12. Public static assets # # Search engines must be able to render CSS/images/assets. # ============================================================ Allow: /pub/media/ Allow: /media/ Allow: /static/ # ============================================================ # 14. Magento Product / Category Sitemap Indexes # ============================================================ Sitemap:https://www.aladdinsci.com/sitemap.xml