## Access Policies
### User-Agent
user-agent: *
### License
x-content-license: "(c) R06-Corp. All rights reserved."
x-ai-training-policy: "allowed-with-attribution"
x-commercial-use: "contact-required"
### Rate Limits
crawl-delay: 1
x-rate-limit: 60
x-rate-limit-window: 60
x-rate-limit-policy: "strict"
x-rate-limit-retry: "delayed-retry"
x-rate-limit-retry-description: "Wait 60 seconds before retry"
x-rate-limit-description: "Maximum 60 requests per 60 seconds. If this limit is exceeded, wait 60 seconds before retrying."
### Concurrency Limits
x-concurrency-limit: 3
x-concurrency-limit-description: "Please limit concurrent requests to a maximum of 3 to help manage server load."
### Error Handling and Retry Policy
x-error-retry-policy: "exponential-backoff"
x-error-retry-policy-description: "For transient errors (5xx except 429), implement exponential backoff starting with an initial wait of 2 seconds, doubling on each retry, with a maximum of 5 retries."
x-rate-limit-exceeded-policy: "wait-and-retry"
x-rate-limit-exceeded-policy-description: "When receiving HTTP 429 (Too Many Requests), do not retry immediately. Wait at least 60 seconds before attempting the request again."
x-max-retries: 5
x-retry-status-codes:
- 500
- 502
- 503
- 504
x-no-immediate-retry-status-codes:
- 429
x-no-retry-status-codes:
- 403
- 404
### Canonical URL
x-canonical-url-policy: "strict"
x-canonical-url: "https://route06.com/"
x-canonical-url-description: "Access via other FQDNs or IP addresses is invalid. Please use only 'https://route06.com/' as the base URL."
### Page Patterns
x-article-pattern: /{section}/{slug}/
x-article-type: "mixed-content"
x-article-description: "Our website contains product information, technical documentation, insights articles, company information, and news with varying structures and formats."
x-article-example: https://route06.com/insights/1
x-article-metadata:
- title
- description
- updated_at
- author
- category
x-article-update-frequency: "bi-weekly"
x-article-new-articles-per-week: "1-2"
### Sitemap and RSS
x-sitemap: https://route06.com/sitemap.xml
x-sitemap-format: xml
x-sitemap-structure: "hierarchical"
x-sitemap-description: "Content is organized in a hierarchical structure. The sitemap.xml provides links to all public pages."
x-feed: https://route06.com/insights/feed
x-feed-format: rss
x-feed-item-count: 15
x-feed-description: "The RSS feed contains the most recent insights articles and news. It is updated whenever new content is published."
### Languages
x-supported-languages:
- en
- ja
### Crawler Hints
x-crawler-hints:
- "Before accessing each URL, check if the URL ends with '/'."
- "If the URL does not end with '/', add '/' to the end of the URL before accessing it."
- "Extract the HTML content of each page."
- "JavaScript rendering is not necessary for most pages. Please use static HTML content when available."
- "Insights articles are in MDX format and may contain code snippets and examples that should be preserved."
- "For numbered insights (e.g., /insights/1, /insights/2), these are individual detailed articles."
- "The site uses Next.js and may include dynamic routes indicated by [slug] patterns."
<!-- Updated: 2025-06-26T08:07:06.873Z -->
