Rights
ScrapeText & data miningAI trainingAI useDeriveRedistributeTransformTag
Overall confidence85%
What this license lets you do
What you can do
- Scrape or crawl these pages.
What you can’t do without permission
- Run text and data mining over the content.
- Use the content to train AI models.
- Use the content with AI at run time (summarizing, search, RAG).
- Create derivative works from the content.
- Redistribute the content.
- Transform or reformat the content.
Ask first
- Tag or annotate the content.
No signal spoke to these. Ask, don’t assume.
Read for US, commercial use. This usage license reflects machine-readable and expressed restrictions detected on the source at check time. It is not legal advice; actual rights depend on your jurisdiction and intended use.
Evidence by signal
- Source
- https://smh.com.au/robots.txt
- Parser
- robots-parser@1.0.0
- Checked
- 6/24/2026, 4:50:32 AM
Allow: /
@ robots.txt (* group)matched: generic crawler allowed for /GPTBot, ChatGPT-User, OAI-SearchBot, CCBot, Google-Extended, anthropic-ai, ClaudeBot, Claude-Web, PerplexityBot, Applebot-Extended, Bytespider, Meta-ExternalAgent, FacebookBot, Amazonbot, cohere-ai, Diffbot, ImagesiftBot, Omgilibot, Timpibot, YouBot
@ robots.txt (AI agents)matched: 20 AI agent(s) disallowed for /
- Source
- https://login.nine.com.au/terms?client_id=smh
- Parser
- tos-parser@1.0.0
- Checked
- 6/24/2026, 4:50:33 AM
All rights reserved
@ ToS / copyright noticematched: copyright reservation (all-rights-reserved / no-reproduction)
- Source
- https://www.smh.com.au/
- Parser
- api-access-parser@1.0.0
- Checked
- 6/24/2026, 4:50:33 AM
official API / developer endpoint detected
@ pagematched: API present (informational)