https://nbcnews.com/
Mixed
Rights
ScrapeText & data miningAI trainingAI useDeriveRedistributeTransformTag
Overall confidence90%
What this license lets you do
What you can do
- Scrape or crawl these pages.
What you can’t do without permission
- Run text and data mining over the content.
- Use the content to train AI models.
- Use the content with AI at run time (summarizing, search, RAG).
Ask first
- Create derivative works from the content.
- Redistribute the content.
- Transform or reformat the content.
- Tag or annotate the content.
No signal spoke to these. Ask, don’t assume.
Read for US, commercial use. This usage license reflects machine-readable and expressed restrictions detected on the source at check time. It is not legal advice; actual rights depend on your jurisdiction and intended use.
Evidence by signal
- Source
- https://nbcnews.com/robots.txt
- Parser
- robots-parser@1.0.0
- Checked
- 6/24/2026, 4:49:43 AM
GPTBot, ChatGPT-User, OAI-SearchBot, CCBot, Google-Extended, anthropic-ai, ClaudeBot, Claude-Web, PerplexityBot, Perplexity-User, Applebot-Extended, Bytespider, Meta-ExternalAgent, FacebookBot, Amazonbot, cohere-ai, Diffbot, Omgilibot
@ robots.txt (AI agents)matched: 18 AI agent(s) disallowed for /
- Source
- https://www.nbcnews.com
- Parser
- api-access-parser@1.0.0
- Checked
- 6/24/2026, 4:49:46 AM
official API / developer endpoint detected
@ pagematched: API present (informational)