Skip to content
Agent Help
Sign in

The website import

Agent reads your public website to suggest your brief and brand. It respects robots.txt, reads public pages only and saves nothing until you continue.

Open this page/onboarding

What it readsLink to What it reads

Agent reads the public pages of the address you give: the home page and robots.txt, then at most 5 more pages on the same site, such as the about, products, pricing, customers and contact pages. It also reads up to 2 stylesheets for colours and fonts. It reads what any visitor can see. It does not sign in.

It looks for:

  • the business name, tagline and description;
  • products or services, customers, industry and location;
  • a contact email and links to social profiles;
  • logos, colours and fonts.

The steps you seeLink to The steps you see

The import shows five steps: Reaching the site, Reading pages, Finding your logo and colours, Understanding the business and Writing your brief. It takes up to a minute. You can stop at any time. When you stop, nothing is saved.

robots.txtLink to robots.txt

When the site's robots.txt asks crawlers to stay out, Agent reads the home page only. The review page then says so. Agent also skips each page that robots.txt closes.

Who writes the briefLink to Who writes the brief

Agent makes one model call to write the business facts from the fetched pages. A field the pages do not support stays empty. The call is paid like other work: from your own model account, the organization's, or the platform's, and it counts against your daily budget. When no model is available, the budget is used up, or the model fails, Agent uses only the page's own tags (title, description, social tags). The review page shows AI suggested next to each value a model wrote.

Addresses it refusesLink to Addresses it refuses

Agent refuses an IP address, localhost, a name without a real top-level domain, an address with a user name or password in it, and a port other than the standard web ports. Use the public domain of your business, for example acme.com.

LimitsLink to Limits

  • Only an owner or an admin can run an import.
  • An organization can run at most 10 imports in one hour.
  • The whole import stops after about 35 seconds of reading.

PrivacyLink to Privacy

The import reads only public pages. The import itself saves nothing. Agent keeps only the values you accept, in your brief (org.profile) and your brand (org.branding), when you select Continue.

Checked against the product on 2026-10-05.

Was this helpful?

Related articles